Jobs in United States

Systems Architect in New York

302 active opportunities · Updated October 2026

Explore current systems architect jobs in New York. Filter by work mode, employment type, experience, department, date posted and distance.

M
📍 New York, new york, United States· Full-time
✓ Quality checkedCompany trend -67.9%

About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now. Our customers include category-defining companies like Lovable , Ramp , Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. We recently raised a $355M Series C at a $4.65B valuation, led by General Catalyst and Redpoint Ventures. We've crossed $300M+ ARR and grown fivefold since September. Our team includes creators of popular open-source projects (e.g., Seaborn , Luig i ), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience. The Role: We're looking for strong backend engineers who love building a developer tools used by the largest AI companies in the world. You’ll be building for things at scale, but also for new AI workflows that change every day. Requirements: Experience building and shipping modern web applications end-to-end. We care more about what you’ve built than how many years you’ve been building. Comfort working across the stack: TypeScript on the frontend, Python services on the backend, and ClickHouse for data and analytics. Deep knowledge of observability tools and patterns used for large-scale workloads such as custom sandboxes, training and inference for large language (LLM) and diffusion models. Experience with at least one of: billing/payments systems, B2B SaaS tooling, or enterprise software, or LLM / diffusion models inference and training loads. Strong product instincts; yo

TypeScriptPythonAIGo
M
📍 New York, new york, United States· Full-time
✓ Quality checkedCompany trend -67.9%

About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now. Our customers include category-defining companies like Lovable , Ramp , Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. We recently raised a $355M Series C at a $4.65B valuation, led by General Catalyst and Redpoint Ventures. We've crossed $300M+ ARR and grown fivefold since September. Our team includes creators of popular open-source projects (e.g., Seaborn , Luig i ), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience. The Role: We’re looking for an Infrastructure Security Engineer to design and secure the core systems that power our platform. This role focuses on building security directly into our infrastructure—from container isolation and orchestration to identity and secrets management in a multi-tenant, cloud-native environment. You’ll work closely with engineering teams to define secure primitives and ensure our platform is resilient, scalable, and trustworthy by design. This is a hands-on, deeply technical role focused on real systems, not compliance or policy. What You'll Do: Platform & Runtime Security Design and improve isolation mechanisms for multi-tenant workloads (containers, sandboxing, execution environments) Strengthen boundaries between customers, workloads, and internal systems Identify and mitigate risks in distributed, dynamic compute environments Container &

AWSGCPKubernetesAI
C
📍 New York, New York, United States· Full-time
✓ Quality checkedCompany trend -79.2%

Who are we? Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems. We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that. We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft. We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us! Why this role? Our team is a fast-growing group of committed researchers and engineers. The mission of the team is to build reliable machine learning systems and optimize audio inference serving efficiency using innovative techniques. As an engineer on this team, you will work on advancing core audio model serving metrics, including latency, throughput, and quality by diving deep into our systems, identifying bottlenecks, and delivering creative solutions for audio processing and streaming workloads. You’ll collaborate closely with both the training and serving infrastructure teams to ensure seamless integration between model development and deployment, with a special focus on real-time and streaming audio inference. Please Note: We have offices in Toronto, Montreal, San Francisco, New York, Paris, Seoul and London. We embrace a remote-friendly environment, and as part of this approach, we strategically distribute teams based on interests, expertise, and time zones to promote collaboration and flexibility. You'll find the Model Efficiency team concentrated in the EST and PST time zones, these are our preferred locations. You may

PythonGitRestMachine Learning
D
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -85.2%

From $192K/yr

Quick readStrong listing-quality and freshness signals

Applied AI is where Datadog's ambitious AI bets get built and shipped ( Bits Chat , updog ). We sit at the intersection of research and product: turning promising capabilities from Datadog AI Research lab and the research community into production systems that reach real customers. The team builds the foundations for agentic systems capable of operating at scale in complex production environments. Current bets span agents that run autonomously at scale, context and memory layers that make those agents more intelligent over time, and tools that help customers build and validate AI-native services in production. The mandate is to move fast from idea to customer impact, and when a product finds its footing, to set it up for growth. As an Engineering Manager I in Applied AI, you will lead a team of engineers and applied scientists working on one of these challenges. You will define technical direction, run short feedback loops, make deliberate decisions about what to pursue or stop, and work closely with product managers, research teams, and cross-functional partners to ship AI capabilities that matter. At Datadog, we place value in our office culture, the relationships and collaboration it builds and the creativity it brings. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You'll Do Lead and develop a team of engineers and applied scientists focused on building the foundations for agents operating at scale Work closely with product managers, research teams, and cross-functional partners to shape the team's bets from initial framing through to broader adoption, with a clear definition of success criteria at each stage Own end-to-end delivery of high-quality AI systems, from early research exploration to production-grade reliability, with high standards for operational excellence, system reliability, and technical quality Navigate the unique challenges of shipping AI-powered products: balancing quali

Machine LearningAIGoRust
D
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -85.2%
Quick readStrong listing-quality and freshness signals

At Datadog, we're on a mission to build the best platform in the world for engineers to understand and scale their systems, applications, and teams. We operate at high scale, enabling seamless collaboration and problem-solving among Dev, Ops, and Security teams globally for tens of thousands of companies. Our engineering culture values pragmatism, honesty, and simplicity to solve hard problems the right way. APM at Datadog is on its way to redefine how users interact with their telemetry. We are integrating intelligence directly into troubleshooting workflows to help engineers find root causes faster, navigate complex distributed systems seamlessly, and optimize application performance with minimal cognitive load. APM provides deep visibility from end-user interactions to backend services and we are now expanding this foundation with new AI-driven insights, guidance, and automation. As a Product Manager II for APM, you will work with world-class engineers, designers, and partner product teams to shape the future of Distributed Tracing, Performance Analysis, and Intelligent Troubleshooting. You will help build advanced capabilities that scale to thousands of customers and make sophisticated observability workflows accessible to every engineer, from experts to beginners. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What you will do: Develop a deep understanding of APM customers, their performance challenges, telemetry workflows, and competitors Lead conversations with design partners and strategic customers to uncover real-world performance issues, validate product assumptions, and guide solutions from early prototypes through General Availability Define and deliver the next generation of APM features with engineering and design, especially agentic on

MicroservicesAIGoRust
D
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -85.2%

From $155K/yr

Quick readStrong listing-quality and freshness signals

Alerting is the beating heart of the Datadog platform. It is the critical bridge between raw data and decisive action, ensuring that when our customers’ systems falter, they are the first to know. Datadog is reimagining alerting; we’re evolving beyond simple triggers into providing a sophisticated, AI-powered posture that covers both known and unknown risks. As the Product Manager for Notification Orchestration, you will lead the evolution of how alerts reach the right people at the right time. You will define the strategy for our notification routing engine, ensuring that thousands of businesses can manage complex alerting logic without being overwhelmed by noise. You will empower customers to move beyond managing individual monitor outputs to a world where notifications are grouped, contextualized, and reliable at massive scale. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Develop a comprehensive understanding of customers and the core problems behind their alerting and notification monitoring challenges. Collaborate across product teams to identify and deliver the most critical alerts and health indicators for every product area. Define, build, and launch the next generation of user experiences for managing automated alerts and configurations. Design intuitive solutions that represent alert status and system health across the entire application, providing users with at-a-glance visibility. Join an engineering team to scope, spec, and design alerting features capable of supporting the most complex, high-scale organizations Continuously evolve the product with the latest technologies, including AI tools and agents. Partner with marketing and customer success teams to help users understand and adopt new alerting frameworks and health-monitoring

AIGoRustSpring
D
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -85.2%

From $100K/yr

Quick readStrong listing-quality and freshness signals

Datadog is seeking curious, driven interns to join our Product Management team and help build products that improve how engineers monitor and understand their systems. As a Product Management Intern, you'll support the product development lifecycle by partnering closely with Engineering, Design, and Product Marketing to bring new ideas and features to life. You'll gain hands-on experience working on products that serve highly technical customers while contributing to meaningful business and user outcomes. Interns are embedded directly within product teams, working on meaningful initiatives alongside full-time Product Managers and contributing to actual product decisions. Our platform processes over 100 trillion events per day across 30,000+ customers in a multi-cloud environment -- giving you direct exposure to large-scale, real-time systems built by engineers, for engineers. It's an environment where you'll develop product thinking, technical communication, and cross-functional collaboration skills by doing the work, not just observing it. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Conduct customer discovery conversations and gather feedback to better understand user needs Drive product initiatives from concept through launch alongside Engineering, Design, and Product Marketing teams Translate customer and business needs into clear product requirements and engineering priorities Analyze customer feedback, product data, and market insights to help inform product decisions Prepare and deliver technical product demonstrations and communication materials Develop technical understanding of Datadog’s observability platform and cloud infrastructure products Who You Are: Targeting a 2028 full-time graduation or start date Pursuing a degree in

GitRestAIGo
D
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -85.2%

From $280K/yr

Quick readStrong listing-quality and freshness signals

Datadog is seeking a Director of Product Management to lead our AI Observability portfolio and shape how organizations build, monitor, and scale AI systems in production. This role leads LLM Observability and helps define the next wave of innovation across GPU Monitoring, Distributed AI Monitoring, and emerging research-oriented tooling such as Model Lab. You will set the vision and strategy for this rapidly growing area, expanding established products while incubating new capabilities that deliver deep visibility into AI infrastructure, model performance, and distributed AI environments. As AI becomes core to modern applications, this team plays a critical role in ensuring customers can deploy and scale AI with confidence. We’re looking for a builder-minded product leader with strong technical depth and hands-on curiosity - someone who has built or worked closely with AI-powered products and understands the realities of production AI. You will lead a team of product managers and partner closely with engineering and design to advance Datadog’s leadership in AI observability. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Own the vision and strategy for AI-driven products, ensuring alignment with overall company goals and customer needs. This will include managing our embed program to enhance the capabilities of existing products as well as developing dedicated and independent AI products. Lead and mentor a team of product managers, helping them grow and advance their careers while ensuring the delivery of high-quality, AI-powered features. Collaborate with cross-functional teams including engineering, data science, marketing, and sales to deliver AI product solutions that meet customer needs and business objectives. Identify new opportunities for

Machine LearningAIGoRust
D
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -85.2%

From $68K/yr

Quick readStrong listing-quality and freshness signals

G&A at Datadog rapidly scales the physical space, hiring, onboarding, and financial and legal systems to keep our business running in top form. As a Deal Desk Analyst, you will work cross-functionally with our Sales Operations, Billing, Contracts and Legal teams to provide quoting and deal structuring support to the Global Sales Team. This will be a growth position as Datadog’s business continues to expand. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Develop in-depth knowledge of Datadog’s licensing and pricing models to provide deal structuring and quoting support to our global sales teams Be a creative problem solver who finds a way to meet customers’ needs while adhering to Datadog’s selling policies Solve customer satisfaction issues following execution of the deal Actively negotiate deals directly with the customer as needed Work cross functionally across various stakeholder groups including legal, contracts, sales operations, order management, revenue, finance and product management Function as point of contact and subject matter expert for Sales on deal pricing matters Drive adherence to internal controls, protocols and business rules Who You Are: At least 4 years of overall experience including related processes such as sales operations, finance, sales strategy, and sales enablement At least 2 years of experience with deal structuring/quoting complex SaaS transactions for a fast-growing multi-national company Working knowledge of revenue recognition principles Must be comfortable representing the company to customers in negotiations and resolving customer satisfaction issues Strong attention to detail Ability to multi-task Strong communication skills Ability to work in fast paced, high press

AI
📍 New York, United States· Remote
✓ High-confidence listingCompany trend +200%
Quick readStrong listing-quality and freshness signals

Abbott is a global healthcare leader that helps people live more fully at all stages of life. Our portfolio of life-changing technologies spans the spectrum of healthcare, with leading businesses and products in diagnostics, medical devices, nutritionals and branded generic medicines. Our 122,000 colleagues serve people in more than 160 countries. JOB DESCRIPTION: About Abbott Abbott is a global healthcare leader, creating breakthrough science to improve people’s health. We’re always looking towards the future, anticipating changes in medical science and technology. Our diagnostic solutions are used in hospitals, laboratories, and clinics around the globe. The crucial information derived from our tests, instruments and informatics systems are often the first step in patient care decision making for hundreds of health conditions from heart attacks to blood disorders to infectious diseases and cancers. Working at Abbott At Abbott, you can do work that matters, grow, and learn, care for yourself and family, be your true self and live a full life. You’ll also have access to: Career development with an international company where you can grow the career you dream of. Employees can qualify for free medical coverage in our Health Investment Plan (HIP) PPO medical plan in the next calendar year. An excellent retirement savings plan with high employer contribution Tuition reimbursement, the Freedom 2 Save student debt program and FreeU education benef

C
📍 New York, New York, United States· Full-time· Remote
✓ High-confidence listingCompany trend -79.2%
Quick readStrong listing-quality and freshness signals

Who are we? Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems. We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that. We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft. We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us! The Opportunity We're seeking an experienced Head of Non-Tech Talent to lead our comprehensive hiring strategy for all non-technical roles. This is a pivotal position as we build out our capabilities across General and Administrative (G&A) Go to Market (GTM) Finance, Legal, and other business-critical functions. You'll transform how we attract, hire, and develop top talent beyond while building and coaching a high performing global talent team. This is an opportunity to join an ambitious high performing, scale up company. Key Responsibilities Strategic Talent Leadership: Develop and execute the non-tech talent strategy aligned with Cohere's growth plan and business objectives while partnering with TA leads across the organization Team Development & Coaching: Recruit, mentor, and develop a high-performing team of non-tech recruiters, sourcers, and coordinators; create career paths and succession plans Process Innovation: Design and implement scalable hiring processes for non-technical roles while maintaining our high-quality standards Business Partnership: Serve as the primary talent advisor to our Talent Leads and partne

AIFinanceRecruitmentHR
C
📍 New York, New York, United States· Full-time· Remote
✓ High-confidence listingCompany trend -79.2%
Quick readStrong listing-quality and freshness signals

Who are we? Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems. We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that. We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft. We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us! Why this role? We are looking for a solutions-driven, detail-oriented, organized Executive Assistant to support our leadership team in Toronto, New York and beyond. Reporting to the EA Manager, this person will have the opportunity to work cross-functionally and provide high value and impact to the leadership team of the Comms and Marketing Teams and the company as a whole. If you are someone that thrives in a dynamic, collaborative, and fast-paced environment and are interested in joining a company that’s in growth mode, we’d be delighted to hear from you! Please Note: We are looking for candidates based in the Eastern timezone (Toronto/New York etc) As an Executive Assistant, you will: Manage the day-to-day schedules for our Comms and Marketing leadership team, including calendaring, booking meetings and other commitments (where necessary) to ensure a balanced and efficient workday Coordinate internal and external meetings (think 1:1s, partner meetings) and assist with documentation that may be required in conjunction with meetings Arrange international/domestic travel and logistics for our leadership team, including booking f

AILogisticsRecruitment
C
📍 New York, New York, United States· Full-time· Remote
✓ High-confidence listingCompany trend -79.2%
Quick readStrong listing-quality and freshness signals

Who are we? Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems. We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that. We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft. We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us! Why this role? We are looking for a solutions-driven, detail-oriented, organised Executive Assistant to support our leadership team in Toronto, New York and beyond. Reporting to the EA Manager for the sales org, this person will have the opportunity to work cross-functionally and provide high value and impact to the sales leadership team and the company as a whole. If you are someone that thrives in a dynamic, collaborative, and fast-paced environment and are interested in joining a company that’s in growth mode, we’d be delighted to hear from you! Please Note: We are looking for candidates based in the Eastern Timezone As an Executive Assistant, you will: Manage the day-to-day schedules for our sales leadership team, including calendaring, booking meetings and other commitments (where necessary) to ensure a balanced and efficient workday Coordinate internal and external meetings (think 1:1s, partner meetings) and assist with documentation that may be required in conjunction with meetings Arrange international/domestic travel and logistics for our leadership team, including booking flights and accommodations, scheduling, and exp

AILogisticsRecruitment
C
📍 New York, New York, United States· Full-time· Remote
✓ High-confidence listingCompany trend -79.2%
Quick readStrong listing-quality and freshness signals

Who are we? Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems. We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that. We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft. We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us! Why this role? The Admin team at Cohere is looking for an Executive Assistant to support Cohere's SVP of People, and to manage some of our global EA team. In this dynamic and collaborative role, you will thrive in a fast-paced environment, working cross-functionally to provide high-value support. You will manage executive calendars, coordinate travel arrangements, enhance team cohesion through various initiatives, and take on diverse projects. Additionally, you will be responsible for managing a high performing team of EAs across the company. We are seeking someone who is eager to dive into the challenges and opportunities that come with supporting our executive team. If you have a passion for providing seamless administrative support and contributing to a high-performing organization, this role is ideal for you. In this role, you will: Manage the day-to-day schedule for our SVP of People, including calendaring, booking meetings [internal and external] and other commitments to ensure a balanced and efficient workday Coordinate internal and external meetings (think 1:1s, board meetings, partner meetings) and assist with documenta

AILogisticsRecruitment
V
📍 New York, New York, United States
✓ High-confidence listing
Quick readStrong listing-quality and freshness signals

The Chief of Staff is a high-visibility leadership role responsible for the operational success of the SVP, General Manager’s organization. Acting as a strategic partner, you will ensure the business operates at peak velocity by driving key initiatives, improving organizational effectiveness, and aligning teams around strategic priorities. You will translate high-level goals into clear execution plans across the business, providing clarity in a fast-paced, complex environment. This role is designed for a seasoned operator who excels at driving accountability among senior leaders and building the systems necessary to scale a SaaS business. You will identify operational gaps, mitigate risks before they impact the bottom line, and act as an extension of leadership—prioritizing, executing, and communicating critical projects to enable the executive team to operate at maximum efficiency. ** Please note that this opportunity is located in New York, NY, and requires this hire to work from our office 4 days a week. ** As a Chief of Staff You Can Expect: Drive the Operating Cadence: Design and manage the GM's leadership meetings, QBRs, and planning cycles to keep the team aligned and hitting KPIs. Force Execution: Partner with Sales, Customer Success, Account Management, Implementation, Product leaders to unblock projects and hold senior stakeholders accountable for deliverables. Own Plan Integrity: Keep the team aligned to the quarterly and annual plan, hold leaders accountable for the commitments behind it, and flag risk early, before it shows up as a miss in the business review. Drive Alignment & Follow-Through: Ensure decisions and commitments made in leadership meetings are clearly communicated across the team, tracked to completion, and actually followed through on, closing the loop between what was decided and what gets done. Prioritize Ruthlessly: Act as a surrogate for the GM in high-level meetings, surfacing critical risks early and filtering out noise to focus

AIRecruitment
🔔

Get new systems architect jobs in New York, United States by email

Daily job updates · Unsubscribe anytime