Jobs in United States

Ai Systems Engineer in New York

648 active opportunities · Updated October 2026

Explore current ai systems engineer jobs in New York. Filter by work mode, employment type, experience, department, date posted and distance.

B
📍 New York, New York, United States· Full-time
✓ High-confidence listing

$340K – $425K/yr

Quick readStrong listing-quality and freshness signals

Why join us Brex is the intelligent finance platform that enables companies to spend smarter and move faster in more than 200 markets. By combining global corporate cards and banking with intuitive spend management, bill pay, and travel software, Brex enables founders and finance teams to accelerate operations, gain real-time visibility, and control spend effortlessly. Brex’s AI-native automation and world-class service eliminate manual expense and accounting tasks for customers so they can focus on what matters most. Tens of thousands of the world's best companies run on Brex, including DoorDash, Coinbase, Robinhood, Zoom, Plaid, Reddit, and SeatGeek. Working at Brex allows you to push your limits, challenge the status quo, and collaborate with some of the brightest minds in the industry. We’re committed to building a diverse team and inclusive culture and believe your potential should only be limited by how big you can dream. We make this a reality by empowering you with the tools, resources, and support you need to grow your career. Product at Brex The Product team is at the forefront of Brex's mission to empower employees anywhere to make better financial decisions. With a deep understanding of the business, we identify and scope out the most impactful opportunities for Brex to tackle. We are responsible for aligning cross-functional teams — such as Engineering, Legal, Compliance, and Design — on key decisions. We set strategy and drive products from inception to launch, enabling Brex to grow rapidly and help our customers reach their full potential. What you’ll do As a Product Leader at Brex, you will be the driving force behind our Growth Product team — overseeing the thoughtful strategy and execution of team and technical systems to drive customer acquisition and onboarding. You will also collaborate closely with our Go-to-Market (GTM) teams to ensure seamless acquisition and onboarding for customers, particularly those with significant and complex spending n

SQLAIGoRust
D
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -84.7%

From $192K/yr

Quick readStrong listing-quality and freshness signals

Databases and data stores are at the center of our applications, for legacy applications and modern AI applications alike. Yet most observability and optimization approaches lack a holistic approach or application context. Datadog has been on a mission to revolutionize how databases are operated, flipping what is often seen as a black box of complexity prone to security and performance risks, into a well oiled machine enabling our builders and businesses to move faster and smarter. We’re looking for an experienced product manager passionate about joining this mission to lead this product opportunity. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Lead ambitious investments that rethink how customers operate and get value from their databases, diving into ambiguity, working with our customers on new models, and shipping new products and changes to existing products. Develop a deep understanding of our customers and their issues, what problems are really behind those issues, and how we can improve how databases are operationalized across SRE teams, DBAs and application developers. Continuously refine your understanding of database management systems and datastores from SQL and OLTP based to NoSQL e.g. AWS RDS, PostgreSQL, SQL Server, MongoDB, MySQL, etc Define, build and launch the next generation of database monitoring and optimization capabilities for our customers Join a talented engineering team with a record of disrupting observability approaches to further the mission of demystifying and optimizing databases using your team’s creativity, alongside your customers’ problems, as a key resource. Collaborate with other Product teams in Datadog to maintain and improve all Datadog products, improve the seamless integration across th

SQLPostgreSQLMySQLMongoDB
D
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -84.7%

From $110K/yr

Quick readStrong listing-quality and freshness signals

Datadog AI Research — Scholars Program with Carnegie Mellon University Datadog AI Research (DAIR) is partnering with Carnegie Mellon University to support a small number of PhD students working on open research problems grounded by ongoing efforts at Datadog/DAIR. You will frame a problem, run your own experiments, and write up what you find, with compute and data at a scale most academic labs cannot provide. You will collaborate with colleagues working on the same questions. The Lab And The Research: DAIR is an industrial research lab motivated by practical challenges in observability and software operation: detecting and diagnosing failures, understanding complex production environments, and helping engineers operate software more effectively. The lab focuses on creating specialized foundation models, post-training and evaluating AI agents, and building frontier-scale machine learning systems. By combining fundamental research with Datadog's large-scale, real-world data and infrastructure, the lab develops new AI capabilities and translates them into practical systems with meaningful impact. Internship projects are shaped with your DAIR mentor and your CMU faculty advisor. You do not need prior experience with observability, monitoring, or infrastructure. What You'll Do: Own a research project end to end: framing the question, running the experiments, writing it up Work directly with a DAIR mentor engaged in the same problem, and stay connected to your advisor and lab Publish, and use the work toward your dissertation See research reach production, when it works Who You Are: Currently enrolled in a PhD program at Carnegie Mellon in machine learning, computer science, statistics, or a related field Depth in at least one area relevant to the research above Comfort running real experiments — training models, working with GPUs, reading and reimplementing recent papers Evidence you can do research: conference or workshop papers, preprin

Machine LearningAIGoRust
M
📍 New York, new york, United States· Full-time
✓ Quality checkedCompany trend -67.9%

About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now. Our customers include category-defining companies like Lovable , Ramp , Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. We recently raised a $355M Series C at a $4.65B valuation, led by General Catalyst and Redpoint Ventures. We've crossed $300M+ ARR and grown fivefold since September. Our team includes creators of popular open-source projects (e.g., Seaborn , Luig i ), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience. The Role: We're looking for strong backend engineers who love building a developer tools used by the largest AI companies in the world. You’ll be building for things at scale, but also for new AI workflows that change every day. Requirements: Experience building and shipping modern web applications end-to-end. We care more about what you’ve built than how many years you’ve been building. Comfort working across the stack: TypeScript on the frontend, Python services on the backend, and ClickHouse for data and analytics. Deep knowledge of observability tools and patterns used for large-scale workloads such as custom sandboxes, training and inference for large language (LLM) and diffusion models. Experience with at least one of: billing/payments systems, B2B SaaS tooling, or enterprise software, or LLM / diffusion models inference and training loads. Strong product instincts; yo

TypeScriptPythonAIGo
M
📍 New York, new york, United States· Full-time
✓ Quality checkedCompany trend -67.9%

About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now. Our customers include category-defining companies like Lovable , Ramp , Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. We recently raised a $355M Series C at a $4.65B valuation, led by General Catalyst and Redpoint Ventures. We've crossed $300M+ ARR and grown fivefold since September. Our team includes creators of popular open-source projects (e.g., Seaborn , Luig i ), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience. The Role: We are looking for PhD research interns with strong research experience in reinforcement learning, machine learning, and foundation models, including large language and multimodal models, to join our research team. This internship is well suited to candidates interested in improving existing methods and developing new techniques for large-scale model training, optimization, and inference, extending models to long-context and long-horizon tasks, and improving inference-time efficiency, reliability, and robustness in high-stakes real-world deployments. Preferred Qualifications: Currently pursuing a PhD in computer science, machine learning, or a related field. A demonstrated record of research in reinforcement learning, machine learning, foundation models, or related areas. Experience developing and evaluating large-scale models or machine learning systems. Familiari

RestMachine LearningAIGo
M
📍 New York, new york, United States· Full-time
✓ Quality checkedCompany trend -67.9%

About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now. Our customers include category-defining companies like Lovable , Ramp , Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. We recently raised a $355M Series C at a $4.65B valuation, led by General Catalyst and Redpoint Ventures. We've crossed $300M+ ARR and grown fivefold since September. Our team includes creators of popular open-source projects (e.g., Seaborn , Luig i ), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience. The Role: We're building a platform that covers the whole life of an LLM: training it, deploying it, and observing it in production. We already run multi-node training, elastic inference, sandboxes, and distributed volumes, and we control the infrastructure underneath. We’re looking for research depth in post-training to sit alongside our systems and product work. What you'll do: We are looking for research scientists with a strong track record in reinforcement learning, machine learning, and foundation models, including large language and multimodal models, to join our research team. This role is well suited to candidates interested in improving existing methods and developing new techniques for large-scale model training, optimization, and inference, extending models to long-context and long-horizon tasks, and improving inference-time efficiency, reliability, and robustnes

RestMachine LearningAIGo
M
📍 New York, new york, United States· Full-time
✓ High-confidence listingCompany trend -67.9%
Quick readStrong listing-quality and freshness signals

About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now. Our customers include category-defining companies like Lovable , Ramp , Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. We recently raised a $355M Series C at a $4.65B valuation, led by General Catalyst and Redpoint Ventures. We've crossed $300M+ ARR and grown fivefold since September. Our team includes creators of popular open-source projects (e.g., Seaborn , Luig i ), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience. The Role: We are looking for a strong technical lead to guide the engineers designing, building, and maintaining the novel, high-performance systems that make up our serverless platform. You'll lead the team responsible for Modal's machines layer: the fleet of bare metal and cloud hosts that every Function, Sandbox, and training job runs on, and the control plane that provisions, images, monitors, and repairs them. You'll own the full lifecycle of a machine, from accepting and benchmarking new hardware from a growing set of providers, to network bring-up, kernel and image management, GPU and disk health tracking, and automated remediation of unhealthy hosts. You'll manage a team of 3–8 engineers while staying hands-on across the stack which involves BMCs, firmware, PXE, bootloaders, Linux networking, drivers, and distributed control-plane services, and you'll shape our long-

M
📍 New York, new york, United States· Full-time
✓ Quality checkedCompany trend -67.9%

About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now. Our customers include category-defining companies like Lovable , Ramp , Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. We recently raised a $355M Series C at a $4.65B valuation, led by General Catalyst and Redpoint Ventures. We've crossed $300M+ ARR and grown fivefold since September. Our team includes creators of popular open-source projects (e.g., Seaborn , Luig i ), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience. The Role: We are looking for strong engineers with experience in making ML systems performant at scale. If you are interested in contributing to open-source projects and Modal’s container runtime to push language and diffusion models towards higher throughput and lower latency, we’d love to hear from you! Requirements: 5+ years of experience writing high-quality, high-performance code. Experience working with torch, high-level ML frameworks, and inference engines (vLLM or TensorRT). Familiarity with Nvidia GPU architecture and CUDA. Experience with ML performance engineering (tell us a story about boosting GPU performance — debugging SM occupancy issues, rewriting an algorithm to be compute-bound, eliminating host overhead, etc). Nice-to-have: familiarity with low-level operating system foundations (Linux kernel, file systems, containers, etc).

LinuxRestAIGo
D
📍 New York, New York, United States
✓ High-confidence listingCompany trend -84.7%
Quick readStrong listing-quality and freshness signals

At Datadog, we're on a mission to build the best platform in the world for engineers to understand and scale their systems, applications, and teams. We operate at high scale, enabling seamless collaboration and problem-solving among Dev, Ops, and Security teams globally for tens of thousands of companies. Our engineering culture values pragmatism, honesty, and simplicity to solve hard problems the right way. Feature flags used to be simple on/off switches. That's changing fast. Flags are becoming a control plane: they're tied to observability, they drive rollout decisions, and AI agents build and run more of this work every day. Datadog is building the platform for that future, and we are now expanding our Feature Flagging & Experimentation product to pair flag decisions directly with observability signals and to modernize the flagging workflow for an SDLC increasingly run by agents. As a Senior Product Manager for Feature Flagging, you will own product strategy and drive execution across flags-plus-observability integration and agentic-era flagging workflows. You will set direction for a critical area of the roadmap, work closely with the observability, RUM, and APM teams, and report directly to the Director of Product leading this team. You'll be relied on to make sound, independent product judgment calls with limited oversight, bring engineering credibility to every decision, and drive B2B go-to-market strategy alongside sales. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. This role is based in New York City and works from our office 3 days a week to support that collaboration. What you will Do: Find every place where a flag decision and an observability signal should talk to each other - rollout gating, anomaly-triggered rollback, experiment diagnostics - and ship a roadmap that unlocks observability and experimentation differentiators in Datadog Feature Flags

D
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -84.7%

From $204K/yr

Quick readStrong listing-quality and freshness signals

The opportunity Datadog’s Infrastructure products help engineers understand and operate the systems their applications depend on. Our customers work in complex environments like Kubernetes and serverless, where infrastructure changes constantly, information is dense, and decisions about reliability, performance, and cost are closely connected. We’re looking for a Staff Product Designer to join Modern Compute, with an initial focus on Containers Autoscaling. Autoscaling helps engineering teams make better decisions about how their applications and infrastructure use resources. Designing these experiences requires making deeply technical systems understandable, helping customers act with confidence, and fitting into the tools and workflows they already use. The team is rethinking how workload and cluster autoscaling come together as a more coherent product experience. This includes how customers get started, understand recommendations, evaluate value, and safely apply changes across their environments. The work also connects to other parts of Datadog, including observability, Cloud Cost Management, permissions, and AI-assisted workflows. As a Staff Product Designer, you will help define that direction and lead the work from early problem framing through shipped product. You will partner closely with product and engineering, bring a high level of interaction and visual craft to complex workflows, and help raise the quality of design across Modern Compute. At Datadog, we place value in our office culture, the relationships and collaboration it builds, and the creativity it brings to the table. We operate as a hybrid workplace to help our Datadogs find a work-life rhythm that works for them. What you’ll do Lead end-to-end product design for Modern Compute, initially focused on our Autoscaling product. Help define the product direction for an area that is still evolving, from early framing and exploration through detailed design and delivery. Design clear, trustwort

KubernetesGitAIGo
D
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -84.7%
Quick readStrong listing-quality and freshness signals

At Datadog, we’re on a mission to build the best platform in the world for engineers to understand and scale their systems, applications, and teams. We operate at high scale, enabling seamless collaboration and problem-solving among Dev, Ops, and Security teams globally for tens of thousands of companies. Our engineering culture values pragmatism, honesty, and simplicity to solve hard problems the right way. The Observability Data Platform (ODP) is the backbone of everything Datadog delivers – powering how data is ingested, stored, routed, and surfaced across every product at planet scale. As a Senior Product Manager for ODP, you will work with world-class engineers and cross-functional partners to shape how the platform is deployed, controlled, and operated. You will define product direction across the control plane and data layer, translate complex infrastructure trade-offs into clear roadmap decisions, and help customers get the most from their observability investment – regardless of architecture, topology, or scale. At Datadog, we place value in our office culture – the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You Will Do: Develop a deep understanding of the Observability Data Platform customers – platform engineers, SREs, and product managers that own the product verticals – their infrastructure challenges, deployment topologies, and cost-to-serve trade-offs. Define product direction across multiple ODP surfaces, including the control plane and data layer, by articulating clear problem statements and desired outcomes, and partnering with engineering on technical approach and sequencing Lead conversations with design partners and strategic customers to understand real-world platform pain points, validate product assumptions, and guide solutions from early prototypes through General Availability Develop a co

AIGoRustSpring
D
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -84.7%

From $162K/yr

Quick readStrong listing-quality and freshness signals

This is a senior individual contributor role for someone who wants to actively shape how Engineering, one of the most important parts of how Datadog develops its people. You'll sit at the center of Datadog's biggest talent bets for Engineering: how we build leaders, define career paths and org design, evolve performance, move talent internally, and plan succession for our most critical roles. You’ll own this work end to end, from the first framing conversation with senior leaders through to delivering a program running at scale. AI is changing how Engineering builds software, and it is changing how People builds the programs that support Engineering too. This role sits at the centre of both: understanding how AI is reshaping engineering roles, skills and structures, and building AI-powered solutions within People to keep pace. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Design and lead complex talent programmes for Engineering, spanning leadership capability, career architecture, org design, performance, internal mobility and succession for critical roles. Partner directly with PBPs and senior leaders to turn ambiguous problems into clear programme goals, design principles and success measures. Help Engineering and People understand and respond to how AI is reshaping roles, skills and ways of working, and translate that shift into practical talent and org design choices. Stay hands-on from concept through to adoption: this is a build and run role, not a strategy and handover role. Work across Enablement, Learning, People Analytics and People Systems so what you build scales and embeds into core people processes. Equip PBPs with frameworks, tools and executive-ready narratives that support real adoption in the business. Operate in ambigu

D
📍 New York, New York, United States
✓ High-confidence listingCompany trend -84.7%
Quick readStrong listing-quality and freshness signals

About Datadog: Datadog is the essential monitoring and security platform for cloud applications. We bring together end-to-end traces, metrics, and logs to make your applications, infrastructure, and third-party services entirely observable. These capabilities help businesses secure their systems, avoid downtime, and ensure customers are getting the best user experience. The Team: The Financial Planning & Analysis (FP&A) team analyzes company financial data (revenue, customers, headcount, expenses, etc.) in order to support the business’ growth and success. Within FP&A, the R&D Finance team enables the financial strategy behind Datadog’s Engineering and Product organizations. We partner directly with technical leadership to drive decision-making around our most critical investments. Your work will be highly cross-functional and play a pivotal role in connecting the dots across the organization through a financial lens, ensuring operational alignment and informing decision making. The Opportunity: As a part of the R&D Finance team, this person will be key in supporting our product and engineering leadership team. Reporting to the Senior Manager, you will help create our annual budget and financial targets and work with operational leaders to support execution against our goals. Your work will be highly cross-functional and strategic, and you will play a pivotal role in connecting the dots across the organization through a financial lens, in order to help ensure operational alignment and inform decision making. What You’ll Do: Partner with senior business leaders to manage their departmental budgets on a regular basis, including but not limited to the company’s co-founder and CTO Manage financial forecasts and analytics, which include data across revenue, customers, product, company expenses, and headcount / workforce. Help manage significant portions of the company’s spend, including but not limited to AI and GPU spend across the compan

AIExcelTableauAccounting
D
📍 New York, New York, United States· Full-time
✓ High-confidence listingCompany trend -84.7%

From $155K/yr

Quick readStrong listing-quality and freshness signals

Alerting is the beating heart of the Datadog platform. It is the critical bridge between raw data and decisive action, ensuring that when our customers’ systems falter, they are the first to know. Datadog is reimagining alerting; we’re evolving beyond simple triggers into providing a sophisticated, AI-powered posture that covers both known and unknown risks. As the Product Manager for Notification Orchestration, you will lead the evolution of how alerts reach the right people at the right time. You will define the strategy for our notification routing engine, ensuring that thousands of businesses can manage complex alerting logic without being overwhelmed by noise. You will empower customers to move beyond managing individual monitor outputs to a world where notifications are grouped, contextualized, and reliable at massive scale. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Develop a comprehensive understanding of customers and the core problems behind their alerting and notification monitoring challenges. Collaborate across product teams to identify and deliver the most critical alerts and health indicators for every product area. Define, build, and launch the next generation of user experiences for managing automated alerts and configurations. Design intuitive solutions that represent alert status and system health across the entire application, providing users with at-a-glance visibility. Join an engineering team to scope, spec, and design alerting features capable of supporting the most complex, high-scale organizations Continuously evolve the product with the latest technologies, including AI tools and agents. Partner with marketing and customer success teams to help users understand and adopt new alerting frameworks and health-monitoring

AIGoRustSpring
D
📍 New York, New York, United States
✓ High-confidence listingCompany trend -84.7%
Quick readStrong listing-quality and freshness signals

Datadog is seeking a Legal Operations Analyst to join our Legal Operations subgroup. In this role you’ll work closely with individuals across the organization in support of various legal-related matters, with a primary focus on supporting the scalability of the global legal team. The Legal team supports Datadog's rapid growth by providing a wide range of legal services across a highly dynamic technology company, from driving new business via contracts and compliance efforts, to protecting Datadog's intellectual property. Datadog's Legal team collaborates with virtually every team across the organization, from engineering to product to marketing. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Partner with legal and non-legal process owners to support process improvements, optimization and automations Assist with technical teams to implement solutions and troubleshoot reported issues by the legal team Maintain knowledge resources for all legal subgroups and collaborate with legal and non-legal colleagues on various projects as needed Conduct vendor and customer sanction screenings to identify potential risks and inconsistencies and ensure compliance Analyze and use data to drive initiatives and assist in planning Support technology by becoming a superuser of systems utilized by the legal team Serve as a point of contact for clients and stakeholders, addressing inquiries, concerns and providing timely updates on matters and escalating where appropriate Handle ad hoc projects within the legal subgroups as they arise Who You Are: A Legal Operations Analyst with 2-3 years of experience with legal operations, contract management or project management experience Proficiency with tools e.g. Google Workspace, Brightflag, Docusign, Salesforce, Coupa, Conflue

AISalesforceProject Management
🔔

Get new ai systems engineer jobs in New York, United States by email

Daily job updates · Unsubscribe anytime