Systems Research Engineer Jobs

As a Research Scientist on our team, you will partner with Research Engineers, working on fundamental research problems and collaborating with Datadog's product and engineering teams to translate research advances into products. Building on our track record of AI-powered solutions (e.g., Bits AI , Bits Evolve , and our time series foundation model ), Datadog AI Research tackles high-risk, high-reward problems grounded in real-world challenges in cloud observability and security. We are focused on two research areas: World Models for Observability -- Training multimodal foundation models that learn the joint dynamics of distributed systems across metrics, traces, logs, topology, and events. These models power advanced forecasting, anomaly detection, root cause analysis, counterfactual simulation ("what if?"), and provide a learned planning backbone for our autonomous agents. Trained Agents for Observability -- Post-training models to operate autonomously across Datadog's domain. SRE incident response is our first target, with a clear path to code repair, security response, and infrastructure optimization. We build the simulation environments, RL training loops, and evaluation infrastructure needed to train agents that match or surpass frontier models at a fraction of the cost. What You'll Do: Conduct research in generative AI and machine learning, building specialized foundation models and trained agents for observability Train multimodal models on large-scale, diverse telemetry data (metrics, logs, traces, topology, events) using distributed training infrastructure Design and build simulated environments and RL training loops for on-policy agent training and evaluation Collaborate with cross-functional teams (Product, Engineering) to integrate capabilities like multimodal world modeling and autonomous agents into Datadog's products Stay at the forefront of foundation models, world models, and RL-based agent research Contribute to r

About Snorkel Snorkel AI is the frontier AI data lab, helping teams build the data and environments behind high-performing frontier and agentic AI. We combine technology with research-driven AI data development to create datasets, benchmarks, evals, and custom solutions for real-world AI systems. Founded out of the Stanford AI Lab in 2019, Snorkel works with leading AI labs and enterprises to move from better data to better outcomes. Excited to help us redefine how AI is built? Apply to be the newest Snorkeler! In September 2026 we raised a $350 million Series E at a $3.5 billion valuation , and we are scaling our engineering and research teams to meet demand. The role Frontier AI data is expensive to make and hard to measure. Every task we deliver is tested against the strongest models, often through many long-running agent rollouts. Your job is to make that process faster, cheaper, and more rigorous with ML and AI You will be one of the early members of ML & Research Engineering at Snorkel. You will study how frontier-grade data is generated and evaluated, form hypotheses, validate them against real production data, and ship the winners at scale. You will shape the discipline's direction, its standards, and the team that grows around it. What you'll work on Efficient agentic evals. Cut the cost of long-horizon agent evaluation with adaptive sampling, statistically grounded early stopping, model cascades, caching, and cheap-first gating. AI model routing. Route every eval and judge call to the cheapest model that clears the quality bar, with fallback, monitoring, and cost attribution. Fine-tuned small models. Fine-tune and serve open-weight models (LoRA and other parameter-efficient methods) where they match frontier quality, and know when they don't. Predictive difficulty. Build models that estimate how hard a task is for frontier systems before running a single rollout. Measurement for AI data. Build golden datasets, quantify the accuracy and calibratio

As a Staff Research Scientist within Datadog AI Research (DAIR), you will drive research in post-training and autonomous agents as a hands-on individual contributor. You will advance reinforcement learning, simulated environments, synthetic data generation, and evaluation methods for agents operating across complex real-world systems. You will set the technical direction for ambitious research programs, raise the technical bar for the researchers and research engineers around you, and collaborate with Datadog's product and engineering teams to translate research advances into products. What You'll Do: Drive research in agent post-training and reinforcement learning, shaping the technical direction of ambitious research programs grounded in observability and security Own research problems end to end, from framing the question through experimentation, model development, and evaluation Design and advance reinforcement learning approaches, post-training methods, and training loops for agents operating in complex environments Build simulated environments, synthetic data generation approaches, and evaluation frameworks that enable scalable agent training and rigorous measurement Raise the technical bar across the team by reviewing research directions, mentoring researchers and research engineers, and setting standards for experimental rigor Collaborate with cross-functional teams across Research, Product, and Engineering to translate advances in autonomous agents into scalable Datadog capabilities Contribute to research publications, present at top-tier conferences such as NeurIPS, ICLR, and ICML, and help open-source key model artifacts and benchmarks Who You Are: You hold a PhD in Computer Science, Machine Learning, or a related field, or have equivalent experience, with deep expertise in areas such as reinforcement learning, AI agents, post-training, or generative modeling You have driven technically ambitious research at meaningful scale as

As a Staff Research Scientist within Datadog AI Research (DAIR), you will drive research in foundation models and world models as a hands-on individual contributor. You will advance large-scale pre-training and multimodal learning across the diverse signals generated by distributed systems, including metrics, traces, logs, topology, and events. You will set the technical direction for ambitious research programs, raise the technical bar for the researchers and research engineers around you, and collaborate with Datadog's product and engineering teams to translate research advances into products. What You'll Do: Drive research in foundation models, world models, and multimodal learning, shaping the technical direction of ambitious research programs grounded in observability Own research problems end to end, from framing the question through experimentation, model development, and evaluation Train large-scale multimodal models on diverse telemetry data, including metrics, logs, traces, topology, events, and other non-text modalities Advance approaches to pre-training, representation learning, world modeling, scaling, and evaluation for models that learn the dynamics of complex distributed systems Raise the technical bar across the team by reviewing research directions, mentoring researchers and research engineers, and setting standards for experimental rigor Collaborate with cross-functional teams across Research, Product, and Engineering to translate research advances into scalable Datadog capabilities Contribute to research publications, present at top-tier conferences such as NeurIPS, ICLR, and ICML, and help open-source key model artifacts and benchmarks Who You Are: You hold a PhD in Computer Science, Machine Learning, or a related field, or have equivalent experience, with deep expertise in areas such as foundation models, world models, multimodal learning, or generative modeling You have driven technically ambitious research at meanin

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Anthropic's Safeguards organization builds the policies, evaluations, and enforcement systems that keep our models from contributing to catastrophic harm. We are hiring a manager to lead the research engineering team responsible for biological safety: the evaluations, datasets, and classifiers that govern how our models handle biological knowledge. You will lead a team of research scientists and engineers who design and run capability evaluations against frontier models, curate training data for our safety classifiers, train and iterate on those classifiers alongside our ML engineers, and measure how they hold up against adversarial pressure in production traffic. You will set the technical direction for that work, decide where the team invests, and own the results. This is a hands-on management role. Most of your time goes to growing and directing the team, but you will keep enough technical depth to review an eval design, interrogate a classifier's failure modes, and represent the work credibly to Research, Product, and Policy partners. The core tension your team owns is precision: safeguards need to be robust against sophisticated actors while staying out of the way of the far larger population of legitimate researchers using Claude to accelerate life sciences work. Getting that tradeoff right is an empirical problem, and your team is the one measuring it. Key responsibilities Manage, coach, and grow a team of research scientists and engineers working on biological safety evaluations and classifiers, including hiring, onboarding, performance, and career development Set the technical direction and roadmap for the biol

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the Role Anthropic manages one of the industry's largest AI fleets — spanning multiple accelerator families, cpu families and clouds. The Capacity Engineering team is responsible for making sure all our infrastructure resources are accounted for, well-utilized, and efficiently allocated. We own the data, tooling, and operational systems that let Anthropic plan, measure, and maximize utilization across first-party and third-party compute. As an engineer on Capacity Engineering, you will build the production systems that power this work: data pipelines that ingest and normalize telemetry from heterogeneous cloud environments, observability tooling that gives the org real-time visibility into fleet health, and performance instrumentation that measures how efficiently every major workload uses the hardware it’s running on. You will be expected to write production-quality code every day, operate alongside Kubernetes-native infrastructure at meaningful scale, and directly influence decisions around Capacity. You’ll collaborate closely with research engineering, infrastructure, inference, and finance teams. The work requires someone who can move between data engineering, systems engineering, and observability with comfort — and who thrives in a high-autonomy, high-ambiguity environment. This is a pipeline role feeding four areas. Depending on your background and business priority, you’ll focus primarily in one, but the boundaries are fluid and the problems overlap: Data platform Pipelines that ingest occupancy and utilization telemetry from Kubernetes clusters, normalize billing and usage across cloud providers, and serve the BigQuery

About the Team Security is at the foundation of OpenAI’s mission to ensure that artificial general intelligence benefits all of humanity. The Security team protects OpenAI’s technology, people, and products. We are technical in what we build but operational in how we execute, and we support every product and research effort at OpenAI. Our tenets include prioritizing for impact, enabling researchers and developers, preparing for future transformative technologies, and fostering a strong, collaborative security culture. About the Role OpenAI is seeking a Security Software Engineer to join the Infrastructure Security (InfraSec) team. InfraSec safeguards the core of OpenAI’s research and production environments—GPU supercomputing clusters, multi-cloud infrastructure, datacenters, networking, storage, and the critical services that power our frontier AI models. Our charter spans everything from bare-metal hardware and firmware to Kubernetes clusters, service meshes, and the data pathways that carry highly sensitive model weights and user data. As a Security Software Engineer, you will design and build critical foundational services, such as authentication systems, egress/ingress proxies, access brokers, and key management platforms, that demand high standards of reliability, scalability, and software craftsmanship. These systems form the security backbone of OpenAI’s supercomputing environment and must remain robust under intense scale and adversarial pressure. In this role, you will: Architect and implement production-grade security services (e.g., auth services, access brokers, secure proxies, key-management infrastructure) that provide strong guarantees across hardware, operating systems, Kubernetes, networks, and CI/CD. Partner with infrastructure and research engineers to embed security into high-performance compute clusters, enabling rapid model training and deployment without compromising protection. Develop automation and detection tooling to continuously identif

As a Research Manager within Datadog AI Research (DAIR), you will lead a team working on fundamental research in post-training and autonomous agents while remaining deeply engaged in the technical direction of the work. You will advance reinforcement learning, simulated environments, synthetic data generation, and evaluation methods for agents operating across complex real-world systems. You will provide technical leadership to a team of researchers and research engineers, mentor and develop highly technical talent, shape research direction, and collaborate with Datadog’s product and engineering teams to translate research advances into products. This role is designed for an exceptional researcher or technical leader who wants to maintain a strong hands-on research identity while developing and leading a high-performing team. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You'll Do: Lead research in agent post-training and reinforcement learning, setting the technical direction for ambitious research programs grounded in observability and security Guide and mentor researchers and research engineers while remaining closely involved in research strategy, experimentation, model development, and technical problem-solving Design and advance reinforcement learning approaches, post-training methods, and training loops for agents operating in complex environments Build simulated environments, synthetic data generation approaches, and evaluation frameworks that enable scalable agent training and rigorous measurement Collaborate with cross-functional teams across Research, Product, and Engineering to translate advances in autonomous agents into scalable Datadog capabilities Contribute to research publications, present at top-tier conferences su

As a Research Manager within Datadog AI Research (DAIR), you will lead a team working on fundamental research in foundation models and world models while remaining deeply engaged in the technical direction of the work. You will advance large-scale pre-training and multimodal learning across the diverse signals generated by distributed systems, including metrics, traces, logs, topology, and events. You will provide technical leadership to a team of researchers and research engineers, mentor and develop highly technical talent, shape research direction, and collaborate with Datadog’s product and engineering teams to translate research advances into products. This role is designed for an exceptional researcher or technical leader who wants to maintain a strong hands-on research identity while developing and leading a high-performing team. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You'll Do: Lead research in foundation models, world models, and multimodal learning, setting the technical direction for ambitious research programs grounded in observability and security Guide and mentor researchers and research engineers while remaining closely involved in research strategy, experimentation, model development, and technical problem-solving Train large-scale multimodal models on diverse telemetry data, including metrics, logs, traces, topology, events, and other non-text modalities Advance approaches to pre-training, representation learning, world modeling, scaling, and evaluation for models that learn the dynamics of complex distributed systems Collaborate with cross-functional teams across Research, Product, and Engineering to translate research advances into scalable Datadog capabilities Contribute to research publications, present at top-tier conferences su

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the Role Anthropic manages one of the largest and fastest-growing infrastructure fleets in the industry — spanning multiple accelerator families, CPU families, and clouds. The Capacity Engineering team is responsible for making sure all of our infrastructure resources are accounted for, well-utilized, and efficiently allocated. We own the data, tooling, and operational systems that let Anthropic plan, measure, and maximize utilization across first-party and third-party compute — one of the company's largest areas of spend. As the Senior Engineering Manager for Capacity Engineering, you will lead the team that builds and operates these production systems. You'll set technical direction, grow and develop a team of senior and staff-level engineers, and be accountable for the reliability and correctness of surfaces that leadership, research engineering, inference, infrastructure, and finance all depend on. This is a hands-on leadership role and will be onsite 5 days a week: we expect you to stay close enough to the systems to review designs, make sound architectural calls, and step into an incident when the team needs you — while spending most of your time on people, priorities, and cross-organizational alignment. The team's work spans three overlapping areas, and you'll be responsible for balancing investment across them as business priorities shift: Data platform — Pipelines that ingest occupancy and utilization telemetry from Kubernetes clusters, normalize billing and usage across cloud providers, and serve the BigQuery tables the rest of the org queries against. Consumers range from research engineers to finance to leadership, s

About the Team The Future of Computing Research team is an applied research team within the Consumer Devices group focused on developing new methods, models, and evaluation frameworks that support our vision for the future of computing. We work at the frontier of multimodal AI, helping turn emerging model capabilities into product experiences that are useful, delightful, and worthy of long-term trust. Our work explores a new class of AI systems that can learn over time, adapt to individuals, and support people in the flow of daily life. This includes long-term memory, user modeling, and personalization systems that are aligned not just with immediate satisfaction, but with a person’s broader goals, values, and well-being. We work closely across research, engineering, design, product, and safety to define what it means to build AI systems that know you over time, act at the right moment, and help in ways that are context-aware, respectful, and demonstrably beneficial. About the Role We are looking for a Research Engineer / Scientist to join the Future of Computing Research team to work on RLHF and post-training for personalized, multimodal AI systems. This role will focus on building the learning and evaluation foundations that help models become more context-aware, adaptive, and useful over time. You will work on problems such as reward modeling, preference learning, long-horizon evaluation, and policy improvement for systems that must make high-quality behavioral decisions in realistic user settings. The work is deeply product-grounded: success is not just higher benchmark performance, but better model behavior in real-world use. The ideal candidate is excited about pushing beyond one-turn assistant behavior toward systems that improve through feedback, learn from richer signals, and are trained against meaningful notions of user value. Internally, that maps closely to the need for careful reward design, feedback loops, and evaluation frameworks that test whether i

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLE Are you the person on your team who builds the agent everyone else ends up using? We're looking for an AI Engineer to join our Training Product team and do that at Baseten. You'll build AI-driven product features for the customers training and post-training frontier models on our platform, and you'll raise the ceiling on how Baseten itself uses AI internally, turning manual workflows into agentic ones that make every other team faster. You'll work directly with our research engineers to scope and build products, taking ideas from a research loop that already works internally to something customers can run themselves. This is a hands-on role with real autonomy. You'll pick the problems worth solving, build the harnesses, execution flows, and guardrails that make AI systems reliable, and own the results. If you've been shipping agents and want that to be the job, let's talk. EXAMPLE INITIATIVES Take a look at these blog posts written by members of our team: Baseten Training: an autoresearch substrate Introducing Baseten Loops Harnesses are everything. Here's how to optimize yours. Building with NVIDIA Nemotron 3 Ultra and LangChain Deep Agents Code on Baseten RESPONSIBILITIES Build and ship agentic product experiences, including chat-style and assistant-like interfaces, from prototype to GA. Design the harnesses, execution flows, and guardrails that make AI systems reliable in production. Build internal automation

With a strong security engineering background, you’re looking for a role that gives you the freedom to increase MongoDB’s resonance with customers by strengthening our core database products. You’re passionate about solving hard security engineering problems while putting a strong emphasis on customer experience, leveraging your own significant experience. You enjoy collaborating with different teams to innovate and implement pragmatic solutions. Who We Are The MongoDB Product Security organization is a diverse collection of individuals working together to scale MongoDB’s security, both security of the products themselves and the security features we offer to customers. The team is responsible for the MongoDB Database Server ( Community and Enterprise editions). The MongoDB Product Security organization works with software engineers to design, implement, and operate systems in a manner that protects customer data. It is a multidisciplinary team that covers product, software, cloud, infrastructure, and operational security concerns. The team does the following: Build a developer driven security program where there is tight integration with engineering artifacts, process, and tooling. Use software architecture and coding patterns to reduce the impact of security issues. Be security subject matter experts for our tech stack and products. We are looking to speak to candidates who are based in Cork for our hybrid working model. Responsibilities You will take ownership, define strategy, and drive improvement for parts of our program such as fuzzing, threat modeling, secrets management, or container security Advocate for and lead complex security projects from inception through completion Drive architecture, patterns, and processes across Server Engineering that make security the easiest path Partner closely with engineering teams to design and implement security controls across our software and systems Research and POC new attacks against our systems. Plan and perfo

With a strong security engineering background, you’re looking for a role that gives you the freedom to increase MongoDB’s resonance with customers by strengthening our core database products. You’re passionate about solving hard security engineering problems while putting a strong emphasis on customer experience, leveraging your own significant experience. You enjoy collaborating with different teams to innovate and implement pragmatic solutions. Who We Are The MongoDB Product Security organization is a diverse collection of individuals working together to scale MongoDB’s security, both security of the products themselves and the security features we offer to customers. The team is responsible for the MongoDB Database Server ( Community and Enterprise editions). The MongoDB Product Security organization works with software engineers to design, implement, and operate systems in a manner that protects customer data. It is a multidisciplinary team that covers product, software, cloud, infrastructure, and operational security concerns. The team does the following: Build a developer driven security program where there is tight integration with engineering artifacts, process, and tooling. Use software architecture and coding patterns to reduce the impact of security issues. Be security subject matter experts for our tech stack and products. We are looking to speak to candidates who are based in Dublin for our hybrid working model. Responsibilities You will take ownership, define strategy, and drive improvement for parts of our program such as fuzzing, threat modeling, secrets management, or container security Advocate for and lead complex security projects from inception through completion Drive architecture, patterns, and processes across Server Engineering that make security the easiest path Partner closely with engineering teams to design and implement security controls across our software and systems Research and POC new attacks against our systems. Plan and per

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLE As a Software Engineer on the Training Infrastructure team, you'll architect and lead development of our training platform, supporting top tier research engineers and model developers. You'll make key technical decisions for the infrastructure enabling developers to deploy, scale, and monitor their workloads with high performance and reliability. You’ll own scheduling, storage, networking, reliability, and observability of technical systems in the training stack EXAMPLE INITIATIVES Take a look at what we’ve built so far: Overview of the product so far Training docs overview Story of the Training product Research we've done RESPONSIBILITIES Design and architect scalable infrastructure systems for our ML training platform (e.g. scheduling, storage, and networking) Partner closely with developers and research engineers to translate complex training requirements into technical solutions Design and architect a global training scheduler Design and architect reinforcement learning systems and continuous learning pipelines Drive long-term improvements to increase reliability of systems and velocity of development Partner closely with SRE and Capacity teams to unlock state of the art training infrastructure Make critical architectural decisions balancing performance with system reliability Lead technical discussions and mentor junior engineers on infrastructure best practices Contribute to long-term technical strategy an