Machine Learning Infrastructure Engineer Jobs

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the Role Anthropic is at the forefront of AI research, dedicated to developing safe, ethical, and powerful artificial intelligence. Our mission is to ensure that transformative AI systems are aligned with human interests. We are seeking a Staff level Engineer to join our Pre-training team, responsible for developing the next generation of large language models. In this role, you will work at the intersection of cutting-edge research and practical engineering, contributing to the development of safe, steerable, and trustworthy AI systems. Responsibilities Design and implement data processing infrastructure for large language model training (highly performant, reproducible, traceable) Develop and maintain core processing primitives (e.g., tokenization, deduplication, chunking) with a focus on scalability Build robust systems for data quality assurance and validation at scale Collaborate with research teams to implement novel data processing architectures Build and operate end-to-end data pipelines that turn raw web-scale corpora into training-ready datasets You may be a good fit if you have: 5+ YOE outside of internships Strong software engineering skills with experience building high-throughput fault-tolerant distributed systems Hands-on experience with distributed computing frameworks, particularly Apache Spark Excellent problem-solving skills and attention to detail Strong communication skills and ability to work in a collaborative environment Advanced degree in Computer Science or related field Experience with language model training infrastructure Background in Data Infrastructure, MLOps, or ML infrastructure Stro

About the Team DoorDash's MDX team sits within Machine Learning Platform and builds the shared foundation that ML engineers across DoorDash, Wolt, and Deliveroo rely on to build and run ML-powered products. We work across the full ML lifecycle: feature engineering, training, evaluation, deployment, serving, and monitoring. Our mission is to increase the velocity and reliability of ML-driven business impact across the company. A central pillar of that work is agentic infrastructure. We are building systems that let agents accelerate and operate the ML workflow itself, including auto research, where agents explore and iterate on modeling ideas, and self-healing systems that detect, diagnose, and remediate failures in ML pipelines and production models with minimal human intervention. About the Role You will join a small, high-leverage team building the agentic layer of DoorDash's ML infrastructure. You'll design and build the systems that let agents accelerate how ML engineers across DoorDash, Wolt, and Deliveroo develop, ship, and operate models. That includes auto research systems that explore and iterate on modeling ideas, and agentic developer support that helps ML engineers move through training, evaluation, deployment, and debugging faster. You'll own well-scoped components end to end, from design through production, working across agent orchestration, tooling and integrations with our ML platform, evaluation of agent behavior, and observability. This role is ideal for an engineer with a strong backend foundation who is excited to apply AI agents to real engineering workflows, learns quickly, and wants to grow into technical leadership in a fast-moving area where model capabilities, tooling, and best practices change month to month. You're excited about this opportunity because you will… Build agentic systems that increase the velocity of ML development across DoorDash, Wolt, and Deliveroo, helping ML engineers get from idea to production model faster. Design an

Our vision is to transform how the world uses information to enrich life for all . Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. The DASG Architecture Lab and Customer Enablement Lab (CEL) teams provide the infrastructure, platforms, and technical expertise required to accelerate technology pathfinding, AI and system workload analysis, memory subsystem characterization, FPGA/LPDRAM prototyping, and customer enablement initiatives. These teams play a critical role in enabling architecture exploration, validation, and teamwork across engineering organizations and external partners. AI Efficiency and Usage is a must. AI proficiency or AI‑enabled ways of working where applicable. Agentic AI and Generative AI usage model is a must. Responsibilities Own the day-to-day bring-up, readiness, maintenance, and operational support of lab systems, racks, benches, test equipment, and reference platforms used by DASG Architecture Lab and Customer Enablement Lab teams. Deploy, configure, and maintain server, GPU, FPGA, client AI, mobile AI, analyzer, and environmental test equipment supporting workload characterization and technology pathfinding activities. Build and maintain stable, reproducible validation environments, including BIOS, BMC, firmware, operating systems, drivers, networking, remote access, and power and thermal configurations. Collaborate with architecture and validation teams to enable memory trace capture, workload analysis, DRAM replay, power and performance characterization, and data-driven engineering decisions. Develop and maintain operational processes for asset tracking, configuration management, equipme

SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today, SpaceX is actively developing the technologies to make this possible, with the ultimate goal of making life multiplanetary and expanding consciousness to the stars. SpaceXSI is building Super Intelligence to help humanity understand the universe. Our teams are building the full Super Intelligence stack: from our Colossus supercomputers, to Grok models, to our suite of applications, including Grok Bot, Grok Build, Grok Imagine, Grok Voice, and X. We're creating a powerful flywheel where more compute trains better models, better models power more useful products, and what we learn from people using those products shapes what we build next. ABOUT THE ROLE: As an ML Infrastructure Engineer, you will play a pivotal role in building and optimizing the reliable, high-performance ML platform that powers recommendations on X. We're looking for exceptional engineers who are passionate about our mission and have a strong desire to make a meaningful impact. RESPONSIBILITIES: Designing, building, and scaling GPU compute infrastructure, training frameworks, and experimentation tools to enable rapid iteration on ML hypotheses Developing data pipelines and integrating large-scale data, training, and inference systems Collaborating with ML teams to productionize models and ensure seamless integration across the stack Ensuring scalability, reliability, and efficiency of large-scale machine learning systems Working across the full stack to solve complex problems independently Mentoring junior engineers and contributing to the growth of the team BASIC QUALIFICATIONS: Bachelor, Master, Post-graduate or PhD in computer science, machine learning, or other quantitative discipline; or equivalent work experience 2+ years of industry experience working with high traffic or large-scale production environments, distributed systems, GPU infr

About Graphcore Graphcore is one of the world’s leading innovators in Artificial Intelligence compute. It is developing hardware, software and systems infrastructure that will unlock the next generation of AI breakthroughs and power the widespread adoption of AI solutions across every industry. As part of the SoftBank Group, Graphcore is a member of an elite family of companies responsible for some of the world’s most transformative technologies. Together, they share a bold vision: to enable Artificial Super Intelligence and ensure its benefits are accessible to everyone. Graphcore’s teams are drawn from diverse backgrounds and bring a broad range of skills and perspectives. A melting pot of AI research specialists, silicon designers, software engineers and systems architects, Graphcore enjoys a culture of continuous learning and constant innovation. Job Summary Join our dynamic Software Infrastructure team and take a pivotal role in scaling and managing our infrastructure. You will develop essential tools and services that empower our broader software team. Your contributions will enhance the build, test, deployment, and productisation processes of our Machine Learning Software components. Work with our High-Performance Computing (HPC) AI platforms and gain invaluable experience in distributed systems. The Team The Software Infrastructure team provides critical platforms and services for software development teams across the business. Our responsibilities include managing the CI platform and services, build engineering, component integration, and packaging and release systems. We operate in squads, fostering a culture of service ownership and empowerment for our engineers. We focus on long-term engineering solutions and strive to eliminate toil wherever possible. Responsibilities and Duties Develop, own, and maintain tools and services to support the software build and release process Deploy and maintain services with Kub

About Graphcore Graphcore is one of the world’s leading innovators in Artificial Intelligence compute. It is developing hardware, software and systems infrastructure that will unlock the next generation of AI breakthroughs and power the widespread adoption of AI solutions across every industry. As part of the SoftBank Group, Graphcore is a member of an elite family of companies responsible for some of the world’s most transformative technologies. Together, they share a bold vision: to enable Artificial Super Intelligence and ensure its benefits are accessible to everyone. Graphcore’s teams are drawn from diverse backgrounds and bring a broad range of skills and perspectives. A melting pot of AI research specialists, silicon designers, software engineers and systems architects, Graphcore enjoys a culture of continuous learning and constant innovation. Job Summary Join our dynamic Software Infrastructure team and take a pivotal role in scaling and managing our infrastructure. You will develop essential tools and services that empower our broader software team. Your contributions will enhance the build, test, deployment, and productisation processes of our Machine Learning Software components. Work with our High-Performance Computing (HPC) AI platforms and gain invaluable experience in distributed systems. The Team The Software Infrastructure team provides critical platforms and services for software development teams across the business. Our responsibilities include managing the CI platform and services, build engineering, component integration, and packaging and release systems. We operate in squads, fostering a culture of service ownership and empowerment for our engineers. We focus on long-term engineering solutions and strive to eliminate toil wherever possible. Responsibilities and Duties Develop, own, and maintain tools and services to support the software build and release process Deploy and maintain services with Kub

About Graphcore Graphcore is one of the world’s leading innovators in Artificial Intelligence compute. It is developing hardware, software and systems infrastructure that will unlock the next generation of AI breakthroughs and power the widespread adoption of AI solutions across every industry. As part of the SoftBank Group, Graphcore is a member of an elite family of companies responsible for some of the world’s most transformative technologies. Together, they share a bold vision: to enable Artificial Super Intelligence and ensure its benefits are accessible to everyone. Graphcore’s teams are drawn from diverse backgrounds and bring a broad range of skills and perspectives. A melting pot of AI research specialists, silicon designers, software engineers and systems architects, Graphcore enjoys a culture of continuous learning and constant innovation. Job Summary Join our dynamic Software Infrastructure team and take a pivotal role in scaling and managing our infrastructure. You will develop essential tools and services that empower our broader software team. Your contributions will enhance the build, test, deployment, and productisation processes of our Machine Learning Software components. Work with our High-Performance Computing (HPC) AI platforms and gain invaluable experience in distributed systems. The Team The Software Infrastructure team provides critical platforms and services for software development teams across the business. Our responsibilities include managing the CI platform and services, build engineering, component integration, and packaging and release systems. We operate in squads, fostering a culture of service ownership and empowerment for our engineers. We focus on long-term engineering solutions and strive to eliminate toil wherever possible. Responsibilities and Duties Develop, own, and maintain tools and services to support the software build and release process Deploy and maintain services with Kub

About Graphcore Graphcore is one of the world’s leading innovators in Artificial Intelligence compute. It is developing hardware, software and systems infrastructure that will unlock the next generation of AI breakthroughs and power the widespread adoption of AI solutions across every industry. As part of the SoftBank Group, Graphcore is a member of an elite family of companies responsible for some of the world’s most transformative technologies. Together, they share a bold vision: to enable Artificial Super Intelligence and ensure its benefits are accessible to everyone. Graphcore’s teams are drawn from diverse backgrounds and bring a broad range of skills and perspectives. A melting pot of AI research specialists, silicon designers, software engineers and systems architects, Graphcore enjoys a culture of continuous learning and constant innovation. Summary Join our dynamic Software Infrastructure team and take a pivotal role in scaling and managing our infrastructure. You will develop essential tools and services that empower our broader software team. Your contributions will enhance the build, test, deployment, and productisation processes of our Machine Learning Software components. Work with our High-Performance Computing (HPC) AI platforms and gain invaluable experience in distributed The Team The Software Infrastructure team provides critical platforms and services for software development teams across the business. Our responsibilities include managing the CI platform and services, build engineering, component integration, and packaging and release systems. We operate in squads, fostering a culture of service ownership and empowerment for our engineers. We focus on long-term engineering solutions and strive to eliminate toil wherever possible. Responsibilities and Dutie s Develop, own, and maintain tools and services to support the software bu

Who We Are At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto trading and decentralized crypto applications (dApps). OKX is also a trusted brand by hundreds of large institutions seeking access to crypto markets. We are safe and reliable, backed by our Proof of Reserves. Across our multiple offices globally, we are united by our core principles: We Before Me , Do the Right Thing , and Get Things Done . These shared values drive our culture, shape our processes, and foster a friendly, rewarding, and diverse environment for every OK-er. OKX is part of OKG, a group that brings the value of Blockchain to users around the world, through our leading products OKX, OKX Wallet, OKLink and more. About the Opportunity OKX’s Internal Audit function has an early but working AI-native capability: a multi-agent platform (Hive Mind), agentic workflows, data pipelines, and AI-enabled tools that let a very small team punch far above its weight. Your job is not to rebuild it at today’s maturity. Your job is to take it to a regulator-grade production standard and well beyond , and to drive AI Enablement across the department. You own the foundation, the agent runtime, and the harness: a resilient cloud platform, the agentic runtime and evaluation harnesses that make agents trustworthy in a regulated setting, and the governed data and AI infrastructure everything else depends on. We hire on demonstrated building , not on claims or credentials. We expect you to be more capable than the hiring manager in your domain: you will co-own and challenge the tooling strategy, not just implement it. This is a two-person engineering team: you deploy, debug, and hotfix your counterpart’s stack when needed. Environment Cloud on AWS or GCP . Claude as the starting point in a deliberately multi-model architecture (Anthropic

About the opportunity We are seeking an experienced Lead Technical Product Manager for our Machine Learning Platform within the Intelligent Operations Platforms segment. In this role, you will define the long term vision, platform architecture, and execution strategy for core Machine Learning infrastructure across N26. Your work will enable squads across the bank to automate risk assessments, prevent financial crime, and scale operational efficiency. Our ML Platforms team serves as the central nervous system for real-time, data-driven decisioning. We build and scale horizontal ML capabilities that allow critical functions including Financial Crime, Credit Risk, and Core Operations to execute with absolute precision at scale. As a Lead Product Manager, you will drive multi-squad strategy, transforming complex predictive models into resilient, compliant, sub-second scoring systems. In this role, you will Drive the Core ML Platform Vision: Define and execute the multi-year roadmap for the central Machine Learning platform, ensuring alignment with broader engineering architecture and executive business goals. Lead High-Volume ML Portfolios: Oversee complex predictive ML capabilities supporting high-throughput banking systems, focusing on real-time transaction monitoring, automated credit risk scoring, and operational workflow decisioning. Scale Enterprise MLOps Infrastructure: Own the platform tooling and standards across the full ML lifecycle. Drive strategic decisions around feature stores, real-time feature extraction pipelines, model registries, automated retraining triggers, and CI/CD for ML. Establish Model Evaluation and Governance: Define robust offline and online model evaluation frameworks, shadow deployment mechanics such as champion and challenger testing, and real-time monitoring for model drift, inference latency, and data quality degradation. Bridge Technical Leadership and Compliance: Partner closely with Principal Data Scientists, ML Engineers, Security

About the opportunity We are seeking an experienced Lead Technical Product Manager for our Machine Learning Platform within the Intelligent Operations Platforms segment. In this role, you will define the long term vision, platform architecture, and execution strategy for core Machine Learning infrastructure across N26. Your work will enable squads across the bank to automate risk assessments, prevent financial crime, and scale operational efficiency. Our ML Platforms team serves as the central nervous system for real-time, data-driven decisioning. We build and scale horizontal ML capabilities that allow critical functions including Financial Crime, Credit Risk, and Core Operations to execute with absolute precision at scale. As a Lead Product Manager, you will drive multi-squad strategy, transforming complex predictive models into resilient, compliant, sub-second scoring systems. In this role, you will Drive the Core ML Platform Vision: Define and execute the multi-year roadmap for the central Machine Learning platform, ensuring alignment with broader engineering architecture and executive business goals. Lead High-Volume ML Portfolios: Oversee complex predictive ML capabilities supporting high-throughput banking systems, focusing on real-time transaction monitoring, automated credit risk scoring, and operational workflow decisioning. Scale Enterprise MLOps Infrastructure: Own the platform tooling and standards across the full ML lifecycle. Drive strategic decisions around feature stores, real-time feature extraction pipelines, model registries, automated retraining triggers, and CI/CD for ML. Establish Model Evaluation and Governance: Define robust offline and online model evaluation frameworks, shadow deployment mechanics such as champion and challenger testing, and real-time monitoring for model drift, inference latency, and data quality degradation. Bridge Technical Leadership and Compliance: Partner closely with Principal Data Scientists, ML Engineers, Security

Location Details: India, Remote At GoDaddy the future of work looks different for each team. Some teams work in the office full-time; others have a hybrid arrangement (they work remotely some days and in the office some days) and some work entirely remotely.​ This is a remote position, so you’ll be working remotely from your home. You may occasionally visit a GoDaddy office to meet with your team for events or meetings. Join Our Team... Here at GoDaddy, the ML Engineering (MLE) team exists as the backbone of our machine learning infrastructure, enabling ML scientists and product teams across Domains to ship models to production reliably, efficiently, and at scale. This team owns the full lifecycle of ML systems — from CI/CD pipelines and model serving infrastructure to GPU workload orchestration and observability. Through disciplined engineering practices, thoughtful system design, and close collaboration with ML scientists, data engineers, and product teams, we deliver the platform that powers domain search, pricing, recommendations, and emerging AI experiences for millions of customers worldwide. We are currently looking for an experienced, highly motivated Senior Engineering Manager to lead our ML Engineering team based in India. This is an established team with existing engineers — we expect the candidate to ramp up quickly on our ML infrastructure stack, build strong relationships with the team, and partner with both India-based teams and US-based teams to drive execution and grow the team further. This individual will join us on our journey to build and scale ML infrastructure that serves real-time predictions at low latency, automates model deployment and promotion, and provides the observability and reliability guarantees that production ML systems demand. Become part of a team that bridges the gap between ML research and production engineering — shipping systems that directly impact GoDaddy's core revenue. What you'll get to do... Lead a team o

Block is one company built from many blocks, all united by the same purpose of economic empowerment. The blocks that form our foundational teams — People, Finance, Counsel, Hardware, Information Security, Platform Infrastructure Engineering, and more — provide support and guidance at the corporate level. They work across business groups and around the globe, spanning time zones and disciplines to develop inclusive People policies, forecast finances, give legal counsel, safeguard systems, nurture new initiatives, and more. Every challenge creates possibilities, and we need different perspectives to see them all. Bring yours to Block. The Role The Risk Automation ML team automates Risk and Compliance investigations and decision making at Block through the application of agentic and generative AI technology. We work globally with partners in Product, Engineering and Operations to ensure that we are providing a safe user experience for our customers while minimizing or eliminating bad activity on our platform. We are leveraging agentic and generative AI as an integral part of our toolkit to fulfill our mission. Block's machine learning systems monitor billions of payment transactions across traditional payment and blockchain networks and surface suspicious activity (fraudulent, suspicious, illegal activity and brand violations) for trained Operations analyst review and decisioning. We are leveraging generative AI to accelerate historically manually intensive analyst workflows; by adding features in the investigative UX to accelerate agent productivity and enable them to make faster, more informed and accurate decisions (aka Copilots). We also automate workflows end to end completely eliminating the need for manual reviews (aka Autopilots). This is a new and significant opportunity to rethink and optimize Risk Operations at Block at scale. This is an IC role, but the senior level has significant leadership responsibilities that include owning, and driving strategic roadm

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Datastores Engineer, Platform Infrastructure The Auth0 platform secures more than 100 million logins each day for customers all around the world - and we're growing fast! The Platform Infrastructure team enables Auth0 engineers to move faster by giving them tools to easily deploy and manage their services on AWS and Azure. This is a role with a huge impact. You will get to work with engineers throughout the organization and what you build will be a foundational piece of the infrastructure that allows Auth0 to scale for years to come. We are looking for Engineer who are passionate about distributed systems, availability, and delivering customer value to join our Platform Infrastructure Datastores team. Because we build and support the overall Auth0 platform, the ideal candidate is someone who is passionate about infrastructure, operations, databases and not intimidated by cross-organization coordination and collaboration. You will: Develop our large, distributed and highly-available infrastructure. Implement platform tools that allow feature teams to deploy and manage the datastores for their services. Research new technologies to accelerate new environment creation. Carry cross team initiatives from end to end: code reviews, design reviews, operational robustness, security hygiene, etc. Participate in the team's on-call rotation. You might be a good fit if you: Have 5-8 years of platform / infrastructure engineering experience. Are proficient in

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role: Our Inference team is responsible for building and maintaining the critical systems that serve Claude to millions of users worldwide. We bring Claude to life by serving our models via the industry's largest compute-agnostic inference deployments. We are responsible for the entire stack from intelligent request routing to fleet-wide orchestration across diverse AI accelerators. The team has a dual mandate: maximizing compute efficiency to serve our explosive customer growth, while enabling breakthrough research by giving our scientists the high-performance inference infrastructure they need to develop next-generation models. We tackle complex, distributed systems challenges across multiple accelerator families and emerging AI hardware running in multiple cloud platforms. Strong candidates may also have experience with: High-performance, large-scale distributed systems Implementing and deploying machine learning systems at scale Load balancing, request routing, or traffic management systems LLM inference optimization, batching, and caching strategies Kubernetes and cloud infrastructure (AWS, GCP) Python or Rust You may be a good fit if you: Have significant software engineering experience, particularly with distributed systems Are results-oriented, with a bias towards flexibility and impact Pick up slack, even if it goes outside your job description Want to learn more about machine learning systems and infrastructure Thrive in environments where technical excellence directly drives both business results and research breakthroughs Care about the societal impacts of your work Representative projects across the org: D