Machine Learning Infrastructure Engineer Jobs

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Anthropic's Infrastructure organization builds and operates the distributed systems that train, serve, and secure our AI models. That includes data pipelines, some of the largest Kubernetes clusters in the world, and the databases, observability, and developer tooling that every other team at Anthropic depends on. As a Staff Software Engineer on the Infrastructure team, you'll scope and lead complex, multi-month infrastructure projects, make the architectural decisions other engineers build on, and work with research and product teams to build systems that keep pace as their needs change. Team placement happens after the interview process, based on your interests and experience alongside organizational needs. This helps us match you with the team where you'll have the most impact. Key responsibilities Independently scope and lead complex, multi-month infrastructure projects, from an ambiguous starting point through to a production system Make architectural decisions that shape the foundation other engineers and teams build on Drive alignment on technical direction across teams, working through ambiguous problem spaces Partner with research and product teams to understand their infrastructure and compute needs, and turn them into technical designs Own the reliability, scalability, and security of the systems you build as usage and complexity grow Set technical strategy and standards for your team's infrastructure Build and improve operational processes such as incident response, postmortems, and on-call rotations, so the team learns from every incident Mentor other engineers and help raise the technical bar for the team

About Graphcore Graphcore is one of the world’s leading innovators in Artificial Intelligence compute. It is developing hardware, software and systems infrastructure that will unlock the next generation of AI breakthroughs and power the widespread adoption of AI solutions across every industry. As part of the SoftBank Group, Graphcore is a member of an elite family of companies responsible for some of the world’s most transformative technologies. Together, they share a bold vision: to enable Artificial Super Intelligence and ensure its benefits are accessible to everyone. Graphcore’s teams are drawn from diverse backgrounds and bring a broad range of skills and perspectives. A melting pot of AI research specialists, silicon designers, software engineers and systems architects, Graphcore enjoys a culture of continuous learning and constant innovation. Summary Join our dynamic Software Infrastructure team and take a pivotal role in scaling and managing our infrastructure. You will develop essential tools and services that empower our broader software team. Your contributions will enhance the build, test, deployment, and productisation processes of our Machine Learning Software components. Work with our High-Performance Computing (HPC) AI platforms and gain invaluable experience in distributed system The Team The Software Infrastructure team provides critical platforms and services for software development teams across the business. Our responsibilities include managing the CI platform and services, build engineering, component integration, and packaging and release systems. We operate in squads, fostering a culture of service ownership and empowerment for our engineers. We focus on long-term engineering solutions and strive to eliminate toil wherever possible. Responsibilities and Duties Develop, own, and maintain tools and services to support the software org

About Graphcore Graphcore is one of the world’s leading innovators in Artificial Intelligence compute. It is developing hardware, software and systems infrastructure that will unlock the next generation of AI breakthroughs and power the widespread adoption of AI solutions across every industry. As part of the SoftBank Group, Graphcore is a member of an elite family of companies responsible for some of the world’s most transformative technologies. Together, they share a bold vision: to enable Artificial Super Intelligence and ensure its benefits are accessible to everyone. Graphcore’s teams are drawn from diverse backgrounds and bring a broad range of skills and perspectives. A melting pot of AI research specialists, silicon designers, software engineers and systems architects, Graphcore enjoys a culture of continuous learning and constant innovation. Summary Join our dynamic Software Infrastructure team and take a pivotal role in scaling and managing our infrastructure. You will develop essential tools and services that empower our broader software team. Your contributions will enhance the build, test, deployment, and productisation processes of our Machine Learning Software components. Work with our High-Performance Computing (HPC) AI platforms and gain invaluable experience in distributed system The Team The Software Infrastructure team provides critical platforms and services for software development teams across the business. Our responsibilities include managing the CI platform and services, build engineering, component integration, and packaging and release systems. We operate in squads, fostering a culture of service ownership and empowerment for our engineers. We focus on long-term engineering solutions and strive to eliminate toil wherever possible. Responsibilities and Duties Develop, own, and maintain tools and services to support the software org

About Graphcore Graphcore is one of the world’s leading innovators in Artificial Intelligence compute. It is developing hardware, software and systems infrastructure that will unlock the next generation of AI breakthroughs and power the widespread adoption of AI solutions across every industry. As part of the SoftBank Group, Graphcore is a member of an elite family of companies responsible for some of the world’s most transformative technologies. Together, they share a bold vision: to enable Artificial Super Intelligence and ensure its benefits are accessible to everyone. Graphcore’s teams are drawn from diverse backgrounds and bring a broad range of skills and perspectives. A melting pot of AI research specialists, silicon designers, software engineers and systems architects, Graphcore enjoys a culture of continuous learning and constant innovation. Summary Join our dynamic Software Infrastructure team and take a pivotal role in scaling and managing our infrastructure. You will develop essential tools and services that empower our broader software team. Your contributions will enhance the build, test, deployment, and productisation processes of our Machine Learning Software components. Work with our High-Performance Computing (HPC) AI platforms and gain invaluable experience in distributed system The Team The Software Infrastructure team provides critical platforms and services for software development teams across the business. Our responsibilities include managing the CI platform and services, build engineering, component integration, and packaging and release systems. We operate in squads, fostering a culture of service ownership and empowerment for our engineers. We focus on long-term engineering solutions and strive to eliminate toil wherever possible. Responsibilities and Duties Develop, own, and maintain tools and services to support the software org

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Anthropic's Infrastructure organization builds and operates the distributed systems that train, serve, and secure our AI models, including data pipelines, some of the largest Kubernetes clusters in the world, along with the databases, observability, and developer tooling that every other team at Anthropic depends on. As a Staff+ Software Engineer on our Infrastructure team, you'll independently scope and lead complex, multi-month infrastructure projects, make the architectural decisions other engineers build on, and work closely with research and product teams to understand their needs and build systems that keep pace as those needs evolve. Team placement happens after the interview process, based on your interests and experience alongside organizational needs. This lets us match you with the team where you'll have the most impact. Key responsibilities Independently scope and lead complex, multi-month infrastructure projects, from an ambiguous starting point through to a production system Make architectural decisions that shape the foundation of infrastructure other engineers and teams build on Drive alignment on technical direction across multiple teams, working through ambiguous problem spaces Partner with research and product teams to understand their infrastructure and compute needs, and translate them into technical designs Take ownership of the reliability, scalability, and security of the systems you build as usage and complexity grow Set technical strategy and standards for your team's infrastructure Build and improve operational processes, such as incident response, postmortems, and on-call rotations, that help

P-1346 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers — and customer obsessed — we leap at every opportunity to solve technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. Databricks Mosaic AI offers a unique data-centric approach to building enterprise-quality, Machine Learning and Generative AI solutions, enabling organizations to securely and cost-effectively own and host ML and Generative AI models, augmented or trained with their enterprise data. And we're only getting started in Bengaluru , India - and currently in the process of setting up 14 new teams from scratch ! As a Staff Software Engineer at Databricks India, you can get to work across : - Backend (Infrastructure) The impact you'll have: Our Infrastructure Backend teams span many domains across our essential service platforms. For instance, you might work on challenges such as: Problems that span from product to infrastructure including: distributed systems, at-scale service architecture and monitoring, workflow orchestration, and developer experience. Deliver reliable and high performance services and client libraries for storing and accessing humongous amount of data on cloud storage backends, e.g., AWS S3, Azure Blob Store. Build reliable, scalable services, e.g. Scala, Kubernetes, and data pipelines, e.g. Apache Spark™, Databricks, to power the pricing infrastructure that serves millions of cluster-hours per day and develop product features that empower customers to easily view and control platform usage. What we look for

About ElevenLabs ElevenLabs is an AI research and product company transforming how we interact with technology. We launched in January 2023 with the first human-like AI voice model. Today, we serve millions of users and thousands of businesses - from fast-growing startups to large enterprises like Deutsche Telekom and Meta. Our investors are some of the world's most prominent, including Andreessen Horowitz, ICONIQ Growth and Sequoia. We've raised $781M in funding and our last valuation was $22B - multiples of 11, always. We have expanded from voice into three main platforms: ElevenAgents enables businesses to deliver seamless and intelligent customer experiences, with the integrations, testing, monitoring, and reliability necessary to deploy voice and chat agents at scale. ElevenCreative empowers creators and marketers to generate and edit speech, music, image, and video across 70+ languages. ElevenAPI gives developers access to our leading AI audio foundational models. Everything we do is the result of the creativity and commitment of our team - builders doing the best work of their lives. We are researchers, engineers, and operators. IOI medalists and ex-founders. If you want to work hard and create lasting positive impact, we want to hear from you. How we work High-velocity: Rapid experimentation, lean autonomous teams, and minimal bureaucracy. Impact not job titles: We don’t have job titles. Instead, it’s about the impact you have. No task is above or beneath you. AI first: We use AI to move faster with higher-quality results. We do this across the whole company—from engineering to growth to operations. Excellence everywhere: Everything we do should match the quality of our AI models. Global team: We prioritize your talent, not your location. What we offer Innovative culture: You’ll be part of a generational opportunity to define the trajectory of AI, surrounded by a team pushing the boundaries of what’s possible. Growth paths: Joining ElevenLabs means joining a

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. The Infrastructure Platform and Shared Services Team Okta authenticates, authorizes and provisions millions of users a day. The service is hosted on Amazon Web Services (AWS) across multiple availability zones and geographically separated regions. The service is designed for high throughput and 99.999 availability. We're looking for a technical leader to help us continue to scale the service with great people and reliable, cost-effective, and efficient infrastructure, processes, and tooling. As the Sr. Manager of Infrastructure Platform and Shared Services, you will oversee multiple teams focused on Edge networking, K8s platform, Observability, automation platform & tooling. What you’ll be doing Lead the Infra platform and shared services org and various initiatives across SRE & Infrastructure organization. Build a world-class observability platform and monitoring capabilities enabled with self-service Accelerate the velocity of SRE and product engineering by developing robust platforms, powerful tooling, and intuitive self-service capabilities. Own the design and operation of scalable, self-service Cloud infrastructure platforms (e.g. Observability Platform, SRE Productivity, deployments, and Edge Infrastructure) Lead, mentor, and grow a high-performing team of engineers and managers across SRE and infrastructure shared services domains. Perform engineering design evaluations and ensure the completion of projects within resource,

We are seeking an experienced and strategic Senior Manager of Network Engineering to lead the team responsible for the connectivity that powers our operations. This position manages our network infrastructure across multiple global sites, data centers, cloud environments, corporate offices, specialized vehicle depots, and charging infrastructure. You will step into a critical leadership role that demands a strong focus on operational stability, security, and safety-critical reliability. A successful candidate will possess strong project management, vendor management, and organizational skills, with deep experience scaling network capacity to meet critical business deadlines. You will guide a highly capable engineering team while heavily leveraging and managing third-party partners to execute builds and maintain support at a global scale. In This Role, You Will... Team Leadership & Strategy: Manage, mentor, and grow a team of Network Architects and Engineers. Establish technical standards, clear roadmaps, and maintain a high bar for team execution. Infrastructure & Deployment: Oversee the end-to-end network design and deployment for all physical expansions, including manufacturing sites, vehicle depots, and high-bandwidth facilities. Lead high-priority, cross-functional projects to accelerate large-scale deployments with tight deadlines. Operations & Reliability: Maintain the availability of production and enterprise networks by defining and reporting on SLAs. Develop key metrics and log data for response and review. Function as an escalation point for network issues and participate in a 24x7 on-call rotation. Cross-Functional Collaboration: Partner with Facilities, Security, and Infosec teams to deploy and support secure site connectivity and vehicle carrier connectivity. Lead cross-functional architecture design review sessions. Vendor & Financial Management: Own and manage budgeting for all networking

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Anthropic is working on frontier AI systems that handle sensitive information at enormous scale. How we protect that data, and how we build privacy into our systems rather than bolting it on afterward, is central to our mission of building AI that is safe and beneficial. This is a foundational role. As one of our first dedicated privacy engineers, you will help establish the privacy engineering function at Anthropic and shape how privacy is designed into our AI systems from the ground up. You'll sit within our Data Infrastructure team, architecting privacy-preserving systems, leading the implementation of privacy-enhancing technologies across our infrastructure, and providing technical leadership on privacy across engineering, research, and product teams. You'll work at the intersection of privacy engineering, AI safety, and distributed systems, solving problems that don't yet have established answers. This is a senior individual contributor role with high autonomy and broad influence. Key responsibilities Design and implement privacy-preserving architectures for AI training and inference systems operating at very large scale, using techniques e.g. differential privacy, federated learning, and secure multi-party computation Partner with researchers to implement privacy-preserving training methods that protect user data while maintaining model quality Build foundational privacy infrastructure, including automated data discovery, classification, access controls, audit logging, and lifecycle management Translate regulatory requirements (e.g., GDPR, CCPA, HIPAA, the EU AI Act) into technical implementations and automated co

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Our Inference team is responsible for building and maintaining the critical systems that serve Claude to millions of users worldwide. We bring Claude to life by serving our models via the industry’s largest compute-agnostic inference deployments. We are responsible for the entire stack from intelligent request routing to fleet-wide orchestration across diverse AI accelerators. The team has a dual mandate: maximizing compute efficiency to reliably serve our explosive customer growth, while enabling breakthrough research by giving our scientists the high-performance inference infrastructure they need to develop next-generation models. We tackle complex, distributed systems challenges across multiple accelerator families and emerging AI hardware running in multiple cloud platforms. Inference systems are highly performance sensitive distributed systems. Inference serves hundreds of thousands of customers every day, and the size & span of the inference fleet requires sophisticated routing, scaling, and networking systems. Key responsibilities Design, build, and maintain the distributed systems that serve Claude to millions of users worldwide Develop resilient, flexible systems that adapt in real time to real world events Develop intelligent request routing, load balancing, and traffic management systems across thousands of accelerators Maximize compute efficiency across the fleet by autoscaling and orchestrating production, research, and experimental workloads Build and operate production-grade deployment pipelines for releasing new models to users Provide high-performance inference infrastructure that enables researcher

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Our Inference team is responsible for building and maintaining the critical systems that serve Claude to millions of users worldwide. We bring Claude to life by serving our models via the industry’s largest compute-agnostic inference deployments. We are responsible for the entire stack from intelligent request routing to fleet-wide orchestration across diverse AI accelerators. The team has a dual mandate: maximizing compute efficiency to reliably serve our explosive customer growth, while enabling breakthrough research by giving our scientists the high-performance inference infrastructure they need to develop next-generation models. We tackle complex, distributed systems challenges across multiple accelerator families and emerging AI hardware running in multiple cloud platforms. Inference systems are highly performance sensitive distributed systems. Inference serves hundreds of thousands of customers every day, and the size & span of the inference fleet requires sophisticated routing, scaling, and networking systems. Key responsibilities Design, build, and maintain the distributed systems that serve Claude to millions of users worldwide Develop resilient, flexible systems that adapt in real time to real world events Develop intelligent request routing, load balancing, and traffic management systems across thousands of accelerators Maximize compute efficiency across the fleet by autoscaling and orchestrating production, research, and experimental workloads Build and operate production-grade deployment pipelines for releasing new models to users Provide high-performance inference infrastructure that enables researcher

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the Role Anthropic manages one of the industry's largest AI fleets — spanning multiple accelerator families, cpu families and clouds. The Capacity Engineering team is responsible for making sure all our infrastructure resources are accounted for, well-utilized, and efficiently allocated. We own the data, tooling, and operational systems that let Anthropic plan, measure, and maximize utilization across first-party and third-party compute. As an engineer on Capacity Engineering, you will build the production systems that power this work: data pipelines that ingest and normalize telemetry from heterogeneous cloud environments, observability tooling that gives the org real-time visibility into fleet health, and performance instrumentation that measures how efficiently every major workload uses the hardware it’s running on. You will be expected to write production-quality code every day, operate alongside Kubernetes-native infrastructure at meaningful scale, and directly influence decisions around Capacity. You’ll collaborate closely with research engineering, infrastructure, inference, and finance teams. The work requires someone who can move between data engineering, systems engineering, and observability with comfort — and who thrives in a high-autonomy, high-ambiguity environment. This is a pipeline role feeding four areas. Depending on your background and business priority, you’ll focus primarily in one, but the boundaries are fluid and the problems overlap: Data platform Pipelines that ingest occupancy and utilization telemetry from Kubernetes clusters, normalize billing and usage across cloud providers, and serve the BigQuery

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Anthropic's Infrastructure organization is foundational to our mission of developing AI systems that are reliable, interpretable, and steerable. The systems we build determine how quickly we can train new models, how reliably we can run safety experiments, and how effectively we can scale Claude to millions of users — demonstrating that safe, reliable infrastructure and frontier capabilities can go hand in hand. Node Infra owns the full lifecycle of accelerator capacity at Anthropic. We ingest and provision compute from all major cloud providers and from datacenters custom-built for Anthropic, stand up and scale the clusters behind one of the industry's largest AI compute fleets, and build the health, diagnostics and repair automation that keep every GPU, TPU and Trainium node in the fleet usable and ready to power Anthropic's frontier AI research. Key responsibilities Own the technical strategy and roadmap for node lifecycle management - ingestion, bring-up, health checking, and automated repair Drive cross-team initiatives to build and scale AI clusters across multiple clouds and accelerator families Design and operate the systems that detect, isolate, and remediate unhealthy hardware automatically, driving up fleet MTBI and minimizing stranded capacity Define infrastructure architecture, ensuring the hardest problems get solved - whether by you directly or by working through others Work closely with cloud providers and internal research/inference/product teams to shape long-term compute, data, and infrastructure strategy Establish and evolve operational excellence practices (incident response, postmortem culture, on-

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Anthropic's Infrastructure organization is foundational to our mission of developing AI systems that are reliable, interpretable, and steerable. The systems we build determine how quickly we can train new models, how reliably we can run safety experiments, and how effectively we can scale Claude to millions of users — demonstrating that safe, reliable infrastructure and frontier capabilities can go hand in hand. Node Infra owns the full lifecycle of accelerator capacity at Anthropic. We ingest and provision compute from all major cloud providers and from datacenters custom-built for Anthropic, stand up and scale the clusters behind one of the industry's largest AI compute fleets, and build the health, diagnostics and repair automation that keep every GPU, TPU and Trainium node in the fleet usable and ready to power Anthropic's frontier AI research. Key responsibilities Own the technical strategy and roadmap for node lifecycle management - ingestion, bring-up, health checking, and automated repair Drive cross-team initiatives to build and scale AI clusters across multiple clouds and accelerator families Design and operate the systems that detect, isolate, and remediate unhealthy hardware automatically, driving up fleet MTBI and minimizing stranded capacity Define infrastructure architecture, ensuring the hardest problems get solved - whether by you directly or by working through others Work closely with cloud providers and internal research/inference/product teams to shape long-term compute, data, and infrastructure strategy Establish and evolve operational excellence practices (incident response, postmortem culture, on-