Machine Learning Infrastructure Engineer Jobs

P-78 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers — and customer obsessed — we leap at every opportunity to solve technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started. As a software engineer with a backend focus, you will work with your team to build infrastructure and products for the Databricks platform at scale. The impact you'll have: Our backend teams span many domains, from our core compute fabric resource management infrastructure, to service platforms, to machine learning infrastructure. For instance, you might work on challenges such as: Resource management infrastructure powering the big data and machine learning workloads on the Databricks platform in a scalable, secure, and cloud-agnostic way Develop reliable, scalable services and client libraries that work with massive amounts of data on the cloud, across geographic regions and Cloud providers Build tools to allow Databricks engineers to operate their services across different clouds and environments Build services, products and infrastructure at the intersection of machine learning and distributed systems. What we look for: BS (or higher) in Computer Science, or a related field 5+ years of production level experience in one of: Java, Scala, C++, or similar language. Experience developing large-scale distributed systems. Experience working on a SaaS platform or with Service-Oriented Architectures. Experience with cloud technologies, e.g. AWS, Azure, GCP, Docker, or Kubernetes. Experience with security and systems that handle sen

Location: United States – Remote Clearance: Ability to obtain and maintain a Public Trust LTS is seeking a Senior AI Platform and Harness Engineer to develop and maintain the infrastructure, tooling, and evaluation frameworks that power enterprise AI solutions. This role is responsible for building the AI platform and reusable "AI harnesses" that enable Large Language Models (LLMs), AI agents, Retrieval-Augmented Generation (RAG), and Generative AI applications to be securely developed, tested, evaluated, monitored, and deployed at scale. The ideal candidate has experience with AI platforms, LLMOps, software engineering, cloud-native technologies, and backend systems, along with a passion for building reliable, observable, and production-ready AI solutions. You will work closely with AI architects, software engineers, data scientists, and product teams to ensure AI solutions are scalable, secure, cost-effective, and continuously improving. What You'll Do: Design, build, and maintain enterprise AI platform capabilities supporting Large Language Models (LLMs), AI agents, RAG, and Generative AI applications. Lead data preparation, training and fine-tuning of LLMs Develop reusable AI harnesses to automate testing, prompt evaluation, model benchmarking, regression testing, and quality assurance. Build AI evaluation frameworks to measure model accuracy, retrieval quality, hallucination detection, latency, throughput, cost, and overall application performance. Implement observability and monitoring solutions for AI applications, including telemetry, tracing, logging, dashboards, and operational metrics. Build and maintain LLMOps pipelines supporting model deployment, versioning, evaluation, experimentation, rollback, and continuous improvement. Design automated workflows for prompt testing, retrieval evaluation, AI system validation, and performance benchmarking. Develop internal tools for prompt management, model experimentation, AI performance optimization, and developer

The Public Sector software engineers (SWEs) create the core product building blocks forward-deployed teams use to develop agentic capabilities that function across multiple domains. SWEs responsibilities include building the systems required to ingest and process federal datasets to support real-time decision-making in contested environments. We develop novel agentic enabling capabilities that includes: Create multi-layered guardrails around agents Optimize data retrieval for agents Orchestrate fleets of asynchronous agents Automatically alerts users to deviations in data Illustrating how an agent reached a decision As a Senior Software Engineer, you will lead the development of a vertical feature or a horizontal capability to include defining requirements with stakeholders and implementation until it is accepted by the stakeholders. You will: Lead the design and implementation of scalable backend systems and distributed architectures for Federal customers. Manage the full lifecycle of feature development from requirement definition to deployment on classified networks. Direct the orchestration of asynchronous agent fleets to meet mission requirements. Lead customer engagements to translate mission needs into technical requirements. Own the communication with stakeholders to ensure implementation meets defined acceptance criteria. Conduct technical reviews and identify risks within machine learning infrastructure and model serving. Drive the platform roadmap by providing technical specifications for Federal product offerings. Ideally you will have: Full Stack Development: Proficiency in front-end, back-end development and infrastructure, including experience with modern web development frameworks, programming languages, and databases Cloud-Native Technologies: Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and experience in developing and deploying applications in a cloud-native environment. Understanding of containerization (e.g., Docker) and contai

P-1343 As a software engineer with a backend focus, you will work with your team to build infrastructure for the Databricks platform at scale. The impact you'll have: Our backend teams cover a diverse range of domains, from core compute fabric resource management to service platforms and machine learning infrastructure. For example, you might work on challenges such as: Supporting Databricks' growth by building foundational infrastructure platforms that enable seamless operation across numerous geographic regions and cloud providers. Implementing cloud-agnostic infrastructure abstractions to help Databricks engineers more efficiently manage and operate their services. Develop tools and processes that drive engineering efficiency at Databricks. We enhance the developer experience for Databricks engineers across various areas, including programming languages, linters, static analysis, IDEs, remote development environments, automated release pipelines, and test automation frameworks. Our current focus is on optimizing the Rust development experience across the organization. What we look for: 5+ years of professional software development experience. Bachelor’s degree or higher in Computer Science, a related field, or equivalent experience. Proficiency in one or more backend languages such as Java, Scala, or Go. Hands-on experience in developing and operating large-scale, critical distributed backend systems. Demonstrated leadership throughout all project phases, from inception and design to implementation and operations. Self-driven and passionate with a strong focus on delivering impact through team collaboration. Strong communication skills, both written and verbal, with the ability to produce clear technical documentation that drives alignment and decision-making. Experience with infrastructure systems, security, and sensitive data, as well as familiarity with Kubernetes or cloud platforms like AWS, Azure, or GCP. About Databricks Databricks is the Data and AI

P-940 (Position Location is open to both our Seattle & Bellevue offices.) At Databricks, we are obsessed with enabling data teams to solve the world’s toughest problems, from security threat detection to cancer drug development. We do this by building and running the world’s best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions. Founded in 2013 by the original creators of Apache Spark, Databricks has grown from a tiny corner office in Berkeley, California to a global organization with over 1000 employees. Thousands of organizations, from small to Fortune 100, trust Databricks with their mission-critical workloads, making us one of the fastest growing SaaS companies in the world. Our engineering teams build highly technical products that fulfill real, important needs in the world. We constantly push the boundaries of data and AI technology, while simultaneously operating with the resilience, security and scale that is critical to making customers successful on our platform. We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above. As a software engineer with a backend focus, you will work closely with your team and product management to prioritize, design, implement, test, and operate micro-services for the Databricks platform and product. This implies, among others, writing software in Scala/Java, building data pipelines (Apache Spark, Apache Kafka), integrating with third-party applications, and interacting with cloud APIs (AWS, Azure, CloudFormation, Terraform). Below are some example teams you can join: Data Science and Machine Learning Infrastructure: Build services and infrastructure

The Public Sector software engineers (SWEs) create the core product building blocks forward-deployed teams use to develop agentic capabilities that function across multiple domains. SWEs responsibilities include building the systems required to ingest and process federal datasets to support real-time decision-making in contested environments. We develop novel agentic enabling capabilities that includes: Create multi-layered guardrails around agents Optimize data retrieval for agents Orchestrate fleets of asynchronous agents Automatically alerts users to deviations in data Illustrating how an agent reached a decision As a Software Engineer, you will own the development of a vertical feature or a horizontal capability to include defining requirements with stakeholders and implementation until it is accepted by the stakeholders. You will: Design and implement scalable backend systems for Federal customers using cloud-native AI infrastructure. Build features for agentic systems including multi-layered guardrails and data retrieval optimization. Develop data pipelines and machine learning infrastructure to make data sources accessible by agents. Collaborate with cross-functional teams to execute backend solutions for secure environments. Participate in customer engagements to understand requirements and deliver technical solutions. Define requirements with stakeholders and implement features until they are accepted. Contribute to the platform roadmap and product strategy for the Federal business. Ideally you will have: Full Stack Development: Proficiency in front-end, back-end development and infrastructure, including experience with modern web development frameworks, programming languages, and databases Cloud-Native Technologies: Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and experience in developing and deploying applications in a cloud-native environment. Understanding of containerization (e.g., Docker) and container orchestration (e.g., Kubernetes

P-939 (Position Location is open to both our Seattle & Bellevue offices.) At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers — and customer obsessed — we leap at every opportunity to solve technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started. The impact you'll have: As a software engineer with a backend focus, you will work with your team to build infrastructure and products for the Databricks platform at scale. Our backend teams span many domains, from OS/container systems, to serverless infrastructure, to partner integration, and to machine learning infrastructure. Below are some example projects and the Serverless platform : Build Databricks serverless platform that powers the big data, machine learning and Gen AI workloads. Automatically improve the performance and efficiency of workloads running on the platform while also ensuring they scale to millions of machines across a multi-cloud environment. Core cloud platform : Build cutting-edge OS, container and networking technologies that power the entire Databricks infrastructure, from internal infrastructure, to serverful, and to serverless platform. Improve the security, efficiency and reliability across the fleet. Partner ecosystem : Build and grow a partner ecosystem for Databricks SQL. Build and offer a variety of toolkits to support partners and customers’ deep and seamless integrations with Databricks. Maintain and nurture productive and beneficial partnerships within the ecosystem. Notebook dataplane : Build mu

P-940 (Position Location is open to both our Seattle & Bellevue offices.) At Databricks, we are obsessed with enabling data teams to solve the world’s toughest problems, from security threat detection to cancer drug development. We do this by building and running the world’s best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions. Founded in 2013 by the original creators of Apache Spark™, Databricks has grown from a tiny corner office in Berkeley, California to a global organization with over 1000 employees. Thousands of organizations, from small to Fortune 100, trust Databricks with their mission-critical workloads, making us one of the fastest growing SaaS companies in the world. Our engineering teams build highly technical products that fulfill real, important needs in the world. We constantly push the boundaries of data and AI technology, while simultaneously operating with the resilience, security and scale that is critical to making customers successful on our platform. We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above. As a software engineer with a backend focus, you will work closely with your team and product management to prioritize, design, implement, test, and operate micro-services for the Databricks platform and product. This implies, among others, writing software in Scala/Java, building data pipelines (Apache Spark™, Apache Kafka), integrating with third-party applications, and interacting with cloud APIs (AWS, Azure, CloudFormation, Terraform). Below are some example teams you can join: Data Science and Machine Learning Infrastructure: Build services and infrastructu

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Technology, Data, and Insights (TDI) is on a mission to accelerate Okta's scale and growth. We bring world-class business acumen and technology expertise to every interaction. We also drive cross-functional collaboration and are focused on delivering measurable business outcomes. The TDI Infrastructure Engineering team owns the foundational platforms that power Okta's business — from cloud infrastructure and AI platform delivery to network engineering, developer productivity, observability, and client platforms. We are a team of builders who design and operate at scale, and we are in the middle of a strategic transformation: evolving our cloud practice from a self-service model into a managed, opinionated platform that the entire business can rely on. The Cloud Platform Architect Opportunity Okta Federal, Inc. is looking for a dedicated Cloud Platform Architect for TDI Infrastructure Engineering — the technical authority for how we design, build, and evolve the cloud infrastructure that underpins our AI platform and the broader workloads running across the business. You will define the architectural standards, patterns, and strategies that the Cloud Platform Engineering team build

Reddit is a community of communities. It’s built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 130 million daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit www.redditinc.com . Team Description: The Ads Marketplace team is a strategic growth engine for Reddit Ads. Our mission is to democratize high-performance advertising by enabling brands to achieve world-class results with minimal friction. To achieve this, we need an incredibly robust, scalable, and state-of-the-art Machine Learning infrastructure. The Ads ML Platform team is at the core of this mission, tasked with building the foundation that powers all of our content understanding, ad targeting, and ad ranking models. We are empowering our ML engineers and data scientists to move faster and build smarter. The Role: As the Staff Product Manager for the Ads ML Platform, you will hold significant ownership over the infrastructure and tools that make our ads marketplace intelligent. You will define the vision and build the roadmap for a platform that enables unparalleled engineering velocity and supports the most modern ML architectures. You will be the bridge between complex ML systems and business outcomes. Whether it's integrating generative AI to increase developer productivity, establishing unified model-serving infrastructure, or optimizing GPU utilization, your work will directly accelerate how quickly and effectively we can ship highly-performant ad products. If you are passionate about the intersection of platform engineering and state-of-the-art ML research, this is the role for you. Responsibilities Define the Vision: Shape the long-term strategy and roadmap for Reddit’s Ads ML platform, ensuring we are adopting cutting-edge tech

P-191 At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions. Founded in 2013 by the original creators of Apache Spark, Databricks has grown from a tiny corner office in Berkeley, California to a global organization with over 1000 employees. Thousands of organizations, from small to Fortune 100, trust Databricks with their mission-critical workloads, making us one of the fastest growing SaaS companies in the world. Our engineering teams build highly technical products that fulfill real, important needs in the world. We constantly push the boundaries of data and AI technology, while simultaneously operating with the resilience, security and scale that is critical to making customers successful on our platform. We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above. As a Data Scientist on the Data Team, you will help build a data-driven culture within Databricks by helping solve product and business challenges. The Data team also functions as a in-house, production "customer" that dogfoods Databricks and drives the future direction of the products. If you are interested in machine learning infrastructure, please apply to the Software Engineer Backend job opening here. The impact you will have: Shape the direction of some of our key data science areas for 2020 - usage forecasting, product analytics, user behavior and funnel analysis. Work closely with Product Management, Sales, Customer Success a

Figma is growing our team of passionate creatives and builders on a mission to make design accessible to all. Figma’s platform helps teams bring ideas to life—whether you're brainstorming, creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline workflows, move faster, and work together in real time from anywhere in the world. If you're excited to shape the future of design and collaboration, join us! We’re looking for applied scientists with a Machine Learning and Artificial Intelligence background to build AI technologies and make Figma products more magical.. You will be driving fundamental and applied research in this area. You will be combining industry best practices and a first-principles approach to design and build AI/ML models and systems to improve Figma’s products. This is a full time role that can be held from one of our US hubs or remotely in the United States. What you’ll do at Figma: You will be driving fundamental and applied research in AI. You will explore the boundaries of what is possible with the current technology set to build best in class models for Figma’s domains You will be combining industry best practices and a first-principles approach to build cutting edge Generative AI models, using techniques like Supervised Finetuning (SFT), Reinforcement Learning (RL), prompt improvements and synthetic data generation Work in concert with product and infrastructure engineers to improve Figma’s products through AI powered features Collaborate closely with product managers and engineers to transform user feedback into requirements for AI systems Build evaluation systems to measure and improve quality of AI features in Figma products We'd love to hear from you if you have: Extensive experience in building generative AI features through prompt engineering, and fine tuning models in production environments Experience working on deep learning and generative AI frameworks li

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLE We’re building a founding team of Strategic Account Executives in London. Strategic accounts at Baseten are the largest and fastest-growing AI companies in the world. These are the teams defining the future of what AI products and services look like. These accounts can scale rapidly from one token to billions of tokens in a matter of weeks. This role owns these relationships, working directly with founders and engineering leaders on mission-critical and large-scale-AI problems in production—and shaping what we build next. This is a highly technical sale. You’ll trade opinions on the latest open-source model releases, run fast and nuanced evaluations alongside customer engineering teams, and often pulling in SMEs from applied research to infrastructure engineers to win. You’ll bring tight sales fundamentals and process discipline, while maintaining flexibility and creativity in how you run each cycle. This role is pioneering what sales looks like at the bleeding-edge of technology sales. This is a front row seat to the most consequential decisions made at the forefront of Artificial Intelligence. There is no faster place to learn and make an immediate impact. RESPONSIBILITIES Own a focused portfolio of high-growth, strategic AI-native accounts end to end — from technical evaluation and initial workload landing through expansion as inference usage scales. Lead technical evaluations and complex, multi-stakeholder s

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLE We're looking for a Capacity Manager for our on-premises data center builds and neo cloud (GPU cloud) delivery programs. This is a high-visibility, execution-critical role sitting at the intersection of infrastructure engineering, capacity planning, vendor/partner management, and customer delivery. You will own the end-to-end delivery lifecycle for large-scale compute infrastructure — from initial site/capacity commitments through power, networking, and hardware bring-up, to production-ready GPU/compute capacity landing in the hands of internal teams or customers. You'll be the person who turns ambitious infrastructure roadmaps into predictable, on-time, delivery. RESPONSIBILITIES Own delivery of on-prem infrastructure builds — colocation expansions, power/cooling readiness, rack-and-stack, network fabric bring-up, and hardware acceptance testing — coordinating across colo providers and partners, network engineering, hardware ops, and vendor teams. Drive neo cloud delivery programs — manage capacity delivery from GPU cloud and neo cloud partners (e.g., colocation/bare-metal/GPU cloud providers), including contract milestones, capacity ramps, SLAs, and go-live readiness. Build and maintain master delivery schedules across concurrent, multi-site, multi-vendor programs, integrating power/shell timelines, hardware lead times, logistics, and software/platform readiness into a single critical path. Manage cross-functi

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLE Product at Baseten is a nascent function. Our company today has a strong engineering culture, is heavily customer obsessed, and moves fast. We're building the product function now, and you'd be one of the first people who will help define it. You'll work directly with our founders and with some of the best systems and infrastructure engineers in the world, and you'll set the standard for building great AI infrastructure. PMs at Baseten don't sit above engineers. You earn ownership by being technical, finding the truth in front of customers, building great cross-functional relationships, and shipping great product experiences. Getting a model into production still takes real expertise: choosing a serving engine, sizing hardware, tuning it, wiring it into an app. We want a developer to go from "it runs on my laptop" to "it's serving production traffic" in minutes, on their own. You'll own the entire experience a developer touches to deploy and iterate: the CLI and SDKs, the console, onboarding, model discovery, deployment configuration, Truss, and the increasingly agent-driven ways developers build. Your job is to make Baseten synonymous with great DevEx and make it effortless for far more developers to self-serve deploy models on Baseten than can today. This role fits someone who gets technical by instinct and does whatever it takes to ship for customers, not only strategy, UX, or docs. You'll define the design s