Software Engineer, Machine Learning Platform - Gen AI

P-59 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers — and customer obsessed — we leap at every opportunity to solve technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started. Modern data analysis employs sophisticated methods such as machine learning that go well beyond the roll-up and drill-down capabilities of traditional SQL query engines. As a software engineer on the Runtime team at Databricks, you will be building the next generation distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance, yet provide the expressiveness and programming abstractions to support diverse workloads ranging from ETL to data science. Below are some example projects: Apache Spark™ : Develop the de facto open source standard framework for big data. Data Plane Storage : Provide reliable and high performance services and client libraries for storing and accessing humongous amount of data on cloud storage backends, e.g., AWS S3, Azure Blob Store. Delta Lake : A storage management system that combines the scale and cost-efficiency of data lakes, the performance and reliability of a data warehouse, and the low latency of streaming. Its higher level abstractions and guarantees, including ACID transactions and time travel, drastically simplify the complexity of real-world data engineering architecture. Delta Pipelines : It's difficult to manage even a single data engineering pipeline. The goal of the Delta Pipelines project is to make it simple and poss

P-78 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers — and customer obsessed — we leap at every opportunity to solve technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started. As a software engineer with a backend focus, you will work with your team to build infrastructure and products for the Databricks platform at scale. The impact you'll have: Our backend teams span many domains, from our core compute fabric resource management infrastructure, to service platforms, to machine learning infrastructure. For instance, you might work on challenges such as: Resource management infrastructure powering the big data and machine learning workloads on the Databricks platform in a scalable, secure, and cloud-agnostic way Develop reliable, scalable services and client libraries that work with massive amounts of data on the cloud, across geographic regions and Cloud providers Build tools to allow Databricks engineers to operate their services across different clouds and environments Build services, products and infrastructure at the intersection of machine learning and distributed systems. What we look for: BS (or higher) in Computer Science, or a related field 5+ years of production level experience in one of: Java, Scala, C++, or similar language. Experience developing large-scale distributed systems. Experience working on a SaaS platform or with Service-Oriented Architectures. Experience with cloud technologies, e.g. AWS, Azure, GCP, Docker, or Kubernetes. Experience with security and systems that handle sen

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLE We are looking for Software Engineers to join our team. This is a specialized, high-impact role sitting at the intersection of high-performance computing (HPC) and Large Language Model (LLM) engineering. You will not just be building the automated "speedometer and diagnostic" suite for our next-generation AI infrastructure; you will be defining the roadmap, driving key technical decisions, and taking full ownership of the future of this work. RESPONSIBILITIES Benchmarking : Evaluate, run and automate standard LLM quality benchmarks (GSM8K, MMLU) alongside custom performance suites for specific workloads (e.g., long-context window, KV cache reuse, disaggregated serving). DevEx Improvement : Develop and maintain internal GPU-enabled development environments (similar to GitHub Codespaces). You will ensure the team has seamless, high-performance "dev machines" optimized for model experimentation. Tool Development : Build and contribute to open-source tools such as InferenceMAX and genai-bench to automate model evaluation, benchmarking and analysis. System Profiling : Use profilers like PyTorch Profiler, NVIDIA Nsight Systems and py-spy to collect performance profiles, identify bottlenecks, and debug the compute/networking stack. Monitoring & Observability : Develop real-time dashboards and alerts to monitor system health, model startup times, and runtime performance. Continuous Integration : Automate performance

About the role Chime’s Machine Learning Platform (MLP) team builds and operates the infrastructure, tooling, and developer experience that powers machine learning across the company. We enable data scientists and ML engineers to develop, train, deploy, and monitor models reliably and efficiently. As a Senior Software Engineer on the Machine Learning Platform team, you will design and build scalable systems spanning traditional machine learning and emerging AI workloads, including model training, feature computation, real-time inference, foundation-model access, evaluation, and agentic orchestration. You’ll work at the intersection of distributed systems, cloud infrastructure, applied machine learning, and AI product engineering. This role focuses on creating secure, reliable, and reusable platform capabilities that help teams choose the right approach, from conventional predictive models to LLM-powered and multi-step agentic systems, while maintaining strong standards for evaluation, observability, governance, privacy, and cost efficiency. In this role, you can expect to Design, build, and operate scalable ML and AI infrastructure on AWS. Design and operate shared platform capabilities for LLM and agentic workloads, including model access, prompt and configuration lifecycle, retrieval, tool integration, state management, and workflow orchestration. Build evaluation frameworks for non-deterministic AI systems, including offline benchmarks, regression testing, online quality signals, human feedback, and failure analysis. Establish observability, reliability, and governance for models and agents, covering traces, model and prompt versions, tool calls, latency, token usage, quality, safety, privacy, and cost. Help teams make principled architecture decisions across traditional ML, LLM-powered applications, and agentic workflows, and contribute to the platform’s technical roadmap. Build distributed training, batch inference, and large-scale processing systems using

About the Team DoorDash's MDX team sits within Machine Learning Platform and builds the shared foundation that ML engineers across DoorDash, Wolt, and Deliveroo rely on to build and run ML-powered products. We work across the full ML lifecycle: feature engineering, training, evaluation, deployment, serving, and monitoring. Our mission is to increase the velocity and reliability of ML-driven business impact across the company. A central pillar of that work is agentic infrastructure. We are building systems that let agents accelerate and operate the ML workflow itself, including auto research, where agents explore and iterate on modeling ideas, and self-healing systems that detect, diagnose, and remediate failures in ML pipelines and production models with minimal human intervention. About the Role You will join a small, high-leverage team building the agentic layer of DoorDash's ML infrastructure. You'll design and build the systems that let agents accelerate how ML engineers across DoorDash, Wolt, and Deliveroo develop, ship, and operate models. That includes auto research systems that explore and iterate on modeling ideas, and agentic developer support that helps ML engineers move through training, evaluation, deployment, and debugging faster. You'll own well-scoped components end to end, from design through production, working across agent orchestration, tooling and integrations with our ML platform, evaluation of agent behavior, and observability. This role is ideal for an engineer with a strong backend foundation who is excited to apply AI agents to real engineering workflows, learns quickly, and wants to grow into technical leadership in a fast-moving area where model capabilities, tooling, and best practices change month to month. You're excited about this opportunity because you will… Build agentic systems that increase the velocity of ML development across DoorDash, Wolt, and Deliveroo, helping ML engineers get from idea to production model faster. Design an

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. With over half a billion rides and counting, Lyft is solving hard problems in a flourishing domain with a lot of data and creative solutions in Marketplace, Mapping, Fraud, Growth and beyond. We're actively building the next-generation Machine Learning (ML) platform for low-cost, ultra-immersive transportation to improve people’s lives using modern ML with petabyte-scale data. Our Machine Learning Engineers are excited to work on these challenging problems and redefine solutions to directly impact various aspects of Lyft's primary business. As a PhD Machine Learning Engineer Intern on our Applied AI team, you'll take on an open research problem tied to product experiences used by millions of riders. Working closely with a Staff ML Engineer mentor, you'll scope the problem, develop and evaluate new methods on real data, and take the work far enough that it can be shared with the research community, with the goal of a paper submission to a top ML venue. If you are a PhD student who enjoys turning open-ended research questions into working systems, and you want your research to be tested against real users and real data, this opportunity is for you! Responsibilities: Own a research project from start to finish: frame the problem, review related work, propose new methods, and design rigorous offline and online evaluations Design, build, train and test ML models in areas such as reinforcement learning, sequential decision-making, personalization Write production-quality code that turns research prototypes into working pipelines on Lyft's data and ML infrastructure Partner with Product Managers, Data Scientists, and fellow ML Engineers to frame research questions within the business context Analyze experimental and observational data, and communicate findings clearly to both technical and non-technical aud