Jobiba hiring network

Software Engineer Ml Infrastructure Jobs

6,335 active opportunities · Updated for October 2026

Fresh results

15 shown

Explore current software engineer ml infrastructure jobs. Use filters to narrow by work mode, employment type, experience and date posted.

A
1mo ago

About Anyscale: At Anyscale , we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray , a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI , Uber , Spotify , Instacart , Cruise , and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. About the role: As a Site Reliability Engineer, you will play a crucial role in ensuring the smooth operation of all user-facing services and other Anyscale production systems. Anyscale values diversity and inclusion, and we encourage applications from individuals of all backgrounds. This includes processes for provisioning, negotiating prices, managing costs, seeing opportunities for teams to reduce wastage by finding applications across the company. You will apply sound engineering principles, operational discipline, and mature automation to our environments and the Anyscale codebase as we scale. As part of this role, you will: Develop a unified perspective on how cloud components are utilized across the company, taking into account diverse needs and requirements. Ensure that deployment methodologies align with the company's reliability goals. Build systems that promote understanding of production environments, facilitating quick identification of issues through robust observability infrastructure for metrics, logging, and tracing. Create monitoring and alerting systems at different levels, enabling teams to easily contribute and enhance the overall monitoring capabilities. Establish testing infrastructure to s

machine learningai
View job →
B
Baseten
📍 San Francisco• Full-time
1mo ago

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE We’re seeking a GPU Kernel Engineer to join our team at the cutting edge of AI acceleration, where your code directly impacts the performance of state-of-the-art machine learning models. As a GPU Kernel Engineer, you'll craft the foundation that powers modern AI workloads, optimizing every microsecond of computation to enable breakthrough applications. You'll work in a fast-paced, intellectually stimulating environment where technical excellence is paramount and your contributions directly influence production systems serving millions of users across numerous products. This role offers exceptional growth potential for engineers passionate about low-level optimization and high-impact systems work. EXAMPLE INITIATIVES You'll get to work on these types of projects as part of our Model Performance team: Baseten Embeddings Inference: The fastest embeddings solution available The Baseten Inference Stack Driving model performance optimization RESPONSIBILITIES Core Engineering Responsibilities Design and implement high-performance GPU kernels for key ML operations, including matrix multiplications, attention mechanisms, and mixture-of-experts routing Write and optimize code using CUDA, PTX assembly, and architecture-specific techniques Apply advanced performance optimization methods such as memory coalescing, warp-level programming, tensor core acceleration, and compute/memory overlap Performance & Innovation Impl

awsmachine learningai
View job →
A
Anyscale
📍 Remote• Full-time
1mo ago

About Anyscale: At Anyscale , we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray , a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI , Uber , Spotify , Instacart , Cruise , and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. About the role Ray aims to provide a universal API for building distributed applications. To achieve this goal requires a distributed system with high levels of performance and reliability. We're looking for engineers with systems software experience that are interested in contributing to the Ray backend. About the Ray Core Team The Ray Core team develops and maintains the Ray C++ backend (e.g., distributed scheduler, language runtime integration, I/O and memory subsystems). We are responsible for the reliability, scalability, and performance of Ray as well as ensuring that Ray provides the right feature set to support higher level libraries and use cases. The team works on a balance of new features / distributed libraries, test infra improvements, debugging, and longer-term architectural improvements to Ray. A snapshot of projects you can work on: Optimizing performance of large-scale workloads on Ray Stability and stress testing infrastructure Improving fault tolerance (HA) As part of this role, you will: Leading cross-team projects while mentoring junior team members Develop high quality open source software to simplify distributed programming (Ray) Identify, implement, and evaluate architectural improvements

restmachine learningai
View job →
A
Anyscale
📍 Remote• Full-time
1mo ago

About Anyscale: At Anyscale , we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray , a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI , Uber , Spotify , Instacart , Cruise , and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. About the role Ray aims to provide a universal API for building distributed applications. To achieve this goal requires a distributed system with high levels of performance and reliability. We're looking for engineers with systems software experience that are interested in contributing to the Ray backend. About the Ray Core Team The Ray Core team develops and maintains the Ray C++ backend (e.g., distributed scheduler, language runtime integration, I/O and memory subsystems). We are responsible for the reliability, scalability, and performance of Ray as well as ensuring that Ray provides the right feature set to support higher level libraries and use cases. The team works on a balance of new features / distributed libraries, test infra improvements, debugging, and longer-term architectural improvements to Ray. A snapshot of projects you can work on: - Optimizing performance of large-scale workloads on Ray - Stability and stress testing infrastructure - Improving fault tolerance (HA) As part of this role, you will: Develop high quality open source software to simplify distributed programming (Ray) Identify, implement, and evaluate architectural improvements to Ray core Improve the testing process for Ray to make re

restmachine learningai
View job →

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role Software Engineers at Palantir build software at scale to transform how organizations around the world use data. As a Defense Tech Software Engineer Intern, you’ll have an opportunity to grow more quickly than you ever envisioned, as you contribute high-quality code directly to Palantir's Gotham product. Palantir's defense product vertical builds mission-critical products for the modern warfighter, enabling them to securely integrate and visualize their data, perform rich analyses, and build sophisticated, full-fledged programs such as common operating pictures, alert-triaging inboxes, and resource allocation planning tools driven by rich-ML models. Our customers use our defense offering to drive core operations within their organizations - these programs are relied upon for daily operations in the command centers and battlefronts of militaries across the world. Palantir's Product Development organization is made up of small teams of Software Engineers, each focusing on a specific aspect of a product. For example, you might join a team that builds geospatial mapping tools for mission critical operations, or a component of the Gotham release infrastructure. We encourage communication and collaboration among teams to share context, skills, and experience, so you'll learn about many different aspects of each product. Core Responsibilities As a Defense Tech Intern - you will be supporting work specifically focusing on delivering our Palantir Defense capabilities to our most critical mission partners. You’ll be involved throughout the product lifecycle - from idea generation, design, and prototyping to execution and shipping. You’ll be paired with a mentor

typescriptjavareact
View job →

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role Software Engineers at Palantir build software at scale to transform how organizations around the world use data. As a Defense Tech Software Engineer Intern, you’ll have an opportunity to grow more quickly than you ever envisioned, as you contribute high-quality code directly to Palantir's Gotham product. Palantir's defense product vertical builds mission-critical products for the modern warfighter, enabling them to securely integrate and visualize their data, perform rich analyses, and build sophisticated, full-fledged programs such as common operating pictures, alert-triaging inboxes, and resource allocation planning tools driven by rich-ML models. Our customers use our defense offering to drive core operations within their organizations - these programs are relied upon for daily operations in the command centers and battlefronts of militaries across the world. Palantir's Product Development organization is made up of small teams of Software Engineers, each focusing on a specific aspect of a product. For example, you might join a team that builds geospatial mapping tools for mission critical operations, or a component of the Gotham release infrastructure. We encourage communication and collaboration among teams to share context, skills, and experience, so you'll learn about many different aspects of each product. Core Responsibilities As a Defense Tech Intern - you will be supporting work specifically focusing on delivering our Palantir Defense capabilities to our most critical mission partners. You’ll be involved throughout the product lifecycle - from idea generation, design, and prototyping to execution and shipping. You’ll be paired with a mentor

typescriptjavareact
View job →
F
Figma
📍 Ca New York• Full-time• From $153K/yr
1mo ago

Figma is growing our team of passionate creatives and builders on a mission to make design accessible to all. Figma’s platform helps teams bring ideas to life—whether you're brainstorming, creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline workflows, move faster, and work together in real time from anywhere in the world. If you're excited to shape the future of design and collaboration, join us! Figma is seeking a versatile and experienced Machine Learning / AI Engineer to join our growing AI team, working at the intersection of applied machine learning, infrastructure, and product innovation. Whether you’re building intelligent search systems, crafting scalable data pipelines, or enhancing AI-powered creativity tools, your work will drive user productivity, shape new product experiences, and advance the state of AI at Figma. You’ll collaborate closely with engineers, researchers, designers, and product managers across multiple teams to deliver high-quality ML-driven features and infrastructure. This is a high-impact, cross-functional role where you’ll shape both foundational systems and user-facing capabilities. This is a full time role that can be held from one of our US hubs or remotely in the United States. What you’ll do at Figma: Design, build, and productionize ML models for Search, Discovery, Ranking, Retrieval-Augmented Generation (RAG), and generative AI features. Build and maintain scalable data pipelines to collect high-quality training and evaluation datasets, including annotation systems and human-in-the-loop workflows. Collaborate with AI researchers to iterate on datasets, evaluation metrics, and model architectures to improve quality and relevance. Work with product engineers to define and deliver impactful AI features across Figma’s platform. Partner with infrastructure engineers to develop and optimize systems for training, inference, monitoring, and deployment. Explo

pythonawsci/cd
View job →
I
Instacart
📍 United States• Full-time• Remote• From $265K/yr
1mo ago

We're transforming the grocery industry At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible earnings opportunities to Instacart Personal Shoppers. Instacart has become a lifeline for millions of people, and we’re building the team to help push our shopping cart forward. If you’re ready to do the best work of your life, come join our table. Instacart is a Flex First team There’s no one-size fits all approach to how we do our best work. Our employees have the flexibility to choose where they do their best work—whether it’s from home, an office, or your favorite coffee shop—while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work. Overview Instacarts Data Infrastructure organization builds and operates the systems that power our company’s data ecosystem, including a modern open data lakehouse on Apache Iceberg, a multi-engine compute platform for stream and analytical workloads, and self-serve tooling that helps Product, Data Science, ML, Ads, Finance, and engineering teams move fast with data. We’re looking for a Staff Software Engineer, Data Infrastructure to join our Data Governance and Foundations Team. In this role, you’ll serve as a senior technical leader owning the architecture and delivery of our open lakehouse foundation, governance and access patterns, and multi-engine compute strategy—balancing today’s reliability with the next three to five years of scale, maturity, and cost efficiency. You’ll collaborate closely with engineering leadership and stakeholders across Data Science,

REMOTEpythonsqlaws
View job →
A
1mo ago

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join: The Host Pricing & Settings team builds the platform and tools that help hosts run their business — with pricing strategies informed by market intelligence, comparable listings, and demand signals. We partner with Search, Listings, Tax, and Payments to ensure our guidance is accurate, timely, and trusted. Behind every pricing recommendation is a sophisticated ML system undergoing a fundamental rearchitecture. Our north star: a serving infrastructure where training, inference, and evaluation are consistent by design — features from a centralized store, model composition in one place, and backfills available on demand so data scientists and MLEs can evaluate candidates in days, not weeks. The Difference You Will Make: As a senior technical individual contributor, you will own the technical strategy for the full Modeling → ML Serving → API interface across the Host Pricing org. Although you will be at one of our highest levels of seniority, all individual contributors at Airbnb are Software Engineers — you are expected to be hands-on and contribute code. Define the architecture and contracts governing how models move from development to production — feature store design, model schema management, online/offline inference consistency, and multi-version support. Lead the buildout of a unified serving stack that eliminates per-model one-off implementations and gives data scientists a turnkey path from training to production. Architect backfill and evaluation infrastructure so the modeling team can simulate production inference over historical data in days, not weeks. Establish do

REMOTEpythonjavaai
View job →

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. The Data Clean Rooms team is Leading the market shift from traditional 2-party data sharing to multi-party collaboration hubs . Our vision is to provide a seamless, "safe-room" environment where enterprises can collaborate on shared datasets while maintaining absolute governance. We ensure that no party can exfiltrate another's underlying content, even while running complex joint workloads and getting high-value results. You will join a fast-paced, collaborative team of engineers on a journey to provide customers with an integrated set of innovative, AI-enabled capabilities to analyze data in a privacy-preserving way. You will have a real opportunity to impact and shape the future of secure data collaboration at Snowflake. AS A SOFTWARE ENGINEER IN DATA CLEAN ROOMS, YOU WILL: Architect and build highly scalable infrastructure that enables secure, multi-party collaboration. Design and implement core clean room features and services, intelligent agents, and robust developer APIs to expand platform capabilities and support custom AI/ML workflows. Partner closely with Product Management and cross-functional teams to drive complex projects from ideation and system design through to production deployment. Mentor peers and foster a warm, supportive culture of innovation, cross-tea

pythonjavaai
View job →
S
1mo ago

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. At Snowflake, we are building a high-impact team to help the world’s most innovative companies unlock the power of AI. As a Forward Deployed Engineer, Applied AI in our Cortex AI team, you will be a hands-on builder and a critical technical partner to our most strategic customers, placing you at the forefront of the enterprise AI revolution. You won't just be working with cutting-edge technology; you will be deploying it to solve real-world business problems at a massive scale. This role places you at the intersection of product, engineering, and customer success, building production-grade AI systems using Snowflake AI Platform, Cortex, and our native LLM capabilities. IN THIS ROLE AT SNOWFLAKE, YOU WILL: Drive Customer Impact: Architect, build, and deploy enterprise-grade AI solutions, including sophisticated AI agents. Build and iterate on AI pipelines and agents within a team-led engagement from prototype to production, contribute to evaluation frameworks and observability infrastructure most complex business challenges. Deliver with Velocity: Rapidly design, iterate, and ship high-quality code and ML pipelines. Translate ambiguous business objectives into robust, scalable, and performant solutions using Python and SQL. Productionize AI at Scale: Own the full lifecycle o

pythonjavasql
View job →

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role Software Engineers at Palantir build software at scale to transform how organizations around the world use data. As a Defense Tech Software Engineer Intern, you’ll have an opportunity to grow more quickly than you ever envisioned, as you contribute high-quality code directly to Palantir's Gotham product. Palantir's defense product vertical builds mission-critical products for the modern warfighter, enabling them to securely integrate and visualize their data, perform rich analyses, and build sophisticated, full-fledged programs such as common operating pictures, alert-triaging inboxes, and resource allocation planning tools driven by rich-ML models. Our customers use our defense offering to drive core operations within their organizations - these programs are relied upon for daily operations in the command centers and battlefronts of militaries across the world. Palantir's Product Development organization is made up of small teams of Software Engineers, each focusing on a specific aspect of a product. For example, you might join a team that builds geospatial mapping tools for mission critical operations, or a component of the Gotham release infrastructure. We encourage communication and collaboration among teams to share context, skills, and experience, so you'll learn about many different aspects of each product. Core Responsibilities As a Defense Tech Intern - you will be supporting work specifically focusing on delivering our Palantir Defense capabilities to our most critical mission partners. You’ll be involved throughout the product lifecycle - from idea generation, design, and prototyping to execution and shipping. You’ll be paired with a mentor

typescriptjavareact
View job →
RS
19 days ago

OUR MISSION At Redwood, we empower our customers with lights-out automation for their mission-critical business processes. ABOUT US Redwood Software is the leader in full stack automation fabric solutions for mission-critical business processes. With the first SaaS-based composable automation platform specifically built for ERP, we believe in the transformative power of automation. Our unparalleled solutions empower you to orchestrate, manage and monitor your workflows across any application, service or server — in the cloud or on premises — with confidence and control. CORE VALUES One Team. One Redwood Make Your Own Weather Obsess over Customer Success Work the Problem Be Curious Own the Outcome Respect Each Other YOUR IMPACT We are looking for a Software Engineer, Products & Platforms to join our Product engineering team to contribute to technical development across Redwood’s Workload Automation Platform, helping modernize and build reliable capabilities across our engineering teams. You will be instrumental in the design, development, and enhancement of our platform, building high-quality, scalable, and secure software that powers enterprise data exchange for more than 1,000 customers worldwide. As a Software Engineer, you will: Technical Delivery & Architecture: Solve complex engineering problems, follow established best practices, participate in design reviews, and collaborate with peers, while contributing to the development, security, compliance, and observability of our Java/Spring Boot microservices. Platform and Infrastructure Implementation: Develop a solid understanding of our core platform and infrastructure, contributing to its resilience, component communication, and scalability. Cross-Team Collaboration: Facilitate and drive cross-team collaboration with Product, QA, and other engineering groups to ensure end-to-end alignment and successful product delivery. AI Integration: Research and apply AI/ML co

javaawskubernetes
View job →
T
22 days ago

At Trustpilot, we're on an incredible journey. We're a profitable, high-growth FTSE-250 company with a big vision: to become the universal symbol of trust. We run the world's largest open customer review platform, and while we've come a long way, there's still so much exciting work to do. Come join us at the heart of trust! We are growing our engineering team at Trustpilot and are looking to welcome a Software Engineer I into the Trust Tech department! You will join a cross-functional team with full ownership of our products and codebase, where you will take part in every step of the development process, from ideation to maintenance. This is a place where you can grow as an individual, learn from senior mentors, and have a real influence on the direction of our projects. About the team: You will be joining a brand new team being built within the Trust Tech department, focusing specifically on businesses. The team is responsible for building and maintaining automated systems that enforce Trustpilot’s terms of use for businesses. This includes developing systems for automatic detection, enforcement of misuse, and internal investigation tools. This work is vital to maintaining Trust and Transparency on the platform. To achieve this, we collaborate closely with Data Scientists, Data Ops, and ML Ops to build sophisticated automated architectures that integrate detection models and robustly scale our misuse enforcement. What you’ll be doing: Work in a cross-functional “full ownership” team alongside Product, Design, and Data Science. Implement and release new features with a focus on backend stability and scalability. Help build solutions to handle high-volume data processing for fraud detection. Maintain and improve the internal tooling frontends (React) used for investigations. Troubleshoot existing software, squash bugs, and learn how to optimize database performance. Participate in technical discussions and learn best practices for Infrastructure as Code. Collab

javascripttypescriptreact
View job →
R
Reddit
📍 Ontario• Full-time• Remote
26 days ago

Reddit is a community of communities. It’s built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 130 million daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit www.redditinc.com . Reddit has a flexible workforce! If you happen to live close to one of our physical office locations our doors are open for you to come into the office as often as you'd like. Don't live near one of our offices? No worries: You can apply to work remotely in any country in which we have a physical presence. Team Description Reddit is poised to rapidly innovate and grow like no other time in its history. We’re currently hiring across multiple teams, some of these teams include: Ads ML Serving Team The Ads ML Serving team is part of Reddit’s Ads ML Platform, which builds the infrastructure and tools that power machine learning across Ads. This team focuses on creating a highly reliable, scalable, and efficient ML serving stack. Their work includes evolving long-term serving architecture, integrating closely with the ads serving stack, optimizing CPU/GPU performance, and building model velocity tools like observability libraries and model quality gating. Attribution & Identity Team The Attribution & Identity team builds products that help advertisers understand and measure the impact of their campaigns. They focus on attribution systems, identity solutions, and advertiser experimentation tools that improve performance insights and usability. Their goal is to make Reddit’s advertising platform more effective, transparent, and data-driven. Ads Growth Team The Ads Growth team drives initiatives to expand Reddit’s advertiser base, with a focus on Small to Medium Businesses (SMBs). We build and scale the technical founda

REMOTEpythonjavaredis
View job →
🔔

Get new software engineer ml infrastructure jobs by email

Daily job updates · Unsubscribe anytime

Explore verified demand

More software engineer ml infrastructure opportunities

Browse all jobs →

Companies hiring

Employers are derived from current jobs in this exact search market.