Ml Services Software Development Engineer Jobs

About the Role Together AI is building the AI Native Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art GPU cloud infrastructure. The Together Cloud team builds the [Together GPU Clusters](https://www.together.ai/gpu-clusters) flagship IaaS product that provides high-performance, AI-ready GPU clusters through a self-serve cloud console, along with the virtualized infrastructure layer powering Together's inference, RL, and fine-tuning products. As a Staff Software Engineer focusing on AI Compute in the Together Cloud org, you will set technical direction for and build major components of the next generation AI cloud platform – a highly available, global cloud infrastructure with cutting-edge virtualization of the latest ML hardware: GB300s/VRs, BlueField DPUs, InfiniBand and dual/quad-plane RoCEv2 fabrics. That virtualized computing platform powers our own SaaS products – inference, RL, and fine-tuning – and serves external cloud customers through self-serve offerings such as on-demand/reserved Kubernetes/Slurm clusters, across dozens of data centers and hundreds of thousands of GPUs. This is an architect-and-build role. Fully automated bootstrapping of GPU data centers, high-performance virtualization of GPU compute and DC networking without compromising isolation or portability, and fault-tolerant decentralized control planes — you'll set the architecture for these across our global and in-DC services, and be a key owner of the hardest parts, in the code as well as the design. Your designs will span the IaaS layer of a greenfield Vera Rubin data center up to the global management plane that schedules capacity across all of them. At this level the job is as much leverage as code: the standards you set and the engineers you grow decide how fast the rest of Together Cloud ships. Responsibilities Own the GPU and network virtualization stack: the hypervisor, kernel, and SDN work that keeps

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Senior Software Reliability Engineer - Data Platform About the Team The Data Platform team is responsible for the foundational data services, systems, and data products for Okta that benefit our users. Today, the Data Platform team solves challenges and enables: Streaming analytics Interactive end-user reporting Data and ML platform for Okta to scale Telemetry of our products and data Our elite team is fast, creative and flexible. We encourage ownership. We expect great things from our engineers and reward them with stimulating new projects, new technologies and the chance to have significant equity in a company. Okta is about to change the cloud computing landscape forever. About the Position This is an opportunity for experienced Software Reliability Engineers to join our fast growing Data Platform organization that is passionate about scaling high volume, low-latency, distributed data-platform services & data products. In this role, you will get to work with engineers throughout the organization to build foundational infrastructure that allows Okta to scale for years to come. As a member of the Data Platform team, you will be responsible for designing, building, and deploying the systems that power our data analytics and ML. Our analytics infrastructure stack sits on top of many modern technologies, including Kinesis, Flink, ElasticSearch, and Snowflake. We are looking for experienced Software Engineers who can help des

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. We are hiring a Intermediate Software Engineer for our Cortex AI Applications team. This team builds the AI/ML-powered user experiences that enable enterprises to converse with their structured data and extract insights in unprecedented ways — spanning the full product lifecycle from conception through deployment. In this role, you will build scalable, responsive, and intuitive user interfaces at the intersection of AI, data, and enterprise UX. AS A SOFTWARE ENGINEER AT SNOWFLAKE, YOU WILL: Contribute to the technical execution and delivery of user-facing frontend features, taking ideas from design concepts to production-ready deployments. Write clean, performant, and maintainable TypeScript/React code while adhering to engineering best practices. Actively participate in frontend architecture discussions, design reviews, and peer code reviews to ensure code quality and system scalability. Collaborate closely with product managers and UX/UI designers to convert user requirements into detailed technical tasks and robust UI components. Monitor, maintain, and optimize the frontend platform’s responsiveness, availability, and user experience. Partner with backend and cross-functional teams to integrate APIs and support backend services that power AI inference and data retrieval.

About the Team The Experimentation Platform Team develops a state-of-the-art platform in industry that enables Product Engineers, Data Scientists, ML Engineers and non-technical audiences to come up with hypotheses; design, configure and analyze experiments; and conduct exploratory and causal analysis. At DoorDash, where we run thousands of experiments per year, our mission is to equip all decision makers with rigorous, data-driven insights by democratizing experimentation with quality and velocity. The team consists of a mix of experienced veterans of backend, web, statistical and data infra engineers and work closely with the data science community. Some of the interesting work done in the team was published in articles such as: Meet Dash-AB-The Statistics Engine of Experimentation at DoorDash Supporting Rapid Product Iteration with an Experimentation Analysis Platform The 4 Principles DoorDash Used to Increase Its Logistics Experiment Capacity by 1000% Improving Online Experiment Capacity by 4X with Parallelization and Increased Sensitivity About the Role If you want to solve the toughest engineering challenges, build cutting-edge experimentation products under rigorous operational constraints (high volume, correctness guarantees) and work with some of the smartest people in the industry, DoorDash’s Experimentation Platform is the right place for you. As a full stack engineer, you’ll build across our backend services, SDKs, and the Decision Portal UI used by thousands of internal users. Come join us and be part of the mission. You will report into the engineering manager on our Decision Experience team as part of the Decision Systems team. We expect this role to be hybrid (San Francisco, Sunnyvale, Seattle, New York) with some time in-office and some time remote. What You'll Do Work on dramatically enhancing and simplifying the Experimentation platform which is used by almost every engineer in the company. Have the opportunity to build a new Experimentation platf

About the role Chime’s Cards org is hiring an engineer to help scale and evolve Cards portfolio. In this role, you’ll dive into high-impact projects across our service architecture, collaborating with product, risk, and design partners to deliver resilient, secure systems. While your focus will be backend, we're looking for someone who’s excited to roll up their sleeves and contribute wherever it’s needed most to move the team forward In this role, you can expect to Drive technical design and architectural decisions, while mentoring engineers and fostering cross-functional collaboration Lead and contribute to multiple projects simultaneously, balancing ownership of key initiatives with support across broader team efforts Build and maintain robust, low-latency APIs and backend services that power our Trust and Safety platforms Become the domain expert in our platform architecture, providing technical decisions and solutions to refine our maturing platforms Partner with data engineers, analysts, and product managers to ship impactful features that enhance member protection and experience Improve platform reliability and performance through thoughtful system architecture, observability practices, and automation Evolve our experimentation, policy lifecycle, and ML integration capabilities to support smarter and faster decision-making at scale Engineers are required to participate in on-call rotation. Being on call may include responding to incidents outside of regular working hours when necessary. To thrive in this role, you have 5+ years of experience developing software in a production environment at scale Prior experience serving as a technical lead for a team and on complex projects—driving architectural decisions, coordinating execution, and aligning cross-functional teams Proven experience with Ruby on Rails or comparable frameworks Experience with transactional databases and caching systems Deep understanding of architectural patterns for large-scale web applicat

About the Role Together AI is building the AI Native Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art GPU cloud infrastructure. The Together Cloud team builds the [Together GPU Clusters](https://www.together.ai/gpu-clusters) flagship IaaS product that provides high-performance, AI-ready GPU clusters through a self-serve cloud console, along with the virtualized infrastructure layer powering Together's inference, RL, and fine-tuning products. As a Staff Software Engineer focusing on AI Compute in the Together Cloud org, you will set technical direction for and build major components of the next generation AI cloud platform – a highly available, global cloud infrastructure with cutting-edge virtualization of the latest ML hardware: GB300s/VRs, BlueField DPUs, InfiniBand and dual/quad-plane RoCEv2 fabrics. That virtualized computing platform powers our own SaaS products – inference, RL, and fine-tuning – and serves external cloud customers through self-serve offerings such as on-demand/reserved Kubernetes/Slurm clusters, across dozens of data centers and hundreds of thousands of GPUs. This is an architect-and-build role. Fully automated bootstrapping of GPU data centers, high-performance virtualization of GPU compute and DC networking without compromising isolation or portability, and fault-tolerant decentralized control planes — you'll set the architecture for these across our global and in-DC services, and be a key owner of the hardest parts, in the code as well as the design. Your designs will span the IaaS layer of a greenfield Vera Rubin data center up to the global management plane that schedules capacity across all of them. At this level the job is as much leverage as code: the standards you set and the engineers you grow decide how fast the rest of Together Cloud ships. Responsibilities Own the GPU and network virtualization stack: the hypervisor, kernel, and SDN work that keeps

About Anyscale: At Anyscale , we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray , a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI , Uber , Spotify , Instacart , Cruise , and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. About the Role Anyscale is seeking a Staff Software Engineer to lead the technical vision for our Infrastructure team. As a Staff Engineer, you will be responsible for the architectural evolution of our control plane and data plane, ensuring that our "infinite laptop" vision scales to meet the most demanding distributed AI workloads in the world. You will act as a force multiplier, setting the standards for Kubernetes-based cloud-native infrastructure while mentoring engineers and driving cross-functional alignment across the Ray open-source community and our proprietary product teams. Key Responsibilities Architectural Leadership: Define and drive the multi-year technical roadmap for services that orchestrate Ray clusters across diverse cloud and on-premises environments. Systemic Optimization: Lead the design and optimization of high-performance control plane components specifically tailored for large-scale, heterogeneous AI/ML workloads. Platform Reliability: Establish the organization-wide standards for the reliability, scalability, and observability of Anyscale-managed infrastructure. Strategic Integration: Direct the long-term strategy for accelerator integration (GPUs, TPUs) and container management to ens

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. We are looking for an experienced backend software engineer to join our Road Safety & Telematics team. At Lyft, Telematics data is used to make Lyft safer by reducing the frequency and severity of accidents, which in turn also makes Lyft more affordable for riders and a better way to earn a living for drivers. The Telematics team acts as a platform team that processes petabytes of mobile sensor data — millisecond-level IMU, gyroscope, and GPS signals — through a series of DAG-based transformations and ML model inferences to detect harsh driving events and convert them into normalized risk features that other Lyft services consume. Our technology stack runs on AWS, Kubernetes, Spark, and Apache Airflow. In this role, you'll work closely with data scientists, actuarial teams, other backend and data engineers, and product management — partnering across geos to build risk-aware products that rank and reward safe drivers, help off-board unsafe ones, notify drivers in real time, and give claims agents the tools to understand exactly what happened in a ride. You'll also be a key technical partner to our insurance team as they optimize coverage costs and provider relationships. If you are a seasoned engineer with a passion for innovation, high-volume data pipelines, microservices, working in cross-disciplinary environments and possess the skills to ensure the ongoing maintenance and improvement of services, you will thrive on our team! You can read about some of the products that Telematics powers in this blog post: https://www.lyft.com/blog/posts/lyfts-impact-on-road-safety Responsibilities: Be a champion of the team's safety and affordability mission, serving as a reliable source of risk insights for teams across Lyft — from driver ranking and safety rewards to accident claims resolution and insurance

Reddit is a community of communities. It’s built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 130 million daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit www.redditinc.com . Reddit's Transport and Site Defense teams build and operate foundational infrastructure behind one of the largest sites in the world. These teams own how requests enter Reddit, how services discover and talk to each other, how traffic moves across clusters and clouds, and how Reddit protects itself from DDoS attacks, scrapers, bots, and other undesired traffic. We are looking for a Staff Software Engineer to join the Site Defense team within Reddit’s Infrastructure organization. Site Defense is responsible for protecting Reddit at internet scale—serving as the first line of defense against DDoS attacks, automated abuse, large-scale scraping, and other network-level threats. This is a high impact role that sits at the intersection of distributed systems, networking, security, and applied machine learning. You will design and own the critical infrastructure that safeguards Reddit’s data from large scale attacks. You will: Design, build, and operate high-scale, low-latency systems that protect Reddit from DDoS attacks, bots, and automated abuse. Analyze, develop and evolve ingress-level defenses across CDN, edge, and internal infrastructure layers. Build systems to detect, score, and mitigate malicious traffic in real time at per-request and per-user granularity Partner closely within Infrastructure and with Security, and internal Safety teams to balance security, performance, and user experience Mentor junior engineers in their professional growth. Contribute to the team’s ML-at-Ingress initiatives, including experimentin

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Staff Software Reliability Engineer - Data Platform About the Team The Data Platform team is responsible for the foundational data services, systems, and data products for Okta that benefit our users. Today, the Data Platform team solves challenges and enables: Streaming analytics Interactive end-user reporting Data and ML platform for Okta to scale Telemetry of our products and data Our elite team is fast, creative and flexible. We encourage ownership. We expect great things from our engineers and reward them with stimulating new projects, new technologies and the chance to have significant equity in a company. Okta is about to change the cloud computing landscape forever. About the Position This is an opportunity for experienced Software Reliability Engineers to join our fast growing Data Platform organization that is passionate about scaling high volume, low-latency, distributed data-platform services & data products. In this role, you will get to work with engineers throughout the organization to build foundational infrastructure that allows Okta to scale for years to come. As a member of the Data Platform team, you will be responsible for designing, building, and deploying the systems that power our data analytics and ML. Our analytics infrastructure stack sits on top of many modern technologies, including Kinesis, Flink, ElasticSearch, and Snowflake. We are looking for experienced Software Engineers who can help desi

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Senior Software Reliability Engineer - Data Platform About the Team The Data Platform team is responsible for the foundational data services, systems, and data products for Okta that benefit our users. Today, the Data Platform team solves challenges and enables: Streaming analytics Interactive end-user reporting Data and ML platform for Okta to scale Telemetry of our products and data Our elite team is fast, creative and flexible. We encourage ownership. We expect great things from our engineers and reward them with stimulating new projects, new technologies and the chance to have significant equity in a company. Okta is about to change the cloud computing landscape forever. About the Position This is an opportunity for experienced Software Reliability Engineers to join our fast growing Data Platform organization that is passionate about scaling high volume, low-latency, distributed data-platform services & data products. In this role, you will get to work with engineers throughout the organization to build foundational infrastructure that allows Okta to scale for years to come. As a member of the Data Platform team, you will be responsible for designing, building, and deploying the systems that power our data analytics and ML. Our analytics infrastructure stack sits on top of many modern technologies, including Kinesis, Flink, ElasticSearch, and Snowflake. We are looking for experienced Software Engineers who can help des

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role We run one of the industry's largest AI compute fleets, spanning multiple cloud providers and datacenters, to train, research, and serve frontier AI models. Those fleets run on Kubernetes, and the Kubernetes Platform team owns the control plane that makes them work. We are operating at a scale where the defaults stop working. We own the scheduler and extend it to place topology-sensitive ML workloads across thousands of accelerators at once. We scale the control plane itself — apiserver, etcd, controllers — so it stays responsive as object counts and node counts grow by orders of magnitude. And we build the core cluster services every workload depends on, like service discovery, so they hold up under the same pressure. We make sure the control plane is fast, correct, and always available. Your work will directly determine whether Anthropic can keep reliably and safely training frontier models as our compute footprint continues to grow. Key responsibilities Own, operate, and extend the Kubernetes scheduler for Anthropic's accelerator fleets, including custom scheduling plugins and policies for gang scheduling, topology awareness, and preemption Scale the Kubernetes control plane (apiserver, etcd, controller-manager) to support clusters far beyond typical limits, and find the next bottleneck before it finds us Design, build, and operate core cluster services such as service discovery that every workload in the fleet depends on Build and maintain custom controllers, operators, and CRDs Partner with research, training, and inference to understand workload shapes and turn their requirements into platform capabilities Collabo

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role We run one of the industry's largest AI compute fleets, spanning multiple cloud providers and datacenters, to train, research, and serve frontier AI models. Those fleets run on Kubernetes, and the Kubernetes Platform team owns the control plane that makes them work. We are operating at a scale where the defaults stop working. We own the scheduler and extend it to place topology-sensitive ML workloads across thousands of accelerators at once. We scale the control plane itself — apiserver, etcd, controllers — so it stays responsive as object counts and node counts grow by orders of magnitude. And we build the core cluster services every workload depends on, like service discovery, so they hold up under the same pressure. We make sure the control plane is fast, correct, and always available. Your work will directly determine whether Anthropic can keep reliably and safely training frontier models as our compute footprint continues to grow. Key responsibilities Own, operate, and extend the Kubernetes scheduler for Anthropic's accelerator fleets, including custom scheduling plugins and policies for gang scheduling, topology awareness, and preemption Scale the Kubernetes control plane (apiserver, etcd, controller-manager) to support clusters far beyond typical limits, and find the next bottleneck before it finds us Design, build, and operate core cluster services such as service discovery that every workload in the fleet depends on Build and maintain custom controllers, operators, and CRDs Partner with research, training, and inference to understand workload shapes and turn their requirements into platform capabilities Collabo

About the Role Together AI is building the AI Native Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art GPU cloud infrastructure. The Together Cloud team builds the [Together GPU Clusters](https://www.together.ai/gpu-clusters) flagship IaaS product that provides high-performance, AI-ready GPU clusters through a self-serve cloud console, along with the virtualized infrastructure layer powering Together's inference, RL, and fine-tuning products. As a Senior Software Engineer focusing on AI Compute in the Together Cloud org, you will build and own major components of the next generation AI cloud platform – a highly available, global cloud infrastructure with cutting-edge virtualization of the latest ML hardware: GB300s/VRs, BlueField DPUs, InfiniBand and dual/quad-plane RoCEv2 fabrics. That virtualized computing platform powers our own SaaS products – inference, RL, and fine-tuning – and serves external cloud customers through self-serve offerings such as on-demand/reserved Kubernetes/Slurm clusters, across dozens of data centers and hundreds of thousands of GPUs. The hard problems in rapidly scaling heterogeneous GPU fleets are software problems: fully automated bootstrapping of GPU data centers, high-performance virtualization of GPU compute and DC networking without compromising isolation or portability, and fault-tolerant decentralized control planes. We solve them by building global and in-DC services, Kubernetes operators, and high-performance SDN libraries, forking hypervisors and Linux kernels, and building infra tailored to inference and fine-tuning. You'll own massive greenfield projects across their full lifecycle – scoping the problem and writing PRDs with our PMs, designing the system, and building it through to GA launch. Responsibilities Build the GPU and network virtualization stack: the hypervisor, kernel, and SDN work that makes GPU compute and DC networking high-perform

Bloomreach is building the world’s premier agentic platform for personalization .We’re revolutionizing how businesses connect with their customers, building and deploying AI agents to personalize the entire customer journey. We're taking autonomous search mainstream, making product discovery more intuitive and conversational for customers, and more profitable for businesses. We’re making conversational shopping a reality, connecting every shopper with tailored guidance and product expertise — available on demand, at every touchpoint in their journey. We're designing the future of autonomous marketing , taking the work out of workflows, and reclaiming the creative, strategic, and customer-first work marketers were always meant to do. And we're building all of that on the intelligence of a single AI engine — Loomi — so that personalization isn't only autonomous…it's also consistent.From retail to financial services, hospitality to gaming, businesses use Bloomreach to drive higher growth and lasting loyalty. We power personalization for more than 1,400 global brands, including American Eagle, Sonepar, and Pandora. About the Team: AI Search The AI Search team owns Bloomreach’s core search platform, serving hundreds of millions of queries per day across enterprise customers. We build and operate highly scalable, low-latency systems that combine traditional information retrieval with modern ML-driven ranking and semantic understanding — all in production at scale. This team sits at the intersection of systems engineering, search relevance, and applied ML , with direct impact on customer revenue and experience. The Role: As a Senior Staff Engineer , you will be a technical leader responsible for shaping the architecture and long-term evolution of Bloomreach’s Search platform. You will lead complex initiatives, set technical direction, and mentor engineers, while remaining deeply hands-on. This role is ideal for someone