Ml Services Software Development Engineer Jobs

About the Role Together AI is building the AI Native Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art GPU cloud infrastructure. The Together Cloud team builds the [Together GPU Clusters](https://www.together.ai/gpu-clusters) flagship IaaS product that provides high-performance, AI-ready GPU clusters through a self-serve cloud console, along with the virtualized infrastructure layer powering Together's inference, RL, and fine-tuning products. As a Senior Software Engineer focusing on AI Compute in the Together Cloud org, you will build and own major components of the next generation AI cloud platform – a highly available, global cloud infrastructure with cutting-edge virtualization of the latest ML hardware: GB300s/VRs, BlueField DPUs, InfiniBand and dual/quad-plane RoCEv2 fabrics. That virtualized computing platform powers our own SaaS products – inference, RL, and fine-tuning – and serves external cloud customers through self-serve offerings such as on-demand/reserved Kubernetes/Slurm clusters, across dozens of data centers and hundreds of thousands of GPUs. The hard problems in rapidly scaling heterogeneous GPU fleets are software problems: fully automated bootstrapping of GPU data centers, high-performance virtualization of GPU compute and DC networking without compromising isolation or portability, and fault-tolerant decentralized control planes. We solve them by building global and in-DC services, Kubernetes operators, and high-performance SDN libraries, forking hypervisors and Linux kernels, and building infra tailored to inference and fine-tuning. You'll own massive greenfield projects across their full lifecycle – scoping the problem and writing PRDs with our PMs, designing the system, and building it through to GA launch. Responsibilities Build the GPU and network virtualization stack: the hypervisor, kernel, and SDN work that makes GPU compute and DC networking high-perform

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. Snowflake is building the most powerful AI Data Cloud in the world — and Canada is a critical part of that mission. Our AI/ML engineering teams are delivering the intelligence layer that powers Cortex AI, large language model inference, AI functions, intelligent search, and the next generation of AI-powered experiences on the Snowflake platform. We're looking for a Software Engineer — AI to join our growing Toronto engineering team. You'll design, build, and ship AI-powered systems and services that are used by thousands of organizations worldwide. If you're passionate about building production AI infrastructure at scale and want to work alongside world-class engineers on problems that matter, this is the role. AS A SOFTWARE ENGINEER — AI, YOU WILL: Design, develop, and ship AI-powered features and services — working across model inference, AI functions, retrieval systems, and intelligent application experiences on the Snowflake platform Build production-quality infrastructure for AI workloads — including model serving, embedding pipelines, retrieval-augmented generation (RAG), and AI-driven automation Write clean, performant, and well-tested code in languages like Python, Java, C++, or Go — contributing to systems that operate at enterprise scale across Snowflake's multi-c

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. About Okta Okta is an enterprise grade identity management service, built from the ground up in the cloud and delivered with an unwavering focus on customer success. With Okta you can manage access across any application, person, or device. Whether the people are employees, partners, or customers, or the applications are in the cloud, on premises, or on a mobile device, Okta helps you become more secure, make people more productive, and maintain compliance. The Okta service provides directory services, single sign-on, strong authentication, provisioning, workflow, and built in reporting. It runs in the cloud on a secure, reliable, extensively audited platform and integrates deeply with on premises applications, directories, and identity management systems. About the Team The Data Platform team is responsible for the foundational data services, systems, and data products for Okta that benefit our users. Today, the Data Platform team solves challenges and enables: Streaming analytics Interactive end-user reporting Data and ML platform for Okta to scale Telemetry of our products and data Our elite team is fast, creative and flexible. We encourage ownership. We expect great things from our engineers and reward them with stimulating new projects, new technologies and the chance to have significant equity in a company. Okta is about to change the cloud computing landscape forever. About the Position This is an opportunity for experienced Softwa

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. About Okta Okta is an enterprise grade identity management service, built from the ground up in the cloud and delivered with an unwavering focus on customer success. With Okta you can manage access across any application, person, or device. Whether the people are employees, partners, or customers, or the applications are in the cloud, on premises, or on a mobile device, Okta helps you become more secure, make people more productive, and maintain compliance. The Okta service provides directory services, single sign-on, strong authentication, provisioning, workflow, and built in reporting. It runs in the cloud on a secure, reliable, extensively audited platform and integrates deeply with on premises applications, directories, and identity management systems. About the Team The Data Platform team is responsible for the foundational data services, systems, and data products for Okta that benefit our users. Today, the Data Platform team solves challenges and enables: Streaming analytics Interactive end-user reporting Data and ML platform for Okta to scale Telemetry of our products and data Our elite team is fast, creative and flexible. We encourage ownership. We expect great things from our engineers and reward them with stimulating new projects, new technologies and the chance to have significant equity in a company. Okta is about to change the cloud computing landscape forever. About the Position This is an opportunity for experienced Softwa

About the role Chime Engineering is growing rapidly as we scale to meet the financial needs of our members. We're looking for driven engineers with strong leadership skills to help evolve our risk architecture, enabling deeper insights and stronger protections for our members. As a Senior Engineer, you'll provide technical leadership to the team, helping drive the modernization of one of our Chime Platforms within Trust & Safety. Your work will ensure a secure, seamless, and frictionless experience for our members. You’ll lead key projects end-to-end by setting technical direction, shaping system architecture, mentoring engineers, implementing APIs, collaborating with data engineers and analysts, and ensuring the reliability and performance of the platform—while also contributing to other team initiatives as needed. In this role, you can expect to Drive technical design and architectural decisions, while mentoring engineers and fostering cross-functional collaboration Lead and contribute to multiple projects simultaneously, balancing ownership of key initiatives with support across broader team efforts Build and maintain robust, low-latency APIs and backend services that power our Trust and Safety platforms Become the domain expert in our platform architecture, providing technical decisions and solutions to refine our maturing platforms Partner with data engineers, analysts, and product managers to ship impactful features that enhance member protection and experience Improve platform reliability and performance through thoughtful system architecture, observability practices, and automation Evolve our experimentation, policy lifecycle, and ML integration capabilities to support smarter and faster decision-making at scale Engineers are required to participate in on-call rotation. Being on call may include responding to incidents outside of regular working hours when necessary. To thrive in this role, you have 5+ years of experience developing software in a product

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible. At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI. Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here . We are seeking a Staff Engineer to lead the App Promotion engineering team. In this role, you will own the engineering roadmap to take Pinterest’s App Install Optimization product from beta to GA, hardening the current alpha/beta experience, closing critical measurement gaps, and ensuring readiness across Ads Manager, backend services, and mobile clients. You will lay the groundwork for future optimizations (App Event Optimization, tROAS, and retargeting) by partnering with Ads Quality, ML, and Measurement teams to build scalable models, robust experimentation, and trustworthy reporting. You will manage a team of 5–6 full stack and mobile engineers, foster an inclusive and high-performing team culture, and work closely with cross-functional leaders across Ads, Measurement, and Product to align on strategy, tradeoffs, and execution. What you’ll d

At Curai, we believe that access to high-quality healthcare is a fundamental human right, not a privilege. Our mission is to radically transform healthcare by harnessing the power of artificial intelligence and clinical expertise to make care more affordable, accessible, and effective for everyone. About the Senior Full-Stack Software Engineer A day in the life of a Curai senior full-stack software engineer is spent doing things like: Working across the stack to drive high-leverage projects from concept through to completion Up-leveling the team on something you have expertise in - API or system design, building applications, cloud infrastructure, healthcare data, or something else entirely Working with a diverse multi-disciplinary team that includes software engineers, machine learning researchers, physicians, product managers, and UX researchers Developing new and updating existing user-facing features Collaborating with backend engineers to establish consistent APIs across our services, and good patterns for interactions with our API on the frontend Leading and guiding cross-team, “big picture” application architectural decisions Producing detailed technical specifications and documentation for features Writing unit, integration, and end-to-end tests for new features Meeting with product owners, AI/ML res

About Hark Hark is an artificial intelligence company building advanced, personalized intelligence. One that is proactive, multimodal, and capable of interacting with the world through speech, text, vision, and persistent memory. We're pairing that intelligence with next-generation hardware to create a universal interface between humans and machines. While today's AI largely operates through chat boxes and decade-old devices, Hark is focused on what comes next: agentic systems that interact naturally with people and the real world. To get there, we're developing multimodal models and next-generation AI hardware together - designed from the ground up as a single, unified interface for a new era of intelligent systems. About the Role Hark’s Device Software team is building the test infrastructure that proves our software works on real hardware, and we are looking for a Software Test Engineer to build it with us from the ground up. You will design and build hardware-in-the-loop (HIL) test benches and the software infrastructure to control them, create test cases that run on them, and turn test results into clear, actionable findings. Our automated test suite shall comprehensively cover nearly all aspects of device functionality and performance, ensuring seamless integration across audio, ML, connectivity, and backend services. This is not a hardware validation role: the hardware team proves the hardware, and your job is to prove the software running on it. It is also not app-only or storage test automation. The work happens on physical devices with radios, audio, cameras, sensors, and actuators. Responsibilities Build physical test systems and HIL benches for software verification, starting from zero Develop the test infrastructure and libraries, mostly in Python, that let any engineer run develop and run automated tests on hardware devices Design test strategies from product requirements and build the test cases that produce the quality signals necessary for rapid dep

Our Mission You call. You wait. You call again. In every other part of your life, you book in seconds. In healthcare, you’re blocked. We’re here to give power to the patient. For nearly 20 years, we’ve built the leading healthcare marketplace - helping tens of millions of people find and book the care they need. Now, we’re going further: building our infrastructure beyond Zocdoc’s marketplace to power access to care wherever patients search, from provider websites and insurance directories to search engines, AI platforms, and more. Healthcare still lacks something every other major consumer industry takes for granted: a seamless way to go from seeking to getting . We don’t want to own the front door to care; there isn't one. We want to make sure all of those doors open when patients are knocking. Fixing healthcare starts with fixing access to it. And we're still just getting started. Your Impact on our Mission We're transforming how healthcare practices interact with Zocdoc, building intelligent systems that understand each practice's needs and guide them toward actions that grow their business. This means personalized homepages, smart recommendations, AI-assisted configuration, and workflows that make Zocdoc essential to daily operations. As Senior Software Engineer, you'll build these systems end-to-end. You'll own features from design through production, work across the stack, and collaborate with Product, Design, and Data Science to ship experiences that matter. What You'll Do Build platform components - including practice profile services, engagement scoring pipelines, recommendation APIs, personalization infrastructure. Ship product features end-to-end - database to API to front-end, owning the full lifecycle. Work with Data Science to integrate ML models build feature pipelines, call model endpoints, instrument feedback loops. Write production-ready code with strong testing, observability, and error handling. Participate in desi

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. We are hiring a Senior Software Engineer for our Anti-Abuse team within Security Foundations. This team is responsible for protecting Snowflake and our customers from abuse on the Snowflake platform — building foundational security primitives across a complex multi-cloud environment to combat fraud, account takeovers, data exfiltration, and AI security threats at the scale of Snowflake’s hyper-growth. AS A SENIOR SOFTWARE ENGINEER, SECURITY FOUNDATIONS AT SNOWFLAKE, YOU WILL: Design, build, and scale security-by-default capabilities that protect Snowflake products across a complex multi-cloud environment Develop intelligent security platforms and services that leverage AI/ML and risk scoring to identify, prioritize, and respond to security threats and policy violations Build real-time detection and prevention systems to defend against account compromise, AI abuse, and data exfiltration through adaptive enforcement and granular policy controls Create security intelligence and monitoring capabilities that detect suspicious account & user activity, generate actionable insights, and enable timely response Partner across Security, Engineering, and Product teams to define security strategy, influence product design, and drive adoption of secure engineering practices Raise the

Location Details: At GoDaddy the future of work looks different for each team. Some teams work in the office full-time, others have a hybrid arrangement (they work remotely some days and in the office some days) and some work entirely remotely. This is a remote position, so you’ll be working remotely from your home. You may occasionally visit a GoDaddy office to meet with your team for events or meetings. This position is not eligible to be performed in Alaska, Mississippi, North Dakota, or the Virgin Islands. GoDaddy is not currently considering candidates for this role in California, Seattle, or NYC. Join Our Team... At GoDaddy, we're building the next generation of AI and machine learning capabilities that power experiences for millions of entrepreneurs worldwide. Our Machine Learning Engineering team bridges the gap between research and production, transforming cutting-edge models into scalable, reliable, and observable services that operate at global scale. We're looking for a Staff Software Engineer to lead the design and evolution of the infrastructure, platforms, and services that enable machine learning models to run in production. This is a highly technical, hands-on role where you'll work closely with ML Scientists, Data Engineers, and Product teams to deliver robust ML-powered solutions while helping shape the future of our machine learning platform. As a senior technical leader, you'll influence architecture, drive engineering excellence, and mentor engineers across a globally distributed team. What you'll get to do... Experience deploying and operating machine learning or generative AI workloads using technologies such as vLLM, Triton, TorchServe, SageMaker Endpoints, or similar serving frameworks. Familiarity with modern observability practices and tools including OpenTelemetry, Prometheus, Grafana, and CloudWatch. Experience with vector databases, feature stores, caching technologies (Valkey/Redis), and infrastructure-as-code solutions

About Anyscale: At Anyscale , we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray , a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI , Uber , Spotify , Instacart , Cruise , and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. About the role: As a Site Reliability Engineer, you will play a crucial role in ensuring the smooth operation of all user-facing services and other Anyscale production systems. Anyscale values diversity and inclusion, and we encourage applications from individuals of all backgrounds. This includes processes for provisioning, negotiating prices, managing costs, seeing opportunities for teams to reduce wastage by finding applications across the company. You will apply sound engineering principles, operational discipline, and mature automation to our environments and the Anyscale codebase as we scale. As part of this role, you will: Develop a unified perspective on how cloud components are utilized across the company, taking into account diverse needs and requirements. Ensure that deployment methodologies align with the company's reliability goals. Build systems that promote understanding of production environments, facilitating quick identification of issues through robust observability infrastructure for metrics, logging, and tracing. Create monitoring and alerting systems at different levels, enabling teams to easily contribute and enhance the overall monitoring capabilities. Establish testing infrastructure to s

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Our mission depends on having a digital representation of the physical world - a map with all routing related (real-time) information. This is what makes Lyft different from many products: our products don’t just facilitate online interactions, they facilitate dynamic, real-world ones. Without mapping services, none of these real world interactions between people and transport can happen. The Mapping organization at Lyft has spent the last few years building up Lyft’s mapping assets and capabilities by combining many internal and external data sources and services into an increasingly powerful and mission-critical technology stack. In doing so, we’ve also enabled new user experiences and features across all of Lyft’s products, including rideshare industry leading firsts like CarPlay, Android Auto, and real-time driver feedback! We are hiring a Software Engineer to join our Mapping experiences team that builds end user features to enhance drivers and riders experience on Lyft’s platform by using our in house navigation system. We are looking for an engineer with expertise in system architecture, cross team collaboration, and experience in building scalable solutions in the cloud environments. In this role, you'll collaborate with engineering, product, data science, analytics, operations, and AI/ML teams on programs that empower us to iterate quickly, delighting our passengers and drivers with rideshare focused mapping experiences. Responsibilities: Drive high-impact projects and innovate new solutions to provide the best user experience Lead large features from idea to positive execution and launch Write well-crafted, well-tested, readable, maintainable code Participate in code reviews to ensure code quality and distribute knowledge, as well as on call rotations Share your knowledge by giving brown ba

Reddit is a community of communities. It’s built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 130 million daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit www.redditinc.com . The Messaging Infra team is looking to hire a Senior Software Engineer who is excited to solve large scale streaming infrastructure and distributed messaging infrastructure problems. Reddit’s mission is to bring community and belonging to everyone in the world. Reddit is a community of communities where people can dive into anything through experiences built around their interests, hobbies, and passions. With more than 50 million people visiting 100,000+ communities daily, it is home to the most open and authentic conversations on the internet. From pets to parenting, skincare to stocks, there’s a community for everybody on Reddit. For more information, visit redditinc.com. Our messaging layer receives 50+ millions of messages/second serving 100GB/s of network traffic. We do this while efficiently storing over a petabyte of live topic data across ~1k brokers. As a senior engineer, you will partner closely with your team and our biggest users (ML/AI/Search) to build technical solutions that can scale to Reddit’s product growth. You’ll do this while maintaining an extremely high availability and reliability bar to ensure that Reddit’s users continue to get a great experience across our entire product portfolio. In your day-to-day, you can expect to: Contribute to developing the team and organization’s long term technical strategy. Refine and maintain our messaging infrastructure to support the asynchronous communication of services supporting hundreds of millions of users. Own the infrastructure (managed and self-hosted)

Ready to do the most impactful work of your career? At Coinbase , we are uncompromising on our mission to increase economic freedom. The bar is high, the environment is intense, and we like it that way. This isn't a place for complacency, it’s a place to be pushed past your perceived limits. If you're ready to build the future of finance alongside people who refuse to settle for "good enough," you belong here. Coinbase is a remote-first, but not remote-only company. Expect to get together quarterly for intense in-person working sessions called “surges.” learn more about working at Coinbase . As a Senior Software Engineer, Backend on the Growth Foundations team within the Consumer & Business group, you'll build and scale the core infrastructure that powers growth across Coinbase. This team owns the foundational systems behind powering efforts as: notifications at scale, incentives and referral platforms, user targeting and segmentation, lifecycle communications, and ML ranking that power more than 50% of Coinbase web and app surfaces. You'll design and ship backend systems that enable high-impact growth initiatives for Retail, Institutional, Base, and international teams while maintaining the reliability, scalability, and performance our customers depend on. What you'll do: Own the design and delivery of scalable distributed backend services that handle high QPS, low latency, and high reliability requirements for growth infrastructure Architect resilient service-oriented systems using modern cloud technologies, contributing across backend, data, and ML layers of the stack Partner with engineers, designers, product managers, and senior leadership to translate product and technical vision into quarterly roadmaps Lead investments in developer tooling, shared platform capabilities, and cross-team relationships that increase organizational velocity Build high-quality, well-tested production code for systems that are secure, reliable, and maintainable at sc