Senior Ai Ml Operations Engineer Jobs

P-1428 At Databricks, we run the world's largest AI platform. We believe the next breakthroughs will come from models trained on domain-specific enterprise data, not from bigger general-purpose models alone. That's why we built AI Runtime , a serverless product that makes GPU training of any size feel simple, so companies can train their own models the way frontier labs do. Customers across industries already use it to train models on governed data, from automotive AI at Rivian to Merck's TEDDY foundation models for single-cell biology and drug discovery, all the way to agents like KARL from Databricks AI Research. It takes a lot of engineering to make that work, and we've written about it on our blog: how we keep GPUs reliable , make training fault-tolerant , and speed up fine-tuning with fused kernels and smart sequence packing. As a Senior Software Engineer, you'll work on the systems behind all of this, solving hard technical problems and helping shape how AI Runtime evolves. The impact you will have: Build core parts of AI Runtime and contribute to Databricks' technical direction in AI training infrastructure. Develop reliability and observability features for a fleet that keeps growing in scale and complexity. Improve AI Runtime's developer experience, so the largest training jobs feel as simple as a first experiment. Help prepare AI Runtime for new GPU generations and workload types. Take on hard multi-node training problems, from orchestration and GPU scheduling to data loading and checkpointing. Make training faster and cheaper by raising GPU efficiency across model architectures and hardware generations. Work with research, product, and customers on what we build next and own features from design through production. Champion engineering excellence, raise the bar, and help the engineers around you grow. What we look for: 5+ years in large-scale distributed systems, with experience in GPU training, high-performance computing, or ML systems. Experience traini

About the Role Together AI is building the best inference infrastructure for voice applications. Our Voice AI platform powers production-grade, real-time voice agents and applications — serving speech-to-text and text-to-speech models with best-in-class latency and reliability. We're looking for a Senior ML Engineer to drive the model serving layer for voice workloads. You'll work hands-on with inference engines like TRT-LLM and SGLang to optimize how we serve models like Whisper, Parakeet, Orpheus, and Kokoro — pushing latency and throughput to the frontier. You'll profile GPU utilization, design batching strategies for streaming audio, and ensure new model architectures can go from research to production quickly. This is a foundational hire on a small, high-impact team. Voice inference has unique challenges — streaming audio, tokenization, real-time latency budgets — that require dedicated ML engineering focus. You'll shape how Together serves voice models as the industry moves from pipeline architectures (ASR → LLM → TTS) toward end-to-end speech-to-speech. Own the model serving stack that powers Together's voice platform across STT, TTS, and speech-to-speech. Work directly with state-of-the-art accelerators (H100s, H200s, B200s) to optimize voice model inference. Collaborate with model partners (Cartesia, Deepgram, Rime, and others) to bring their models to production on Together's infrastructure. Build quality evaluation frameworks that guide model selection for customers and inform the roadmap. Join a small, early-stage team with outsized impact on a fast-growing product area. Responsibilities Optimize inference performance for voice models (STT, TTS, speech-to-speech) — targeting best-in-class TTFB, throughput, and GPU utilization across our curated model set. Productionize voice models on serverless and dedicated endpoints, including batching strategies, streaming inference, and memory management tailored to audio workloads. Build and maintain a voice model

About Scale AI Scale AI is the data foundation for AI, helping organizations build and deploy reliable production AI applications. We partner with the world's leading enterprises and government organizations to accelerate their AI transformation through frontier AI systems that solve real business problems. Every day, we work with organizations across finance, healthcare, manufacturing, media and telecommunications to build production AI agents that automate complex workflows, help humans, reason over enterprise knowledge, and operate safely at scale. The Opportunity Applied AI is moving faster than ever. New foundation models, reasoning techniques, agent architectures, and research papers emerge every week. Yet building AI systems that reliably solve real-world problems remains one of the hardest engineering challenges. As a Senior Frontier Agent Engineer (Applied AI) , you'll bridge the gap between cutting-edge AI research and production deployment. You'll work directly with enterprise customers to design, evaluate, and deploy intelligent systems that combine frontier models with structured knowledge, retrieval, traditional machine learning, and enterprise software. Unlike traditional ML roles that focus on a single model or product, you'll work across a diverse portfolio of AI challenges spanning multiple industries and use cases. You may build a multi-agent research system and then participate in designing a customer intelligence platform, a healthcare copilot, or an autonomous workflow for a Fortune 100 company. If you enjoy reading new AI papers, experimenting with the latest models, and shipping production systems that create measurable business impact, you'll fit right in. What You'll Build Frontier AI Systems Design and deploy production AI agents that leverage the latest advances in large language models, reasoning, retrieval, memory, and tool use. Architect intelligent systems that combine LLMs, traditional machine learning, structured knowledge, enterpri

The AI Retrieval team powers the intelligence behind Asana's AI features by finding relevant work graph content and delivering it to LLM context windows. Our work enables AI features that truly understand your work—both within and outside of Asana—and use that understanding to take action. We also own Asana's traditional search experience. As a Senior Software Engineer on the AI Retrieval team, you'll build the systems that make Asana's AI smart and responsive. You'll tackle challenging problems in search and retrieval, working to improve the speed, cost-efficiency, and quality of our systems while expanding their capabilities to new data sources. This role is based in our New York City office with an office-centric hybrid schedule. The standard in-office days are Monday, Tuesday, and Thursday. Most Asanas have the option to work from home on Wednesdays. Working from home on Fridays depends on the type of work you do, and your recruiter can share more about the in-office requirements. What you'll achieve Reduce the latency and cost of our retrieval system, making Asana's AI features faster and more efficient Improve the quality and relevance of search results to help users find exactly what they need Expand the retrieval system's capabilities to query new Asana objects and third-party data sources Build and optimize search infrastructure using OpenSearch/ElasticSearch Contribute to ML-powered features like embeddings-based retrieval and semantic search Collaborate with cross-functional partners in New York City while building strong relationships with your Warsaw-based peers About you 6+ years of experience writing code in a production environment Curiosity about how AI and technology can solve problems and a desire to use it regularly in your work Hands-on experience in search engineering, including with OpenSearch or ElasticSearch Experience with embeddings and machine learning approaches to search and retrieval Experience in an Applied AI role is a plus Dem

The AI Retrieval team powers the intelligence behind Asana's AI features by finding relevant work graph content and delivering it to LLM context windows. Our work enables AI features that truly understand your work—both within and outside of Asana—and use that understanding to take action. We also own Asana's traditional search experience. As a Senior Software Engineer on the AI Retrieval team, you'll build the systems that make Asana's AI smart and responsive. You'll tackle challenging problems in search and retrieval, working to improve the speed, cost-efficiency, and quality of our systems while expanding their capabilities to new data sources. This role is based in our Warsaw office with an office-centric hybrid schedule. The standard in-office days are Monday, Tuesday, and Thursday. Most Asanas have the option to work from home on Wednesdays. Working from home on Fridays depends on the type of work you do, and your recruiter can share more about the in-office requirements. We offer a Contract of Employment (UoP) for our employees in Poland. What you'll achieve Reduce the latency and cost of our retrieval system, making Asana's AI features faster and more efficient Improve the quality and relevance of search results to help users find exactly what they need Expand the retrieval system's capabilities to query new Asana objects and third-party data sources Build and optimize search infrastructure using OpenSearch/ElasticSearch Contribute to ML-powered features like embeddings-based retrieval and semantic search Collaborate with cross-functional partners in New York City while building strong relationships with your Warsaw-based peers About you 6+ years of experience writing code in a production environment Demonstrates curiosity about AI tools and emerging technologies, with a willingness to learn and leverage them to enhance productivity, collaboration, or decision-making Hands-on experience in search engineering, including with OpenSearch or ElasticSearch

Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify innovations in software models, compilers, platforms, networking, and semiconductors. Our diverse team of technologists have developed a high performance RISC-V CPU from scratch, and share a passion for AI and a deep desire to build the best AI platform possible. We value collaboration, curiosity, and a commitment to solving hard problems. We are growing our team and looking for contributors of all seniorities. Join Tenstorrent’s AI IP software team and help customers bring AI workloads to products built on Tenstorrent technology. In addition to building our own hardware platforms, Tenstorrent offers AI acceleration IP that customers can integrate into their own SoCs. You’ll work directly with those customers to help bring models into Tenstorrent workflows, answer technical questions, and solve integration challenges. This is a broad, hands-on software role spanning models, compiler and runtime workflows, and AI IP. This role is hybrid, based out of Belgrade, Serbia. We welcome candidates at various experience levels for this role. During the interview process, candidates will be assessed for the appropriate level, and offers will align with that level, which may differ from the one in this posting. Who You Are A strong software engineer who enjoys working across a broad technical stack and learning new tools and workflows quickly. You have a working understanding of machine learning fundamentals and common model architectures, especially computer vision models and large language models. You don’t need to be an ML researcher or an expert in every architecture. A practical problem-solver who can turn customer questions and ambiguous requirements into clear investigations and workable solutions. A collaborative communicator who enjoys workin

Fin , now part of Salesforce, is on a mission to help businesses provide perfect customer experiences. Our AI Agent Fin is the highest-performing AI Customer Agent on the market today, enabling businesses to deliver impeccable, always-on customer support across the customer journey, from service, to sales, to ecommerce. Powered by our own AI models, Fin resolves complex customer issues end-to-end across every channel, with minimal set-up and integration. Fin can also be combined with our natively integrated Intercom help desk, giving modern support teams one single system. Together with Salesforce, the #1 AI CRM, where humans with agents drive customer success, we're building the future of customer experience. Here, ambition meets action. Tech meets trust. And innovation isn't a buzzword, it's a way of life. The world of work as we know it is changing, and we're looking for Trailblazers who are passionate about bettering business and the world through AI. Ready to level up your career at the company leading workforce transformation in the agentic era? You're in the right place. Agentforce is the future of AI, and you are the future of Salesforce. What's the opportunity? We’re looking for Senior Product Engineers to join the AI Group to build Fin's AI-powered products. Product Engineers working in ML work closely with both our ML Scientists and product teams. They must deeply understand our product, our customers, our ML tech stack and our broader product stack. Our group is responsible for defining new ML features, researching appropriate algorithms and technologies, and rapidly getting first prototypes in our customers’ hands. We are an extremely product focussed team. We work in partnership with Product and Design functions of teams we support. Our team's dedicated Engineers enable us to move to production fast, often shipping to beta in weeks after a successful offline test. We are very passionate about applying machine learning technology, and have p

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. As a member of the Infrastructure Foundation Hardware Engineering team, you will play a key role in enabling our mission to deliver a reliable, high-performing, and cost-efficient infrastructure that powers the world’s play. In this specialized role, you will be the technical lead for our GPU and AI accelerator ecosystem. You will be responsible for the full lifecycle of GPU hardware, from initial architectural evaluation and firmware qualification to large-scale fleet integration and performance tuning. You will ensure that Roblox’s massive-scale rendering and ML workloads run on the most optimized and stable hardware possible. You Will: Architect & Prototype: Prototype next-generation GPU-accelerated hardware platforms, ensuring seamless integration between high-density compute nodes, high-speed interconnects (NVLink/PCIe Gen5/6), and system firmware. GPU Optimization: Drive the integration, performance testing, and debugging of GPUs in our fleet, focusing specifically on hardware-level optimizations, driver tuning, and thermal/power management. Validation & Certification: Develop and execute rigorous evaluation and stress-testing strategies for GPU-heavy server platforms to ensur

About Decagon Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences. Our technology enables industry-defining enterprises like Avis Budget Group, Block’s Cash App and Square, Chime, Oura Health, and Hunter Douglas to deploy AI agents that power personalized, deeply satisfying interactions across voice, chat, email, SMS, and every other channel. We’re building a future where customer experiences are being redefined from support tickets and hold music to faster resolutions, richer conversations, and deeper relationships. We’re proud to be backed by world-class investors who share that vision, including a16z, Accel, Bain Capital Ventures, Coatue, and Index Ventures, along with many others. We’re an in-office company, driven by a shared commitment to excellence and velocity. Our values — Just Get It Done, Invent What Customers Want, Winner’s Mindset, and The Polymath Principle — shape how we work and grow as a team. About the Team The AI Platform team builds the foundational systems that enable every engineer at Decagon to build with AI. Our users are both engineers and coding agents. We build the execution environments, agent harnesses, evaluation systems, developer tools, and shared abstractions they use to plan, write, test, review, and ship production software. We sit within Infrastructure and work closely with product, ML, data, and security teams. Our goal is to turn rapidly evolving agent capabilities into reliable, secure platforms that materially change how software gets built at Decagon. About the Role We’re looking for an experienced software engineer to help build Decagon’s AI-native developer platform. You’ll work at the intersection of distributed systems, developer tooling, and applied AI. You will experiment with new agentic workflows, identify where they create real leverage, and turn the best ideas into dependable systems used across the engineering organization. This is a highly product-orie

At Curai, we believe that access to high-quality healthcare is a fundamental human right, not a privilege. Our mission is to radically transform healthcare delivery by harnessing the power of artificial intelligence and clinical expertise to make care more affordable, accessible, and effective for everyone. Patients interact with advanced AI systems at every step of their care and follow-up. Licensed physicians review each case with the patient for the clinical decision in our integrated virtual clinic. We ground our approach in rigorous research, continuous learning, and a deep commitment to clinical integrity. We focus on making a real impact: improving health outcomes, expanding access to care, and setting new standards for what trustworthy, patient-centered healthcare is. Read some of our latest publications. About the Senior Software Engineer, Agentic AI role We are hiring a Full-Stack Senior Software Engineer across a range of seniority levels to push the frontier of agentic / applied AI in healthcare. As a member of the technical staff on the artificial intelligence engineering team, you will design, build, and ship ML and LLM systems (agentic AI workflows) that directly shape how clinicians and patients interact with our platform. You will work end-to-end: framing the problem, exploring data, training and evaluating models, productionizing inference, and measuring real-world clinical and product impact. The bar is high and the surface area is large; we are looking for engineers who want significant ownership and are excited to operate where research meets production. What You'll Do Lead the technical execution of complex AI initiatives, owning the design and delivery of solutions within a product or technical domain while partnering with senior engineers on broader architectural direction. <span style="

Our vision is to transform how the world uses information to enrich life for all . Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. At Micron, our Technology Development team sits at the center of innovation. We build advanced modeling and AI solutions that shape how memory and storage technologies are designed, built, and scaled. Working at the intersection of physics, data, and engineering, we turn complex problems into practical breakthroughs that matter! This role is critical to how we accelerate semiconductor technology development using advanced AI and physics-based modeling. You will lead the design and deployment of agentic and LLM-powered solutions that directly influence process technology, packaging, and early manufacturing decisions. If you enjoy driving hard problems end to end and collaborating across hardware and software teams, this role offers real impact and visibility. Note: We are hiring for more than one role spanning Senior/Staff/Principal/Technical Staff Engineer. Responsibilities: Design and deploy physics-based, ML, and LLM-powered modeling solutions for semiconductor process, package, and manufacturing workflows Architect agentic AI systems that integrate with modeling tools, design automation environments, and fab/test platforms to enable digital twin development Define and promote best known methods for deploying LLMs and agentic systems reliably in production environments Evaluate and improve model performance using methods such as structured benchmarking, prompt tuning

Our vision is to transform how the world uses information to enrich life for all . Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. At Micron, our Technology Development team sits at the center of innovation. We build advanced modeling and AI solutions that shape how memory and storage technologies are designed, built, and scaled. Working at the intersection of physics, data, and engineering, we turn complex problems into practical breakthroughs that matter! This role is critical to how we accelerate semiconductor technology development using advanced AI and physics-based modeling. You will lead the design and deployment of agentic and LLM-powered solutions that directly influence process technology, packaging, and early manufacturing decisions. If you enjoy driving hard problems end to end and collaborating across hardware and software teams, this role offers real impact and visibility. Note: We are hiring for more than one role spanning Senior/Staff/Principal/Technical Staff Engineer. Responsibilities: Design and deploy physics-based, ML, and LLM-powered modeling solutions for semiconductor process, package, and manufacturing workflows Architect agentic AI systems that integrate with modeling tools, design automation environments, and fab/test platforms to enable digital twin development Define and promote best known methods for deploying LLMs and agentic systems reliably in production environments Evaluate and improve model performance using methods such as structured benchmarking, prompt tuning, RLHF, and feedback loops Translate modeling results into clear insights through data storytelling and visualiza

Our vision is to transform how the world uses information to enrich life for all . Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. At Micron, our Technology Development team sits at the center of innovation. We build advanced modeling and AI solutions that shape how memory and storage technologies are designed, built, and scaled. Working at the intersection of physics, data, and engineering, we turn complex problems into practical breakthroughs that matter! This role is critical to how we accelerate semiconductor technology development using advanced AI and physics-based modeling. You will lead the design and deployment of agentic and LLM-powered solutions that directly influence process technology, packaging, and early manufacturing decisions. If you enjoy driving hard problems end to end and collaborating across hardware and software teams, this role offers real impact and visibility. Note: We are hiring for more than one role spanning Senior/Staff/Principal/Technical Staff Engineer. Responsibilities: Design and deploy physics-based, ML, and LLM-powered modeling solutions for semiconductor process, package, and manufacturing workflows Architect agentic AI systems that integrate with modeling tools, design automation environments, and fab/test platforms to enable digital twin development Define and promote best known methods for deploying LLMs and agentic systems reliably in production environments Evaluate and improve model performance using methods such as structured benchmarking, prompt tuning, RLHF, and feedback loops Translate modeling results into clear insights through data storytelling and visualiza

Scale GP (Scale Generative AI Platform) is an enterprise-grade Generative AI platform providing APIs for knowledge retrieval, inference, evaluation, and more. We are seeking a strong Senior Full-Stack Engineer to help us build, scale, and refine our rapidly growing product. The ideal candidate is deeply grounded in software engineering best practices and experienced in developing and scaling modern web applications end-to-end. You will work across the stack—from React/TypeScript frontends to Python-based backends—while integrating with LLMs and machine learning systems. You will solve complex challenges in scalability, reliability, and product experience while owning significant product areas in a fast-paced environment. What You’ll Do Own major full-stack product areas , driving features from design through production deployment. Build modern frontend experiences using React and TypeScript, ensuring performance, usability, and responsiveness. Develop reliable backend services in Python, working with distributed systems, data pipelines, and ML/LLM components. Integrate with LLMs, vector databases, and AI infrastructure to power intelligent product experiences. Deliver experiments and new features quickly , maintaining high quality and tight feedback loops with customers. Collaborate across product, ML, and infrastructure teams to shape the direction of Scale GP. Adapt quickly —learning new technologies, frameworks, and tools as needed across the stack. Ideal Experience 5+ years of full-time engineering experience , post-graduation. Strong experience developing full-stack applications using React, TypeScript, and Python . Experience scaling or shipping products at high-growth startups . Familiarity with LLMs, vector databases, embeddings, or other modern AI tooling (tinkering or production experience welcome). Proficiency with SQL and modern API development. Experience with Kubernetes , containerization, and microservice architectures. Experience working with at leas

About the Role Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure. As a Senior Backend Engineer, you will play a key role in building the next generation AI cloud platform – a highly available, global, blazing-fast cloud infrastructure that virtualizes cutting-edge ML hardware (GB200s/GB300s, BlueField DPUs) and enables state-of-the-art ML practitioners with self-serve AI cloud services, such as on-demand + managed Kubernetes and Slurm clusters. This platform serves both our internal StaaS products (inference, fine-tuning) and our external cloud customers, spanning dozens of data centers across the world. Some of what you’ll work on: Work on a distributed GPU scheduling system for the on-demand clusters product, Instant Clusters. Build out a global management plane for managing our data center compute, networking, and storage. Design and build new customer-facing cloud platform services, delivering killer enterprise AI cloud features. Responsibilities Identify, design, and develop foundational backend services that power Together’s cloud platform Analyze and improve the robustness and scalability of existing distributed systems, APIs, databases, and infrastructure Partner with product teams to understand functional requirements and deliver solutions that meet business needs Write clear, well-tested, and maintainable software and IaC for both new and existing systems Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance Participate in an on-call rotation to address critical incidents when necessary Requirements 5+ years of demonstrated experience in building large scale, fault tolerant, distributed systems and API microservices Experience designing, analyzing and improving efficiency, scalability, and stability of various system resources Excel