Software Engineer Ml Infrastructure Jobs

Truveta is the world’s first health provider led data platform with a vision of Saving Lives with Data. Our mission is to enable researchers to find cures faster, empower every clinician to be an expert, and help families make the most informed decisions about their care. Achieving Truveta’ s ambitious vision requires an incredible team of talented and inspired people with a special combination of health, software and big data experience who share our company values . Truveta was born in the Pacific Northwest in the USA and has employees who live across the country. As we expand our global footprint with a new presence in Hyderabad, India, we’re building a world-class team to help us scale this mission and Clinical Intelligence and AI Evaluation is at the heart of everything we do. This job requires daily onsite work at our headquarters in Hyderabad, India. This Opportunity Join the founding team of the Truveta India Development Center (IDC) and play a pivotal role in shaping its future. As one of the initial members, you'll help build and scale a high-impact organization while contributing to products and platforms that advance healthcare through data and AI. This is a unique opportunity to influence both the technical direction and the culture of a growing global engineering hub. This highly visible position will report to our Director of Clinical Intelligence and AI Evaluation team directly and will collaborate closely with engineers, product managers, designers, and ML teams across geographies. Who We Need Truveta is rapidly building a talented and diverse team to tackle complex healthcare domain data and technical challenges. Beyond core capabilities, we are seeking problem solvers, passionate and collaborative teammates, and those willing to roll up their sleeves while making a difference. If you are interested in the opportunity to pursue purposeful work, join a mission-driven team, and build a rewarding career while h

Opportunity Overview: We are seeking a Staff Software Engineer to join our Engineering department. In this role, you will direct a fast-paced, collaborative, agile team of software engineers in the design, development, and scaling of highly available AI healthcare products on the Cohere platform. You'll set the technical direction for how the platform evolves — owning architecture and design decisions that span multiple teams and outlive any single release. This is an opportunity to drive technical excellence, define customer-configurability capabilities, and establish patterns other teams build on at the intersection of healthcare interoperability and modern distributed systems. This is a remote-first role that may require travel to Boston, MA for new hire onboarding and occasional in-person team meetings and company events. What you’ll do: Technical Leadership: Provide technical leadership across architecture, system design, and mentor junior engineers for building scalable SaaS products. Platform Ownership: Lead the development and enhancement of Cohere’s AI-powered applications and platforms, ensuring that it is highly configurable, and optimized for performance. Data & Retrieval Architecture: Design data and retrieval architectures that give AI agents the right context, across diverse healthcare sources. Hands-On Engineering: Design, review, and own high-quality production code — actively contributing alongside the team, leading releases, production deployments, reducing developer development friction and on-call support. NFR, Security & Compliance: Drive technical strategy to ensure the team's designs consistently address non-functional requirements — observability, instrumentation, performance, and operational readiness that incorporate security and privacy regulations Cross-Functional Collaboration: Work closely with ML/DS teams, product teams, and architects to understand requirements and ensure systems meet business needs. A

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. WHY SAFETY? At Roblox, we strive to connect a billion people with optimism and civility, and the Safety organization’s mission is to become the leader in civil immersive online communities. We systematically detect, remove, and prevent problematic accounts, content and behavior, and we make Roblox accounts secure and free from compromise. We cover a broad area of the tech spectrum, including machine learning, classifiers for 3D models, experimentation, automation, detection workflows, and AI-powered text filters. Aligned and partnering with product teams, we use this toolbelt to discover new opportunities, influence and shape the product roadmap and prioritization, build safety products, and measure the impact on our community of users and developers. In doing so, we keep Roblox safe, civil, and inclusive, and we foster positive relationships between people around the world. WHY BOT DEFENSE? Roblox is a prime target for automated scripts that cause harm to our users, and creators. Join our Bots and Spam team, where you will tackle the critical challenge of safeguarding the platform against sophisticated bot threats. While our current team Backend and ML engineers have made tremendous

About the Team The Spark Platform team owns and operates DoorDash's Apache Spark ecosystem — the execution runtime, remote shuffle service, cluster scheduler, and reliability tooling that powers the company's data, analytics, and ML workloads. We run Spark across the company at significant scale and continue to expand the workloads, capabilities, and consumer base we serve. Orchestrating and operating thousands of Spark cluster deployments is a complex distributed system problem which the team invests heavily in runtime optimization, systems architecture, multi-tenant scheduling, and end-user tooling. About the Role As a Senior Software Engineer on Spark Platform, you will set the technical direction for our in-house Spark deployment and shape the architecture that will run DoorDash's data, analytics, and ML compute for the next five years and beyond. You will own the deep, cross-cutting problems that span the runtime, the shuffle service, the scheduler, and the overall service reliability — making the architectural calls that compound across the platform's lifetime. You will partner with the Engineering Manager on technical roadmap, hiring, and team shape, and act as the senior technical voice in cross-team partnerships with Data Engineering, ML Platform, and product engineering teams that depend on the platform. You must be located in San Francisco, Sunnyvale, Seattle, or New York City for this hybrid position. You will report into the Engineering Manager on our Spark Platform team. You're excited about this opportunity because you will… Set the multi-year technical direction for an in-house Spark-on-Kubernetes platform — runtime, shuffle, scheduler, reliability — and make the architectural calls that compound for years. Own the deepest distributed-systems problems on the team: shuffle architecture, multi-tenant scheduling, runtime performance, and the failure modes that only show up at scale. Partner with the Engineering Manager on technical roadmap, hiring, inte

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Marketplace teams are at the heart of our products and decision-making, owning everything from rider pricing to driver earnings, incentives, and efficient matching. We’re looking for passionate, driven engineers to build systems that empower our riders and drivers to have the best transportation experience possible through prediction, adaptivity, and personalization. We’re looking for someone who is excited about working in a fast-paced, innovative, and impactful environment to create reliable solutions to distributed computing, ML, and data problems. The Pricing team is a centerpiece of Lyft’s Marketplace org, determining prices for all rideshare products and supporting new initiatives. We work with Product & Science to solve and implement complex pricing requirements, balancing the needs of riders, drivers, and the business goals. As an owner of one of the most critical flows in the company, you will work on a wide array of challenges such as latency-sensitive concurrency problems, large scale distributed systems, and experimentation. If you’re interested in playing a large part in demand / supply management and improving the Lyft customer experience, this could be a great fit for you. Responsibilities: Help define the roadmap and architecture based on technology and business needs Unblock, support, effectively communicate, and obtain buy-in across teams to achieve results Lead projects of multiple people from idea to positive execution Write clear, scalable and clear design documentation Write well-crafted, well-tested, readable, maintainable code Utilize your expertise in Python, Golang, AWS to deliver robust and scalable solutions Participate in code reviews to ensure code quality and distribute knowledge Proactively participate in resolving ongoing incidents Share your kno

The Perception team is pioneering the development of a multi-modality foundation model to drive the next generation of autonomous system intelligence. As a Machine Learning and System Optimization Engineer, you will orchestrate and allocate overall system capacity to various core perception models running on-bot, as well as drive large initiatives that allow for more efficient inference by sharing various parts of the perception stack with one another. You will focus on bringing highly efficient, production-ready large-scale models to our on-vehicle stack. We are looking for experts with hands-on experience compressing, accelerating, and deploying complex models, including LLMs, VLMs, or foundation models, for power- and thermal-constrained vehicle SoCs. In addition, you will optimize ML models, write custom CUDA kernels, and build highly concurrent inference code to ensure real-time, deterministic execution on edge devices. In this role, you will: Allocate and distribute system resources (CPU/GPU/interconnect) to various models and inference engines running on the robot. Spearhead cross-cutting initiatives that allow for better compute utilization through sharing/fusing models and better scheduling strategies. Optimize large-scale models (Multi-Modal Sensor Fusion models, LLMs, VLMs) using advanced quantization (PTQ, QAT), pruning, mixed-precision inference frameworks, and parameter-efficient fine-tuning (LoRA, QLoRA). Architect and implement model conversion and compilation pipelines using TensorRT for edge deployment. Write production-level, low-latency, and memory-safe C++ and CUDA code for real-time inference on vehicle systems. Qualifications: Deep experience in system and performance optimization in CPU/GPU systems designed for low latency or high throughput. Deep expertise in working with real-time systems & required

What you’ll do Act as the technical lead for large parts of the scanner platform: system architecture, codebase structure, and long-term maintainability. Own core runtime foundations: distributed control, state management, fault handling, and reliability. Drive engineering rigor: testability, code quality, review standards, performance regression prevention, and release processes. Build robust observability: logs, metrics, traces, and replayable diagnostics (with privacy constraints). Collaborate with hardware and recon/ML teams to define interfaces, data contracts, timing/synchronization, and failure modes. Lead complex refactors (e.g., message passing / RPC boundaries, modularization, concurrency model) without halting forward progress. What we’re looking for Deep software architecture experience for real-world systems: robotics, instrumentation, medical devices, or other complex distributed products. Strong Python and concurrency background (asyncio, multiprocessing, profiling, performance engineering). Track record of shipping systems that are observable, debuggable, and resilient. Strong technical leadership: clarity, pragmatic trade-offs, and mentoring. Useful experience Building but rock-solid systems: clear interfaces (gRPC/protobuf or equivalent), strong state modeling, and failure handling. High-leverage engineering habits on a lean team: good tests, CI, reproducible dev environments, and fast code review. Practical performance + concurrency work in Python (asyncio, profiling, multiprocessing) and comfort debugging distributed behavior. Security-minded device software: safe defaults, encrypted data paths, and disciplined handling of PII/PHI. Operational thinking: remote updates/management, excellent logging, and diagnostics that make real hardware debuggable.

About the Team The Future of Computing Research team is an Applied Research team within the Consumer Devices group focused on developing new methods and models as we advance forward in our mission of building AGI that benefits all of humanity. As a Software Engineer on the Future of Computing Research team, you will work together with both the best ML researchers in the world and the greatest design talent of our generation to push the frontier of model capabilities. About the Role We are looking for a Software Engineer to join our team to build tools and services that enable AI research, evaluation, and data generation workflows. The best work in this role will start with an ambiguous design question and turn it into working research systems. You will work closely with researchers, designers, and engineers to build the evaluation systems, synthetic data generation pipelines, review tools, and supporting platform services. The goal is to make these workflows easier to create, run, and trust without requiring bespoke engineering support for each new design concept. You will help ensure that research artifacts have a clear lifecycle, runs are reproducible and observable, and results provide useful evidence for product and model-training decisions while the underlying systems remain reliable and reusable. This role is based in San Francisco, CA. We use a hybrid work model of three days in the office per week and offer relocation assistance to new employees. In this role, you will: Build web applications, APIs, data models, and backend services for AI research workflows. Build tools to author and manage evaluation tasks, rubrics, graders, suites, and rollout configurations, including workflows for publishing, versioning, auditing, and sharing research artifacts. Automate evaluation runs and generate useful reports for design, research, and engineering teams. Support synthetic data generation workflows for multimodal and conversational research, including tools that comb

Why Sony Interactive Entertainment? Sony Interactive Entertainment isn’t just the Best Place to Play — it’s also the Best Place to Work. Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. As a subsidiary of Sony Group Corporation, we’re part of a proud legacy of innovation and excellence. SIE is a dynamic technology company, delivering cutting-edge hardware and network services to more than 100 million people and an entertainment leader, home to some of the most beloved and recognizable intellectual properties (IP) in the world. Our role at SIE is to create and nurture the experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity. Who we are The Direct to Consumer (D2C) Data Science organisation comprises Data Science, Data Engineering and ML Engineering practices. D2C Data Science helps PlayStation grow and operate its digital business across commerce, subscriptions, payments, lifecycle experiences and player-facing services. We partner with product, engineering, finance, marketing and operations teams to turn experimentation, forecasting, AI and production-quality measurement into better player experiences. Role overview Within D2C Data Science, the D2C ML Engineering team is seeking a software engineer to help design, build, and support production AI platform capabilities that solve high-value business problems across the broader digital commerce ecosystem. This is not a model-training or predictive-platform ownership role; it is an engineering role focused on turning AI into dependable products, services, and automation. The ideal candidate is a strong software engineer with backend experience and practical hands-on applied AI experience. What you’ll be doing: Create services, workflows, and reusable components for LLM-powered solutions. Collaborate with stakeholders to understand use cases, identify if and how AI could be used, prototype solutions, measure outcomes, and help move

We're transforming the grocery industry At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible earnings opportunities to Instacart Personal Shoppers. Instacart has become a lifeline for millions of people, and we’re building the team to help push our shopping cart forward. If you’re ready to do the best work of your life, come join our table. Instacart is a Flex First team There’s no one-size fits all approach to how we do our best work. Our employees have the flexibility to choose where they do their best work—whether it’s from home, an office, or your favorite coffee shop—while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work. Overview This role challenges traditional approaches to digital shopping by improving backend systems that power a seamless user journey. You will lead efforts to enhance content discoverability and purchase processes, helping to perfect the interaction between user desires and our vast product offerings. The Senior Software Engineer will focus on enhancing the user experience by developing robust backend architectures that support advanced recommendation and personalization systems. In close collaboration with ML engineers, product teams, and data scientists, you will lead the innovation of our backend services, enabling sophisticated, data-driven features that adapt to our customers' shopping behaviors. The Core Experience teams are dedicated to creating engaging and straightforward shopping experiences. You will be part of a team that is at the heart of product

Our vision is to transform how the world uses information to enrich life for all . Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. As a Systems Software Engineer in Micron’s Storage and Memory Systems (SMS) group within TPG Pathfinding, you will design, develop, and demonstrate innovative system‑level software that influences Micron’s future memory and storage technologies. You will work in a small, highly skilled engineering team, collaborating closely with AI/ML specialists, hardware engineers, and system architects to evaluate emerging hardware concepts, quantify performance gains, and guide long‑term product direction. This role requires versatility, strong system‑level problem‑solving skills, and the ability to apply hardware architecture knowledge across the full software stack. Responsibilities Develop software and port applications to demonstrate and measure the value of proof‑of‑concept hardware systems and features. Collaborate with AI/ML experts, software engineers, hardware teams, and system architects to analyze future AI workloads and identify memory‑ and storage‑related opportunities. Define, configure, and complete analytical experiments to evaluate new system features and hardware behaviors. Build and modify Linux applications and libraries using C, C++, Python, Rust, SYCL, and/or CUDA for advanced heterogeneous computing systems. Develop and use emulators to predict system‑level performance and functional impacts prior to hardware availability. Debug system‑level issues across application, kernel, OS configuration, libraries, and hardware boundaries. Utilize emerging AI tools to accele

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. Staff Software Engineer - Container Platform (Menlo Park) About the Role We build the foundational container platform that runs Snowflake's production, AI/ML, and CI workloads across AWS, Azure, and GCP, including a rapidly growing AI/ML footprint. Hundreds of large Kubernetes clusters under management and growing. The work is to make that fleet reliable, automated, and invisible to the thousands of engineers building on top of it. This is a staff-level role on a senior, high-performing platform team. You'll own hard problems end to end, drive technical direction across teams, and build the automation and platform abstractions that make operating at this scale sustainable. There is significant unsolved work ahead: improving the developer experience for thousands of internal engineers and continuing to scale the platform to meet Snowflake's growth. What You'll Do Own the design and delivery of large, complex platform initiatives spanning cluster lifecycle management, multi-cloud automation, and internal developer tooling. Identify and drive cross-team technical improvements across the platform, from architecture through adoption. Make and defend architectural trade-offs grounded in reliability, scalability, and operational reality. Act as a technical anchor for the team, dev

Why Sony Interactive Entertainment? Sony Interactive Entertainment isn’t just the Best Place to Play — it’s also the Best Place to Work. Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. As a subsidiary of Sony Group Corporation, we’re part of a proud legacy of innovation and excellence. SIE is a dynamic technology company, delivering cutting-edge hardware and network services to more than 100 million people and an entertainment leader, home to some of the most beloved and recognizable intellectual properties (IP) in the world. Our role at SIE is to create and nurture the experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity. Sr. Software Engineer, Video Team San Mateo, CA Responsibilities: Drive video codecs architecture design and development for PlayStation SDKs and cloud gaming platform. Drive product-focused algorithm innovation for video codecs, aligning performance optimizations with product and user requirements Own multiple encoder/decoder features with strong accountability, leveraging ML-based techniques for video quality enhancement Partner with platform, hardware, and system software teams to investigate and resolve complex, high-priority issues across the codec pipeline. Evaluate emerging codec and media technologies and recommend integration strategies for future platforms. Required Qualifications: Experience with GPU programming (HLSL, Vulkan, CUDA) with proven skills in profiling, debugging, and optimizations across CPU and GPU. Knowledge of multi-threaded programming and debugging using C and C++ Proficient with a wide range of development tools, including IDEs, Git/SVN, JIRA Proven ability to deliver features from design to validation with clean, efficient code. Bachelor’s degree required; Master’s degree preferred Nice to have: Expertise with video compression standards (e.g. AV1, VVC, VP9, H.265, H.264) AI/ML modeling and training experience Embedded system ex

Scale GP (Scale Generative AI Platform) is an enterprise-grade Generative AI platform that provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong engineer to join our team and help us build and scale our product in a fast-paced environment. The ideal candidate will have a strong understanding of software engineering principles and practices, as well as experience with large-scale distributed systems. You will be responsible for owning large new areas within our product, working across backend, frontend, and interacting with LLMs and ML models. You will solve hard engineering problems in scalability and reliability. You will: Own large new areas within our product Work across backend, frontend, and interacting with LLMs and ML models Deliver experiments at a high velocity and level of quality to engage our customers Work across the entire product lifecycle from conceptualization through production Be able, and willing, to multi-task and learn new technologies quickly Ideally you'd have: 7+ years of full-time engineering experience, post-graduation Experience scaling products at hyper growth startups Experience tinkering with or productizing LLMs, vector databases, and the other latest AI technologies Proficient in Python or Javascript/Typescript, and SQL Experience with Kubernetes Experience with major cloud providers (AWS, Azure, GCP) Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position and may be inclusive of several career levels at Scale; it will be determined during the interview process based on work location and additional factors, including job-related skills, experience, qualifications, interview performance, and relevant education or training. Scale employees in eligible roles are also granted equity based compensation, subject to Board of Director approval

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role Palantir's defense product vertical builds mission-critical products for the modern warfighter. We provide a complete ecosystem where customers can securely integrate and visualize their data, and build sophisticated, full-fledged programs such as common operating pictures, alert-triaging inboxes, and resource allocation planning tools driven by rich-ML models. Our customers use our defense offering to perform rich analyses that drive core operations within their organizations - these programs are relied upon for daily operations in the command centers and battlefronts of militaries across the world. Backend Software Engineers at Palantir build software at scale to transform how organizations use data. Our Software Engineers are involved throughout the product lifecycle, from idea generation, design, prototyping, and production delivery. You will collaborate closely with technical and non-technical teammates to understand our customers' problems and build products that solve them. We encourage movement across teams to share context, skills, and experience, so you'll learn about many different technologies and aspects of each product. Engineers work autonomously and make decisions independently, within a community that will support and challenge you as you grow and develop, becoming a strong technical contributor and engineering leader. Your day-to-day workflow will vary, adapting to the requirements of our users and the technical challenges that arise. One day, you may find yourself collaborating with other engineers to architect a new system that enables a novel workflow, the next you could be fine-tuning performance to enable low-latency operational o