Software Engineer Infrastructure Jobs

About the Team Our team analyzes inference stack performance across the application, model, and fleet layers to identify bottlenecks and drive faster, cheaper inference. We combine systems profiling, benchmarking, and analysis to understand where time and cost are spent, then turn that understanding into performance optimizations and models that project performance and capacity needs for future launches. About the Role In this role, you will model inference performance across application, model, and fleet layers with higher fidelity. You will build cost-to-serve estimates from microbenchmarks and create tools that help cross-functional teams reason about latency, capacity, utilization, and cost tradeoffs. In this role, you will Build and refine performance models that translate microbenchmark results into cost-to-serve estimates. Analyze inference workloads end to end across applications, models, and fleet infrastructure. Enhance tooling to identify bottlenecks across layers for latency and throughput. Partner with other teams to turn performance insights into concrete improvements and project how future changes affect inference. You might thrive in this role if you: Enjoy reasoning from first principles about distributed systems, model inference, and hardware efficiency. Are comfortable working across abstraction layers, from application behavior to kernels, accelerators, networking, and fleet scheduling. Have deep expertise with performance profiling, benchmarking, analysis, and optimization. Enjoy collaborating with engineering and research teams to improve real production systems. About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve o

About the Team The Foundations Research team works on high-risk, high-reward ideas that could shape the next decade of AI. Our goal is to advance the science and data that enable our training and scaling efforts, with a particular focus on future frontier models. Pushing the boundaries of data, scaling laws, optimization techniques, model architectures, and efficiency improvements to propel our science. The Search team sits within Foundations, building agentic search by co-designing model–system interfaces with the core search stack (serving, indexing, retrieval) to translate model intent into reliable, real-world actions. Operating at the frontier of AI and information retrieval, the team develops large-scale systems that transform and index vast corpora, enabling models to reason over global knowledge and act dependably. In close partnership with researchers, we rapidly bring modeling breakthroughs into production and redefine how intelligent systems discover, retrieve, and synthesize information at planetary scale. About the Role We’re looking for a Software Engineer focused on building and scaling retrieval systems. You’ll work with a team of researchers and engineers to develop infrastructure that enables models to retrieve and act on the right information at the right time. This includes designing and operating indexing systems, retrieval pipelines, and serving layers. This work supports retrieval across OpenAI products and research, with direct impact on system performance, reliability, and scale. Responsibilities Build and scale retrieval infrastructure across indexing, serving, and query execution. Develop low-latency, high-throughput systems for real-time model interaction. Partner with research to productionize embedding and retrieval techniques. Support dense, sparse, and hybrid retrieval pipelines. Own system performance, reliability, and observability at scale. Collaborate across Pretraining, Inference, and Product teams to integrate retrieval end-to-e

Who We Are Notion is the collaborative AI workspace where teams and agents think together . We're building one place where your knowledge, projects, meetings, and AI tools live side by side, so work is faster, clearer, and less fragmented. Millions of individuals, small teams, and large companies run their work on Notion. Notinos (our employees) are customer zero in bringing this future of work to life. We care about craft, building things that last, and the belief that great work is still fundamentally human. Our goal isn’t to ship the next feature. Each and every team of Notinos is working to set the standard for how humans work together in the AI era. From building a business’s system of record to making and managing AI agents to automating away the busy work, we care deeply about giving our customers more time for their life’s work. About the Role: As a Software Engineer on Collections Infra, you’ll help scale the infrastructure behind Notion’s database block. Databases power views, boards, charts, forms, and the workflows customers use to run their companies; as Notion grows into larger enterprise deployments and AI-native work, those systems need to become faster, more reliable, and ready for much higher concurrency. This team sits between infrastructure and product, building backend architecture that improves the customer experience while becoming a platform other Notion teams can build on. You’ll work on problems like database load performance, microservices, high-volume writes from agents, and the flexibility that makes Notion databases powerful and hard to scale. This role can be based in either San Francisco or New York City. We work from our offices on Mondays, Tuesdays and Thursdays (our Anchor Days) because we do our best thinking and building together in person. We’re looking for someone who’s excited to work alongside the team during those days. What You'll Achieve: By your 90th day, you’ll understand how Collections Infra supports Notion’s database

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. About the Team The Apps & Experiences (AppEx) organization powers the unified user experience (Snowsight) for Snowflake. Every major Snowflake customer interacts with our platform through these surfaces, making AppEx central to both customer satisfaction and revenue growth. Within Appex, our team sits at the intersection of AI, platform, and user experience. We are on a mission to create an AI‑first, scalable, maintainable, and extensible platform to build all Snowflake user experience features. The team owns: The serving layer that powers Snowsight, Snowflake CoWork, and UX features Developer tooling that enable our engineers to move fast and deliver Frontend infrastructure and shared services for product teams CI pipelines that ensure fast and reliable builds Testing and validation platform that maintains code and product quality The monitoring and logging stack that ensures observability and trust What You Will Do As a software engineer on the team, you will play a central role in delivering the next generation of tools and evolve our developer infrastructure and tooling to be scalable, highly performant, and AI-first. Design and build AI-first platforms, tools, and best practices to significantly enhance the developer experience for Snowsight Drive strategy and init

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. The Data Clean Rooms team is Leading the market shift from traditional 2-party data sharing to multi-party collaboration hubs . Our vision is to provide a seamless, "safe-room" environment where enterprises can collaborate on shared datasets while maintaining absolute governance. We ensure that no party can exfiltrate another's underlying content, even while running complex joint workloads and getting high-value results. You will join a fast-paced, collaborative team of engineers on a journey to provide customers with an integrated set of innovative, AI-enabled capabilities to analyze data in a privacy-preserving way. You will have a real opportunity to impact and shape the future of secure data collaboration at Snowflake. AS A SOFTWARE ENGINEER IN DATA CLEAN ROOMS, YOU WILL: Architect and build highly scalable infrastructure that enables secure, multi-party collaboration. Design and implement core clean room features and services, intelligent agents, and robust developer APIs to expand platform capabilities and support custom AI/ML workflows. Partner closely with Product Management and cross-functional teams to drive complex projects from ideation and system design through to production deployment. Mentor peers and foster a warm, supportive culture of innovation, cross-tea

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. At Snowflake, we are building a high-impact team to help the world’s most innovative companies unlock the power of AI. As a Forward Deployed Engineer, Applied AI in our Cortex AI team, you will be a hands-on builder and a critical technical partner to our most strategic customers, placing you at the forefront of the enterprise AI revolution. You won't just be working with cutting-edge technology; you will be deploying it to solve real-world business problems at a massive scale. This role places you at the intersection of product, engineering, and customer success, building production-grade AI systems using Snowflake AI Platform, Cortex, and our native LLM capabilities. IN THIS ROLE AT SNOWFLAKE, YOU WILL: Drive Customer Impact: Architect, build, and deploy enterprise-grade AI solutions, including sophisticated AI agents. Build and iterate on AI pipelines and agents within a team-led engagement from prototype to production, contribute to evaluation frameworks and observability infrastructure most complex business challenges. Deliver with Velocity: Rapidly design, iterate, and ship high-quality code and ML pipelines. Translate ambiguous business objectives into robust, scalable, and performant solutions using Python and SQL. Productionize AI at Scale: Own the full lifecycle o

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. The Snowhouse Foundation team builds our globally distributed data warehouse. We manage a vast array of petabyte scale data sets that are continuously ingested, processed and replicated from across all Snowflake environments and external data sources. Snowhouse powers all of Snowflake’s core business, engineering and data science needs and provides customers with full visibility into their account activities, usage, and resource consumption from all their global environments. The team is investing in multiple critical areas, including a pipeline authoring platform, high performance/high efficiency data export, ingestion and data layout. Our team is also responsible for a fundamental product for Snowflake’s customers: the Snowflake system database/application that provides customers with all usage insights they need to reason about their global Snowflake footprint as well as 1st party business logic such as ML powered functions and Budgeting applications. AS A PRINCIPAL SOFTWARE ENGINEER IN SNOWHOUSE FOUNDATION, YOU WILL: Design and implement innovative highly available distributed platforms and pipelines and enhance the overall Snowflake data infrastructure Lead and drive projects from idea formulation to design, implementation and successful productionization. Collaborate

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. We’re at the forefront of the data revolution, committed to building the world’s greatest data and applications platform. Snowflake started with a clear vision: develop a cloud data platform that is effective, affordable, and accessible to all data users. Data Cloud allows sharing live data in governed and secure ways so our customers can solve their business problems. Data Cloud allows sharing live data in governed and secure ways so our customers can solve their business problems. Come join our world-class team as a Software Engineer to build the backend services for data cloud to help our customers to share data internally within their company or outside with external organizations. We are investing in initiatives across multiple engineering areas that include: Data Engineering & Open Lakehouse, Database Engineering, Engineering Systems, Product Experiences, Apps & Collaboration,Platform Engineering, and Public Sector, Security and Governance AS A SOFTWARE ENGINEER, YOU WILL: Design and build features, and/or distributed platforms at scale. Drive impactful initiatives for the globally distributed infrastructure Collaborate with product managers, architects, other engineering teams, and business groups, to drive end-to-end solutions. Contribute to improving our en

We're transforming the grocery industry At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible earnings opportunities to Instacart Personal Shoppers. Instacart has become a lifeline for millions of people, and we’re building the team to help push our shopping cart forward. If you’re ready to do the best work of your life, come join our table. Instacart is a Flex First team There’s no one-size fits all approach to how we do our best work. Our employees have the flexibility to choose where they do their best work—whether it’s from home, an office, or your favorite coffee shop—while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work. Overview As a Senior Software Engineer II in the Ads Quality team specializing in ML infrastructure, you'll work with a team of software and machine learning engineers to build state-of-the-art systems that optimize Ads performance throughout the ads serving funnel, from retrieval to pricing. You'll own the technical direction of our data, feature processing and model training/serving solutions, enabling next-generation modelling opportunities—from utilizing out of the box LLMs to building bespoke Foundation Models that powers all the Ads use cases. You will eliminate bottlenecks across the training and serving system to optimize stability, latency and cost. Building on Instacart's unique data and market position, these systems create value for advertising partners, improve consumer experience, and directly contribute to Instacart's overall revenue / business succe

Here’s a summary of the role: As a Staff Ruby on Rails Engineer at Diligent, you will set technical direction for secure, scalable, and high-performing SaaS applications and services that power our governance platform. This role is ideal for you if you thrive on solving the hardest technical problems, shaping architecture across multiple teams, and driving how the organization builds software — including how we responsibly adopt AI into our engineering practices and products. You will own critical systems end-to-end, partner closely with Product, Security, DevOps, and other engineering leaders to shape technical roadmaps, and mentor engineers across the department. A key part of this role is helping define our AI strategy: embedding AI responsibly into our systems and workflows, advising on where AI tools and capabilities can meaningfully improve delivery, and raising the bar on how the team uses them safely and effectively. Here’s a breakdown of what you’ll do (not all of it, just the important stuff): Champion the design, delivery, and evolution of secure, scalable Ruby on Rails applications and services, driving architecture decisions across multiple teams and codebases, with responsibility for scalability, reliability, and the underlying infrastructure required to run them effectively. Set technical direction for major projects and platform initiatives, from solution design and prototyping through implementation and production ownership. Own and evolve the technical roadmap by identifying, shaping, and driving new technical initiatives and investments. Develop and evolve web applications and services with a strong focus on scalability, maintainability, reliability, and long-term platform health. Identify systemic pain points across services and propose pragmatic architectural improvements, including decomposition of monoliths and evolution toward service-oriented or microservices patterns where it adds valu

Our Mission You call. You wait. You call again. In every other part of your life, you book in seconds. In healthcare, you’re blocked. We’re here to give power to the patient. For nearly 20 years, we’ve built the leading healthcare marketplace - helping tens of millions of people find and book the care they need. Now, we’re going further: building our infrastructure beyond Zocdoc’s marketplace to power access to care wherever patients search, from provider websites and insurance directories to search engines, AI platforms, and more. Healthcare still lacks something every other major consumer industry takes for granted: a seamless way to go from seeking to getting . We don’t want to own the front door to care; there isn't one. We want to make sure all of those doors open when patients are knocking. Fixing healthcare starts with fixing access to it. And we're still just getting started. About the Role We're transforming how healthcare practices interact with Zocdoc, building intelligent systems that understand each practice's needs and guide them toward actions that grow their business. This means personalized homepages, smart recommendations, AI-assisted configuration, and workflows that make Zocdoc essential to daily operations. As Senior Software Engineer, you'll build these systems end-to-end. You'll own features from design through production, work across the stack, and collaborate with Product, Design, and Data Science to ship experiences that matter. What You'll Do Build platform components - including practice profile services, engagement scoring pipelines, recommendation APIs, personalization infrastructure. Ship product features end-to-end - database to API to front-end, owning the full lifecycle. Work with Data Science to integrate ML models build feature pipelines, call model endpoints, instrument feedback loops. Write production-ready code with strong testing, observability, and error handling. Participate in design discussio

About the Team The Intelligence & Investigations Engineering team builds systems that detect, analyze, and disrupt abuse across OpenAI’s products. We partner closely with the Child Safety team and cross-functional groups to protect users while advancing OpenAI’s goal of developing AI that benefits everyone. About the Role As a Fullstack Engineer focused on child safety, you’ll build data-intensive, AI-powered applications and infrastructure that enable operators and investigators to work effectively and responsibly. You’ll adapt quickly in ambiguous, fast-moving environments to deliver well-crafted, reliable tooling for high-severity safety work. *Candidates should understand this role involves exposure to sensitive and egregious content. In this role, you will: 4+ years of experience as a software engineer Prototype, build, and maintain intelligence systems that detect, triage, and enable efficient human review of possible high severity harm Work hand in hand with operators and investigators, designing and delivering systems that enable them to do their work faster, more accurately, and more safely. Develop across the stack: UIs, services, pipelines, and anything else required to solve the problems we face. Interact with partners across Product Policy, Platform Integrity, Safety Systems, and Research Contribute to the team’s technical strategy, especially for child safety related tools and systems Report on impact in a data-driven fashion You might thrive in this role if you: Have a strong software engineering foundation and enjoy owning systems end-to-end—from infrastructure and data ingestion to frontend tooling Are energized by working at the frontier of AI capabilities, integrating new models and APIs into practical systems Have experience building and operating large-scale data pipelines or search/retrieval systems Are proficient in Python and/or TypeScript, and familiar with tools like Spark, Kafka, Flink, data warehouses, and SQL Take a product-minded ap

About Datadog We're on a mission to build the best platform in the world for engineers to understand and scale their systems, applications, and teams. We operate at a high scale - trillions of data points per day — providing always-on alerting, metrics visualization, logs, and application tracing for tens of thousands of companies. Our engineering culture values pragmatism, honesty, and simplicity to solve hard problems the right way. The Opportunity We are looking for an experienced software engineer to join our CI/CD Security Team within our SDLC Security organization. We work at the intersection of security and engineering infrastructure to secure Datadog's continuous integration and continuous delivery systems. Our responsibilities include hardening pipelines, protecting credentials, and enforcing tightly scoped access controls. We also develop authorization and verification mechanisms to ensure that only trusted code and approved processes can reach production. In this role, you will shape and build a new security layer for our CI/CD infrastructure and drive its adoption across the engineering organization. You will solve challenging systems problems around trusted build provenance, secure secret delivery, and real-time policy enforcement at high throughput. The work sits directly in the critical path of software delivery, where strong security guarantees have to coexist with low latency, high reliability, and a seamless developer experience. You’ll join at an ideal time to make a big impact, as the need for robust software supply chain security is higher than ever. Datadog is growing rapidly, and AI-assisted development is increasing both the pace of software delivery and the amount of activity flowing through our CI/CD systems. Securing that scale without slowing engineers down requires strong software engineering fundamentals, thoughtful automation, and security controls designed to operate reliably at high throughput. At Datadog, we pla

We are seeking a Staff Engineer to join our growing team to provide technical direction and implement core parts of a new platform we are building to make it easier for customers to build AI applications using MongoDB. As a Staff Engineer on this new team, you will be responsible for providing technical leadership to teams developing cutting edge technologies related to enabling deployment at scale of AI applications. You will take on challenging, high-visibility projects that improve and enhance the performance, scalability, and reliability of the distributed systems infrastructure for this new product. MongoDB engineering teams pride themselves on building high-quality software and living MongoDB cultural values every day. We value intellectual curiosity and honesty, and building together in an environment that prioritizes collaboration over competition. We're looking to speak with candidates based in the New York City area for our hybrid or in-office working models. Position Expectations Work closely with product management, product engineering, product design peers as well as other teams within the company to define the first version and future evolution of the service Design, build and deliver well-tested core pieces of the platform in collaboration with other vested parties Contribute to shaping architecture, code reviews and development practices, developer experience as the teams and product grow Mentor fellow engineers and assume ownership and accountability of projects Qualifications Strong background in building core components for high scale compute and data distributed systems 8+ years experience of building distributed systems, and/or foundational cloud services at scale and an interest in working with Python, Go and Java Proven success in designing, writing, testing, debugging, performance tuning, possessing a strong grip on the foundational materials of computer science and maintaining distributed and/or highly concurrent software s

About the Role: The Growth team is responsible for building and optimizing the UI/UX across all Web and OTT applications at Tubi. The team primarily focuses on implementing features related to full funnel user acquisition and growth, including SEO user registration, onboarding, and account management. As a Staff Engineer (L5) on this team, you act as the technical leader for one or more Growth areas. You own the technical architecture and direction, solve ambiguous problems that few others can, and influence cross-functional teams across multiple pods. You will work closely with Product and Design to develop cutting-edge, experiment-driven features, while driving the front-end architecture that ensures performance and scalability for millions of users. You will be working with React, Node.js, GitHub Actions, Terraform, and CDN infrastructure to build and deploy high-performance applications that reach millions of users. This is a hybrid role based out of our Toronto office. You must be willing to travel to our Toronto office two days/week. What You'll Do: Own the technical roadmap and architecture for a Growth area with large amounts of ambiguity: driving direction across web, mobile web, and smart TV platforms, and influencing the team to invest in new projects. Solve challenging, ambiguous problems with a focus on scalability and performance; proactively identify systemic issues and propose innovative solutions. Lead and drive innovation in building experiment-driven features; independently design, implement, and interpret a series of A/B experiments that move growth metrics. Lead and coordinate major rollouts and releases: including cross-team coordination, migrations, and phased releases of major initiatives across Web and OTT apps. Establish team-wide quality and engineering standards; set the bar for code quality and front-end best practices. Identify and implement improvements in shared UI components, platform-specific optimizations, and overall fr