Ai Runtime Engineer Jobs

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers who are energized by the opportunity to reinvent how they work. The Cortex Apps team is building the future of AI for enterprise data, and this role focuses on the backend infrastructure that powers our flagship products like Snowflake Intelligence, Cortex Agents, and Search. You won't just be using AI tools; you will be building the high-performance systems that orchestrate them, making agentic AI fast, reliable, scalable, and secure at the enterprise level. What you will do in this role: Build Agentic Runtimes: Help build and scale the orchestration engines that execute complex agentic workflows, ensuring low-latency tool execution and robust state management. Scale Context Engineering Infra: Develop and design high-performance systems for RAG (Retrieval-Augmented Generation), including vector database integration, scalable search indexing, query processing, and semantic caching. Develop the "Evals Engine": Build the automated infrastructure required to run massive-scale golden set simulations, error analysis pipelines, and experiments. Productionize AI Workflows: Collaborate with the modeling team to take raw LLM capabilities and turn them into hardened,

Join us in building the future of finance. Our mission is to democratize finance for all. An estimated $124 trillion of assets will be inherited by younger generations in the next two decades. The largest transfer of wealth in human history. If you’re ready to be at the epicenter of this historic cultural and financial shift, keep reading. About the team + role We are building an elite team, applying frontier technologies to the world's biggest financial problems. We're looking for bold thinkers. Sharp problem-solvers. Builders who are wired to make an impact. Robinhood isn't a place for complacency, it's where ambitious people do the best work of their careers. We're a high-performing, fast-moving team with ethics at the center of everything we do. Expectations are high, and so are the rewards. The Developer Infrastructure org is the engine behind Robinhood's entire engineering organization — a collection of tightly integrated teams whose collective mission is to make every engineer at Robinhood faster, more reliable, and exponentially more productive. The org spans four major teams: DevX (Developer Experience), TestX (Test Infrastructure), Backend Platform, and Mobile Platform. DevX owns Robinhood's monorepo and Bazel-based build infrastructure — the critical layer between a developer writing code and that code being ready to ship — along with the company's full CI/CD pipeline and remote build execution cluster. TestX owns the infrastructure behind Robinhood's entire test experience: the integration test environments, and personal development environments that serve as miniature simulations of the full Robinhood system, giving engineers a safe, isolated space to test their code end-to-end before it ever touches production. Backend Platform and Mobile Platform own the core language runtimes, libraries, IDEs, and developer toolchains across Python, Go, TypeScript, Swift, and Android. Together, these teams share a single north star: leveraging AI and agentic systems

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. Join the AI-Native Authoring team and help shape how data scientists, analysts, engineers, and AI developers build on Snowflake. From SQL to python, and from Workspaces to our VS Code extension, our team owns the highest impact workloads and surfaces across Snowflake. We even own Snowflake Notebooks end to end, including the notebook service backend, container runtimes, and interactive, Jupyter-based experience our customers work in every day. Our team is at the center of delivering a profound AI and application-development platform, delivering secure, reliable, reproducible compute environments with a delightful and intuitive editing experience layered on top. These serve all of our customers, including our most critical security-sensitive customers running in regulated and air-gapped deployments. If you're excited by deep backend systems and delivering polished customer-facing experiences across the full stack, we invite you to be part of our team's success story. AS A TECH LEAD/MANAGER YOU WILL: Own your team’s technical strategy and execution , driving projects from initial idea formulation and detailed system design to high-quality implementation and successful deployment. Provide deep technical oversight by actively participating in design reviews, architecture discus

P-1285 About This Role As a staff software engineer for GenAI inference, you will lead the architecture, development, and optimization of the inference engine that powers Databricks Foundation Model API.. You’ll bridge research advances and production demands, ensuring high throughput, low latency, and robust scaling. Your work will encompass the full GenAI inference stack: kernels, runtimes, orchestration, memory, and integration with frameworks and orchestration systems. What You Will Do Own and drive the architecture, design, and implementation of the inference engine, and collaborate on model-serving stack optimized for large-scale LLMs inference Partner closely with researchers to bring new model architectures or features (sparsity, activation compression, mixture-of-experts) into the engine Lead the end-to-end optimization for latency, throughput, memory efficiency, and hardware utilization across GPUs, and accelerators Define and guide standards to build and maintain instrumentation, profiling, and tracing tooling to uncover bottlenecks and guide optimizations Architect scalable routing, batching, scheduling, memory management, and dynamic loading mechanisms for inference workloads Ensure reliability, reproducibility, and fault tolerance in the inference pipelines, including A/B launches, rollback, and model versioning Collaborate cross-functionally on Integrating with federated, distributed inference infrastructure – orchestrate across nodes, balance load, handle communication overhead Drive cross-team collaboration: with platform engineers, cloud infrastructure, and security/compliance teams Represent the team externally through benchmarks, whitepapers, and open-source contributions What We Look For BS/MS/PhD in Computer Science, or a related field Strong software engineering background (6+ years or equivalent) in performance-critical systems Proven track record of owning complex system components and driving architectural decisions end-to-end Deep understa

DeepIntent is the leading healthcare marketing platform, purpose-built to help marketers plan, activate, and optimize data-driven campaigns with speed and precision. Trusted by the world’s top healthcare brands and their agencies, DeepIntent uniquely unites media, identity, and real-world clinical data to power privacy-safe, omnichannel marketing across every screen. Backed by patented technology and proven outcomes, DeepIntent’s platform delivers measurable audience quality and script lift at scale. Learn more at www.deepintent.com . Location: Banja Luka, Bosnia and Herzegovina (primary) or Belgrade, Serbia What You’ll Do: As a Senior Security Engineer, you will own the security architecture and enforcement across our infrastructure. Our infrastructure relies heavily on a Linux ecosystem, and as we scale our cloud footprint and AI initiatives, this layer is becoming increasingly security-sensitive. You will be embedded directly with the teams operating these systems, bridging the gap between high engineering velocity and secure-by-design architecture. Your core mandate is to protect production, harden our Linux environments, establish AI guardrails, and build secure access patterns without creating process overhead. This role will report to the Sr Director, Infrastructure and Networking and will be a hybrid role based out of Banja Luka, Bosnia. Linux Hardening & Threat Detection: Secure our underlying Linux infrastructure and container runtimes. Deploy, tune, and manage our SIEM for continuous threat detection, file integrity monitoring, and host-based intrusion detection (HIDS) across our fleet. Identity & Access Control: Design and enforce secure access patterns. Ruthlessly eliminate shared accounts, long-lived credentials, and overly broad permissions across the organization. Cloud & Infrastructure Governance: Own the security posture across our cloud environments. Implement secure infrastructure-as-code practices using Terraform an

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE: Baseten’s Model Performance (MP) team is responsible for ensuring the models running on our platform are fast, reliable, and cost‑efficient. As part of this team, you’ll focus on Model APIs — the infrastructure powering our hosted API endpoints for the latest open‑source models. This work spans distributed systems, model serving, and developer experience. You’ll join a small, high‑impact team operating at the intersection of product, model performance, and infra, helping to define how developers interact with AI models at scale. RESPONSIBILITIES: Design, build, and operate the Model APIs surface with focus on advanced inference capabilities: structured outputs (JSON mode, grammar-constrained generation), tool/function calling and multi-modal serving Profile and optimize TensorRT-LLM kernels, analyze CUDA kernel performance, implement custom CUDA operators, tune memory allocation patterns for maximum throughput and optimize communication patterns across multi-GPU setups Productionize performance improvements across runtimes with deep understanding of their internals: speculative decoding implementations, guided generation for structured outputs, custom scheduling and routing algorithms for high-performance serving Build comprehensive benchmarking frameworks that measure real-world performance across different model architectures, batch sizes, sequence lengths, and hardware configurations Productionize performa

About the Team: GTM Innovation’s mission is to automate 100% of digital knowledge work for OpenAI's GTM so sellers spend more time directly with customers applying their strategy and judgment. AGI-level reasoning doesn’t mean organization-level transformation “just works” out of the box; orgs must be redesigned around abundant intelligence and persistent virtual coworkers. The team builds and scales a fleet of virtual coworkers that operate as full-time employees and move increasingly ambitious tasks from the foreground to the background. About the Role We’re looking for a product-minded backend engineer to build the systems behind a new generation of AI coworkers: persistent agents that understand their environment, take on meaningful work, and improve over time. You’ll design and ship the foundational infrastructure that makes these agents effective in production, from durable workflow orchestration to long-running agent loops built on the Codex harness to the context, memory, tools, and permissions model they need to act reliably. You’ll also build rigorous evaluation, observability, and feedback systems that make agent quality measurable and continuously improve how these systems perform. This is a hands-on, high-ownership role at the intersection of agent infrastructure, applied AI, and product engineering. You’ll work directly with go-to-market teams and collaborate across OpenAI’s product and research organizations to turn ambiguous, real-world needs into dependable systems that help OpenAI meet the world at scale. In this role, you will: Build and scale durable agent runtimes, long-running agent loops, and workflow orchestration using the Codex harness and emerging agent infrastructure. Design context and memory systems that ground agents in the information they need while preserving clear access boundaries. Develop rigorous evaluation frameworks, production feedback loops, and observability to measure agent quality and improve it over time. Partner directly

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars. NVIDIA is looking for phenomenal people like you to help us accelerate the next wave of artificial intelligence. We are looking for a highly motivated senior software engineer for an exciting role in our communication libraries and network software team. The position will be part of a fast-paced crew that develops and maintains software for complex heterogeneous computing systems that power disruptive products in High Performance Computing and Deep Learning. What you will be doing: Design, implement and maintain highly-optimized communication runtimes for Deep Learning frameworks (e.g. NCCL for TensorFlow/Pytorch) and HPC programming interfaces (e.g. UCX for MPI/OpenSHMEM) on GPU clusters. Participating in and contributing to parallel programming interface specifications like MPI/OpenSHMEM. Design, implement and maintain system software that enables interactions among GPUs and interactions between GPUs and other system components. Creating proof-of-concepts to evaluate and motivate extensions in programming models, new designs in runtimes and new features in hardware. What we need to see: M.S./Ph.D. degree in CS/CE or equivalent experience. 5+ years of relevant experience. Excellent C/C++ programming and debugging skills. Strong experience with Linux. Expert understanding of computer syst

Perplexity API Platform Perplexity innovates at the frontier of AI infrastructure, search, and orchestration to serve the world's most discerning users. The Perplexity API Platform brings our technology to the world's most discerning developers. From exabyte-scale knowledge indexes to codegen-first agent runtimes, the building blocks behind Perplexity's applications are some of the most battle-tested AI systems in the industry. We believe these same building blocks can and should power the aspirations of builders everywhere. It's one thing to solve planet-scale retrieval, long-horizon orchestration, and other foundational AI challenges within a single product ecosystem. The true measure of success is to turn those solutions into elegant APIs that delight developers and agents alike. Our API Platform delivers frontier intelligence to thousands of customers: startups, trillion-dollar enterprises, U.S. and allied governments, and everyone in between. We've achieved incredible scale, yet we're just getting started. Join us to build tools for curious minds. About this role Perplexity is seeking a strong technical leader to steer the API Platform engineering team through a rapid period of growth. Our company builds technology that reshapes how people search, reason, and interact with the world around them. Week after week, we observe increasing demand for programmatic interfaces to that technology. The API Platform engineering team is charged with designing, implementing, and scaling these interfaces. You and your team will work on an eclectic portfolio spanning distributed systems, performance optimization, agent orchestration, and frontier topics that often change with each passing month. Throughout this work, you'll prioritize great developer and agent experience alike. You'll also define technical strategy for how we scale to meet compounding growth exponentials (number of customers, agents per customer, compute/retrieval per agent, etc.). This role is ideal for seaso

Perplexity API Platform Perplexity innovates at the frontier of AI infrastructure, search, and orchestration to serve the world's most discerning users. The Perplexity API Platform brings our technology to the world's most discerning developers. From exabyte-scale knowledge indexes to codegen-first agent runtimes, the building blocks behind Perplexity's applications are some of the most battle-tested AI systems in the industry. We believe these same building blocks can and should power the aspirations of builders everywhere. It's one thing to solve planet-scale retrieval, long-horizon orchestration, and other foundational AI challenges within a single product ecosystem. The true measure of success is to turn those solutions into elegant APIs that delight developers and agents alike. Our API Platform delivers frontier intelligence to thousands of customers: startups, trillion-dollar enterprises, U.S. and allied governments, and everyone in between. We've achieved incredible scale, yet we're just getting started. Join us to build tools for curious minds. About this role Perplexity is seeking strong engineers with a passion for delivering frontier intelligence and infrastructure to developers. Our company builds technology that reshapes how people search, reason, and interact with the world around them. Week after week, we observe increasing demand for programmatic interfaces to that technology. The API Platform engineering team is charged with designing, implementing, and scaling these interfaces. As a member of our team, you'll work on an eclectic portfolio spanning distributed systems, performance optimization, agent orchestration, and frontier topics that often change with each passing month. Throughout this work, you'll prioritize great developer and agent experience alike. You'll also define technical strategy for how we scale to meet compounding growth exponentials (number of customers, agents per customer, compute/retrieval per agent, etc.). Key Responsibilitie

The Security Libraries team owns the customer-side integrations behind Datadog’s run-time security products — App & API Protection , Workload Protection , and Code Security — shipping and maintaining security capabilities across seven open-source language libraries ( .NET , Java , Go , Node.js , Python , Ruby , PHP ) and a set of HTTP proxy integrations (Envoy, NGINX, and HAProxy), running inside thousands of production clusters worldwide. Recent work spans exploit prevention (RASP), WAF detections, API Security, code security (IAST and SCA), and AI-assisted onboarding. As Engineering Manager, you’ll lead part of this polyglot team, setting the technical bar and team culture while driving the pace at which new detections and AI-assisted capabilities reach customers. This is a hands-on role: you’ll balance people leadership, product and roadmap ownership, and the operational health of code that runs in production at massive scale, with room to grow into more of Datadog’s security portfolio over time. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Lead, grow, and develop a team of roughly 4-8 library engineers — coaching, giving direct feedback, and empowering senior ICs as technical leaders Own team delivery and productivity: planning, milestones, reviews, and the on-call rotation Set product direction with Product Management and balance priorities across App & API Protection, Workload Protection, and Code Security Stay technically close to the work — apply strong technical judgment, contribute code where it matters most, and keep quality and architecture high Build strong relationships and drive alignment across the language teams and product, backend, and frontend partners Shape team identity and culture, and own accountability when problems oc

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. About the Role We are hiring a Senior Software Engineer for our Data Platform team - the team that owns the core streaming execution and database internals powering Snowflake's platform. You'll work deep in the stack: stream processing runtimes, query execution engines, storage layers, and the distributed systems primitive that everything else is built on. AS A SOFTWARE ENGINEER, DATA PLATFORM AT SNOWFLAKE, YOU WILL: Design and implement high-throughput stream processing systems with strong correctness guarantees - exactly-once semantics, out-of-order event handling, low-latency execution Work on database internals - query execution, operator design, storage engine components, or transaction processing at cloud scale Own features and systems end-to-end: design, implementation, testing, deployment, and production observability Drive architectural decisions that shape the long-term evolution of Snowflake's streaming and core platform layers Mentor engineers through design reviews, code reviews, and technical guidance Partner across product, infrastructure, and research teams to deliver high-impact, foundational capabilities OUR IDEAL CANDIDATE WILL HAVE: 5+ years of software engineering experience in distributed systems, query engines, streaming infrastructure, or database in

The eBPF APM team is building a zero-instrumentation observability solution that automatically discovers services on every host, supports both plaintext and TLS-encrypted traffic, classifies Layer 7 protocols, decodes service-level traffic, and reports RED (requests, errors, duration) metrics. Leveraging deep expertise in eBPF, the team operates across a wide range of Linux kernel versions, distributions, and complex customer environments. In addition to low-level networking, the team solves challenges related to protocol versioning, TLS detection across diverse languages and runtimes, and resilient performance in production systems We’re looking for a senior engineer with strong systems-level thinking and a good understanding of Linux. You should be comfortable working close to the kernel, ideally with experience in eBPF, or with a strong desire to dive into it. Proficiency in C/C++/ Go is essential, and familiarity with networking protocols, TLS internals, or distributed tracing is a strong advantage. You’ll join a high-impact team tackling ambitious technical challenges—like decoding traffic across multiple protocols, and ensuring high-fidelity metrics in complex, real-world environments. You’ll be expected to lead design and implementation efforts, contribute to roadmap planning, and collaborate across teams to ensure our solution remains robust, scalable, and frictionless for our users. This role is a great fit for engineers who thrive on low-level, performance-sensitive problems, and want to shape the future of observability through cutting-edge kernel technology. At Datadog, we place value in our office culture - the relationships that it builds, the creativity it brings to the table, and the collaboration of being together. We operate as a hybrid workplace to ensure our employees can create a work-life harmony that best fits them. What You’ll Do: Design and build core components of our zero-instrumentation APM product using eBPF and Go Develop systems to aut

The Server Programmability team is focused on programming velocity and safety in the core MongoDB Server. We own low-level libraries, runtimes, and tools that allow internal MongoDB developers to develop features in C++ and Rust quickly and safely. We are an agile and small team looking for an experienced engineer to join us. We are looking for someone who is excited about operating systems, development tools, programming languages and low-level C++ libraries. We are looking to speak to candidates who are based in Dublin for our hybrid working model. Candidate Profile 3+ years of experience in Systems programming in C++ or other low-level programming languages Hands-on experience with building production-level code. Experience in C++ is required Passionate about delivering and deploying a product with cross-team stakeholders Solid computer science fundamentals, with strong competencies in data structures, algorithms, and software design/architecture Passion for learning new things in the domains of software engineering, distributed systems, and performance Solid verbal and written communication skills and highly motivated to collaborate with colleagues Position Expectations Understand and improve the current functionality of the MongoDB Server’s Programmability features Lead medium sized projects related to the team’s charter Collaborate with colleagues at all stages of project lifecycle (ideation, requirements gathering, design, execution, and delivery) Own our leadership principles , and exemplify them in your work Continue to learn and be curious in growing your career! Write production-ready code in C++ Write unit tests and integration tests in C++, Javascript, and Python to demonstrate application correctness Investigate the performance characteristics of the server and write performance regression tests Interview candidates for software engineering positions Handle customer escalations Collaborate with stakeholders and engineering teams across the compan

About Datadog We're on a mission to build the best platform in the world for engineers to understand and scale their systems, applications, and teams. We operate at high scale with trillions of data points per day, enabling seamless collaboration and problem-solving among Dev, Ops, and Security teams for tens of thousands of companies globally. Our engineering culture values pragmatism, honesty, and simplicity to solve hard problems the right way. The Team The Datadog Security Libraries team owns the customer-side integrations behind our run-time security products App & API Protection , Workload Protection , and Code Security . Our libraries let customers automatically manage application security risk with continuous, real-time monitoring of vulnerabilities and threats against their web applications, serverless applications, and APIs, in production. Automatically integrated with Application Performance Monitoring (APM) distributed tracing and code-level context, our software empowers development, operations, and security teams to build and run secure applications. As a polyglot team we ship and maintain the security capabilities of Datadog's tracing libraries across .NET , Java , Go , Node.js , Python , Ruby , and PHP , on top of a shared C++ core and a set of HTTP proxy integrations (primarily Envoy, NGINX, and HAProxy). Our code runs inside thousands of production applications around the world. Recent work spans exploit prevention (RASP) and WAF detections, API Security, code security (IAST and SCA), and AI-assisted ("agentic") onboarding, always measured by real product outcomes and operational telemetry. The Opportunity We're looking for a senior, polyglot engineer to contribute across several of our security libraries, with .NET or Java expertise. You'll design and build security integrations and detection features, take them from prototype to production-hardened, and own them operationally as they instrument thousands of applications. As a se