Ai Runtime Engineer Jobs

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute efficiency and density compared to today’s best-in-class solutions. The high-performance architecture is coupled with seamless software integration and will enable the immense potential of AI to be accessible in power, energy, and space constrained applications. EnCharge AI launched in 2022 and is led by veteran technologists with backgrounds in semiconductor design and AI systems. About the Role EnCharge AI is seeking an AI Runtime Engineer to develop and optimize the execution stack for our next-generation AI accelerator. In this role, you will work on low-latency, high-performance runtime software that enables efficient execution of deep learning models on specialized hardware. You will collaborate with hardware, compiler, and AI framework teams to deliver optimized AI inference and training performance across cloud and edge environments. Responsibilities Develop and optimize the AI runtime software stack for executing deep learning workloads on AI accelerators. Implement task scheduling, memory management, and kernel execution strategies for efficient computation. Optimize data movement between host and device using PCIe, DMA, shared memory. Design and implement high-performance APIs for AI Inference frameworks such as OpenVino, ONNX Runtime, vLLM Wo

Strength in Trust OneTrust’s mission is to enable innovation through the responsible use of data and AI. We believe that ensuring data is trusted shouldn’t slow teams down—it should accelerate what’s possible. This led us to develop the first technology platform for responsible data use in 2016. Today, with AI representing the latest and most impactful expansion of data yet, OneTrust is once again redefining what responsible innovation looks like. OneTrust, the AI‑Ready Governance Platform™, unifies regulatory intelligence, automation, and connected governance workflows so businesses can continue to move at the speed of AI while ensuring good governance to prevent data misuse at scale. Trusted by thousands of organizations worldwide, OneTrust is shaping the future where trusted data becomes a transformative force for business and society. Principal PM AI Governance - Runtime Governance About OneTrust OneTrust helps organizations operationalize trust through privacy, security, data governance, and responsible technology adoption. As AI governance becomes a board-level and regulatory priority, customers increasingly need structured ways to understand AI systems, assess risk, monitor behavior, and demonstrate compliance over time. The Challenge We are looking for a Principal PM to help shape the future of our AI Governance product with a specific focus on observability and enforcement across AI systems. This role is for a product manager

Manager, Commercial Solution Engineering San Francisco, CA (hybrid, 4 days/week onsite) Sigma is the AI runtime environment for the modern enterprise. Teams build apps, agents, and analytics directly in Sigma, with governance and security inherited from the cloud data warehouse. No extracts, no separate AI pipelines, no shadow stack to maintain. Sigma is trusted by more than 2,000 customers, including AMD, Duolingo, Colgate-Palmolive, and JPMorgan Chase. Sigma announced its $80M in Series E financing in May 2026. The round was led by Princeville Capital, with new strategic investors Databricks Ventures, ServiceNow Ventures, and Workday Ventures participating alongside returning investors Altimeter Capital, Avenir Growth Capital, D1 Capital Partners, K5 Global, NewView Capital, Spark Capital, Sutter Hill Ventures, and XN. This milestone follows Sigma reaching $200M in annual recurring revenue in April 2026, with more than 100% year-over-year growth and 1.1 million new active users added in the latest fiscal year. We are growing the Solution Engineering team and are looking for a Manager, Commercial Solution Engineering to lead our Commercial team — a group of Solution Engineers with a shared mission to make data access easy and drive business results. The Sigma Solution Engineering Manager is a first-line, player-coach leader who believes in the power of coaching people and the power of analytics to transform organizations. You act as a trusted advisor to y

About the role AI and coding agents have made building enterprise apps nearly effortless and exposed a massive gap in the infrastructure to run them. Sigma is emerging as the AI Runtime Environment that makes enterprise AI actually work, and this role will tell that story to the market, why it matters, and help define and create this new category. As Director of Product Marketing for AI, you will own the positioning and go-to-market strategy for Sigma's overall AI narrative and its specific capabilities, including: natural language exploration, agentic workflows, and AI-powered application building (both internal and using external coding agents). This is a high-visibility, high-impact role that sits at the intersection of product, sales, and the market. You'll translate a rapidly evolving AI roadmap into sharp, differentiated messaging that resonates with data teams, business leaders, and the enterprise IT buyers who evaluate and approve AI investments. You will be a key voice in helping Sigma win the category. What you'll do Define and own Sigma's AI product positioning and messaging from core value propositions to competitive differentiation and persona-specific narratives. Partner with Product and Engineering to understand and influence Sigma's AI capabilities and roadmap. Lead product launches for AI features and capabilities, coordinating across marketing, sales, customer success, and partnerships. Partner with sales leadership and frontline re

Solution Architect Sigma Computing The SA role has evolved. Here’s the version we’re hiring for. The SA job in 2026 is not the SA job in 2023. Three things now sit at the center of how we evaluate this role. This hire has to do all three at a senior level, with the architectural depth to back it up. 1. Use AI every day to do the job better. If you are not using Claude, ChatGPT, Cursor, or equivalents to accelerate your account prep, architecture diagramming, prototype builds, RFP responses, and discovery synthesis, you are getting outworked by SAs who are. We expect this hire to treat AI tooling as default infrastructure, not novelty. Come with a point of view on what you run, why, and how you use it to compress weeks of work into days. 2. Sell AI into the account. Buyers want to talk about agents, MCP, A2A, context engineering, and which model is powering what. You have to be fluent. You know Sigma’s AI surface cold: Sigma Assistant in build, analyze, and plan modes, AI functions, input tables with LLM enrichment, MCP integration, and warehouse-native agent patterns. You can architect Sigma agents and warehouse agents into a customer’s stack and explain the tradeoffs to a head of data and a CISO in the same call. You also speak credibly about Claude, OpenAI, Gemini, and the broader stack the customer already runs. 3. Sell against AI. Every enterprise deal has AI competition in it. Sometimes it is Databricks Genie. Sometimes it is Snowflake Cortex Analyst. Somet

About the role Every enterprise is racing to build AI-powered apps and agents but speed without the right runtime creates chaos, not transformation. Sigma is the AI Runtime Environment that makes those apps governable, scalable, and real, and the Sr. PMM, Sigma Apps will play a critical role in developing and executing the go-to-market narrative and strategy for Sigma Apps. This role requires someone who understands both sides of the enterprise software conversation: the IT leaders and data engineers who evaluate and govern application infrastructure, and the line-of-business owners who care about outcomes, speed, and usability. You'll translate Sigma's application development capabilities into stories that resonate with both and create the materials the sales team needs to tell those stories in the field. What you'll do Develop and maintain positioning and messaging for Sigma Apps including no-code app building, AI-assisted workflow automation, embedded analytics, and apps built with external coding agents working closely with the Director of Product Marketing, Apps and the Product team. Support new feature launches and capability expansions, coordinating across product, design, marketing, and sales to bring new capabilities to market clearly and effectively. Work closely with Product and Engineering to deeply understand and influence the Sigma Apps roadmap bringing market, customer, and competitive insights that help shape and prioritize it. Partner with sales

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLE Voice is becoming the internet’s next interface, but a production-grade Voice AI system is "hard to build" . You’ll join a small founding team of Baseten Voice AI, focused on bringing state-of-the-art open source models into production for Voice AI customers across productivity, customer service, clinical conversation, creator tools, education, and more. You’ll make a meaningful impact on people’s daily lives and help reshape these industries. This is a high-impact, high-ownership role. You will be the primary owner of Baseten Voice AI - our in-house inference stack to power Voice AI models - from product roadmap through engineering implementation. You’ll partner closely with Forward Deployed Engineers, Model Performance Engineers, and sister engineering teams to push the boundaries of Voice AI. EXAMPLE INITIATIVES Develop world-class model serving stack for state-of-the-art open-source voice models - reduce end-to-end an

About the Team OpenAI’s Hardware organization develops AI-native silicon and system-level solutions for the unique demands of advanced AI workloads. Building on efforts like Jalapeño, the team is developing future generations of AI-native silicon and tightly integrated systems to power the next generation of frontier models. By co-designing chips, systems, tools, and methodologies, the team helps deliver faster, more efficient, and production-ready hardware for OpenAI’s supercomputing platform. About the Role You will build the low-level device runtime that turns compiled programs into efficient, functional and performant execution on OpenAI’s custom AI accelerator. This software will schedule kernel launches, manage device memory and address spaces, coordinate synchronization, and expose reliable abstractions to higher-level runtimes and frameworks. You will work at the boundary of software and hardware, partnering with compiler, kernel, architecture, verification, and silicon teams to define interfaces and validate behavior. You will also use and improve event-based, cycle-accurate simulation to develop runtime capabilities before silicon is available, diagnose performance and correctness issues, and guide hardware-software co-design. In this role, you will: Design and implement the low-level device runtime for OpenAI custom silicon. Build kernel-launch scheduling, command submission, queueing, dependency tracking, and completion handling. Manage device memory spaces, alloc

About the Team Training Runtime designs the core distributed runtime that powers everything from early research experiments to frontier-scale model runs. We build robust, scalable, high performance components to support our distributed training workloads. Our priorities are to maximize the productivity of our researchers and our hardware, accelerating progress towards AGI. Within Training Runtime, the Runtime Foundations team develops the distributed OS responsible for orchestrating the large numbers of processes that make up modern training workloads and providing all necessary observability and resilience to operate in frontier scale environments. Our runtime sits beneath training frameworks and on top of research infrastructure, ensuring jobs run reliably across massive clusters while maintaining performance, stability, and observability. Success for us is measured by both system reliability and researcher velocity - enabling ideas to scale from experiments to production training runs. About the Role As a Training Runtime: Runtime Foundations Engineer , you will work on the software that ties thousands of computers together and exposes them as a unified system. This system has to serve individual researchers running multiple parallel experiments, as well as our largest training runs spanning 100’s of thousands and even millions of machines and accelerators. This requires easy to use, introspectable systems that can promote a fast debugging and development cycle, as well as

Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify innovations in software models, compilers, platforms, networking, and semiconductors. Our diverse team of technologists have developed a high performance RISC-V CPU from scratch, and share a passion for AI and a deep desire to build the best AI platform possible. We value collaboration, curiosity, and a commitment to solving hard problems. We are growing our team and looking for contributors of all seniorities. We are seeking a GCC Compiler Engineer to design, develop, and optimize compilers for next-generation RISC-V and AI compute architectures. You will work across hardware and software teams to improve performance, programmability, and integration of our custom toolchains into real applications. This role is fully hands-on and central to how developers interact with Tenstorrent hardware across both traditional compute and advanced machine learning workloads. This role is Hybrid, based out of Santa Clara, CA, Austin, TX, or Toronto, ON. We welcome candidates at various experience levels for this role. During the interview process, candidates will be assessed for the appropriate level, and offers will align with that level, which may differ from the one in this posting. Who You Are Experienced compiler engineer with deep knowledge of GCC and LLVM interna

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role We are seeking an experienced Software Engineer to join a newly-formed team focused on developing and deploying advanced AI systems to the tactical edge. This role involves training, evaluating, and deploying LLM agents to edge hardware for interfacing with sensors, effectors, and drone systems. This project is in support of multiple customers in the defense sector that are looking for untethered AI solutions that can be rapidly deployed downrange on hardware with limited capabilities. As a part of this team, you will build and deploy specialized models and agents that can run on tactical edge hardware, working alongside other experts in AI, LLMs, and systems to shape solutions that redefine complex tactical defense scenarios. Core Responsibilities Train and fine-tune edge-capable LLMs for tactical defense applications Optimize model performance for various edge hardware (GPU, CPU, and specialized accelerator) platforms Design and implement multi-agent systems for various mission scenarios Interface LLM agents with sensors, effectors, and drone systems Benchmark and evaluate agent capabilities, performance, and reliabili

About the Team Training Runtime designs the core distributed runtime that powers everything from early research experiments to frontier-scale model runs. We work on building robust, scalable, high performance components to support our distributed training workloads. Our priorities are to maximize the productivity of our researchers and our hardware, with the goal of accelerating progress towards AGI. Within Training Runtime, the Process Management team develops the distributed OS responsible for launching, coordinating, and supervising the large numbers of processes that make up modern training workloads. Our runtime sits beneath training frameworks and on top of research infrastructure, ensuring jobs run reliably across massive clusters while maintaining performance, stability, and observability. Success for us is measured by both system reliability and researcher velocity - enabling ideas to scale from experiments to production training runs. About the Role As a Training Runtime: Process Management Engineer , you will work on the software that ties thousands of computers together and exposes them as a unified system. This system has to serve individual researchers running multiple parallel experiments, as well as our largest training runs spanning 100’s of thousands and even millions of machines and accelerators. This requires easy to use, introspectable systems that can promote a fast debugging and development cycle, as well as relentless optimization for scale while maint

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. The Game Engine team at Roblox works on the systems that power the experiences at the heart of the metaverse. Our code is the technical foundation in our client, editor, and our simulation servers. The Game Engine team is broadly split into departments — Audio-Video-Communication, Avatar, Core AI, Digital Matter, Productivity, and Systems. This position is for the Systems Runtime pod. The Runtime pod builds and maintains the foundational C++ components that power the entire Roblox engine and Studio stack. We own the runtime layer — the performance, efficiency, and usability of the core primitives that every other engineering team relies on. Think of Runtime as the “standard library” and execution eng

About the Team OpenAI’s Hardware organization develops AI-native silicon and system-level solutions for the unique demands of advanced AI workloads. Building on efforts like Jalapeño, the team is developing future generations of AI-native silicon and tightly integrated systems to power the next generation of frontier models. By co-designing chips, systems, tools, and methodologies, the team helps deliver faster, more efficient, and production-ready hardware for OpenAI’s supercomputing platform. About the Role You will build the model runtime within the inference engine that executes complex, frontier models at scale on OpenAI’s custom silicon. The runtime will sit between models running on the hardware and the upper layers of the cluster serving software stack, translating demanding inference workloads into efficient execution while optimizing for throughput, latency, utilization, and reliability. You will work across model architecture, distributed systems, compilers, kernels, and silicon to design a production-grade runtime comparable in ambition to systems such as vLLM and SGLang, but customized and optimized for OpenAI’s AI accelerator. Your work will shape how new model capabilities map onto the platform and how quickly custom silicon can deliver meaningful performance in production. In this role, you will: Design and implement the LLM inference runtime for frontier models running on custom silicon. Build scheduling, continuous batching, memory management, KV-cache manag

WHAT IS BOX? Box (NYSE:BOX) is the leader in Intelligent Content Management. Our platform enables organizations to fuel collaboration, manage the entire content lifecycle, secure critical content, and transform business workflows with enterprise AI. We help companies thrive in the new AI-first era of business. Founded in 2005, Box simplifies work for leading global organizations, including JLL, Morgan Stanley, and Nationwide. Box is headquartered in Redwood City, CA, with offices across the United States, Europe, and Asia. By joining Box, you will have the unique opportunity to continue driving our platform forward. Content powers how we work. It’s the billions of files and information flowing across teams, departments, and key business processes every single day: contracts, invoices, employee records, financials, product specs, marketing assets, and more. Our mission is to bring intelligence to the world of content management and empower our customers to completely transform workflows across their organizations. With the combination of AI and enterprise content, the opportunity has never been greater to transform how the world works together and at Box you will be on the front lines of this massive shift. WHY BOX NEEDS YOU Box is building the infrastructure that powers AI agents across our entire product ecosystem — and we need a hands-on engineering leader to run it. The Agent Runtime team is a platform team at the heart of Box's AI-first strategy. You will ow