Inference Technical Lead Jobs

About the Role As a Director, Compute & Infrastructure FP&A, you will own and drive the monthly forecasting process for the Compute & Infrastructure org by partnering with various stakeholders across Finance, Accounting, Tax and Engineering. You will play a critical role in planning and forecasting the company’s largest and most complex cost center ( Compute & Infrastructure ). You will collaborate cross-functionally to develop long-range infrastructure investment plans, evaluate build vs. buy decisions, and ensure capital is deployed efficiently to support rapid growth. You will also provide strategic financial guidance through scenario modeling, ROI analysis, and performance tracking, enabling leadership to make high-stakes decisions under uncertainty. What You’ll Do Own compute financial planning & Forecasting. Build and manage consolidation models for GPU/CPU capacity, storage, networking, and data center investments. Translate infrastructure roadmaps into short- and long-term financial forecasts (LRP, annual planning) Coordinate closely with Corporate FP&A on timelines and process Present insights on a monthly basis to senior management. Drive infrastructure investment decisions. Evaluate build vs. buy, vendor vs. owned infrastructure, and capacity allocation tradeoffs. Develop frameworks for investment trade-offs to guide executive decision making. Build scalable tooling & reporting. Implement stakeholder-facing dashboards to track compute spend, utilization, and efficiency metrics. Improve visibility into unit economics (e.g., cost per training run, cost per inference, cost per customer). Drive forecasting accuracy & accountability. Lead budget vs. actual analysis for compute and infrastructure spend. Identify key cost drivers (utilization, pricing, efficiency gains) and reduce forecast variance. Support close & financial reporting. Partner with Accounting to ensure accurate classification of infrastructure spend (OpEx vs C

About the Team: The OpenAI API team builds the foundation that enables every developer to harness OpenAI’s models safely, reliably, and at scale. We design and operate the systems that power model serving, API access, billing, developer tooling, and enterprise integrations—forming the connective tissue between OpenAI’s research breakthroughs and real-world products. Our mission is to make it effortless for anyone to build with OpenAI technology. We’re responsible for the infrastructure and product layers that allow millions of developers to integrate GPT models, fine-tune behavior, manage data, and deliver transformative experiences to their users. We collaborate across product, research, and engineering teams to ensure that innovation in model capabilities translates directly into value for customers. The API team spans multiple disciplines, including product management, infrastructure engineering, developer experience, and data systems. We care deeply about reliability, scalability, and simplicity—creating tools that let developers focus on their ideas while we handle the complexity of running world-class AI systems. About the Role: We are seeking an experienced Product Manager to define and scale the construction of our data processing, data privacy, billing, and access controls products. You will set strategy and execute on projects like expanding our regional data processing footprint, enabling new inference caching controls in the API or building APIs that make it easier for organizations to manage their spend limits. You will also define the strategy and ship foundational capabilities that ensure customers use OpenAI products securely, privately, and with enterprise-grade controls. This role partners deeply with engineering, security, legal, compliance, finance and leadership to deliver high-trust, enterprise-grade systems. This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to n

About the Team The Foundations Research team works on high-risk, high-reward ideas that could shape the next decade of AI. Our goal is to advance the science and data that enable our training and scaling efforts, with a particular focus on future frontier models. Pushing the boundaries of data, scaling laws, optimization techniques, model architectures, and efficiency improvements to propel our science. The Search team sits within Foundations, building agentic search by co-designing model–system interfaces with the core search stack (serving, indexing, retrieval) to translate model intent into reliable, real-world actions. Operating at the frontier of AI and information retrieval, the team develops large-scale systems that transform and index vast corpora, enabling models to reason over global knowledge and act dependably. In close partnership with researchers, we rapidly bring modeling breakthroughs into production and redefine how intelligent systems discover, retrieve, and synthesize information at planetary scale. About the Role We’re looking for a Software Engineer focused on building and scaling retrieval systems. You’ll work with a team of researchers and engineers to develop infrastructure that enables models to retrieve and act on the right information at the right time. This includes designing and operating indexing systems, retrieval pipelines, and serving layers. This work supports retrieval across OpenAI products and research, with direct impact on system performance, reliability, and scale. Responsibilities Build and scale retrieval infrastructure across indexing, serving, and query execution. Develop low-latency, high-throughput systems for real-time model interaction. Partner with research to productionize embedding and retrieval techniques. Support dense, sparse, and hybrid retrieval pipelines. Own system performance, reliability, and observability at scale. Collaborate across Pretraining, Inference, and Product teams to integrate retrieval end-to-e

About Ema Ema is building the world’s leading Agentic AI platform to transform enterprise productivity. We enable organizations to delegate repetitive tasks to Ema, the Universal AI Employee, delivering 10x gains in workforce efficiency, across functions. Founded by former executives from Google, Coinbase, Flipkart, and Okta, our team includes engineers from premier tech companies and graduates of Stanford, MIT, UC Berkeley, CMU, and IITs. We are backed by industry leading investors including Accel, Naspers/Prosus, Section32, and angels like Sheryl Sandberg and Dustin Moskovitz. Headquartered in Silicon Valley and with offices in London, Bangalore and Vancouver, Ema is at the frontier of what Agentic AI can do in production — we ship real systems that run real business processes at scale. The residency You own one hard problem end to end. You write the proposal, build the system, design the evaluation, ship behind a gate, and finish with a write-up of what turned out to be true, including the parts that didn't work. You'll sit in the production codebase with a senior mentor and real production data. Recent residents have shipped self-improving harnesses, inference-cost work, agent memory, and eval infrastructure. Your project gets scoped with you, not handed to you. The problem space The loop we care about: production traces become data, data becomes training and evaluation, and better agents produce better traces. Projects live somewhere on that loop. Harness and inference-time work. Context engineering, tool and skill design, orchestration, and deciding where extra inference compute actually pays. Self-improvement loops run behind hard fences. Post-training for agents. SFT on curated trajectories, preference optimization, RL on real agent tasks. Reward design where outcomes are verifiable, process vs. outcome supervision, distilling frontier behavior into cheaper models. Environments and rewards. Turning enterprise workflows into training and eval environments: fi

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. Senior Software Engineer — Cortex Training The Snowflake ML Platform team's mission is to let customers run their most demanding ML/AI workloads inside Snowflake. Cortex Training is our LLM post-training platform: it turns scarce, expensive GPU capacity into a simple, composable service, so customers can adapt open-weight foundation models to their own business problems while we handle the hard distributed-systems parts, including scheduling, orchestration, multi-node training and inference, fault tolerance, and throughput. The platform already runs post-training at scale. Under the hood, it decouples GPU computation from the training loop and exposes it as primitive APIs that compose into everything from SFT to full RL workflows. You'll work alongside a team that ships fast & sweats reliability and the researchers behind DeepSpeed. We're looking for an engineer who thrives in the ML infrastructure layer and brings a solid understanding of LLMs and post-training to help us scale and grow it. YOU WILL: Design and build across the full stack — from the public training APIs and SDK through the control plane to the GPU data plane. Scale the distributed systems that make GPU compute serverless — multi-tenant scheduling, placement, and capacity-aware routing across regional G

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. Snowflake is transforming how the world uses data and AI — and the networking and traffic infrastructure that powers these experiences is mission-critical. As a Product Manager focused on Traffic & Networking, you will define how Snowflake delivers secure, reliable, and high-performance connectivity at global scale, including the networking foundations required to support AI-driven products and workloads. You will own the product vision and roadmap for internal traffic management, service-to-service networking, customer connectivity, and performance optimization across multi-cloud environments. A core part of this role is defining and evolving Snowflake’s network strategy to support AI products , including latency-sensitive inference, large-scale model training pipelines, vector search, streaming ingestion, and cross-region data movement. This is a high-impact role at the intersection of distributed systems, cloud networking, and AI infrastructure. AS A PRODUCT MANAGER AT SNOWFLAKE YOU WILL: Define the networking strategy required to support Snowflake’s AI products , including low-latency inference paths, high-throughput data pipelines, GPU-adjacent services, and elastic scaling for AI workloads. Partner with AI platform, compute, and storage teams to ensure networking

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. The Product Data Science team is looking for a Full-stack Senior Data Scientist to come aboard and be part of Snowflake’s most critical initiatives. In this role, you will work closely with our Product and Engineering teams on everything from core operations, to innovative AI/ML tools, to our fastest-growing new and experimental features. You will work on long-running analytical initiatives yielding substantial product enhancements. This is a strategic, high-impact role that will help shape the future of Snowflake products and services. PLEASE NOTE: The position level is determined during the interview process and is influenced by various factors, including experience, educational attainment, skill level requirements, and overall interview performance. AS A SENIOR FULL STACK DATA SCIENTIST AT SNOWFLAKE YOU WILL: Be a proactive partner to Product Management and Engineering to shape feature roadmaps and help design metrics and analytical workflows to evaluate their success and effectiveness. Build efficient data models and high quality production pipelines and partner with Engineering for all necessary telemetry. Build scalable and extensible analytics/ML/causal inference frameworks to uncover feature usage patterns, subtle issues with the system, potential performance enhanc

About Us At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world’s largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of code. Internet properties powered by Cloudflare all have web traffic routed through its intelligent global network, which gets smarter with every request. As a result, they see significant improvement in performance and a decrease in spam and other attacks. Cloudflare was named to Entrepreneur Magazine’s Top Company Cultures list and ranked among the World’s Most Innovative Companies by Fast Company. At Cloudflare, we’re not looking for people who wait for a polished roadmap; we’re looking for the builders who see the cracks in the Internet that everyone else has simply learned to live with. We value candidates who have the instinct to spot a "normalized" problem and the AI-native curiosity to create a solution using the latest tools. Our culture is built on iteration, leveraging AI to ship faster today to make it better tomorrow, while ensuring that every improvement, no matter how small, is shared across the team to lift everyone up. If you’re the type of person who values curiosity over bureaucracy, and that AI is a partner in solving tough problems to keep the Internet moving forward, you’ll fit right in. Available Locations: Bangalore, India About the Role As a Business Development Representative (BDR), you will play a critical role in territory planning and work closely with Enterprise Account Executives to build closable pipeline. Your two primary goals will be to: Generate qualified pipeline through outbound activities Influence revenue via strong collaboration and stakeholder management We are looking for a driven individual with experience in

Become a part of our caring community The Financial Analytics Professional 2 manages data to support and influence decisions on day-to-day operations, strategic planning and specific business performance issues. The Financial Analytics Professional 2 work assignments are varied and frequently require interpretation and independent determination of the appropriate courses of action. The Financial Analytics Professional 2 collates, models, interprets and analyzes data in order to identify, explain, influence variances and trends. Explains variances and trends in clinical and financial data and enhances modeling techniques to improve forecast accuracy. May possess financial or actuarial background. Understands department, segment, and organizational strategy and operating objectives, including their linkages to related areas. Makes decisions regarding own work methods, occasionally in ambiguous situations, and requires minimal direction and receives guidance where needed. Follows established guidelines/procedures. Use your skills to make an impact Required Qualifications Bachelor's Degree 1&#43; years SQL and Python experience Microsoft Office (Excel, Power BI, etc.) Experience in compiling, modeling, interpreting and analyzing data in order to identify, explain, influence variances and trends Explain variances and trends and enhance modeling techniques Experience in managing data to support and influence decisions on day-to-day operations, strategic planning and specific business performance issues Must be passionate about contributing to an organization focused on continuously improving consumer experiences Preferred Qualifications Business Intelligence, Financial, or Actuarial background Azure Databricks experience</

About the Team OpenAI’s Hardware organization develops AI-native silicon and system-level solutions for the unique demands of advanced AI workloads. Building on efforts like Jalapeño, the team is developing future generations of AI-native silicon and tightly integrated systems to power the next generation of frontier models. By co-designing chips, systems, tools, and methodologies, the team helps deliver faster, more efficient, and production-ready hardware for OpenAI’s supercomputing platform. About the Role OpenAI's Hardware organization builds supercompute platforms from silicon and boards to full rack-scale systems to power advanced AI workloads. This role owns end-to-end quality for high-speed interconnect hardware across the product lifecycle: early design influence, supplier/contract manufacturer readiness, qualification, ramp, and fleet quality in lab and data center environments. You will be the quality lead for advanced interconnect components and assemblies, including high-speed copper cables, cable cartridges, patch panels, backplane/cable-backplane solutions, high-speed connectors, and related electro-mechanical interfaces. You will partner closely with electrical, mechanical, SI/PI, systems, reliability, operations, and external vendors to prevent escapes and drive rapid, data-driven containment and corrective action. In this role you will: Own quality for advanced interconnect components and assemblies: high-speed connectors, high-speed copper cables, cable cartridges (e.g., cable cassette style assemblies), patch panels & optics, and backplane/cable-backplane interconnect solutions. Drive quality-by-design: participate in design reviews, DFM/DFx, tolerance stacks, material and plating selections, connector mating strategy, strain relief, and assembly methods to reduce variation and field failures. Define and track quality and reliability metrics (DPPM, yield, escapes, RMA/FRACAS trends, Cpk/Ppk where applicable) for interconnects across NPI and m

About the team OpenAI’s mission is to ensure the responsible and widespread adoption of artificial intelligence. In support of that mission, the Marketing team helps deeply understand customer audiences and market dynamics, influence the development of the right products, build sustainable and customer-aligned monetization models, and drive awareness, adoption, and usage across OpenAI’s products and platform. We take a data-driven approach to understand markets, develop monetization strategies, and uncover customer needs that shape product strategy and messaging. We partner closely with Sales, Partnerships, Product, Engineering, Research, Comms, and Design to deliver a cohesive end-to-end customer experience and lead go-to-market efforts for new product launches across channels. About the role We’re looking for a Product Marketing Manager, Advertising to help bring together advertiser insights, market understanding, and product knowledge to inform positioning, support product priorities, and execute go-to-market initiatives that drive adoption and measurable business impact. You’ll work closely with Product, Engineering, Sales, and Partnerships to understand advertiser needs, translate complex AI capabilities into clear customer value, and bring new products and features to market. This role is ideal for someone who combines strong analytical thinking with hands-on execution, can independently drive clearly scoped workstreams, and is eager to grow their strategic ownership in a fast-moving environment. In this role, you will: Contribute to the product and marketing strategy for a defined area of OpenAI’s advertising business in partnership with senior product marketers and cross-functional partners. Build an understanding of advertisers through customer research, market analysis, and competitive insights, identifying opportunities to improve positioning, adoption, and the customer experience. Develop and maintain positioning and messaging for assigned products or fe

About the team OpenAI’s mission is to ensure the responsible and widespread adoption of artificial intelligence. In support of that mission, the Marketing team helps deeply understand customer audiences and market dynamics, influence the development of the right products, build sustainable and customer-aligned monetization models, and drive awareness, adoption, and usage across OpenAI’s products and platform. We take a data-driven approach to understand markets, develop monetization strategies, and uncover customer needs that shape product strategy and messaging. We partner closely with Sales, Partnerships, Product, Engineering, Research, Comms, and Design to deliver a cohesive end-to-end customer experience and lead go-to-market efforts for new product launches across channels. About the role We’re looking for a Product Marketing Manager, Advertising to bring together advertiser insights, market understanding, and product knowledge to shape positioning, inform product priorities, and deliver go-to-market initiatives that drive adoption and measurable business impact. You’ll work closely with Product, Engineering, Sales, and Partnerships to understand advertiser needs, translate complex AI capabilities into clear customer value, and bring new products and features to market. This role is ideal for someone who combines strategic thinking with hands-on execution, independently navigates ambiguity, and brings cross-functional partners together to deliver results. In this role you will: Define the product and marketing strategy for a component of OpenAI’s advertising business in partnership with cross-functional partners Develop a deep understanding of advertisers through customer research, market analysis, and competitive insights, identifying opportunities to improve positioning, adoption, and product-market fit. Own positioning and messaging for your product area, translating complex capabilities into compelling narratives for different advertiser audiences and use c

About the Team OpenAI’s mission is to ensure the responsible and widespread adoption of artificial intelligence. In support of that mission, the Marketing team helps deeply understand customer audiences and market dynamics, influence the development of the right products, build sustainable and customer-aligned monetization models, and drive awareness, adoption, and usage across OpenAI’s products and platform. We take a data-driven approach to understand markets, develop monetization strategies, and uncover customer needs that shape product strategy and messaging. We partner closely with Sales, Partnerships, Product, Engineering, Research, Comms, and Design to deliver a cohesive end-to-end customer experience and lead go-to-market efforts for new product launches across channels. About the Role We’re looking for a Marketing Scientist to join OpenAI’s Ads Marketing Science function. Reporting to Marketing Science leadership, you’ll be a senior individual contributor who combines rigorous measurement expertise with strong client judgment and hands-on execution. Your mission is to help OpenAI Ads prove and improve advertisers’ media performance. You’ll work with sales, partners, and clients supporting all forms of measurement including verification, attribution, incrementality, brand, marketing mix modeling (MMM), and scalable advertiser reporting, connecting sound methodology to decisions advertisers can act on. You will partner closely with Sales on key advertising accounts and with Product, Engineering, Data Science, Partnerships, Legal, and Privacy. Initial priorities include advancing incrementality measurement, helping onboard measurement partners to privacy-forward measurement workflows and integrations, and creating reusable programs, tools, agents, skills, and workflows that let sales and clients access high-quality Marketing Science support at scale. This role is based in either San Francisco or New York, and follows a hybrid schedule (Monday-Wednesday). In th

About the Team OpenAI’s mission is to ensure the responsible and widespread adoption of artificial intelligence. In support of that mission, the Marketing team helps deeply understand customer audiences and market dynamics, influence the development of the right products, build sustainable and customer-aligned monetization models, and drive awareness, adoption, and usage across OpenAI’s products and platform. We take a data-driven approach to understand markets, develop monetization strategies, and uncover customer needs that shape product strategy and messaging. We partner closely with Sales, Partnerships, Product, Engineering, Research, Comms, and Design to deliver a cohesive end-to-end customer experience and lead go-to-market efforts for new product launches across channels. About the Role We are hiring a Head of Enterprise Ads Marketing to define and scale OpenAI’s global marketing strategy for enterprise advertisers, agencies, and strategic brand partners. This leader will own how advertisers understand, evaluate, adopt, and grow with OpenAI’s advertising solutions. This is a highly strategic and hands-on leadership role where you will shape the narratives that position OpenAI as a premium advertising platform for the world’s marketers while building the content, thought leadership, events, and demand programs that drive pipeline and long-term strategic growth. You will partner closely with Sales, Partnerships, Product, Finance, Legal, Communications, Research, and Data Science to help establish OpenAI as a trusted leader in the future of AI-powered advertising. This role is ideally based in San Francisco, CA, with a hybrid schedule of three days per week in the office. In This Role, You Will: Define the end-to-end enterprise advertiser marketing strategy across awareness, consideration, pipeline creation, adoption, expansion, and long-term growth. Develop OpenAI’s enterprise advertising narratives, positioning, and messaging architecture across AI-powered mar

The Performance Research Engineer will play a critical role in advancing TaylorMade's leadership in golf equipment performance. This role bridges physical testing, player testing, Tour-level data collection, and advanced analytics to deliver actionable insights that influence product design, product validation, and performance optimization. The ideal candidate is a hands-on engineer with strong mechanical aptitude, advanced data skills, deep golf intuition, and the ability to translate player feedback into clear engineering direction. Essential Functions and Key Responsibilities: Lead the design and execution of advanced performance testing protocols for golf clubs and balls, including lab, player, field, and Tour-based testing environments. Serve as a category-focused Performance Engineering owner for one or more product areas, with potential emphasis across Woods, Irons, Putter/Wedge, or cross-category initiatives. Support PGA/LPGA Tour and elite-athlete testing by collecting clean, repeatable, decision-ready data while operating professionally and respectfully in player-facing environments. Analyze large datasets from lab, player, and field testing to extract insights on ball speed, launch, spin, consistency, delivery, impact location, dispersion, and performance tradeoffs. Translate Tour and player-test observations into clear engineering recommendations, product questions, validation plans, and follow-up experiments. Develop and maintain automated data pipelines, dashboards, and reporting tools for performance tracking, project communication, and cross-functional decision-making. Collaborate with R&D, Product Development, Tour, Fitting, Consumer Insights, and Analytics teams to integrate player feedback and real-world data into product design.