ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. At Baseten, we are building the global operating system for distributed, heterogeneous AI hardware. We believe that as LLM and multi-modal workloads scale, the network is the computer. We are looking for foundational engineers to lead our GPU Networking efforts, making RDMA a first-class building block in our infrastructure and unlocking the next generation of distributed inference optimizations. THE OPPORTUNITY Networking and compute are no longer separate disciplines; they are converging. The massive throughput of H100, B200, and NVL72 architectures enables and demands a new approach where communication is co-optimized alongside computation. We are entering an era where the network is an active accelerator, leveraging smart hardware offloads and direct interconnects to ensure that data movement operates at wire-speed. In this role, you will go beyond network configuration to architect the software fabric that unifies thousands of GPUs into a cohesive operating system. While you will leverage the best of the open-source ecosystem, you won't be limited by it. Where off-the-shelf solutions stop, you will build from scratch, engineering the primitives required to co-optimize communication and compute for Disaggregated Serving, Wide Expert Parallelism (WideEP), and lightening cold starts. WHAT YOU'LL DO Make RDMA First-Class: You will work on integrating RDMA/RoCE/InfiniBand capabilities directly into our inference stack,
Jobs in United States
Inference Engineering And Product Lead in San Francisco
268 active opportunities · Updated October 2026
Showing
15 jobs
Explore current inference engineering and product lead jobs in San Francisco. Filter by work mode, employment type, experience, department, date posted and distance.
ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLE As a Global Capacity Lead at Baseten, you will lead the "engine room" of the company, architecting, securing, and optimizing the global GPU fleet that powers our customers' AI workloads. You’ll own the end-to-end journey of capacity management, from securing multi-million dollar GPU clusters to building the automation that ensures 99.9% uptime across multi-cloud environments. This role is a great fit for entrepreneurial engineers who want to bridge the gap between high-finance asset management and deep infrastructure engineering. You will act as the fleet orchestrator for the world's most advanced chips, ensuring Baseten never experiences a capacity outage while maintaining elite unit economics. To be clear, this is a high-stakes engineering role. You will be hands-on with Kubernetes orchestration while also leading specialized pods focused on the next generation of hardware, like NVIDIA’s Blackwell (B200) architecture. EXAMPLE INITIATIVES The B200 Frontier: Architecting the infrastructure readiness and deployment strategy for Baseten's first Blackwell GPU clusters. Global Workload Orchestration: Building "Multi-cloud Capacity Management" systems to move customer workloads seamlessly across regions to optimize cost and latency. Precision GPU Triage: Developing automated Go-based operators to identify, cordon, and repair unhealthy H100 nodes in under an hour. The Supply Chain of Intelligence: Partnering with lead
ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE Baseten's GTM org is in hyper growth. As it grows and matures, the needs of the GTM stack get more sophisticated with scale — and this team exists to stay ahead of those needs. This role owns a core set of the platforms the field runs on. You'll administer, configure, and continuously improve them, build AI and automation on top of the CRM to keep it clean and current, and run the adoption programs that make sure the field actually uses what we put in front of them. We're an AI-native company scaling fast, and we want to add sophistication without adding drag — you'll be the person deciding how much system is enough. This isn't a classic Salesforce admin role. You know the ecosystem, but you come at it as a builder and an orchestrator, not a ticket-taker. What You'll Walk Into Central RevOps is the systems and operations center of excellence for Baseten's GTM org. The stack includes Salesforce, Pylon, Outreach, Sales Navigator, Clay, and a growing set of AI-native GTM tools. The field is scaling fast, and the systems need to mature with it without slowing anyone down. You'll co-own Salesforce with our other GTM Systems Manager and work alongside a GTM Engineering team who builds internal AI products for GTM productivity — plus partner closely with sales leadership and the field. Responsibilities Own adminship, configuration, and enablement for Pylon, Gong, Sales Navigator, Outreach, and Prospect. These platfor
ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLE We're looking for a Delivery Director, Capacity programs for our on-premises data center builds and neo cloud (GPU cloud) delivery programs. This is a high-visibility, execution-critical role sitting at the intersection of infrastructure engineering, capacity planning, vendor/partner management, and customer delivery. You will own the end-to-end delivery lifecycle for large-scale compute infrastructure — from initial site/capacity commitments through power, networking, and hardware bring-up, to production-ready GPU/compute capacity landing in the hands of internal teams or customers. You'll be the person who turns ambitious infrastructure roadmaps into predictable, on-time, delivery. RESPONSIBILITIES Own delivery of on-prem infrastructure builds — colocation expansions, power/cooling readiness, rack-and-stack, network fabric bring-up, and hardware acceptance testing — coordinating across colo providers and partners, network engineering, hardware ops, and vendor teams. Drive neo cloud delivery programs — manage capacity delivery from GPU cloud and neo cloud partners (e.g., colocation/bare-metal/GPU cloud providers), including contract milestones, capacity ramps, SLAs, and go-live readiness. Build and maintain master delivery schedules across concurrent, multi-site, multi-vendor programs, integrating power/shell timelines, hardware lead times, logistics, and software/platform readiness into a single critical path.
Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Vice President, Software Engineering Overview Decision Stream is Mastercard's next-generation AI-native decisioning platform, designed to power intelligent, real-time decisions across fraud, authentication, payments, and risk. Built with a startup mindset and enterprise-scale ambition, the platform combines innovation, speed, and engineering excellence to redefine decisioning across Mastercard's global ecosystem. We are seeking a visionary and hands-on VP of Software Engineering to help build and scale the platform. This leader will partner closely with Product, Architecture, AI, and Platform Engineering teams to drive technology strategy, architecture, engineering execution, and organizational growth. What You'll Do Lead Through Technical Excellence • Serve as a senior technology leader and role model for engineering teams. • Drive architecture, design, and technology decisions across distributed systems, streaming, AI, and cloud-native platforms. • Engage deeply with engineers, architects, and product leaders to solve complex technical challenges. • Influence engineering standards, software quality, and operational excellence. Build and Scale the Platform • Help shape and deliver a highly scalable, resilient, and secure decisioning platform operating at Mastercard scale. • Balan
From £100K/yr
Who are we? Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems. We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that. We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft. We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us! Why this role? Cohere has a strong AI narrative, the most deployable product, and a CEO who co-authored the foundational paper of modern AI. The company is positioned to become the transatlantic leader in sovereign AI for enterprise and government, and needs a storytelling engine to deliver that story at scale. This role sits within the team that is building that engine. This is an opportunity to define the narratives that influence how enterprises, developers, and the broader ecosystem understand the future of AI and Cohere’s role in building it. In this cross‑functional, individual‑contributor role, you’ll partner deeply with product, research, engineering, and go‑to‑market teams to translate complex technical work into clear, compelling stories. You’ll help Cohere articulate what we’re building, why it matters, and how our technology is reshaping enterprise AI. You’ll craft narratives that resonate with technical and non‑technical audiences alike, and build programs that elevate Cohere’s product leadership and technical credibility. This is a rare opportunity to build a product and technology communications function at a fast
About the Role As a Field CTO (Strategic Pursuits) , you will serve as a strategic bridge between our customers, go-to-market (GTM) teams, and product organization. You will partner closely with Sales, Technical Success, and Product to shape high-impact deals, guide customer architecture decisions, and influence our product roadmap based on real-world adoption and feedback. This is a highly cross-functional, externally facing leadership role for someone who combines deep technical expertise with strong business acumen and customer empathy. In this role, you will: Customer & Deal Strategy Partner with Sales, Product and Technical Success teams to support complex, high-value deals as a technical and strategic advisor. Translate customer business needs into scalable technical solutions and architectures. Engage with senior customer stakeholders (CTO/CIO/VP-level) to drive alignment on vision, roadmap, and adoption. Lead technical strategy discussions during key deal stages, including discovery, solution design, and executive presentations. Architecture & Implementation Guidance Guide customers on best practices for deploying and scaling AI-driven solutions in production. Provide architectural oversight across use cases such as LLM applications, integrations, data pipelines, and security. Act as a trusted advisor to ensure long-term success, not just short-term wins. Product & Feedback Loop Bring structured customer insights back to Product and Engineering teams to inform roadmap and prioritization. Identify gaps, opportunities, and emerging patterns from customer deployments. Influence product direction based on real-world usage, scalability needs, and enterprise requirements. GTM Strategy & Thought Leadership Help shape GTM strategies by identifying repeatable patterns across industries and customer segments. Develop scalable frameworks, reference architectures, and playbooks for broader field teams. Represent the company externally through customer en
Datadog's Forward Deployed Engineering function is in an active growth phase, and the FDE Lead will play a central role in shaping what comes next. Working in close partnership with the Head of Datadog for Startups and Forward Deployed Engineers, and the existing FDE team, you will help define and expand the FDE framework, build out the structures and processes that allow the team to operate at scale, and extend the program's reach well beyond any single customer segment. This role sits at the rare intersection of sales, execution, program design, and hands-on engineering leadership. You are part field technical leader, part program architect, and part cross-functional connector. You will help determine what the FDE motion looks like at Datadog, contribute to its playbook, and push the boundaries of what the team can deliver. At Datadog, we place value in our office culture - the relationships and collaboration it builds, and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Evolve and scale the FDE operating model end to end: engagement intake, scoping, sprint delivery, handoff back to account teams, and the success metrics (time-to-value, adoption lift, ARR influence, NPS) and reporting infrastructure that support them. Build out a catalog of FDE offerings spanning observability quickstarts, custom integration development, LLM/AI observability accelerators, CI/CD pipeline instrumentation, and cost optimization deep dives, and contribute to their pricing and business models, including free-to-paid conversion plays, paid deployment packages, and post-deployment success motions. Capture product and feature gaps uncovered during deployments, translate them into structured prioritized briefs, and partner with PM and Engineering to strengthen the field-feedback channel that informs roadmap decisions on a regular cadence. Hire, onboard, an
About the Team Our Robotics team is focused on unlocking general-purpose robotics and pushing towards AGI-level intelligence in dynamic, real-world settings. Working across the entire model stack, we integrate cutting-edge hardware and software to explore a broad range of robotic form factors. We strive to seamlessly blend high-level AI capabilities with the constraints of physical systems to improve peoples’ lives. About the Role We are seeking a Lead Robotics Safety Engineer to define and lead the product safety strategy for our robotics program. You will work closely with leadership, engineering, research, legal, and policy teams to ensure safety is integrated into our products from the earliest stages of development through deployment. This role combines product safety, regulatory strategy, systems engineering, and risk management. You will help shape how we think about safety across robotic platforms, influence product architecture and development decisions, and ensure our systems are designed to meet both current and emerging regulatory expectations. You will serve as a subject matter expert on robotics safety standards, regulatory frameworks, and safety engineering practices while helping establish the long-term safety strategy for our products and organization. This role is based in San Francisco, CA. This role will be expected to be in office 4 days per week and offer relocation assistance to new employees. In this role, you will Define and lead the product safety strategy for robotic systems across the development lifecycle. Monitor and influence emerging regulatory frameworks, industry standards, and policy developments relevant to robotics and autonomous systems. Partner with engineering teams to translate safety requirements into product architecture, design decisions, and engineering requirements. Develop and maintain system-level hazard analyses, risk assessments, and safety cases for robotic products. Establish safety requirements, verification strat
About the team OpenAI’s mission is to ensure the responsible and widespread adoption of artificial intelligence. In support of that mission, the Marketing team helps deeply understand customer audiences and market dynamics, influence the development of the right products, build sustainable and customer-aligned monetization models, and drive awareness, adoption, and usage across OpenAI’s products and platform. We take a data-driven approach to understand markets, develop monetization strategies, and uncover customer needs that shape product strategy and messaging. We partner closely with Sales, Partnerships, Product, Engineering, Research, Comms, and Design to deliver a cohesive end-to-end customer experience and lead go-to-market efforts for new product launches across channels. About the role We’re looking for a Product Marketing Manager, Advertising to help bring together advertiser insights, market understanding, and product knowledge to inform positioning, support product priorities, and execute go-to-market initiatives that drive adoption and measurable business impact. You’ll work closely with Product, Engineering, Sales, and Partnerships to understand advertiser needs, translate complex AI capabilities into clear customer value, and bring new products and features to market. This role is ideal for someone who combines strong analytical thinking with hands-on execution, can independently drive clearly scoped workstreams, and is eager to grow their strategic ownership in a fast-moving environment. In this role, you will: Contribute to the product and marketing strategy for a defined area of OpenAI’s advertising business in partnership with senior product marketers and cross-functional partners. Build an understanding of advertisers through customer research, market analysis, and competitive insights, identifying opportunities to improve positioning, adoption, and the customer experience. Develop and maintain positioning and messaging for assigned products or fe
About the team OpenAI’s mission is to ensure the responsible and widespread adoption of artificial intelligence. In support of that mission, the Marketing team helps deeply understand customer audiences and market dynamics, influence the development of the right products, build sustainable and customer-aligned monetization models, and drive awareness, adoption, and usage across OpenAI’s products and platform. We take a data-driven approach to understand markets, develop monetization strategies, and uncover customer needs that shape product strategy and messaging. We partner closely with Sales, Partnerships, Product, Engineering, Research, Comms, and Design to deliver a cohesive end-to-end customer experience and lead go-to-market efforts for new product launches across channels. About the role We’re looking for a Product Marketing Manager, Advertising to bring together advertiser insights, market understanding, and product knowledge to shape positioning, inform product priorities, and deliver go-to-market initiatives that drive adoption and measurable business impact. You’ll work closely with Product, Engineering, Sales, and Partnerships to understand advertiser needs, translate complex AI capabilities into clear customer value, and bring new products and features to market. This role is ideal for someone who combines strategic thinking with hands-on execution, independently navigates ambiguity, and brings cross-functional partners together to deliver results. In this role you will: Define the product and marketing strategy for a component of OpenAI’s advertising business in partnership with cross-functional partners Develop a deep understanding of advertisers through customer research, market analysis, and competitive insights, identifying opportunities to improve positioning, adoption, and product-market fit. Own positioning and messaging for your product area, translating complex capabilities into compelling narratives for different advertiser audiences and use c
About the Team OpenAI’s mission is to ensure the responsible and widespread adoption of artificial intelligence. In support of that mission, the Marketing team helps deeply understand customer audiences and market dynamics, influence the development of the right products, build sustainable and customer-aligned monetization models, and drive awareness, adoption, and usage across OpenAI’s products and platform. We take a data-driven approach to understand markets, develop monetization strategies, and uncover customer needs that shape product strategy and messaging. We partner closely with Sales, Partnerships, Product, Engineering, Research, Comms, and Design to deliver a cohesive end-to-end customer experience and lead go-to-market efforts for new product launches across channels. About the Role As a Product Marketing Manager, Research & Safety , you will shape how the world understands OpenAI’s frontier research and our approach to developing AI responsibly. You will establish the strategic narrative for some of the company’s most important research themes—including frontier capabilities, safety, preparedness, reasoning, and compute—and translate complex technical work into clear, credible stories for researchers, policymakers, and the broader public, working with cross-functional teams to translate that messaging and reach developers and enterprise. Working closely with Research, Safety Systems, Policy, Communications, and Product teams, you’ll lead the go-to-market strategy and messaging for major research and safety initiatives. You’ll develop narratives that build trust, translating technical concepts into tangible artifacts and messaging, drive industry understanding of emerging evaluation frameworks, and help communicate OpenAI’s unique perspective on responsible frontier AI development. You’ll also identify creative and non-traditional ways to bring these stories to the audiences that matter most. In this role, you will: Establish the strategic narrative f
About the Team OpenAI’s mission is to ensure that general-purpose artificial intelligence benefits all of humanity. The Payments team works across product, engineering, design, and finance to build the financial infrastructure that makes OpenAI’s products accessible to consumers and enterprises around the world. As AI introduces new ways for people and organizations to work, the team is defining how to support and monetize emerging forms of product usage, from usage-based pricing to agentic work. We’re building the foundational systems that help OpenAI products deliver clear, reliable, and scalable payment experiences while ensuring that this powerful technology is deployed responsibly. About the Role In this role, you’ll lead design for one of OpenAI’s most foundational product areas: the payments and monetization infrastructure that supports our consumer and enterprise products. You’ll partner closely with product, engineering, and cross-functional teams to shape how customers understand, manage, and pay for entirely new kinds of AI usage. Your work will extend beyond traditional checkout and billing. You’ll help define the systems, frameworks, and experiences behind durable pay-as-you-go models, Codex usage, and agentic workflows, translating complex business and technical requirements into intuitive experiences. As a product designer in a highly ambiguous and rapidly evolving space, you’ll influence both product strategy and the underlying infrastructure that OpenAI products depend on. This role is based in our San Francisco HQ. We offer relocation assistance to new employees. In this role, you will: Lead the design direction for foundational payments, billing, and monetization experiences across OpenAI’s consumer and enterprise products. Design and ship high-quality, end-to-end product experiences, from early systems and interaction concepts to high-fidelity prototypes and production-ready designs. Shape the infrastructure and product frameworks that support em
About the Team The Applied AI Engineering team partners closely with customers to help them move from experimentation to production with OpenAI’s technologies. We act as trusted technical advisors, working across customer strategy, architecture, deployment, and adoption to help organizations realize meaningful impact from frontier AI. The Startups segment serves fast-moving, high-growth companies that are often building new products, workflows, and businesses directly on top of AI. These customers move quickly, operate with high ambiguity, and expect practical, creative, and technically rigorous partnership. About the Role We are looking for an Applied AI Engineering Manager, Startups to lead and scale the Startups Applied AI Engineering motion. This team helps high-growth startups move quickly from experimentation to production, unlock meaningful usage, and build durable technical partnerships with OpenAI. This leader will operate in a high-velocity customer segment where founders, CTOs, and technical teams expect speed, judgment, and hands-on problem-solving. They will balance team leadership, technical depth, customer prioritization, and cross-functional influence across Sales, Product, Engineering, Research, and broader go-to-market teams. In this role, you will define how OpenAI supports startup customers at scale: identifying where deep technical engagement can unlock outsized impact, building repeatable deployment mechanisms, and ensuring the team can serve a broad and dynamic customer base without losing quality or strategic focus. In this role, you will: Craft and continuously refine the strategic vision and operating model for the Startups Applied AI Engineering team, aligning it with OpenAI’s broader company objectives and the evolving needs of high-growth startup customers. Lead, mentor, and grow a team of high-performing technical ICs supporting startup customers across AI-native, developer-led, and product-led companies. Help startups move from early e
$200K – $240K/yr
About Sentry Software runs the world and the pace is faster than ever. Sentry helps developers fix errors and performance issues before users notice, so teams can spend less time firefighting and more time building. Trusted by 200,000+ organizations, Sentry is today’s application monitoring standard and our team is building its AI-native future. About the role The Platform org at Sentry is the engine that everything else runs on, spanning developer platform, core infrastructure underpinning the product, SRE, security, and IT. It's a broad, technically complex, and deeply consequential organization. We're looking for a Staff Technical Program Manager who can operate at the intersection of technical depth and strategic execution: someone who thrives in complexity, builds trust with senior engineering leaders, and has a gift for turning ambiguity into clarity and momentum. You'll report to the Head of Technical Program Management and work closely with the VP of Platform Engineering, their staff, and partner teams across Engineering, Product, and Design (EPD). This is a high-visibility role with real influence. You'll work directly with the CTO and senior leaders, shape how the Platform org operates, and help Sentry scale through one of its most important chapters. In this role, you will: Drive strategic execution. Partner with the VP of Platform Engineering and senior EPD leaders to translate priorities into clear, measurable plans. Own sequencing, milestones, and key decisions, and make sure leadership always has reliable visibility into progress and tradeoffs. Build data-driven delivery health. Establish the metrics and dashboards that reflect delivery confidence, risk, and engineering health across the Platform org. Keep planning and reporting high-signal and lightweight, focused on outcomes rather than activity. Manage capacity, dependencies, and risk. Create visibility into resourcing, cross-team dependencies, and constraints so leaders can align investment to the
Other cities to consider
More places hiring for this role
Get new inference engineering and product lead jobs in San Francisco, United States by email
Daily job updates · Unsubscribe anytime