Inference Technical Lead Jobs

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE We’re looking for an experienced Executive Assistant to support our CRO and Head of Strategic Sales. This is a highly operational role that goes well beyond calendar management. You’ll own the day-to-day operating rhythm of the Sales organization, ensuring leaders are prepared, priorities stay coordinated, and critical meetings, communications, and follow-ups happen seamlessly. You’ll partner closely with senior sales leaders and serve as a trusted point of coordination for employees, customers, candidates, and external partners. Success in this role comes from exceptional organization, judgment, attention to detail, and the ability to keep many moving pieces aligned in a fast-growing environment. EA to CRO and Head of Strategic Sales Own complex calendar management for the CRO and Head of Strategic Sales, balancing shifting priorities while ensuring time is allocated intentionally Ensure leaders are prepared for every day and every meeting by proactively managing agendas, materials, context, logistics, and follow-ups so time is used effectively and decisions move forward Support forward-looking calendar planning, coordinating recurring operating cadences including pipeline reviews, leadership meetings, QBRs, Sales All Hands, and other cross-functional forums Partner with customers and external partners to coordinate executive meetings, visits, and other engagements Support executive inbox management, helping

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE Baseten's GTM org is in hyper growth. As it grows and matures, the needs of the GTM stack get more sophisticated with scale — and this team exists to stay ahead of those needs. This role owns a core set of the platforms the field runs on. You'll administer, configure, and continuously improve them, build AI and automation on top of the CRM to keep it clean and current, and run the adoption programs that make sure the field actually uses what we put in front of them. We're an AI-native company scaling fast, and we want to add sophistication without adding drag — you'll be the person deciding how much system is enough. This isn't a classic Salesforce admin role. You know the ecosystem, but you come at it as a builder and an orchestrator, not a ticket-taker. What You'll Walk Into Central RevOps is the systems and operations center of excellence for Baseten's GTM org. The stack includes Salesforce, Pylon, Outreach, Sales Navigator, Clay, and a growing set of AI-native GTM tools. The field is scaling fast, and the systems need to mature with it without slowing anyone down. You'll co-own Salesforce with our other GTM Systems Manager and work alongside a GTM Engineering team who builds internal AI products for GTM productivity — plus partner closely with sales leadership and the field. Responsibilities Own adminship, configuration, and enablement for Pylon, Gong, Sales Navigator, Outreach, and Prospect. These platfor

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE We're looking for a Web Designer / Design Engineer to own baseten.co day to day, from concept through production. You'll design and build landing pages, bring product launches to life, run experiments, improve conversion, and keep raising the quality bar on the site. This is a high-ownership role on the brand design team, sitting between brand design and frontend engineering. We want the website to be one of the best expressions of the Baseten brand and one of the best developer-focused sites on the internet, which means treating it as a product that's constantly evolving rather than something we redesign every few years. You'll have a lot of autonomy to ship, while partnering closely with brand, product marketing, engineering, and leadership on bigger launches. RESPONSIBILITIES Own the design and frontend implementation of the Baseten marketing site. Ship landing pages, product pages, launches, and campaigns from concept through production. Improve the site continuously, finding and acting on opportunities to make it better rather than waiting for a redesign cycle. Partner with growth and product marketing to test messaging, layouts, and conversion improvements without sacrificing craft. Build polished interactions, motion, and details that make the site feel distinctly Baseten. Build and evolve the components, patterns, and design systems that let the team move quickly without lowering the bar. Turn complex

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE Baseten's GTM org is in hyper growth. As it grows and matures, the needs of the GTM stack get more sophisticated with scale — and this team exists to stay ahead of those needs. Our GTM Engineering team plays a critical role in building and maintaining the connective tissue across Baseten’s GTM tools, processes, and user experience for the field. The GTM tooling landscape is changing fast, and the teams that win are the ones that adapt and iterate the fastest. This role exists to make sure Baseten is one of them. You'll design, build, and ship AI-powered workflows that scale our GTM functions as a competitive advantage. We want someone who can walk in, audit what we have, identify what we're missing, and start shipping fast. You know when to reach for Clay and when to build something custom in Claude Code. You think two to three steps ahead about how the thing you build today fits into the broader systems architecture tomorrow. And you bring a point of view — on our stack, on what we should be building, and on where AI can do something low-code tooling simply can't. RESPONSIBILITIES Ship AI-powered workflows for the field — build the agents and automations that give reps and managers real leverage, off-loading the manual and repetitive work. Reach for AI where it does something low-code can't. Get insights in front of reps — turn Salesforce, warehouse, and usage data into the dashboards, scores, and alerts reps

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE: Baseten is looking for a Workplace Coordinator to help run our San Francisco office and create an exceptional experience for everyone who works in or visits the space. You will work alongside our Office Manager and be at the center of the day-to-day operations of our largest and fastest-growing office. Over 200 employees are based in San Francisco today, and we expect that population to more than double over the next year. We are also expanding from one space into two additional nearby buildings, creating a campus-like footprint that regularly hosts visiting employees, candidates, customers, investors, and events. A major focus of this role is making our increasingly complex space work well. You will manage high demand for conference rooms and phone booths, anticipate competing needs, and make thoughtful tradeoffs based on team and business priorities. Like a great EA managing an executive’s calendar, you will constantly look ahead, spot conflicts, and adjust the puzzle. You’ll be part of a growing, highly collaborative team that works together to raise the bar for how we support Baseten. The team shares context, jumps in to support one another, and continuously looks for ways to improve how we operate. As Baseten grows, you’ll have opportunities to take on new challenges and expand your scope. This is an in-person role in San Francisco, expected to be in-office five days per week. RESPONSIBILITIES: Own front

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE: Are you the person on your team who builds the agent everyone else ends up using? We're looking for an AI Engineer to join our Training Product team and do that at Baseten. You'll build AI-driven product features for the customers training and post-training frontier models on our platform, and you'll raise the ceiling on how Baseten itself uses AI internally, turning manual workflows into agentic ones that make every other team faster. You'll work directly with our research engineers to scope and build products, taking ideas from a research loop that already works internally to something customers can run themselves. This is a hands-on role with real autonomy. You'll pick the problems worth solving, build the harnesses, execution flows, and guardrails that make AI systems reliable, and own the results. If you've been shipping agents and want that to be the job, let's talk. EXAMPLE INITIATIVES: Take a look at these blog posts written by members of our team: Baseten Training: an autoresearch substrate Introducing Baseten Loops Harnesses are everything. Here's how to optimize yours. Building with NVIDIA Nemotron 3 Ultra and LangChain Deep Agents Code on Baseten RESPONSIBILITIES: Build and ship agentic product experiences, including chat-style and assistant-like interfaces, from prototype to GA. Design the harnesses, execution flows, and guardrails that make AI systems reliable in production. Build internal autom

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. ABOUT THE ROLE As a Event Marketing Manager, you will lead the development and execution of regional marketing strategies to support sales goals, drive demand, and enhance brand awareness. This role requires a strategic thinker with a builder mentality that has a strong understanding of the New York tech ecosystem. RESPONSIBILITIES Develop and execute regional field marketing plans and programs to align with sales priorities and pipeline goals. Plan and manage events to drive demand, accelerate pipeline, and engage customers. Own program management, including event logistics, budget oversight, and vendor coordination. Analyze and report on campaign effectiveness, providing insights to optimize future initiatives. Collaborate with product marketing to align messaging and go-to-market strategies with field initiatives. Prioritize seller requests by expected revenue. Represent Baseten at industry events and build brand presence in-market. QUALIFICATIONS Bachelor’s degree in Marketing, Business, or related field. 5-7 years of experience in field marketing in the technology or SaaS industry. Proven track record in delivering and optimizing demand generation programs to meet pipeline goals. Strong understanding of sales processes. Proficiency with marketing tools such as Salesforce & Hubspot. Excellent project management skills with the ability to prioritize and execute multiple initiatives simultaneously. Collaborativel

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE We are seeking an experienced and proactive Security Engineer to help us build, maintain, and continuously improve the security posture of our rapidly growing ML infrastructure platform. As one of the first dedicated security hires at Baseten, you will work cross-functionally with engineering and operations teams to ensure we’re meeting the highest standards of confidentiality, integrity, and availability. You’ll have an opportunity to shape our security strategy and best practices from the ground up, influencing the way our platform handles sensitive data for both internal and external stakeholders. RESPONSIBILITIES Security architecture and design: Collaborate with engineering teams to design and implement secure systems and infrastructure, including cloud (AWS/GCP) environments and container orchestration platforms. Vulnerability management: Lead proactive vulnerability assessments, pen tests, and remediation efforts to ensure our products and infrastructure remain secure. Incident response: Develop and maintain incident response processes, including detection, analysis, containment, eradication, and post-incident reviews. Identity and access management (IAM): Oversee IAM strategies and tools to ensure the right people have the right level of access to our systems and data. Security compliance and audits: Work closely with operations to ensure compliance with relevant standards (e.g., SOC 2, ISO 27001) and

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE We are seeking an experienced and proactive Recruiter to help us grow our team. You will focus on hiring across our Sales team, collaborating closely with hiring managers and Sales leadership. This is a unique opportunity to build and scale the go-to-market recruiting function from the ground up—shaping strategies, processes, and candidate experience as we grow. Every hire you bring on board will play a direct role in building the future of ML infrastructure at Baseten. RESPONSIBILITIES Full-cycle recruiting: Own the hiring goals and recruiting process, from role kickoff through offer acceptance Sourcing excellence: Work closely with hiring managers to define what "excellent" looks like for a given role. Develop and execute sourcing strategies to build pipelines of highly qualified candidates, leveraging tools and creative outreach. Candidate experience: Ensure a smooth experience for every candidate, with clear communication and timely updates throughout the process Process improvements: Continuously refine and scale recruiting processes to increase efficiency, reduce time-to-fill, and improve quality of hire Data-driven insights: Track and analyze recruiting metrics (e.g., pipeline health, time-to-fill, conversion rates, acceptance rates) to inform strategies REQUIREMENTS 3+ years of full-cycle recruiting experience, preferably in a rapidly growing startup environment with big headcount goals Proven success

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE Are you passionate about advancing the application of artificial intelligence? We are looking for a Software Engineer focused on ML performance to join our dynamic team. This role is ideal for someone who thrives in a fast-paced startup environment and is eager to make significant contributions to the exciting field of LLM Inference. If you are a backend engineer who thrives on making things faster and is excited about open-source ML models, we look forward to your application. EXAMPLE INITIATIVES You'll get to work on these types of projects as part of our Model Performance team: Baseten Embeddings Inference: The fastest embeddings solution available The Baseten Inference Stack Driving model performance optimization RESPONSIBILITIES Implement, refine, and productionize cutting-edge techniques (quantization, speculative decoding, kv cache reuse, chunked prefill and LoRA) for ML model inference and infrastructure. Deep dive into underlying codebases of TensorRT, PyTorch, TensorRT-LLM, vllm, sglang, CUDA, and other libraries to debug ML performance issues. Apply and scale optimization techniques across a wide range of ML models, particularly large language models. Collaborate with a diverse team to design and implement innovative solutions. Own projects from idea to production. REQUIREMENTS Bachelor's, Master's, or Ph.D. degree in Computer Science, Engineering, Mathematics, or related field. Experience with one

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE As a Site Reliability Engineer at Baseten, you'll define and codify the gold standards of day 2 operations for our ML infrastructure platform. You'll envision and build robust systems, processes, automations, and observability tooling that keep our platform reliable at scale — and that empower the broader organization to operate confidently. You'll work closely with engineering, forward-deployed and product teams: learning from recurring failure patterns, turning tribal knowledge into automated mitigations, and raising the operational floor for the entire company. EXAMPLE INITIATIVES You'll work on projects like these as part of the SRE team: Improve Baseten SRE Practices, by instrumenting SLOs and SLIs, improving alerting and observability for all services. Building AI-assisted tooling for incident triage and response. RESPONSIBILITIES Own the reliability of Baseten's multi-cloud Kubernetes infrastructure, including incident response, post-mortems, and remediation tracking. Build and maintain observability infrastructure — metrics, logging, dashboards, and alerting — as code. Author, validate, and improve runbooks for recurring failure patterns, ensuring they're structured for low-context, safe execution. Identify high-frequency failure patterns and convert them into automated mitigations or self-healing automations. Diagnose and resolve runtime issues related to latency, memory behavior, GPU utilization, con

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. ROLE We're looking for a Solutions Product Marketing Manager to define and own Baseten's up-market, enterprise, and industries go-to-market strategy. You'll build the playbook that helps Baseten win large, complex deals and the vertical go-to-market strategies that let us compete in Financial Services, and Health & Life Sciences, and the use cases that scale across all of them. This is a highly cross-functional, largely greenfield role. You'll partner closely with the Industries sales team, product marketing, demand gen, and executive leadership to build on our enterprise go to market motion. RESPONSIBILITIES Enterprise Deal Playbook & Buyer Enablement Build the enterprise deal playbook and full bill of materials (BOM) — pricing guides, one-pagers, TCO/ROI guides, landing pages, and event/field collateral — mapped to every stage of the buyer's journey Build the system for keeping every sales asset current — clear ownership, last-updated dates, and a refresh cadence Develop industry-specific event concepts featuring anchor customers and AI-native accounts to build credibility with target executive audiences Vertical GTM & Industry Go-to-Market Kits Build vertical sales kits and ICP/positioning frameworks for priority industries Own industry-specific landing pages, messaging, and TCO guides, extrapolating from early AI-native accounts to larger enterprise targets Design and help launch an ABM experiments in p

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE We’re looking for an experienced Executive Assistant to support our CTO (co-founder) and Head of Engineering. This is a highly operational role that goes well beyond calendar management. You’ll own the day-to-day operating rhythm of the Engineering organization, ensuring leaders are prepared, priorities stay coordinated, and critical meetings, communications, and follow-ups happen seamlessly. You’ll partner closely with senior engineering leaders and serve as a trusted point of coordination for employees, customers, candidates, and external partners. Success in this role comes from exceptional organization, judgment, attention to detail, and the ability to keep many moving pieces aligned in a fast-growing environment. RESPONSIBILITIES Own complex calendar management for the CTO and Head of Engineering, balancing shifting priorities while ensuring time is allocated intentionally Ensure leaders are prepared for every day and every meeting by proactively managing agendas, materials, context, logistics, and follow-ups so time is used effectively and decisions move forward Support forward-looking calendar planning, coordinating recurring operating cadences including roadmap planning, leadership meetings, P0 reviews, Engineering All Hands, and other cross-functional forums Own the operational cadence of the Engineering organization, including weekly leadership meetings, monthly Show & Tells, Engineering All Hand

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. ROLE We’re looking for a high-performing strategic finance professional to join our growing GTM Finance team. Our business grows with our customers' usage, which makes the finance function highly strategic at Baseten: growth, pricing, margin, and capacity decisions are business model decisions. You'll sit at the center of them, partnering directly with GTM leadership and reporting into a finance team with a seat at the table for the calls that shape the company's trajectory. This role is ideal for someone with 3 to 7 years of experience across strategic finance, investing, and/or investment banking who wants broad exposure to company-building inside a fast-scaling AI infrastructure company. Experience at a usage-based software company is a plus. RESPONSIBILITIES Own financial planning, forecasting, and budgeting processes for the GTM org Build and maintain financial models across revenue, S&M spend, headcount, and strategic bets Analyze the metrics that define a usage-based business – ARR, gross margin, consumption trends, retention, and GTM efficiency Partner with GTM leaders to set targets, evaluate growth initiatives, shape pricing, and design sales compensation Help prepare board materials, investor updates, and fundraising analyses Improve financial reporting, dashboards, and operational rigor so our infrastructure scales as fast as our revenue Work cross-functionally to turn ambiguous business questions into

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE We’re looking for a high-performing strategic finance professional to join our growing Finance team. This role is ideal for someone with 3 - 4 years of experience across investment banking, venture capital, private equity and/or strategic finance who wants broad exposure to company-building inside a fast-scaling AI infrastructure company. Experience in strategic finance is a plus, but not required. You’ll work closely with Finance leadership and partner cross-functionally across the Finance leadership team. THE RESPONSIBILITIES Support company-wide financial planning, forecasting, and budgeting processes Build and maintain operating and financial models across revenue, infrastructure costs, hiring, and strategic initiatives Help prepare board materials, investor updates, and fundraising analyses Partner with business leaders to evaluate investments, acquisitions, pricing, growth initiatives, and operational tradeoffs Analyze consumption and infrastructure metrics including ARR, gross margin, usage trends, retention, and efficiency metrics Drive ad hoc strategic projects including market analysis and scenario planning Improve financial reporting processes, dashboards, and operational rigor as the company scales Act as key data and modeling lead on reporting and analysis Assist with finance operations, procurement, and vendor management as needed Work cross-functionally to turn ambiguous business questions into