Inference Technical Lead Jobs

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute efficiency and density compared to today’s best-in-class solutions. The high-performance architecture is coupled with seamless software integration and will enable the immense potential of AI to be accessible in power, energy, and space constrained applications. EnCharge AI launched in 2022 and is led by veteran technologists with backgrounds in semiconductor design and AI systems. About the Role EnCharge AI is seeking a highly skilled and experienced AI Compiler Engineer to spearhead the efforts in developing and optimizing graph compilers tailored to cutting-edge AI and ML workloads. You will collaborate with hardware architects, and AI researchers to enhance performance, optimize computation graphs, and enable efficient model deployment on EnCharge’s Inference Accelerators. Responsibilities Architect, design, and implement optimizations for AI model execution on graph compilers to improve performance, reduce latency, and maximize hardware utilization. Work closely with ML researchers, hardware engineers, and software developers to design and deploy AI models, understanding and addressing hardware-specific challenges. Work on performance optimizations for neural network models, such as layer fusion, operator fusion, and graph-level transformations. Develop compiler optimizations and passes that convert high-level AI models (e.g., from TensorFlow, PyTorch) into intermediate representations (IR). Implement parsing, semantic analysis, and IR generation for deep learning frameworks. Research and integrate the latest advancements in compiler design, ML model optimizations, and hardware acceleration into graph compilers. Provide leadership, mentorship, and technical guidance to a team of engineers focused on graph compiler optimizations. Qual

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE As the Head of IT at Baseten, you will build, scale, and secure our internal technology function to support our rapid growth. Reporting to our Chief Information Security Officer, you will lead and mentor a team of 5+ IT engineers, leading the charge to transition Baseten from startup-era IT to a highly automated, enterprise-ready IT organization. You will take full ownership of corporate IT infrastructure, Helpdesk operations, corporate identity management, device lifecycles, and vendor procurement. As we scale to support the world’s most dynamic AI companies, you will ensure our internal systems scale seamlessly with our headcount, providing a secure, frictionless, and world-class technology experience for all Baseten employees. RESPONSIBILITIES Team Leadership: Manage, mentor, and grow a team of IT engineers, fostering a high-performance culture focused on technical excellence and end-user satisfaction. Helpdesk Operational Excellence: Build a fast-response support function by establishing clear response SLAs, tracking employee satisfaction metrics, and formalizing on-call and incident response processes. Zero-Touch Automation: Architect and implement automated employee onboarding, offboarding, and role-based access changes through deep integrations across HRIS, MDM, and IAM systems. SaaS Management & Procurement: Establish comprehensive SaaS management processes to eliminate shadow IT, automate access w

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE As an Outbound Sales Development Representative at Baseten, you'll drive strategic outbound into a defined set of target accounts - partnering closely with your Account Executive to research key decision-makers and break through via cold calls, email, and LinkedIn. Together, you'll turn cold accounts into qualified pipeline. RESPONSIBILITIES Build revenue pipeline by setting introductory meetings with potential businesses and key decision makers. Help influence Baseten's product roadmap for customers and prospects. Identify high-potential businesses and verticals and develop and execute outbound strategies to bring them to Baseten. Stay up-to-date on market trends, competition, and industry developments. Manage and document the progression of the sales pipeline. Drive pre- & post-engagement at industry events (will attend multiple events in person). REQUIREMENTS 1+ year of experience in a sales/lead generation role in a high-tech/SaaS company. Ability to develop strong, long-lasting relationships both internally and externally. Collaborative and coachable, always looking to improve your skills and impact. Ability to handle rejection and stay persistent in pursuing leads. Excellent verbal and written communication skills. A basic understanding of a standard SaaS seller's technical stack (CRM, Outreach/Salesloft, Prospect Research, etc.). Excellent time management, process, and prioritization skills. Preferr

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE Lead large-scale brand campaigns across digital, events, and out-of-home. Partner with engineering and product marketing on major product launches. Turn complex technical ideas into clear, compelling visual communication. Evolve the Baseten visual identity into a brand system that scales. Own projects end-to-end, from concept through launch, collaborating directly with marketing, product, engineering, and leadership. Shape our employer brand and help define how new hires experience Baseten. Raise the bar for craft across every customer touchpoint. ABOUT YOU You have a portfolio of exceptional work with outstanding visual craft and attention to detail. You care deeply about quality and sweat the details. You communicate ideas clearly and thrive in collaborative environments. You know when to build systems, not just execute on assets. You default to ownership and are comfortable leading highly cross-functional projects from concept through launch. You're excited by technical products and know how to make complex ideas feel consumable without oversimplifying them. You thrive in a fast-moving environment with a high bar for quality. You have strong opinions about design and can articulate why something works - and why it doesn't. BONUS Motion design and animation experience Experience designing for developers or highly technical audiences. BENEFITS Competitive compensation, including meaningful equity. 100% covera

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE As Manager (Player & Coach) of the Solution Architect team, you will lead and mentor a team of Solution Architects who will partner closely with Sales and customers to translate business needs into technical solutions, run technical discovery, and guide repeatable deployments and proofs of value for customers. Applying both hands-on technical ownership and managerial leadership, you will guide your team through the processes of owning discovery calls, demos, technical scoping and driving POC’s through to execution as well as designing, deploying, and managing high performance, low latency AI applications on Baseten’s platform. You will also partner with product, infrastructure, and other customer engineering teams to ensure that large language models (LLMs) and other generative AI systems deliver best-in-class performance, reliability, and cost efficiency in production environments. EXAMPLE INITIATIVES Take a look at these blog posts written by members of our Forward Deployed Engineering team: Forward Deployed Engineering on the frontier of AI The fastest, most accurate Whisper transcription Deploy production-ready model servers from Docker images Deploy custom ComfyUI workflows as APIs RESPONSIBILITIES Leadership Lead, mentor, and grow a team of Solution Architects, providing guidance on technical direction, project execution, and professional development. Set clear goals and ensure timely, high-quality d

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join: Guest Experience is responsible for Search and Discovery, Merchandising, and end-to-end online software experience worldwide from top-of-funnel discovery through post-booking engagement. We are looking for a talented Data Scientist to join the Guest Data Science team. This tech lead will be at the core of using AI and casual inference to understand user behavior in our app, detect underlying intent, and to build data products needed to provide a compelling and personalized experience of our app. We build products that help guests find the inventory most relevant to them in our marketplace. The Difference You Will Make: As a Senior Staff Data Scientist, you will lead innovation efforts to build methodologies to identify and evaluate the preferences important to every guest, at every step of their online discovery funnel. You will be instrumental in shaping our data strategy to drive guest conversion and regular engagement with the Airbnb platform across our Homes, Experiences and Services business verticals. This role emphasizes technical excellence and driving business impact with cutting-edge science. Your role will involve close collaboration with Product to identify in-product optimizations and shape UX design architecture to path how guests navigate from surface-to-surface in our app. The ideal candidate will demonstrate to be a domain expert with granular user behavior and sequence datasets in a marketplace setting. You will hold a high bar for our customer experience and balance a passion for AI with a strong desire to accurately understand user behavior and business suc

About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now. Our customers include category-defining companies like Lovable , Ramp , Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. We recently raised a $355M Series C at a $4.65B valuation, led by General Catalyst and Redpoint Ventures. We've crossed $300M+ ARR and grown fivefold since September. Our team includes creators of popular open-source projects (e.g., Seaborn , Luig i ), academic researchers, international olympiad medalists, and experienced engineering and product leaders About the Role We're hiring the first Account Managers at Modal. You'll report to the Regional Director of Account Management and be a founding member of the team. This function does not exist yet. There is no playbook, no territory map, no established motion. You'll own a book of business from day one and build the motion at the same time — from fast-moving AI startups to large enterprise teams running critical infrastructure on Modal. This is a commercial role with a revenue target. You'll be measured on retention and expansion across your accounts. While you won't be delivering the technical recommendations and implementation, the work is technical by nature. Our customers are engineers running GPU workloads, inference, and batch jobs in production, and you need to hold your own in those conversations. The profile we're hiring is a technical account manager. You've worked at companies that are deepl

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE We're hiring a Sales Development Manager to lead the team of SDRs generating pipeline for our North American sales org. You'll own the day-to-day leadership of the team — coaching reps, aligning with AEs and sales leadership, holding a high bar on execution, hiring, and building the systems that make the team consistently productive. Our market is new and evolves by the day, and our buyers are hyper-technical. Prospecting at Baseten means earning credibility with that audience, and coaching a team to do it at scale. The right person for this role is a coach and a builder — someone who gets energy from developing people, is obsessive about execution, and wants to define what world-class pipeline generation looks like when the product, the buyers, and the sales motion are all AI-native. RESPONSIBILITIES Lead, coach, and develop a team of SDRs responsible for opening doors with the next wave of Baseten customers. Own the team's pipeline generation targets and drive consistent execution against weekly, monthly, and quarterly goals. Build and refine outbound strategies, messaging, and frameworks across a wide range of accounts, tuned to a technical audience. Run 1:1s, team meetings, training, and pipeline reviews that make reps measurably better week over week. Partner with AEs and sales managers on account strategy, lead quality, and handoff processes. Analyze pipeline data to identify what's working, diagnose wha

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE We are seeking a Sales Manager to help lead a team of Strategic Account Executives. This person will be responsible for building and coaching a team of high-performing sales reps, driving revenue growth, and partnering closely with product and engineering to bring our cutting-edge AI infrastructure to customers. RESPONSIBILITIES Lead and mentor a team of Strategic Account Executives to consistently exceed pipeline and revenue goals. Help define and execution on go-to-market strategy for our fastest growing customer segment. Collaborate cross-functionally with Marketing, Product, and Engineering to align customer needs with Baseten’s product roadmap. Be deeply engaged with the product, enabling reps to have highly technical conversations with prospects and customers. Foster a culture of accountability, learning, and collaboration within the sales team. REQUIREMENTS 6+ years of closing sales experience, with 2+ years in management leading high-performing teams. Strong technical acumen, ideally with background in AI infrastructure, cloud infrastructure, or developer platforms. Comfortable operating in the weeds with technical products and guiding reps through complex deals. Proven track record of success in Strategic/Enterprise sales environments. Based in San Francisco or New York and open to coming in office at least 3 days per week (Tuesday-Thursday). BENEFITS Competitive compensation, including meaningful equ

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE: As a Solution Architect at Baseten you will partner closely with Sales and customers to translate business needs into technical solutions, run technical discovery, and guide repeatable deployments and proofs of value for customers. This role is a great fit for entrepreneurial, customer-facing technical professionals who want a front-row view into how modern companies adopt AI at scale, and who enjoy working across technical discovery, solution design, demos, deployment scoping, and hands-on customer implementations, in close partnership with Sales and Engineering. RESPONSIBILITIES: Partner with Sales on customer discovery calls (most often second calls, occasionally first calls for large accounts). Lead demos and technical scoping to align on success criteria, architecture, and deployment approach. Own benchmarking and repeatable deployments , including: Handling standard deployment patterns and configurations across many modalities – LLMs, embeddings, image and video generation, VoiceAI, etc. Advising on tradeoffs like H100s vs B200s and latency-optimized vs throughput-optimized setups. Driving consistent “playbook” style deployments for common models and use cases. Become a power user of different runtimes such as vllm, sglang, and TRT-LLM and all the common configurations and tradeoffs between them Drive POC and project execution , including: Scoping POCs and keeping stakeholders aligned on timeline, deliv

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE We are seeking a Sales Manager to help lead a team of Account Executives within our Startups segment. This hire will be responsible for building and coaching a team of high-performing sales reps, driving revenue growth, and partnering closely with product and engineering to bring our cutting-edge AI infrastructure to customers. RESPONSIBILITIES Lead and mentor a team of Startups Account Executives to consistently exceed pipeline and revenue goals. Help define and execution on go-to-market strategy for our fastest growing customer segment. Hire and scale the team by recruiting, interviewing, and onboarding top talent Collaborate cross-functionally with Marketing, Product, and Engineering to align customer needs with Baseten’s product roadmap. Be deeply engaged with the product, enabling reps to have highly technical conversations with prospects and customers. Foster a culture of accountability, learning, and collaboration within the sales team. REQUIREMENTS 4+ years of closing sales experience, with 2+ years in management leading high-performing teams. Strong technical acumen, ideally with background in AI infrastructure, cloud infrastructure, or developer platforms. Comfortable operating in the weeds with technical products and guiding reps through complex deals. Proven track record of success in high velocity sales environments. Based in San Francisco or New York City and open to coming in office at least 3 d

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. ABOUT THE ROLE We are seeking a strategic and creative Partnerships Product Marketing Manager to drive the success of our partner ecosystem. In this role, you will work closely with our partnerships team and with leading technology companies including NVIDIA, Cloud Hyperscalers, Neocloud providers, and emerging ecosystem players, to bring differentiated joint solutions to market. You will be responsible for shaping partner narratives, creating impactful content, and enabling joint go-to-market programs that amplify our reach. The ideal candidate combines storytelling skills, technical acumen, and the ability to collaborate across partner and internal teams. RESPONSIBILITIES Partner Storytelling & Content Develop compelling blog posts, white papers, solution briefs, and customer success stories highlighting the value of joint solutions. Translate technical integrations into clear, differentiated messaging for both technical and business audiences. Enablement & Training Build and deliver enablement programs to arm partner sales teams with the tools, messaging, and collateral they need to position and sell our solutions. Create sales playbooks and battlecards tailored to each partner’s ecosystem. Joint Go-to-Market Campaigns Plan and execute co-marketing campaigns with partners, including webinars, events, solution launches, and demand-generation activities. Manage partner marketing calendars and ensure alignment

Backend Engineer (Senior Level) - SDE IV We're looking for a Senior Backend Engineer to lead the architecture and evolution of backend services that deploy and serve machine learning models in production. You'll work closely with ML Engineers, Platform, and Product teams to build scalable, reliable systems and drive technical direction across multiple teams. What You’ll Do Design and drive the long-term architecture of backend services for biometrics and ML model serving. Collaborate with core platform and backend teams on organization-wide architectural initiatives. Partner with business and engineering teams to design and deliver cross-cutting platform capabilities. Lead architectural reviews, mentor engineers, and promote engineering best practices. Build and maintain backend services for deploying and serving ML models Monitor service reliability, performance, and scalability in production Deploy and operate services on AWS using ECS + Fargate, SageMaker, or EC2 + Kubernetes Support real-time and batch inference workflows Contribute to CI/CD pipelines and deployment automation What We’re Looking For Strong expertise in backend development using Java and working knowledge of Python. Experience mentoring engineers and driving architectural decisions. Working knowledge of Python, especially for ML-related workflows Hands-on experience with AWS (e.g., DynamoDB, ECS, EC2, Redis, S3, SageMaker) Familiarity with Terraform or other infrastructure-as-code tools, and experience with CI/CD and production monitoring Experience with observability tools (Datadog, New Relic, etc.) Experience with containers and orchestration (Docker, ECS, etc.) Understanding of how ML models are deployed and served in production Experience with Kubernetes Nice to Have Experience with MLOps or ML platform engineering. Experience with asynchronous programming and event-driven systems. Jumio Values: IDEAL: Integrity, Diversity, Empowerment, Accountability, Leading Innovation Equal Opportunities :

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE We're looking for an exceptional Motion Designer to help bring the Baseten brand to life. This will be a defining role on the brand design team. You'll shape the motion language for Baseten and bring it to life across everything from product launches and social video to huge out-of-home campaigns, events, web, and experimental brand work. We're building a brand in a market that's moving fast, and we want the work to feel just as ambitious. This isn't a role focused on turning out one-off animations or supporting an existing system - you'll help define and build the system, push it into places we haven’t thought about, and set the bar for motion across the company. You'll partner closely with brand, product, marketing, and leadership to turn technical ideas into work that's clear, distinctive, and memorable. RESPONSIBILITIES Define and evolve the motion language for the Baseten brand. Create high-craft motion work across product launches, social, campaigns, web, events, and out-of-home. Concept and produce video content that makes highly technical products feel compelling. Think at every scale, from a five-second social clip to a Times Square takeover. Partner with brand designers to bring identity systems, typography, illustration, and product storytelling to life through motion. Experiment with new formats, tools, techniques, and emerging technology to push the brand into unexpected places. Build motion syste

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE Baseten is looking for a Product Designer to help shape the next generation of our platform. You'll join a small design team with a lot of ownership and a high bar for craft, working across the entire Baseten product to solve hard problems for technical users. This role covers the full arc of the work: early exploration through production. You'll establish patterns that show up across the product, evolve our design system, and raise the quality bar as we scale. RESPONSIBILITIES Lead product design end to end, including research, product definition, prototypes, design reviews, specs, and final implementation. Work directly with engineering and product to frame problems, explore solutions, and ship quickly. Collaborate with customers to understand their workflows, validate ideas, and test prototypes. Push the visual and interaction quality of the Baseten product across surfaces. Create interactions and details that make complex technical workflows feel clear, fast, and polished. Evolve our design system and establish patterns that scale across a growing product. Look across the product for opportunities to improve consistency, usability, and overall quality. Get into the code with engineers to polish UI and make sure the shipped experience matches the design. Help shape how the design team works and raise the bar for product quality across the company. REQUIREMENTS A portfolio that demonstrates strong visual and