Llm Infrastructure Engineer Jobs

About UltaHost UltaHost is a fast-growing global web hosting and cloud infrastructure company delivering high-performance, reliable, and scalable technology solutions to customers worldwide. Since our founding in 2018, we have grown rapidly across global markets, supporting…

Unlike complex hyperscalers or ephemeral edge/serverless solutions, Render offers a developer-first experience with persistent compute, dynamic autoscaling, built-in orchestration, and observability, allowing teams to launch, scale, and manage real-world appl

About Decagon Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences. Our technology enables industry-defining enterprises like Avis Budget Group, Block’s Cash App and Square, Chime, Oura Health, and Hunter Douglas to…

Software Engineer, Compute Infrastructure at Render in United States. Full-time · Remote · $170K – $290K/yr.

Software Engineer, Infrastructure (all levels) at Render in United States. Full-time · Remote · $170K – $290K/yr.

At its core, Glean is redefining how enterprises find, use,

About the Team The Workload team is responsible for designing and running OpenAI’s LLM training and inference infrastructure that powers frontier models at massive scale. Our systems unify how researchers train and serve models, abstracting away the complexity of performance,…

Software Engineer, AI/ML Infrastructure at Glean in Mountain View, California, United States. Full-time · On-site · From $175K/yr.

With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their lap

Distributed LLM Inference Engineer at Anyscale in San Francisco. Full-time · Remote · $170K – $245K/yr.

NVIDIA DGX Cloud builds large-scale GPU infrastructure that powers the world’s most demanding AI workloads. Our Bare Metal Infrastructure team owns the software that turns newly racked hardware into reliable, validated production capacity. We’re looking for a software engineer…

NVIDIA is at the forefront of the generative AI revolution, building the software and systems that power the world’s most advanced large language model workloads. We are looking for a Software Engineer focused on bring-up, triage, benchmarking, analysis, and optimization of…

About the Team and Role: We are hiring a senior/staff software engineer to help design and build core components of our next-generation knowledge retrieval system built for the AI era – search and retrieval infrastructure that powers high-qua

Senior/Staff Software Engineer, Search & Retrieval Infrastructure at Pinecone in United States. Full-time · Remote · $190K – $270K/yr.

About us Sierra is the leading platform for customer-facing AI agents, working with many of the world's biggest brands — including The GAP, Rocket Mortgage, SoFi, Sutter Health, and SoftBank — to transform how they serve customers and grow their businesses. We are primarily an…