The NVIDIA PerfTech team is looking for a talented C++ Software Engineer to help build the next generation of AI-powered developer tools. You will apply strong C++ and software-engineering fundamentals while gaining hands-on experience with agentic workflows, retrieval systems, and AI services. In this role, you will contribute to Genie, NVIDIA’s company-wide AI knowledge and developer-productivity service. You will work across C++ tools and AI services to help engineers find information, understand complex systems, and work more effectively. What You’ll Be Doing: Develop production-quality C++ components, APIs, and integrations for NVIDIA’s AI-powered developer-tools ecosystem. Build capabilities connecting native C++ tools with Genie’s retrieval and agentic features. Contribute to agentic workflows, retrieval systems, ingestion pipelines, MCP tools, APIs, and enterprise integrations. Build benchmarks and improve retrieval quality, reliability, performance, and resource usage. Own features from investigation and design through implementation, testing, and delivery. Collaborate with graphics, software, and hardware teams developing performance-analysis and developer tools. What We Need to See: Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience. 5+ years of modern C++ programming skills gained through professional experience, internships, or substantial technical projects. Good understanding of data structures, algorithms, object-oriented design, multithreading, debugging, and testing. Ability and motivation to work across C++ systems and Python-based AI services. Familiarity with AI-powered applications, agentic workflows, retrieval systems, or related technologies. Abil
Salary not disclosed
Check market pay for comparable Senior AI Backend Engineer roles before applying.
Role overview
Job description
About the role: We are seeking a Senior Backend Engineer with deep backend engineering expertise and proficiency in one or more major programming languages (e.g., Python, Java, Go, Rust, or Kotlin), along with a strong understanding of AI models and agents. As a core member of our AI Engineering team, you will collaborate with data scientists, ML engineers, and product managers to build scalable, production-ready infrastructure and APIs that power intelligent systems. What you'll be doing: As a Senior Backend Engineer in the AI Engineering team, you will: Build and maintain reliable, scalable backend services to support AI agent execution and orchestration. Develop AI agent systems for complex operational workflows using LangChain, LangGraph, LiteLLM, and Langfuse. Orchestrate a hybrid model stack that includes OpenAI and Google Gemini alongside self-hosted and fine-tuned LLMs like Gem
…What they are looking for
Skills & requirements
Department · Engineering
Hiring company
K Health
Join The Team Modernizing AI-Enabled Care K Health is a leading AI-enabled clinical care company focused on managing large patient populations within health systems. The company provides high-quality primary care at scale, both virtually and in-person, and is expanding into specialties such as endocrinology and cardiology. Its health system partners include Mass General Brigham, Mayo Clinic, Northwell Health, Hartford HealthCare, Novant Health, Cedars-Sinai, Hackensack Meridian Health, Penn Medicine, and Atlantic Health along with additional health system partners yet to be announced. K Health's clinical AI has powered over 4 million patient visits, serving thousands of new users daily. Its offering includes PatientGPT, a clinical AI platform fully integrated with the health system, which engages with patients, grounds the clinical conversation in the medical record, and orchestrates a high-quality, efficient patient visit. K Health is headquartered in New York, NY, and has raised over $443.5M in venture capital since launching in November 2016. For more information, please visit khealth.com.
Keep exploring
Similar active roles
Fresh roles matched to this title and market.
🔔 Get job alerts
New Senior AI Backend Engineer jobs in Tel-Aviv, Israel, straight to your inbox.
No spam · Unsubscribe anytime