Title: Senior AI QA Engineer Location: Bengaluru (Bangalore) Opportunity: As a Senior AI QA Engineer for our Precision Patient Care Pipeline , you will go beyond traditional functional testing. You will be responsible for building the framework that ensures our clinical insights are accurate, safe, and reliable. This role requires a unique blend of high-level software testing and data engineering to validate complex, non-deterministic medical outputs using a hybrid of automated grading methodologies . Key Responsibilities: Architect Multi-Layered Validation Frameworks: Design and implement structured testing strategies that combine deterministic checks, semantic similarity metrics, and model-based evaluations. Automated Model Grading: Develop systems to evaluate clinical pipeline outputs for faithfulness, safety, and hallucination detection using various automated scoring techniques (e.g., BERTScore, ROUGE, or custom heuristics). Vibe-Driven Development: Leverage agentic AI tools to rapidly prototype complex test harnesses, "red-team" clinical logic, and build internal validation utilities at high velocity. Data Pipeline Integrity: Execute integration and regression tests for data-heavy backend processes, ensuring medical data remains consistent from ingestion to insight generation. Collaborative Strategy: Work closely with Data Scientists and Product Managers to define "Ground Truth" datasets and clinical evaluation rubrics. Root Cause Analysis: Deep-dive into complex system failures to identify whether issues stem from code logic, data drift, or model behavior. Requirements: 6+ years of technical experience in Quality Assurance, with a strong focus on system architecture and backend data validation. Advanced Python Proficiency: Expert-level skills in Python for building custom test scripts and working within AI/ML ecosystems. AI/ML Validation Experience: Proven experience testing model outputs using diverse metrics (e.g., Semantic Similarity, NLP metrics, an
Salary not disclosed
Check market pay for comparable Senior Agentic AI Engineer roles before applying.
Role overview
Job description
About the Role We are building a new class of clinical-grade AI agents powered by a foundational model that unifies 3D volumetric medical data and textual reasoning . These agents will assist with radiology workflows, treatment planning, case summarization, longitudinal patient analysis, and human-in-the-loop clinical decision support. In this role, you will design the agent layer that transforms a powerful multimodal foundation model into a safe, reliable, adaptive medical assistant capable of analyzing 3D scans, retrieving past cases, explaining findings, and coordinating multi-step reasoning chains. This position is ideal for researchers from multimodal/VLM/CLIP ecosystems who want to move up the stack into autonomous medical reasoning , multimodal alignment, and real-world clinical impact. What You Will Work On Architect LLM-driven medical agents capable of: Reading & interpreting 3D
…About this listing
- Listed from SAIGroup's careers site via Greenhouse · last confirmed on the source 19 Oct 2026
- Posted 9 Sept 2026
Jobiba does not charge job seekers. Never pay to apply or share OTPs, card or bank details.
What they are looking for
Skills & requirements
Qualification
What You Will Work On Architect LLM-driven medical agents capable of: Reading & interpreting 3D medical volumes (MRI, CT, PET); What We’re Looking For Experience developing LLM-based agents, tool-using models, chain-of-thought systems, or orchestrated pipelines
Department · Product- Concert AI
Hiring company
SAIGroup
View the company profile, current openings and hiring details.
Related opportunities
Similar active roles
Relevant, currently active roles for this market.
🔔 Get job alerts
New Senior Agentic AI Engineer — Agentic Medical AI jobs in Bengaluru, KARNATAKA, India, straight to your inbox.
No spam · Unsubscribe anytime