Title: Senior AI QA Engineer Location: Bengaluru (Bangalore) Opportunity: As a Senior AI QA Engineer for our Precision Patient Care Pipeline , you will go beyond traditional functional testing. You will be responsible for building the framework that ensures our clinical insights are accurate, safe, and reliable. This role requires a unique blend of high-level software testing and data engineering to validate complex, non-deterministic medical outputs using a hybrid of automated grading methodologies . Key Responsibilities: Architect Multi-Layered Validation Frameworks: Design and implement structured testing strategies that combine deterministic checks, semantic similarity metrics, and model-based evaluations. Automated Model Grading: Develop systems to evaluate clinical pipeline outputs for faithfulness, safety, and hallucination detection using various automated scoring techniques (e.g., BERTScore, ROUGE, or custom heuristics). Vibe-Driven Development: Leverage agentic AI tools to rapidly prototype complex test harnesses, "red-team" clinical logic, and build internal validation utilities at high velocity. Data Pipeline Integrity: Execute integration and regression tests for data-heavy backend processes, ensuring medical data remains consistent from ingestion to insight generation. Collaborative Strategy: Work closely with Data Scientists and Product Managers to define "Ground Truth" datasets and clinical evaluation rubrics. Root Cause Analysis: Deep-dive into complex system failures to identify whether issues stem from code logic, data drift, or model behavior. Requirements: 6+ years of technical experience in Quality Assurance, with a strong focus on system architecture and backend data validation. Advanced Python Proficiency: Expert-level skills in Python for building custom test scripts and working within AI/ML ecosystems. AI/ML Validation Experience: Proven experience testing model outputs using diverse metrics (e.g., Semantic Similarity, NLP metrics, an
Salary not disclosed
Check market pay for comparable Engineering Manager roles before applying.
Role market pulse
How Engineering Manager demand looks in India
Live jobs
43
Posted 30d
27
30d movement
+68.8%
Remote share
4.7%
Salary listed
2.3%
Salary trend 1Y
Not enough history
Role overview
Job description
Everpure (NYSE: P) has evolved from storage pioneer to data platform, closing fiscal 2026 with $3.7 billion in revenue, its first billion-dollar quarter, and accelerating growth into FY27. Our strategic agenda spans the companies defining the next era of technology - hyperscalers, AI labs, the AI hardware supply chain, data platform providers, and the broader AI ecosystem. This type of work—work that changes the world—is what the tech industry was founded on. So, if you're ready to seize the endless opportunities and leave your mark, come join us. THE ROLE The next leap in enterprise Finance will not come from automating what we already do; it will come from making Finance intelligent — helping the Office of the CFO move from gatekeepers to growth catalysts with faster insight, stronger controls, and better decisions at enterprise scale. At Everpure, we do not layer AI on top of legacy w
…What they are looking for
Skills & requirements
Qualification
Production agentic AI: You've built, deployed, or operated production LLM, agentic AI, or AI-enabled workflow systems in Python, with strong experience in RAG, tool orchestration, structured outputs, memory management, evaluation, and production monitoring
Department · Finance
Hiring company
Everpure
We’re in an unbelievably exciting area of tech and are fundamentally reshaping the data storage industry. Here, you lead with innovative thinking, grow along with us, and join the smartest team in the industry. This type of work—work that changes the world—is what the tech industry was founded on. So, if you're ready to seize the endless opportunities and leave your mark, come join us.
Keep exploring
Similar active roles
Fresh roles matched to this title and market.
🔔 Get job alerts
New Senior Engineering Manager, Agentic AI for Finance jobs in Bengaluru, India, straight to your inbox.
No spam · Unsubscribe anytime