Title: Senior AI QA Engineer Location: Bengaluru (Bangalore) Opportunity: As a Senior AI QA Engineer for our Precision Patient Care Pipeline , you will go beyond traditional functional testing. You will be responsible for building the framework that ensures our clinical insights are accurate, safe, and reliable. This role requires a unique blend of high-level software testing and data engineering to validate complex, non-deterministic medical outputs using a hybrid of automated grading methodologies . Key Responsibilities: Architect Multi-Layered Validation Frameworks: Design and implement structured testing strategies that combine deterministic checks, semantic similarity metrics, and model-based evaluations. Automated Model Grading: Develop systems to evaluate clinical pipeline outputs for faithfulness, safety, and hallucination detection using various automated scoring techniques (e.g., BERTScore, ROUGE, or custom heuristics). Vibe-Driven Development: Leverage agentic AI tools to rapidly prototype complex test harnesses, "red-team" clinical logic, and build internal validation utilities at high velocity. Data Pipeline Integrity: Execute integration and regression tests for data-heavy backend processes, ensuring medical data remains consistent from ingestion to insight generation. Collaborative Strategy: Work closely with Data Scientists and Product Managers to define "Ground Truth" datasets and clinical evaluation rubrics. Root Cause Analysis: Deep-dive into complex system failures to identify whether issues stem from code logic, data drift, or model behavior. Requirements: 6+ years of technical experience in Quality Assurance, with a strong focus on system architecture and backend data validation. Advanced Python Proficiency: Expert-level skills in Python for building custom test scripts and working within AI/ML ecosystems. AI/ML Validation Experience: Proven experience testing model outputs using diverse metrics (e.g., Semantic Similarity, NLP metrics, an
Senior AI & Agentic Engineer – Expression of Interest (Future Opportunities)
Salary not disclosed
Check market pay for comparable Senior AI and Agentic Engineer roles before applying.
Role overview
Job description
Expression of Interest – Future Opportunities We’re building a pipeline of talented professionals interested in future opportunities with Artefact. This posting is for resume collection and does not represent an immediate vacancy. We welcome you to share your resume, and our recruiting team may reach out as opportunities aligned with your experience become available. Who We Are Founded and headquartered in Paris, Artefact is a next-generation consulting firm, specializing in data, analytics & AI consulting, dedicated to transforming data into business impact across the entire value chain of organizations. We are proud to say that we help our clients grow their data and digital capabilities, and that we’re also growing in parallel. We have 2000 employees across 36 offices who are focused on accelerating digital transformation. Our state-of-the-art data technologies, lean AI agile methodol
…About this listing
- Listed from Artefact's careers site via Greenhouse · last confirmed on the source 19 Oct 2026
- Posted 4 Sept 2026
Jobiba does not charge job seekers. Never pay to apply or share OTPs, card or bank details.
What they are looking for
Skills & requirements
Qualification
Certifications in Azure, AWS, or similar technologies. Certifications in Databricks, Snowflake or similar technologies Experience in the leading large scale data engineering projects Why Join Us We are united by our values and strengthened by our hybrid expertise . There is always a way: We're from the breed of does, of diggers, of makers. Because ideas are valuable only if executed. Client trust is won on the field: Addressing client needs flows better hands on at their side. If not used, it is useless: Our love for technology translates into a steep desire for adoption, true brilliance is about impact. If not shared, our work is not done: Sharing knowledge is the best way to button up a mission, benefitting clients and colleagues. We learn everyday: Tech is a land where everything moves at the speed of light, you better be ready to challenge yourself.
Department · Data Engineering
Hiring company
Artefact
Global data and AI consulting company. From strategy to deployment: AI solutions by industry, data platforms, governance, analytics and data marketing.
Related opportunities
Similar active roles
Relevant, currently active roles for this market.
🔔 Get job alerts
New Senior AI & Agentic Engineer – Expression of Interest (Future Opportunities) jobs in North America, straight to your inbox.
No spam · Unsubscribe anytime