Title: Senior AI QA Engineer Location: Bengaluru (Bangalore) Opportunity: As a Senior AI QA Engineer for our Precision Patient Care Pipeline , you will go beyond traditional functional testing. You will be responsible for building the framework that ensures our clinical insights are accurate, safe, and reliable. This role requires a unique blend of high-level software testing and data engineering to validate complex, non-deterministic medical outputs using a hybrid of automated grading methodologies . Key Responsibilities: Architect Multi-Layered Validation Frameworks: Design and implement structured testing strategies that combine deterministic checks, semantic similarity metrics, and model-based evaluations. Automated Model Grading: Develop systems to evaluate clinical pipeline outputs for faithfulness, safety, and hallucination detection using various automated scoring techniques (e.g., BERTScore, ROUGE, or custom heuristics). Vibe-Driven Development: Leverage agentic AI tools to rapidly prototype complex test harnesses, "red-team" clinical logic, and build internal validation utilities at high velocity. Data Pipeline Integrity: Execute integration and regression tests for data-heavy backend processes, ensuring medical data remains consistent from ingestion to insight generation. Collaborative Strategy: Work closely with Data Scientists and Product Managers to define "Ground Truth" datasets and clinical evaluation rubrics. Root Cause Analysis: Deep-dive into complex system failures to identify whether issues stem from code logic, data drift, or model behavior. Requirements: 6+ years of technical experience in Quality Assurance, with a strong focus on system architecture and backend data validation. Advanced Python Proficiency: Expert-level skills in Python for building custom test scripts and working within AI/ML ecosystems. AI/ML Validation Experience: Proven experience testing model outputs using diverse metrics (e.g., Semantic Similarity, NLP metrics, an
Jobs in India
Model Behavior Engineer Manager Manager Manager Manager in India
15 active opportunities · Updated September 2026
Showing
15 jobs
Explore current model behavior engineer manager manager manager manager jobs across India. Filter by work mode, employment type, experience, department, date posted and distance.
AI Engineer - Enterprise Search Overview We are looking for an experienced Enterprise Search Lead to build and optimize our multi-tenant enterprise search solution. This role focuses on creating scalable systems that integrate seamlessly with customer environments, leveraging cutting-edge AI and ML technologies. You will design and manage the enterprise knowledge graph, implement personalized search experiences, and drive AI- powered innovations to enhance search relevance and ITSM workflows. What You Will Do: Build and structure our enterprise knowledge graph to organize content, people, and activity into meaningful relationships for better search relevance. Develop and refine personalized ranking models that adapt to user behavior and improve search results over time. Design ways to adapt AI language models to each customerʼs data for enhanced accuracy and context. Explore innovative methods to combine LLMs with search engines for answering complex queries Write clean, robust, and maintainable code that integrates smoothly with multi-tenant systems. Collaborate with cross-functional teams to align search capabilities with ITSM workflows. Mentor junior engineers or learn from experienced ones to grow as a technical leader. What You Should Have 3-5 years of experience working on enterprise search products with AI/ML integration. Expertise in multi-tenant systems and securely integrating with external customer systems. Hands-on experience with tools like Elasticsearch, Solr, or similar search platforms. Strong coding skills in Python, Java, or equivalent languages. A passion for solving complex problems with AI and delivering intuitive user experiences. Important notice for candidates: Job scams are on the rise. Please keep these guidelines in mind when applying for any open roles at Atomicwork. Only apply through official Atomicwork channels. We do not use third-party agencies or individuals who ask for payments in exchange for interviews or offer letter
Staff Engineer - Enterprise Search Overview We are looking for an experienced Enterprise Search Lead to build and optimize our multi-tenant enterprise search solution. This role focuses on creating scalable systems that integrate seamlessly with customer environments, leveraging cutting-edge AI and ML technologies. You will design and manage the enterprise knowledge graph, implement personalized search experiences, and drive AI-powered innovations to enhance search relevance and ITSM workflows. What You Will Do Build and structure our enterprise knowledge graph to organize content, people, and activity into meaningful relationships for better search relevance. Develop and refine personalized ranking models that adapt to user behavior and improve search results over time. Design ways to adapt AI language models to each customer’s data for enhanced accuracy and context. Explore innovative methods to combine LLMs with search engines for answering complex queries. Write clean, robust, and maintainable code that integrates smoothly with multi-tenant systems. Collaborate with cross-functional teams to align search capabilities with ITSM workflows. Mentor junior engineers or learn from experienced ones to grow as a technical leader. What You Should Have 5+ years of experience working on enterprise search products with AI/ML integration. Expertise in multi-tenant systems and securely integrating with external customer systems. Hands-on experience with tools like Elasticsearch, Solr, or similar search platforms. Strong coding skills in Python, Java, or equivalent languages. A passion for solving complex problems with AI and delivering intuitive user experiences. Important notice for candidates: Job scams are on the rise. Please keep these guidelines in mind when applying for any open roles at Atomicwork. Only apply through official Atomicwork channels. We do not use third-party agencies or individuals wh
About the Team OpenAI’s Applied AI Engineering team helps organizations turn frontier AI capabilities into safe, reliable, and high-impact production systems. We work with customer executives, product and engineering teams, security leaders, and transformation teams to identify valuable opportunities, accelerate technical implementation, and scale what works. Enterprise deployments are defined by complexity rather than any one industry: existing architectures, diverse data environments, security and governance requirements, multiple stakeholder groups, and organization-wide change. We turn lessons from these deployments into better products and reusable patterns for customers everywhere. About the Role As an Applied AI Engineer you will partner directly with leading organizations to design, build, and deploy AI systems that deliver measurable business outcomes. You will combine deep technical judgment, hands-on engineering, and customer leadership to take ambitious ideas from use-case selection and architecture through prototyping, evaluation, production launch, and scale. You will write and debug code, build evaluation systems, resolve complex integrations, and guide decisions involving model behavior, reliability, latency, cost, safety, security, governance, and operational readiness. Success is measured by production systems, sustained adoption, and meaningful customer impact—not simply activity or successful demonstrations. This is a rare opportunity to work on consequential real-world deployments at the frontier of AI while directly influencing how OpenAI’s products evolve. This role can be based in Delhi, Mumbai or Bangalore. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees In this role, you will: Partner directly with enterprise customers to identify high-value opportunities and translate them into technical architectures, implementation plans, evaluation strategies, and measurable success criteria.
At Dscout, we’re building the most flexible and powerful UX research platform on the market—trusted by the world’s top brands in finance (JP Morgan Chase, Intuit, Charles Schwab, PayPal), healthcare (Aya, Headspace), consumer goods (Keen, Verizon, Target, Northface), and tech (Google, Amazon, Facebook, Meta, Spotify, AirBnB). Our tools help teams deeply understand the humans behind their products, so they can build better ones. We are expanding our smart and driven team and would love for you to join us. Building AI-native products is a different problem than building deterministic software: the same input won't always produce the same output. Good product engineering here means designing experiences that stay useful, trustworthy, and easy to understand even when the AI underneath doesn't behave the same way twice — and knowing when that's a product design problem, not just a model problem. We're looking for a Software Engineer with 2-7 years of experience who thinks like a product owner, not just an implementer. You're comfortable being handed a vague, half-formed problem and figuring out what's actually worth building. You default to empathy for the researcher or participant on the other end of the screen, and you'd rather ship something real and learn from it than wait for a perfect spec. You're fluent enough with modern LLM-based systems to build good product experiences on top of them, even if tuning the model itself isn't your job. What you'll do Own end-to-end delivery of product features — from an ambiguous problem statement to shipped, working software real researchers and participants use Partner directly with Product and Design to help define what should be built, not just how to build it Use our design system to make sound, independent calls on smaller UX and interaction decisions, and know when a change is big enough to loop Design in Build the product surfaces (web app flows, dashboards, in-product controls) that make AI-driven behavior understand
At Dscout, we’re building the most flexible and powerful UX research platform on the market—trusted by the world’s top brands in finance (JP Morgan Chase, Intuit, Charles Schwab, PayPal), healthcare (Aya, Headspace), consumer goods (Keen, Verizon, Target, Northface), and tech (Google, Amazon, Facebook, Meta, Spotify, AirBnB). Our tools help teams deeply understand the humans behind their products, so they can build better ones. We are expanding our smart and driven team and would love for you to join us. AI native product is fundamentally different engineering problem than building deterministic software: the same input won't always produce the same output, and "working" means the agent behaves well across the full distribution of real world scenarios, not that it passes a fixed test suite. We're looking for an Applied AI Engineer with 2-5 years of experience building and shipping AI systems used by professionals at enterprise. You're comfortable working with modern LLM-based systems and agentic workflows, and you know how to turn powerful models into reliable product features. You have strong product judgment and think deeply about tradeoffs between LLM approaches and traditional ML when designing solutions. You care about evaluation, iteration speed, and making sure AI systems actually drive measurable business impact reliably . What you'll do Own the production improvement loop across agent behavior, customer and operator feedback, evaluation, experimentation, and verified business outcomes Instrument agent workflows so model interactions, tool use, decisions, failures, human edits, and downstream outcomes can be understood in context Define meaningful quality standards, representative evaluation datasets, regression coverage, and production monitoring. Investigate why agents underperform across context, knowledge, instructions, tools, routing, guardrails, or workflow design Design and ship targeted behavior improvements, including changes to prompting, cont
Job Title: Senior QA Engineer - Performance Testing Paytm is India's leading mobile payments and financial services distribution company. A pioneer of the mobile QR payments revolution in India, Paytm builds technologies that empower small businesses with payments and commerce solutions. Paytm’s mission is to serve half a billion Indians and bring them into the mainstream economy through the power of technology. About the Role: We are seeking a skilled Performance Test Engineer to design, execute, and analyze performance tests to ensure application scalability, stability, and responsiveness under varying load conditions. The ideal candidate will have hands-on experience with industry-standard performance testing tools and a strong understanding of system architecture, monitoring, and troubleshooting. Expectations/ Requirements Develop comprehensive performance test strategies and plans aligned with system requirements, project timelines, and business goals. Understand application architecture and identify critical business transactions for performance validation. Design realistic workload models to simulate real-world usage scenarios. Create, maintain, and execute performance test scripts using tools such as JMeter, LoadRunner, Gatling, or similar. Conduct baseline, load, stress, and scalability testing to evaluate system behavior under different conditions. Monitor system performance using tools like Influx DB, Grafana, JVM monitoring tools, and MAT (Memory Analyzer Tool). Analyze test results to identify performance bottlenecks and system limitations. Collaborate with development and infrastructure teams to troubleshoot and resolve performance issues. Assess system scalability and recommend optimizations to improve performance and reliability. Generate detailed performance test reports, including metrics, findings, and actionable recommendations. Work with stakeholders to gather and validate Non-Functional Requirements (NFRs), SLAs, and KPIs. Perform API an
WPP is the trusted growth partner for the world’s leading brands. We unite cutting-edge media intelligence and data solutions, world-class creativity, next-generation production, transformative enterprise solutions and expert strategic counsel in a single company – powered by exceptional talent and our agentic marketing platform, WPP Open, to help our clients navigate change, capture opportunity and deliver transformational growth. We work with the world's most valuable brands and have global reach across 100+ markets, with deep local expertise. Our people are the key to our success. We're committed to fostering a culture of creativity, belonging and continuous learning, attracting and developing the brightest talent, and providing exciting career opportunities that help our people grow. For more information, visit WPP.com. Why we're hiring: The Automation Engineer is responsible for designing, developing, and maintaining security automation solutions that enhance detection, response, workflow efficiency, and operational consistency across Operational Security. Working under the Automation Lead, this role builds high-quality SOAR playbooks, integrations, scripts, AI-assisted workflows, and orchestration pipelines to reduce manual workloads and support the Autonomic Security Operations (ASO) model. What you'll be doing: Core Responsibilities Automation Engineering & Development Develop SOAR playbooks, workflows, and automations for alert triage, enrichment, containment, and remediation. Build scalable, reusable automation components, scripts, and integrations. Implement high-quality scripting using Python, PowerShell, and REST APIs. Ensure appropriate version control, QA, testing, and documentation of automation artefacts. Maintain reliability of automations by monitoring performance, exceptions, and system behaviour. Platform Integration & Tooling Engineering Integrate SOAR with SIEM, EDR, TIP, cloud-native secur
NVIDIA has been redefining computer graphics, PC gaming, and accelerated computing for more than 25 years. Today, we are tapping into the unlimited potential of AI to define the next era of computing. As an NVIDIAN, you will address challenges spanning architecture, silicon, firmware, software, and production — and excellent judgment matters as much as technical depth! Every major NVIDIA silicon product family—from the chips powering AI and datacentre systems to gaming, professional, embedded, and automotive platforms—passes through our productization work on its way to production. NVIDIA’s Silicon Co-Design Productization team works from pre-silicon strategy and feature development through bring-up, characterization, correlation, and optimization. Our charter spans power & performance modelling, bring up & tuning of low-power features, power & thermal controllers , and system-level optimization that ultimately shape how NVIDIA products are configured, binned, specified, and shipped. What you'll be doing Drive silicon power productization from pre-silicon planning through bring-up and production, including test strategy, feature readiness, characterization, and optimization. Partner with architecture and design teams to identify improvements, validate features, and help translate them into production-ready solutions. Correlate measured silicon behaviour with pre-silicon expectations, investigate gaps, and drive complex issues to root cause. Build power and performance models and characterization methodologies that decide silicon binning, product specifications, productization decisions, and customer guidance. Use AI/ML and data-driven methods to analyse characterization & telemetry data, identify anomalies & trends , and accelerate issue debug across silicon, board, power delivery, firmware,
Level Up Your Career with Zynga! At Zynga, we bring people together through the power of play. As a global leader in interactive entertainment and a proud label of Take-Two Interactive, our games have been downloaded over 6 billion times—connecting players in 175+ countries through fun, strategy, and a little friendly competition. From thrilling casino spins to epic strategy battles, mind-bending puzzles, and social word challenges, our diverse game portfolio has something for everyone. Fan-favorites and latest hits include FarmVille™, Words With Friends™, Zynga Poker™, Game of Thrones Slots Casino™, Wizard of Oz Slots™, Hit it Rich! Slots™, Wonka Slots™, Top Eleven™, Toon Blast™, Empires & Puzzles™, Merge Dragons!™, CSR Racing™, Harry Potter: Puzzles & Spells™, Match Factory™, and Color Block Jam™—plus many more! Founded in 2007 and headquartered in California, our teams span North America, Europe, and Asia, working together to craft unforgettable gaming experiences. Whether you're spinning, strategizing, matching, or competing, Zynga is where fun meets innovation—and where you can take your career to the next level. Join us and be part of the play! Position Overview : Zynga’s data science and analytics team uses our unique and expansive data to model and predict user behavior, making our games more personalized and more fun to play! We strive for a better understanding of our players which translates into challenges and features that delight them and increased social engagement within our games. Here’s where you would come in: identify and formalize problems to understand user behavior. Create systems and analyses to derive insights that change the studio’s world view. Be innovative, be creative, use every bit of that key commodity – data. Millions of people play Zynga games every day, so our data is tremendously rich and we have a lot of it! We will rely on you to communicate your findings to your peers – both technical and non-technical. Your solutions t
About Us Paytm is India’s leading payments Super App, offering consumers and merchants a wide range of financial services. A pioneer of the mobile QR payments revolution, Paytm’s mission is to bring half a billion Indians into the mainstream economy through technology-led financial inclusion. Paytm Money is the wealth-tech arm of Paytm, enabling users to invest in mutual funds, equities, and derivatives seamlessly. Owned by One97 Communications, founded by Vijay Shekhar Sharma, the company is headquartered in Noida and backed by leading global investors. Role Overview We are looking for a strategic, business-oriented, and AI-forward Analytics Leader to drive data-led and AI-powered decision-making for Paytm Money across equities, mutual funds, and derivatives. This role will define and lead the analytics vision across user growth, trading behavior, portfolio analytics, customer lifecycle, monetization, and product experience, while partnering closely with Product, Growth, Business, Risk, and Engineering teams to scale Paytm Money’s wealth platform. The ideal candidate will bring deep expertise in financial markets, broking platforms, and investment products, along with strong experience in building scalable analytics functions. In addition, this leader should have worked intensively on AI-led modeling, predictive decision systems, AI adoption across analytics workflows, and data models designed for advanced analytics and machine learning use cases. This is not just a reporting or dashboarding role. It is a leadership role focused on building a proactive, predictive, and AI-enabled analytics engine that helps the business make faster, sharper, and more scalable decisions. Key Responsibilities 1. Analytics Strategy, AI Vision & Business Impact · Define and own the analytics and decision intelligence roadmap aligned with Paytm Money’s growth, engagement, and revenue goals. · Translate business problems across acquisition, activation, trading behavior, retention,
Envoy Global is a proven innovator in the global immigration space. Our mission combines our industry-leading tech platform with holistic service to streamline, simplify and expedite the immigration process for employers and individuals. As a Product Designer, you will partner with Product Managers to turn user problems and desired outcomes into clear user journeys, testable experiences, and practical design direction. You will work closely with Product and Engineering from early problem framing through implementation, using rapid prototypes to clarify decisions, expose gaps, and improve the product experience. This is a hands-on, early-career role for a designer who combines strong UX and product thinking with visual judgment and prototyping fluency. The role also owns the quality and continuity of clickable product demos and selected product storytelling. As our Product Designer, you will be required to: Partner with Product Managers to frame user problems, clarify desired outcomes, challenge assumptions, and identify what needs to be learned before a solution is committed. Translate problems and outcomes into user journeys, task flows, interaction models, and testable experience concepts. Build rapid, AI-assisted prototypes using Figma, Figma Make, Lovable, or comparable tools, selecting the lightest approach that can answer the question at hand. Explore and communicate multiple design approaches, gather feedback, and iterate quickly rather than treating the first proposed screen as the answer. Maintain and evolve the persistent clickable product demo so that priority workflows remain current, coherent, visually credible, and easy to present. Create and update demo scenarios for Sales and stakeholder conversations when the production product does not yet tell the intended product story clearly. Produce clear development reference and handoff material, including annotated flows, states, edge cases, interaction behavior, and required assets. Partner with Engi
TEGNA Inc. helps people thrive in their local communities by providing the trusted local news and services that matter most. With 64 television stations in 51 U.S. markets, TEGNA reaches more than 100 million people monthly across web, mobile apps, streaming, and linear television, while also maintaining a strong global presence in India with offices in Bangalore and Chennai that support technology, product, and business operations initiatives. Together, we are building a sustainable future for local news. Position Overview TEGNA is looking for a Senior Data Analyst is seeking a skilled and forward-thinking CloudEngineer to join our growing technology team. We are a demand-side platform (DSP) helping advertisers and agencies programmatically reach their target audiences at scale. We are looking for a Senior Data Analyst to drive insights across advertiser performance, audience quality, and supply-side partnerships — going beyond surface-level reporting to uncover the stories that data tells. In this role, you will work at the intersection of data, engineering, and data science — collaborating closely with our engineering team to maintain data integrity and with our ML team to translate model outputs into business intelligence. You will analyse how audiences behave across our platform, evaluate the quality and efficiency of inventory sources, develop forecasts that help advertisers and internal teams plan with confidence, and surface actionable intelligence that helps our advertisers deliver better outcomes while growing the overall business. What You’ll Do • Analyse audience behaviour and segment performance to help advertisers improve targeting efficiency, reach, and campaign ROI across programmatic channels. • Evaluate supply-side inventory quality — assessing publisher segments, bid stream data, win rates, and CPM trends — to inform smarter buying decisions and supply curation strategi
Quantitative Researcher Every trading strategy begins with a question worth answering. At Graviton, we believe the best trading strategies don't come from following established playbooks. They come from asking better questions. Why does a pattern exist? What is driving it? Is it real or just noise? Can it be explained, modelled and turned into an edge? As a Quantitative Researcher , you'll work on these questions every day. You'll investigate market behaviour, develop quantitative models, build and test hypotheses and turn insights into trading strategies. You'll work alongside quantitative researchers and technologists in an environment where research moves quickly from an idea on a whiteboard to something that can influence live trading. The problems are open-ended. The data is enormous. The answers aren't in a textbook. You'll be expected to find them. What You'll Work On You'll work across different areas of quantitative research and systematic trading. Depending on your team and research interests, your work may include: Discovering predictive patterns and sources of alpha from billions of market events . Formulating hypotheses about market behaviour and designing experiments to test them. Applying probability, statistics, optimization and machine learning to complex research problems. Building predictive models and quantitative signals for systematic trading. Developing and improving research infrastructure that enables faster experimentation and deeper analysis. Working with large and complex datasets to uncover patterns that aren't immediately visible. Designing robust backtests and statistical tests to distinguish genuine signals from noise. Investigating market microstructure and understanding how markets behave at different timescales. Evaluating strategy performance, identifying weaknesses and continuously refining models. Working closely with technologists to translate research ideas into efficient, production-ready systems. Building AI-powered r
Zscaler (NASDAQ: ZS) accelerates digital transformation so customers can be more agile, efficient, resilient, and secure. The Zscaler Zero Trust Exchange™️ platform protects thousands of customers from cyberattacks and data loss by securely connecting users, devices, and applications in any location. Distributed across 160+ public exchanges globally and thousands of private exchanges at the edge, the SASE-based Zero Trust Exchange is the world’s largest in-line cloud security platform. We believe the future of work is Human + AI and are building an AI-native enterprise where human potential is amplified by machine intelligence to solve the world’s hardest security challenges. Driven by deep customer obsession, we are committed to the mission, outcome, and to each other. We bring these commitments to life through three core behaviors: ownership and collaboration, trust through outcomes and impact, and a challenge culture with ongoing feedback. Ready to make an impact at the company pioneering security transformation in the AI era? Join us at Zscaler. Role We are looking for a Senior Business System Analyst to join our team. This is a remote position within India reporting directly to the Director, CRM & PRM Applications in the IT Business Apps department. In this pivotal role, you will act as a strategic link between business goals and technical execution, leading the design and delivery of scalable Sales Cloud / Experience Cloud solutions. You will partner deeply with cross-functional teams to translate complex GTM requirements into high-impact systems that drive efficiency and growth. What you’ll do (Role Expectations) Serve as a process and systems leader with deep ownership of how GTM strategy is operationalized across tools, workflows, and data models Propose and lead initiatives to implement new processes and optimize existing technologies and methodologies that enhance GTM experience and simplification Lead business and functional requirements while
Other cities to consider
More places hiring for this role
Get new model behavior engineer manager manager manager manager jobs in India by email
Daily job updates · Unsubscribe anytime