Model Validation Senior Manager Jobs

Who We Are Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier access to the world around us—that’s why we’re building a universal autonomy platform: self-driving for all roads and all rides. Founded in 2016, Nuro is a physical AI company developing Level 4 autonomous driving technology for a wide range of vehicles, use cases, and markets. Powered by the Nuro Driver™, our universal autonomy platform enables the global mobility ecosystem to deploy autonomy at scale—from robotaxis and logistics fleets to personal vehicles. With years of real-world deployment experience and a flexible, partner-led business model, Nuro is working toward a future where millions of autonomous vehicles powered by our technology help make everyday life safer, easier, and more connected. Nuro has raised over $2B in capital from Uber, NVIDIA, Google, Softbank, Fidelity, T. Rowe Price, and other leading investors. About the Role Nuro's autonomous vehicle platform has to work - not just in the easy cases, but in the hard ones. The ones we design for, simulate at scale, and deliberately break to understand. We're looking for a Senior/Staff Systems Engineering TPM who owns the technical substance of how we validate autonomy: what we test, why we test it, and whether our coverage actually means something. This is not a planning or scheduling role. You'll work embedded with Autonomy, Simulation, and Systems Engineering teams to drive the technical rigor behind our validation program — defining scene sets, structuring fault injection campaigns, and ensuring our simulation coverage is meaningful, traceable, and systematically growing. The program infrastructure is owned elsewhere; your job is to make sure what's inside it is technically sound. About the Work Scenario & Coverage Strategy Understanding the taxonomy of challenging scene sets used for auto

The HR Shared Services Compensation operations senior associate combines analytical rigour with a service-orientated mindset. They will be comfortable working in the details of HR systems and cases while also understanding the broader impact of compensation data and decisions on employees, managers, payroll, reporting, and business operations. We are looking to speak to candidates who are based in Gurugram for our hybrid working model. Key Responsibilities You will play a vital role in processing the backend transactions related to general compensation questions or tasks, along with making sure that the relevant SLA’s are met Review and process requests related to job architecture, job codes, career levels, compensation tiers, pay ranges, compa-ratio, salary positioning, bonus eligibility, and other compensation-related fields in the HRIS Pull ad hoc compensation reports, review data for accuracy and completeness, and help summarize basic findings for the compensation team and business partners Assist with program documentation, supporting records, data integrity, audit readiness, and compliance materials Partner with Compensation, HR Business Partners, Recruiting, Payroll, HRIS, Finance, and regional People Teams to investigate issues, resolve discrepancies, and coordinate end-to-end completion of transactions Adhere to and demonstrate high proficiency in agreed critical metrics & SLAs Create, maintain, and improve standard operating procedures, knowledge articles, checklists, process maps, and case-handling guidance for compensation processes Perform data validation, reconciliation, and quality-control checks across SuccessFactors, case-management tools, payroll inputs, compensation planning files, and downstream reporting systems Expected Skills Experience for 4+ years in HR Operations / Shared Services in an HR Shared Services role (EMEA and Americas) Strong Excel or spreadsheet skills, including data validation, lookups, filters, pivot tables, reconciliatio

Title: Senior AI QA Engineer Location: Bengaluru (Bangalore) Opportunity: As a Senior AI QA Engineer for our Precision Patient Care Pipeline , you will go beyond traditional functional testing. You will be responsible for building the framework that ensures our clinical insights are accurate, safe, and reliable. This role requires a unique blend of high-level software testing and data engineering to validate complex, non-deterministic medical outputs using a hybrid of automated grading methodologies . Key Responsibilities: Architect Multi-Layered Validation Frameworks: Design and implement structured testing strategies that combine deterministic checks, semantic similarity metrics, and model-based evaluations. Automated Model Grading: Develop systems to evaluate clinical pipeline outputs for faithfulness, safety, and hallucination detection using various automated scoring techniques (e.g., BERTScore, ROUGE, or custom heuristics). Vibe-Driven Development: Leverage agentic AI tools to rapidly prototype complex test harnesses, "red-team" clinical logic, and build internal validation utilities at high velocity. Data Pipeline Integrity: Execute integration and regression tests for data-heavy backend processes, ensuring medical data remains consistent from ingestion to insight generation. Collaborative Strategy: Work closely with Data Scientists and Product Managers to define "Ground Truth" datasets and clinical evaluation rubrics. Root Cause Analysis: Deep-dive into complex system failures to identify whether issues stem from code logic, data drift, or model behavior. Requirements: 6+ years of technical experience in Quality Assurance, with a strong focus on system architecture and backend data validation. Advanced Python Proficiency: Expert-level skills in Python for building custom test scripts and working within AI/ML ecosystems. AI/ML Validation Experience: Proven experience testing model outputs using diverse metrics (e.g., Semantic Similarity, NLP metrics, an

As a Manager in our ISV Practice, you will lead a team of Forward Deployed Engineers working directly with independent software vendors (ISVs) and their engineering organizations. The team builds MongoDB capabilities inside partner products and turns successful engagements into reusable patterns for future partner engagements. You will lead the people, priorities, and operating model that enable the team to deliver production-oriented solutions with partners. This role combines people leadership, technical judgment, partner engagement, and cross-functional execution. We are looking to speak to candidates who are based in Gurugram for our hybrid working model. What you’ll do at MongoDB Lead, coach, develop, hire, onboard, and retain a team of Forward Deployed Engineers while creating a high-performing and inclusive engineering culture Set priorities and allocate capacity across multiple partner engagements, enabling the team to work effectively in parallel Establish a repeatable engagement model from qualification through build, validation, documentation, and handoff, ensuring partners provide the context, access, technical counterparts, and release path needed for delivery Guide the team in building production MongoDB integrations, application capabilities, migration approaches, deployment patterns, and operational guidance while maintaining a high bar for quality, readiness, security, performance, observability, resilience, and supportability Ensure engagements produce reusable architectures, implementation patterns, tooling, documentation, and lessons learned that accelerate future partner engagements and benefit the wider organization Coordinate with Solutions Architecture, Solution Validation, Technical Services, Sales, Product, Engineering, and partner stakeholders on scope, ownership, technical contribution, validation, handoff, escalation, and support boundaries Engage directly with strategic partners when senior technical or leadership involvement is needed

About Ubiquiti At Ubiquiti Inc., we create technology platforms for Businesses, Smart Homes, and Internet Service Providers, driven by our goal to connect everyone, everywhere. To date, Ubiquiti has shipped over 100 million devices worldwide, from ISP networking products to next generation of IT solutions. Our growth is made possible by the dedicated team of hundreds behind the scenes. From software developers and product managers to designers and strategists, Team UI is driven to achieve our common goal: Rethinking IT. At Ubiquiti, you’ll heighten your potential and broaden your horizons - all while shaping the future of connectivity. We’re looking for a Senior AI/Computer Vision Engineer to build AI systems end to end, from defining the problem and data requirements to training models, validating them, deploying on edge devices, and integrating them into C++ pipelines. This is a hands-on engineering role for someone who can take applied AI projects from concept to production and is comfortable working across modeling, evaluation, deployment, and system integration. Responsibilities: Own AI and computer vision projects end to end, from technical definition to production deployment; Translate product needs into system, data, model, and evaluation requirements; Define data collection, annotation, and validation strategies; Train and optimize deep learning models for real-world vision and multimodal applications; Build testing, benchmarking, and failure analysis workflows; Optimize models for edge devices with attention to latency, memory, throughput, and accuracy tradeoffs; Integrate models into production inference systems, including C++ edge pipelines; Work closely with software and product teams to ship reliable AI features at scale. Requirements: MS or PhD in Computer Science, Electrical Engineering, or a related field, or equivalent practical experience; Strong Python skills; Solid experience with PyTorch, TensorFlow, or similar frameworks; 4+ years of expe

About Ubiquiti At Ubiquiti Inc., we create technology platforms for Businesses, Smart Homes, and Internet Service Providers, driven by our goal to connect everyone, everywhere. To date, Ubiquiti has shipped over 100 million devices worldwide, from ISP networking products to next generation of IT solutions. Our growth is made possible by the dedicated team of hundreds behind the scenes. From software developers and product managers to designers and strategists, Team UI is driven to achieve our common goal: Rethinking IT. At Ubiquiti, you’ll heighten your potential and broaden your horizons - all while shaping the future of connectivity. We’re looking for a Senior AI/Computer Vision Engineer to build AI systems end to end, from defining the problem and data requirements to training models, validating them, deploying on edge devices, and integrating them into C++ pipelines. This is a hands-on engineering role for someone who can take applied AI projects from concept to production and is comfortable working across modeling, evaluation, deployment, and system integration. Responsibilities: Own AI and computer vision projects end to end, from technical definition to production deployment; Translate product needs into system, data, model, and evaluation requirements; Define data collection, annotation, and validation strategies; Train and optimize deep learning models for real-world vision and multimodal applications; Build testing, benchmarking, and failure analysis workflows; Optimize models for edge devices with attention to latency, memory, throughput, and accuracy tradeoffs; Integrate models into production inference systems, including C++ edge pipelines; Work closely with software and product teams to ship reliable AI features at scale. Requirements: MS or PhD in Computer Science, Electrical Engineering, or a related field, or equivalent practical experience; Strong Python skills; Solid experience with PyTorch, TensorFlow, or similar frameworks; 4+ years of expe

Who We Are At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto trading and decentralized crypto applications (dApps). OKX is also a trusted brand by hundreds of large institutions seeking access to crypto markets. We are safe and reliable, backed by our Proof of Reserves. Across our multiple offices globally, we are united by our core principles: We Before Me , Do the Right Thing , and Get Things Done . These shared values drive our culture, shape our processes, and foster a friendly, rewarding, and diverse environment for every OK-er. OKX is part of OKG, a group that brings the value of Blockchain to users around the world, through our leading products OKX, OKX Wallet, OKLink and more. What You’ll Be Doing Independent review and challenge of fraud risk assessments conducted by 1 LoD, including RCSA validation, control effectiveness testing, and escalation of identified gaps to senior management Oversight and quality assurance of incident documentation, ensuring completeness, accuracy, and alignment with BCB regulatory standards; contribution to the BCB 260 annual fraud report Regulatory SLA oversight for participant fraud investigation requests: review 1 LoD responses for adequacy, flag deficiencies, and ensure timely escalation where SLAs are at risk BCB 343 compliance monitoring of 24-hour fraud event registrations and monthly declarations submitted by 1 LoD Independent assessment of BCB-directed investigations: evidence review, challenge of 1 LoD findings, and preparation of formal regulatory responses AML interface: independent identification and escalation of fraud patterns with potential money laundering indicators to the Compliance/AML function Ongoing independent monitoring of the Dynamic Deposit Limit scoring model and Eagle Eye controls, including periodic effectiveness reviews and r

The IT SaaS Engineering Team plays a critical role in optimizing MongoDB sales processes, streamlining customer interactions, and maximizing the efficiency of our sales efforts. By leveraging Salesforce, the team ensures that business users have the tools, automation, security, and governance needed to effectively manage customer relationships, support operational processes, and drive business growth. With deep expertise in Salesforce administration, platform governance, automation, and system operations, the team continuously enhances the Salesforce CRM platform to meet evolving business needs. The team partners closely with stakeholders across Sales Operations, Revenue Operations, Security, Compliance, and Engineering to deliver scalable, secure, and reliable Salesforce solutions. We are looking to speak to candidates who are based in Gurugram for our hybrid working model. What you’ll do We are looking for a Senior Salesforce Administrator to manage and enhance the Salesforce CRM system supporting MongoDB’s Sales organization Effectively work both autonomously and collaboratively across Salesforce platform administration, configuration, release support, security, and audit-related activities Work closely with Tech Leads, Program Managers, Developers, DevOps teams, and Business Stakeholders to understand requirements and deliver scalable declarative solutions Contribute across multiple functions including platform administration, CI/CD participation, release support, access governance, security improvements, and audit readiness Ensure appropriate controls, documentation, and governance practices are followed to maintain a strong and effective control environment Responsibilities Administer, configure, and maintain the Salesforce platform, including users, roles, profiles, permission sets, sharing settings, page layouts, record types, and other core administrative functions Build and enhance Salesforce solutions using declarative tools such as Flows, Validation Rule

About the Role: Tubi is seeking a highly skilled and experienced Senior QA Automation Engineer to lead quality assurance initiatives for our cutting-edge streaming and AI-driven product features. This pivotal role involves ensuring exceptional end-to-end user experiences, robust streaming playback, and the accuracy and integrity of our AI/ML features across web, mobile, and OTT platforms. We're looking for a candidate with a strong background in streaming QA and deep technical knowledge of media workflows. You'll be instrumental in collaborating with engineering, product, and data science teams to define comprehensive QA strategies that guarantee both functional excellence and data-level quality. This is a hybrid role based out of our Toronto office. You must be willing to travel to our Toronto office three days/week. What You'll Do: Design and lead test strategies for streaming workflows, playback systems, and AI-powered features. Test across platforms (web, mobile, and connected TV) to ensure functional parity and playback stability. Validate streaming performance—including ABR logic, encoding pipelines, and DRM integrations—under diverse real-world conditions. Debug with precision using tools like Charles Proxy, Chrome DevTools, ADB, and Xcode. Collaborate with data and ML teams to validate AI model updates, recommendations, and personalization accuracy. Leverage AI-assisted QA tools to enhance regression coverage, UI validation, and anomaly detection. Contribute to automation and CI/CD frameworks, driving faster, more reliable releases. Help drive a shift-left testing approach by engaging early in the software development lifecycle, partnering with product managers, engineers, and data scientists to identify quality risks, define test strategies, and ensure testability during requirements and design phases. Oversee QA deliverables for multiple concurrent releases and ensure seamless sign-off for production launches. Monitor live environments for playback or reco

Principal Consultant (Senior Manager) – Trade & Transaction Reporting Location: Edinburgh or Glasgow | Practice Area: Finance, Risk, Regulatory & Financial Crime | Type: Permanent Shape the future of global regulatory reporting transformation The Role Capco is seeking a Principal Consultant (Senior Manager) to join our Trade & Transaction Reporting capability within the Finance, Risk, Regulatory & Financial Crime (FRRF) practice. This role is suited to someone with strong regulatory reporting expertise and proven experience delivering complex, multi-jurisdictional transformation programmes. You'll work with leading global financial institutions to implement regulatory change, strengthen reporting controls, and optimise reporting operating models across regimes including EMIR Refit, MiFIR, SFTR, CFTC, MAS, and HKMA. You'll also leverage approved AI tools and AI-enabled ways of working to improve analysis, accelerate delivery, and enhance reporting quality while applying responsible AI practices and appropriate human oversight. What You'll Do Lead and deliver trade and transaction reporting transformation initiatives across multiple global regulatory regimes, identifying opportunities to leverage AI-enabled workflows and automation to improve reporting quality and operational efficiency. Support regulatory implementation, remediation, and control optimisation across EMIR Refit, MiFIR, SFTR, CFTC, MAS, HKMA, and other reporting frameworks, translating regulatory requirements into practical business solutions. Analyse and enhance reporting architectures, data lineage, reconciliations, and data quality frameworks, using AI-enabled analytics where appropriate to improve transparency, traceability, and regulatory compliance. Guide the implementation of regulatory reporting platforms and RegTech solutions while ensuring appropriate governance, validation, and oversight where AI-assisted capabilities are utilised. Build strong client relationship

Principal Consultant (Senior Manager) – Trade & Transaction Reporting Location: London or Edinburgh (Hybrid) | Practice Area: Finance, Risk, Regulatory & Financial Crime | Type: Permanent Shape the future of global regulatory reporting transformation The Role Capco is seeking a Principal Consultant (Senior Manager) to join our Trade & Transaction Reporting capability within the Finance, Risk, Regulatory & Financial Crime (FRRF) practice. This role is suited to someone with strong regulatory reporting expertise and proven experience delivering complex, multi-jurisdictional transformation programmes. You'll work with leading global financial institutions to implement regulatory change, strengthen reporting controls, and optimise reporting operating models across regimes including EMIR Refit, MiFIR, SFTR, CFTC, MAS, and HKMA. You'll also leverage approved AI tools and AI-enabled ways of working to improve analysis, accelerate delivery, and enhance reporting quality while applying responsible AI practices and appropriate human oversight. What You'll Do Lead and deliver trade and transaction reporting transformation initiatives across multiple global regulatory regimes, identifying opportunities to leverage AI-enabled workflows and automation to improve reporting quality and operational efficiency. Support regulatory implementation, remediation, and control optimisation across EMIR Refit, MiFIR, SFTR, CFTC, MAS, HKMA, and other reporting frameworks, translating regulatory requirements into practical business solutions. Analyse and enhance reporting architectures, data lineage, reconciliations, and data quality frameworks, using AI-enabled analytics where appropriate to improve transparency, traceability, and regulatory compliance. Guide the implementation of regulatory reporting platforms and RegTech solutions while ensuring appropriate governance, validation, and oversight where AI-assisted capabilities are utilised. Build strong client relationships whi

Principal Consultant – Cyber & Operational Resilience Location: London (Hybrid) | Practice Area: Finance, Risk, Regulatory & Financial Crime | Type: Permanent Strengthen cyber resilience and safeguard critical operations across financial services The Role Capco is seeking experienced Principal Consultants to join our Cyber & Operational Resilience capability within the Finance, Risk, Regulatory & Financial Crime (FRRF) practice. You'll work with senior stakeholders across financial services organisations to design and deliver cyber resilience strategies, implement robust resilience frameworks, and enhance operational resilience capabilities. This role combines strategic advisory with hands-on delivery, helping clients strengthen cyber risk management, meet evolving regulatory expectations, and build resilient operating models. You'll also leverage approved AI tools and AI-enabled ways of working to enhance analysis, improve delivery, and generate data-driven insights while applying responsible AI practices and appropriate human oversight. What You'll Do Deliver cyber and operational resilience transformation programmes aligned to regulatory frameworks such as PRA, DORA, and other global resilience standards, identifying opportunities to leverage AI-enabled workflows and automation. Assess and enhance cyber resilience capabilities, including resilience frameworks, operating models, controls, and governance, using AI-enabled analysis where appropriate to strengthen decision-making and operational effectiveness. Support third-party and vendor risk assessments, identifying vulnerabilities across supply chains and technology ecosystems while combining AI-enabled insights with expert judgement. Design and implement resilience governance, Important Business Services (IBS), Impact Tolerance (ITOL), scenario testing, and reporting frameworks, ensuring robust governance, validation, and oversight where AI-assisted tools are utilised. Collaborate with technolog

Principal Consultant (Senior Manager) – Operational Resilience & Cyber Risk Location: Edinburgh or Glasgow (Hybrid) | Practice Area: Finance, Risk, Regulatory & Financial Crime | Type: Permanent Build resilience where it matters most across cyber, technology, and third-party risk The Role Capco is seeking experienced Principal Consultants in Operational Resilience and Cyber Risk to join our growing Finance, Risk, Regulatory & Financial Crime (FRRF) capability. In this senior role, you'll lead complex client engagements across financial services and energy, advising on regulatory expectations such as PRA and DORA while driving the design and implementation of robust resilience frameworks. You'll play a key role in shaping client strategy, leading transformation programmes, and contributing to capability growth. You'll also leverage approved AI tools and AI-enabled ways of working to enhance analysis, accelerate insight generation, and improve delivery while applying responsible AI practices and appropriate human oversight. What You'll Do Lead operational resilience assessments, scenario testing, and control implementation programmes, identifying opportunities to leverage AI-enabled workflows and automation to strengthen resilience outcomes. Advise clients on regulatory readiness across PRA, DORA, and other resilience frameworks, translating regulatory expectations into practical transformation strategies and sustainable operating models. Oversee cyber risk, third-party risk, and vendor resilience assessments, using AI-enabled analytics where appropriate to strengthen risk identification, prioritisation, and decision-making. Design and implement governance models, dashboards, Important Business Services (IBS), Impact Tolerance (ITOL), and reporting frameworks, ensuring robust governance, validation, and oversight where AI-assisted tools are utilised. Lead cyber and technology resilience transformation initiatives, including tooling, cloud secu

Principal Consultant (Senior Manager) – Operational Resilience & Cyber Risk Location: London (Hybrid) | Practice Area: Finance, Risk, Regulatory & Financial Crime | Type: Permanent Build resilience where it matters most across cyber, technology, and third-party risk The Role Capco is seeking experienced Principal Consultants in Operational Resilience and Cyber Risk to join our growing Finance, Risk, Regulatory & Financial Crime (FRRF) capability. In this senior role, you'll lead complex client engagements across financial services and energy, advising on regulatory expectations such as PRA and DORA while driving the design and implementation of robust resilience frameworks. You'll play a key role in shaping client strategy, leading transformation programmes, and contributing to capability growth. You'll also leverage approved AI tools and AI-enabled ways of working to enhance analysis, accelerate insight generation, and improve delivery while applying responsible AI practices and appropriate human oversight. What You'll Do Lead operational resilience assessments, scenario testing, and control implementation programmes, identifying opportunities to leverage AI-enabled workflows and automation to strengthen resilience outcomes. Advise clients on regulatory readiness across PRA, DORA, and other resilience frameworks, translating regulatory expectations into practical transformation strategies and sustainable operating models. Oversee cyber risk, third-party risk, and vendor resilience assessments, using AI-enabled analytics where appropriate to strengthen risk identification, prioritisation, and decision-making. Design and implement governance models, dashboards, Important Business Services (IBS), Impact Tolerance (ITOL), and reporting frameworks, ensuring robust governance, validation, and oversight where AI-assisted tools are utilised. Lead cyber and technology resilience transformation initiatives, including tooling, cloud security, and control enhanceme

Opportunity Overview: As the Sr. Manager, Applied Science, you will play a key role in building and scaling Cohere Health's AI capabilities. You'll lead a team of Applied Scientists focused on developing, evaluating, and deploying models that automate and augment complex clinical and administrative workflows. This team is responsible for the full lifecycle of applied machine learning from problem framing, rigorous attention to methods and experimentation, to partnering with AI Engineering to deploy and monitor models. You'll work with structured and unstructured healthcare data to generate insights and power intelligent systems that improve prior authorization and broader clinical decision-making. As a player-coach, you'll combine hands-on technical contributions with team leadership, helping to establish best practices, mentor team members, and drive high-impact solutions in close partnership with Product, Engineering, Clinical, and Analytics stakeholders. This is an opportunity to shape both the technical direction and team culture within a growing global organization. This is a remote-first role that may require travel to Boston, MA for new hire onboarding and occasional in-person team meetings and company events. What you'll do: Lead, mentor, and develop a team of Applied Scientists, fostering a collaborative, high-performance environment Translate complex healthcare business and clinical problems into scalable machine learning and data science solutions Validate those solutions with methodological and statistical rigor to assure that our Clinical AI is reliable, reproducible, and safe Partner with AI Engineering to scale those solutions to create real healthcare impact! Partner cross-functionally with Clinical Operations, Product, Engineering, and platform teams to align technical research and validation work with business priorities Communicate technical concepts, methodologies, and insights clearly to both technical and non-technical stakeholders Contri