Test And Evaluation Lab Tech Jobs

Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Data Scientist II Role Overview Build and productionize enterprise-grade AI and Generative AI solutions for Mastercard. This role combines strong software engineering with model fine-tuning, Databricks-based ML engineering, AWS deployment, and end-to-end MLOps. Key Responsibilities Design, develop, test, and maintain scalable AI/ML applications, APIs, and reusable engineering components. Fine-tune and evaluate foundation models using techniques such as LoRA, QLoRA, PEFT, and supervised fine-tuning. Build RAG solutions, embeddings workflows, vector-search applications, and AI agents. Create end-to-end ML pipelines for data preparation, training, evaluation, deployment, monitoring, and retraining. Use Databricks, PySpark, MLflow, Unity Catalog, Workflows, Vector Search, and Model Serving for governed model development and operations. Implement CI/CD, automated testing, observability, model monitoring, and production support practices. Partner with data science, engineering, product, security, privacy, and governance teams to deliver reliable and responsible AI solutions. Required Skills & Experience 3–4 years of experience in AI/ML engineering, software engineering, data science, or a related field. Strong Python, SQL, object-or

Key Responsibilities Enterprise Data Strategy & Client Engagement: Develop and maintain a comprehensive data architecture strategy that aligns with organizational and client business objectives. Serve as a key technical advisor for clients, translating business requirements into innovative data solutions. Build and maintain strong client relationships by providing expert guidance and managing expectations throughout project lifecycles. Data Modeling, Design & Engineering: Design and optimize both logical and physical data models to support enterprise-wide systems. Architect data warehousing solutions, overseeing the integration of data from multiple sources to enable robust business intelligence and analytics. Directly develop, test, and implement ETL processes and data pipelines, ensuring data quality, consistency, and performance. Technology Evaluation & Implementation: Evaluate emerging data technologies and tools to determine their fit within the existing architecture and potential for future scalability. Oversee the integration of new technologies into the enterprise data architecture, balancing innovation with risk management. Team Leadership & Hands-On Management: Lead cross-functional teams, providing mentorship and technical guidance to junior data engineers and architects. Maintain a hands-on approach by actively participating in coding, design sessions, and troubleshooting complex data issues. Ensure project milestones are met through effective resource management and team coordination. Performance, Security & Best Practices: Optimize data storage, retrieval, and processing performance across various systems. Collaborate with security teams to enforce data governance, compliance, and privacy standards. Establish and promote best practices in data management, data engineering, and architecture design. Documentation & Reporting: Develop and maintain comprehensive documentation covering data architecture designs, data flows, integrati

We are looking for a talented engineer to lead evaluation of startup acquisition opportunities in the AI, cloud and security space. You will drive product evaluations, prepare and manage technical architecture discussions with target groups in Product and Engineering and provide roadmap suggestions for M&A and investments for Datadog. You will be a key partner to Datadog’s C-level leadership and highly visible at the most senior levels of Datadog. The role is reporting into the Senior Director of Product Strategy and falls within the Product organization. We are looking for an innovative and strategic thinker who is passionate about the latest tech being developed by startups in the cloud, AI and security space. The ideal candidate enjoys researching and evaluating new technologies, works effectively with cross-functional teams, and communicates opinions concisely to our leadership team. Broad understanding of relevant Cloud Technologies and deep understanding of the full coverage of Datadogs current offerings is necessary. The Corporate Development team is small and values authentic, strong-willed individuals who think creatively and proactively. This role leads technical due diligence from a product and architecture perspective across our acquisition pipeline. You'll scope and stand up proof-of-concept and sandbox environments to stress-test candidate products, then give an honest, unvarnished view of their quality and depth - the kind of assessment that holds up regardless of deal momentum. You'll assess technical architecture, flag the risks and open questions that matter most early, and turn that into a clear post-acquisition integration path. Working closely with engineering, you'll keep the evaluation focused on what's actually decision-relevant, then translate the findings into strategic recommendations for leadership and help carry the integration through by partnering with the right people on the other side. What You’l

We are looking for a talented engineer to lead evaluation of startup acquisition opportunities in the AI, cloud and security space. You will drive product evaluations, prepare and manage technical architecture discussions with target groups in Product and Engineering and provide roadmap suggestions for M&A and investments for Datadog. You will be a key partner to Datadog’s C-level leadership and highly visible at the most senior levels of Datadog. The role is reporting into the Senior Director of Product Strategy and falls within the Product organization. We are looking for an innovative and strategic thinker who is passionate about the latest tech being developed by startups in the cloud, AI and security space. The ideal candidate enjoys researching and evaluating new technologies, works effectively with cross-functional teams, and communicates opinions concisely to our leadership team. Broad understanding of relevant Cloud Technologies and deep understanding of the full coverage of Datadogs current offerings is necessary. The Corporate Development team is small and values authentic, strong-willed individuals who think creatively and proactively. This role leads technical due diligence from a product and architecture perspective across our acquisition pipeline. You'll scope and stand up proof-of-concept and sandbox environments to stress-test candidate products, then give an honest, unvarnished view of their quality and depth - the kind of assessment that holds up regardless of deal momentum. You'll assess technical architecture, flag the risks and open questions that matter most early, and turn that into a clear post-acquisition integration path. Working closely with engineering, you'll keep the evaluation focused on what's actually decision-relevant, then translate the findings into strategic recommendations for leadership and help carry the integration through by partnering with the right people on the other side. What You’l

At Dscout, we’re building the most flexible and powerful UX research platform on the market—trusted by the world’s top brands in finance (JP Morgan Chase, Intuit, Charles Schwab, PayPal), healthcare (Aya, Headspace), consumer goods (Keen, Verizon, Target, Northface), and tech (Google, Amazon, Facebook, Meta, Spotify, AirBnB). Our tools help teams deeply understand the humans behind their products, so they can build better ones. We are expanding our smart and driven team and would love for you to join us. AI native product is fundamentally different engineering problem than building deterministic software: the same input won't always produce the same output, and "working" means the agent behaves well across the full distribution of real world scenarios, not that it passes a fixed test suite. We're looking for an Applied AI Engineer with 2-5 years of experience building and shipping AI systems used by professionals at enterprise. You're comfortable working with modern LLM-based systems and agentic workflows, and you know how to turn powerful models into reliable product features. You have strong product judgment and think deeply about tradeoffs between LLM approaches and traditional ML when designing solutions. You care about evaluation, iteration speed, and making sure AI systems actually drive measurable business impact reliably . What you'll do Own the production improvement loop across agent behavior, customer and operator feedback, evaluation, experimentation, and verified business outcomes Instrument agent workflows so model interactions, tool use, decisions, failures, human edits, and downstream outcomes can be understood in context Define meaningful quality standards, representative evaluation datasets, regression coverage, and production monitoring. Investigate why agents underperform across context, knowledge, instructions, tools, routing, guardrails, or workflow design Design and ship targeted behavior improvements, including changes to prompting, cont

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. We seek a highly specialised technical Senior Security Architect (SA) who practices security with an obsession for helping customers design and implement the best security mechanisms, particularly those that would relate to the Snowflake AI & Data Cloud. At Snowflake, Security Architects are passionate about security, often involving tremendous technology challenges that require no simple solutions. Success requires working collaboratively with a broad range of people inside and outside the company. Operating out of our APJ Field CTO Office , you will serve as our primary South Korean Security expert, who will be a cloud compliance evangelist, technical architect, and hands-on practitioner. This specialized role bridges the gap between global cloud data architecture and South Korea’s rigorous, localized regulatory frameworks, specifically the Cloud Security Assurance Program (CSAP) and the Korea Financial Services Institute (K-FSI) Safety Evaluation. IN THIS ROLE YOU WILL GET TO: Help to scope security related feature enhancements on behalf of customers to work with Product Management and Engineering on ways to enhance requirements for the local market. Help drive Snowflake adoption by advising customers and engineering teams on how to build secure Korea-compliant Data

Our vision is to transform how the world uses information to enrich life for all . Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. Job Summary We are seeking a motivated engineer to join the DRAM Systems Engineering team, focusing on the development, evaluation, and optimization of next-generation memory systems for AI accelerators. This role emphasizes research and development across hardware architecture, operating systems, and performance analysis to support Agentic AI inference workloads. If you are ambitious and eager to make an impact in the exciting world of AI and memory systems, this is the perfect opportunity for you! Responsibilities Characterize AI inference workloads and examine memory behavior Build and evaluate tiered memory hierarchies for AI accelerators Study KV cache lifecycles, MoE models, and data placement strategies Compare and optimize explicit versus hardware-assisted data movement Develop, test, debug, and detail system-level and OS components Prototype and evaluate agentic AI systems by building agents and multi-agent workflows using modern frameworks and orchestration patterns (planning, tool use, memory, and context management). Apply these technologies both as workloads under study and as accelerators for internal engineering workflows <h2 style="color:!importan

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. The Services Solutions Manager is a fully qualified professional responsible for managing complex engagements. This role focuses on the strategic transition of customers from purchasing "hours" to achieving "defined impact" and business value. You will act as a consultative challenger, ensuring that every Statement of Work (SOW) is a rigorous, milestone-driven roadmap linked to specific business outcomes. WHY THIS ROLE? Complex Problem Solving: Work on problems of diverse scope where analysis of data requires evaluation of identifiable factors. Strategic Impact: Own the services lifecycle for high-stakes, complex engagements, ensuring technical discovery is grounded in core product capabilities. Operational Leadership: Implement formal Scope Governance and maintain practice margin health through meticulous SFDC rigor. WHAT YOU’LL DO: Consultative Challenger: Provide the confidence to challenge unrealistic customer requests and offer strategic trade-off options to protect project health and customer success. Scope Governance: Lead deep technical discovery pre-signature and implement formal, auditable change management processes for all scope modifications. Commercial Data Integrity: Own the accuracy of bookings forecasts and financial milestones in SFDC, ensuring the commerc

Who We Are Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier access to the world around us, that’s why we’re building a universal autonomy platform: self-driving for all roads and all rides. Founded in 2016, Nuro is a physical AI company developing Level 4 autonomous driving technology for a wide range of vehicles, use cases, and markets. Powered by the Nuro Driver™, our universal autonomy platform enables the global mobility ecosystem to deploy autonomy at scale, from robotaxis and logistics fleets to personal vehicles. With years of real-world deployment experience and a flexible, partner-led business model, Nuro is working toward a future where millions of autonomous vehicles powered by our technology help make everyday life safer, easier, and more connected. Nuro has raised over $2B in capital from Uber, NVIDIA, Google, Softbank, Fidelity, T. Rowe Price, and other leading investors. About the Role As a Senior Software Engineer, Collision Avoidance Testing, you will work closely with the onboard autonomy, evaluation infrastructure, data science, operations, and simulation teams to evaluate the performance of the autonomous vehicle in collision avoidance scenarios. You will be responsible for identifying gaps in onroad and simulation tests, designing appropriate tests to fill those gaps, reviewing test outcomes, and iterating on test design. You will analyse the results, recommend product changes, and report on residual risk both to leadership and in the safety case. About the Work Using human benchmarks from naturalistic data, develop statistical models that drive strategic decisions as a function of test volume, system performance, and confidence level. Identify and design realistic scenarios to drive test coverage of collision avoidance scenarios and collision detection scenarios using replay simulations of logs an

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. The Services Solutions Manager (SSM) is a fully qualified professional responsible for managing complex engagements. This role focuses on the strategic transition of customers from purchasing "hours" to achieving "defined impact" and business value. You will act as a consultative challenger, ensuring that every Statement of Work (SOW) is a rigorous, milestone-driven roadmap linked to specific business outcomes. WHY THIS ROLE? Complex Problem Solving: Work on problems of diverse scope where analysis of data requires evaluation of identifiable factors. Strategic Impact: Own the services lifecycle for high-stakes, complex engagements, ensuring technical discovery is grounded in core product capabilities. Operational Leadership: Implement formal Scope Governance and maintain practice margin health through meticulous SFDC rigor. WHAT YOU’LL DO: Consultative Challenger: Provide the confidence to challenge unrealistic customer requests and offer strategic trade-off options to protect project health and customer success. Scope Governance: Lead deep technical discovery pre-signature and implement formal, auditable change management processes for all scope modifications. Commercial Data Integrity: Own the accuracy of bookings forecasts and financial milestones in SFDC, ensuring the c

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. The Senior Services Solutions Manager (SSM) at Level 4 is a fully qualified professional responsible for managing complex engagements. This role focuses on the strategic transition of customers from purchasing "hours" to achieving "defined impact" and business value. You will act as a consultative challenger, ensuring that every Statement of Work (SOW) is a rigorous, milestone-driven roadmap linked to specific business outcomes. WHY THIS ROLE? Complex Problem Solving: Work on problems of diverse scope where analysis of data requires evaluation of identifiable factors. Strategic Impact: Own the services lifecycle for high-stakes, complex engagements, ensuring technical discovery is grounded in core product capabilities. Operational Leadership: Implement formal Scope Governance and maintain practice margin health through meticulous SFDC rigor. WHAT YOU’LL DO: Consultative Challenger: Provide the confidence to challenge unrealistic customer requests and offer strategic trade-off options to protect project health and customer success. Scope Governance: Lead deep technical discovery pre-signature and implement formal, auditable change management processes for all scope modifications. Commercial Data Integrity: Own the accuracy of bookings forecasts and financial milestones in SF

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. At Snowflake, we are building a high-impact team to help the world's most innovative companies unlock the power of AI. As an Forward Deployed Engineer, Applied AI on our Cortex AI team, you will be a hands-on builder and a key technical partner to our most strategic customers, placing you at the forefront of the enterprise AI revolution. You won't just work with cutting-edge technology – you'll deploy it to solve real-world business problems at scale, building production-grade AI systems using Snowpark, Cortex, and our native LLM capabilities. IN THIS ROLE AT SNOWFLAKE, YOU WILL: Build Customer Solutions : Architect, build, and deploy enterprise-grade AI solutions, including sophisticated AI agents. Own the end-to-end lifecycle of your work streams – from prototype to production – directly solving customers' most complex business challenges. Own the Quality of What You Ship : Define what "good" means for the systems you build. Translate ambiguous customer goals into measurable quality metrics, evaluation frameworks, and golden datasets – then run systematic eval loops to hill-climb on agent quality, catch regressions before customers do, and continuously raise the bar on accuracy, faithfulness, and safety. Treat measurement as a first-class part of building, not an aftertho

About the Team The ChatGPT Search Product Infrastructure team builds the foundational systems that power search experiences across ChatGPT. We develop the product infrastructure that connects models with search systems and other sources of real-time information, enabling ChatGPT to deliver timely, relevant, and trustworthy answers to users around the world. Our work sits at the intersection of product engineering, AI, and large-scale infrastructure. We build shared platforms and abstractions that enable product teams to independently develop, evaluate, and launch new search-powered experiences. These platforms provide the guardrails, testing capabilities, observability, and rollout controls needed to prevent reliability, scalability, quality, and latency regressions while supporting rapid product iteration. The team partners closely with: Post-Training on model launches, experimentation, and prompt optimization Search product verticals on new user experiences Inference on GPU efficiencies Indexing and Retrieval on the systems that identify and deliver relevant information Capacity/Fleet team to ensure optimal regionalized provisioning of GPUs and CPUs About the Role We are looking for an Engineering Manager to lead the team responsible for ChatGPT’s Search Product Infrastructure. You will set the technical and organizational direction for the systems that bring search capabilities into ChatGPT. You will guide architectural decisions across search orchestration, model and prompt integration, serving infrastructure, experimentation, observability, evaluation, and product integrations. You will balance immediate launch and product needs with the long-term reliability, scalability, latency, and maintainability of the platform. A central responsibility of this role is creating leverage for Search product verticals. You will lead the development of extensible platforms that allow those teams to independently build, test, and launch features without requiring ongoing invol

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. Snowflake is about empowering enterprises to achieve their full potential, and people too. With a culture that’s all in on impact, innovation, and collaboration, Snowflake is the sweet spot for building big, moving fast, and taking technology, and careers, to the next level. About the Role The Cortex Code team is building the future of coding agents for working with data. See our flagship product in action: Cortex Code in Action: Live Demos + AMA . Your work will directly impact how developers and businesses build with data. You'll own the full AI engineering lifecycle: design, prompt/tool engineering, evals, deployment, measurement, and optimization. You'll work with a small, high-powered modeling and infrastructure team. What you will do in this role: Own features end-to-end for Snowflake Cortex Code products. Build agentic workflows, coding harnesses, evaluation pipelines. Build enterprise-grade context engineering: function calling, tool schemas, guardrails, agent teams, and verification/repair. Partner with product and infra: translate customer problems into products and experiments. Collaborate with infrastructure teams to productionize improvements. Work with an elite team of engineers towards building great products Requirements: Bachelor’s degree in Computer Scienc

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. Snowflake is about empowering enterprises to achieve their full potential — and people too. With a culture that’s all in on impact, innovation, and collaboration, Snowflake is the sweet spot for building big, moving fast, and taking technology — and careers — to the next level. ABOUT THE ROLE: You will work on critical business initiatives in the core database engine, bring an AI-forward approach to software development and accelerate roadmap cycles for the benefit of our customers. Your work will directly impact how developers and businesses build with data. You'll own the full AI engineering lifecycle: design, prompt/tool engineering, evals, deployment, measurement, and optimization. You'll work with a small, high-powered engineering team. What you will do in this role: Own features end-to-end for Snowflake Database Engineering products. Build agentic workflows, coding harnesses, evaluation pipelines. Build enterprise-grade context engineering: function calling, tool schemas, guardrails, agent teams, and verification/repair. Design evals and hillclimb : create golden sets, create rubrics and metrics, analyze errors, run experiments to hill climb on the metrics. Partner with product and infra: translate customer problems into products and experiments. Collaborate with infr