About the Role The Senior AI Evals Test Engineer is a hands-on technical role responsible for defining, developing, and executing robust evaluation frameworks and test strategies for AI agents built using the Google Agent Development Kit (ADK) or similar sort of agentic frameworks . This role bridges AI development and reliable deployment — ensuring our agents are safe, ethical, effective, and meet high-quality performance standards. A significant focus of the role is on Responsible AI and Safety Evals, including adversarial testing, red-teaming, bias detection, and toxicity measurement . The engineer will design scalable evaluation pipelines , build synthetic test environments, and work closely with AI/ML Engineers, Researchers, and policy teams to ensure agents are production-ready and compliant with regulatory and ethical standards. The role is 70% Automation and 30% Manual Testing , and sits within the Applied AI: Test Engineering team as a key technical authority. Key Responsibilities Design and build agent evaluation frameworks — create end-to-end infrastructure for evaluating LLM-based agents across correctness, latency, cost, safety, and task completion rate Build synthetic testing environments and simulation strategies to stress-test AI agents under diverse real-world conditions, with specific focus on agents built on Google ADK and related Google AI/ML services (e.g., Vertex AI, Gemini models) Build golden datasets and test harnesses — curate domain-specific evaluation sets for Rubrik's product verticals (data security, SaaS protection, cyber recovery, compliance) Establish eval-as-a-service — build and enhance centralized evaluation platform that any IT team members can self-serve to test their agents against standardized and custom benchmarks Automate regression and drift detection — implement CI/CD-integrated eval pipelines that catch regressions on every model or prompt change before production deployment Define eval taxonomies and rubrics — est
Jobiba hiring network
Test Automation Handler Engineer Jobs
4,176 active opportunities · Updated for October 2026
Fresh results
15 shown
Explore current test automation handler engineer jobs. Use filters to narrow by work mode, employment type, experience and date posted.
At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. As a Deal Desk Manager at Snowflake, you’ll be at the forefront of the company’s growth efforts working in close partnership with our Sales organization in the construct, review, approval and negotiation of business opportunities. In addition to this, you will also act as the coordinator between the Sales team and all other corporate functions as business opportunities are evaluated, negotiated and closed. Finally, you’ll develop relationships at all levels and across the entire company in support of your deal function. RESPONSIBILITIES: Partner with the Sales organization, particularly our Acquisition Accounts Sales team and become a trusted advisor for the deal construct and negotiation process of complex transactions. Coordinate the flow of information across multiple groups, such as Sales, Services, Legal, Revenue Accounting, Operations, etc. to facilitate the deal process. Ensure that the execution of the deal review and approval process follows company policies and guidelines. In partnership with other company functions, help set policies, process and procedures and assist or drive their implementation. Create and develop the internal relationships with groups across the company to help facilitate the deal process. Use AI-assisted deal workflows and automation tooling
Position Overview: Diligent is looking for a talented QA Analyst to improve the quality of Diligent products. The QA Analyst is part of a cross-functional agile team and involved in every step of the software testing life cycle, from planning to releasing the product. Key Responsibilities Demonstrates entry level technical capabilities Ability to complete smaller stories independently, more complex ones with guidance from senior members of the team Curious and high potential for learning and growing as an engineer. Understand the process and keep the Flow healthy. Understands specifications, can draw up test scenarios, create regression test cases and updates test cases as needed. Executes test cases and analyses test results. Interrogating failed scenarios and accurately record defects following them through to resolution. Use AI tools to enhance productivity: Use AI tools to automatically generate test scenarios Speed up the creation of edge case scenarios that might be overlooked manually. Use AI to query test results, logs, or bug databases using natural language Automatically generate or update QA documentation Required Experience/Skills 0-3 years of experience in Software Testing, preferably testing of Web applications. Experience in working with bug-tracking systems, and version control systems. Knowledge of testing methods and technologies, understanding of formal software development processes (SDLC) Flexible analytical and algorithmic thinking, desire for self-development, persistence in finding solutions, and achieving goals. Awareness of modern AI-enhanced development tools (e.g., GitHub Copilot, ChatGPT, Cody). Preferred Experience/Skills Basic programming or scripting skills. Automation testing experience / Desire to learn. Experience with CI/CD Can-do attitude ISTQB certification About Us Diligent is the AI leader in governance, risk and compliance (GR
NVIDIA Networking division is a leading supplier of innovative end-to-end InfiniBand and Ethernet connectivity solutions and services for servers and storage. We offer market-leading solutions that include adapter cards, switches, cables, and software to support networking technologies. Our products optimize Data Center performance and deliver industry-leading bandwidth and scalability. In addition, we serve a wide range of sectors including high performance computing, enterprise, Data Center, cloud computing and Web 2.0. We are constantly reinventing ourselves to stay ahead of the market and bring groundbreaking products and services to the industry. Our product line is focused on delivering the most optimized Ethernet solutions for industries like Media and Entertainment as well as any other industry that can benefit from our DataStream and TCP/IP acceleration. What you will be doing: Drive multiple early-stage design concepts of Test Equipment & fixtures while working in fast-paced product development cycles. Independently lead Test Equipment & fixtures design from concept, through detailed design, and support it during Bring-up, Qualification and Mass-Production phases. Participate and lead design and design reviews of Test Equipment & fixtures by using our CMs (Contract Manufacturers) as the designers Collaborate in research of groundbreaking technologies, materials, and processes with other groups to bring in creative ideas that address evolving needs. What we need to see: B.Sc. in Mechanical Engineering or higher degree. 5+ years of experience in classical mechanical design of mechanisms, jigs, fixtures, products and machines development. Knowledge and experience in automation (pneumatics XYZ motion systems, etc) and in design of machining and sheet metal parts Knowledge and experience in static analysis and simulations.
About Eulerity Eulerity is a rapidly growing technology company revolutionizing marketing automation for small businesses and franchises with our industry-leading proprietary software. Founded by leaders from Google, Facebook, and Yahoo! with more than 20 years of digital advertising, engineering, and marketing experience, we build tools that make enterprise-grade marketing accessible at scale. The Role We're looking for a Backend Developer with 1–3 years of experience to join our engineering team. You'll take an active role in building, testing, and maintaining the backend services that power our platform — and you'll do it with AI as a core part of your workflow, not an afterthought. This is a role for someone who's genuinely excited about what AI-assisted development makes possible and wants to push that further every day. What You'll Do Build, test, and maintain backend services across Eulerity's core platform Own features end-to-end — from design and implementation through deployment Use AI agents and LLM tooling to prototype, iterate, and ship faster Contribute product ideas and help shape the engineering roadmap Collaborate closely with cross-functional teams on features and releases Assist with documentation, system support, and knowledge sharing across the team About You 1–3 years of hands-on backend development experience, with at least 1 year building in Java You've actually used AI agents (Claude, Copilot, Cursor, or similar) to build, debug, and ship software — not just experimented with them Familiarity with LLMs, AI agent frameworks, or AI-assisted development workflows Comfortable integrating third-party APIs A strong drive to keep learning — especially when it comes to evolving AI tooling and how it applies to real engineering problems You think creatively about complex problems and enjoy finding elegant solutions A collaborative, communicative team player with a friendly, low-ego approach Requirements Based in the NYC tri-state area Available to wo
Our vision is to transform how the world uses information to enrich life for all . Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. Design, develop, and automate test content for next-generation Micron solid-state storage products. In this role, required to contribute directly to feature validation, test method innovation, requirements analysis, and execution of validation workflows across multiple technologies and platforms. Required to collaborate closely with firmware, hardware, systems, and product teams to ensure SSD features meet industry standards, customer requirements, and high reliability expectations. This position required engineers motivated by hands-on development, deep debug, and building strong technical foundations in SSD architecture and validation methodology. Develop automated test cases for functional, performance, power, interoperability, stress, and negative-testing scenarios. Translate feature requirements, customer specifications, and industry standards into robust, reusable test content. Build and maintain test tools, utilities, and frameworks in Python or equivalent languages. Enhance automation workflows to improve coverage, reliability, and execution efficiency. Execute validation plans across multiple hardware, OS, and platform configurations. Investigate failures using logs, analyzers, debug tools, and structured root-cause methods. File well-documented issues and participate in triage discussions with cross-functional teams. Support qualification phases by providing accurate test results, metrics, and risk assessments. Contribute to CI-based automated regression systems and reporting dashboards. Improve test reliability, repeatability, and scalability across
Why This Role Exists Eulerity-GACS is an AI-native marketing automation platform — not a legacy tool with AI bolted on. We serve enterprise brands like Mastercard, UPS Store, Uber Eats, automating digital advertising across thousands of franchise locations. As we scale, we are expanding our India-based Mobile Engineering team to support our rapidly growing client base! We aren't looking for a traditional developer who writes Swift. We want an AI-augmented engineer who treats agentic coding workflows as their primary development tool. At Eulerity-GACS, AI-first development enables us to ship high-impact features to real users at a pace that leaves legacy competitors behind. If you are a senior-level developer who has already restructured your workflow around Claude Code, Copilot, and system prompting to move faster than your peers, we want you on our team. The Fast Facts Location: Remote (India) Schedule: Shifted to ensure close alignment and high-bandwidth collaboration with US EST hours (e.g., approximately 5:30 PM – 2:30 AM IST). Compensation: ₹13-16 LPA (depending on experience) AI Tools: Unlimited. Claude Code, Copilot, whatever makes you sharp — we don't gatekeep tools here. Start Date: Early joiners preferred What You'll Actually Do This is a high-ownership role where you will be building features that real users depend on daily. Develop, test, and maintain our high-quality iOS application using Swift, SwiftUI/UIKit, and AI-first development practices. Agentic coding tools will be your daily drivers. Collaborate closely with US-based Product and Design teams to implement features from architecture through deployment, leveraging AI for code generation, debugging, and review. Write clean, scalable, and highly maintainable code following best practices and architectural patterns. Utilize effective prompts and system instructions as a core engineering skill to maintain a robust MVVM architecture. Who You Are We are looking for a technically sharp devel
POSITION SUMMARY: Natera is a global leader in cell-free DNA testing. We measure fetal, tumor, or donor cfDNA at the molecular level to help inform personalized health care decisions with a non-invasive test. The Natera R&D Department is looking for a highly motivated Senior Scientist to join the rapidly growing assay development team to help build the future of Natera. In this position, you will be an integral part of high-performing teams across functions to develop laboratory tests that positively impact the business and our patients. A successful candidate will have a deep understanding of molecular biology, strong scientific curiosity and high level of expertise of developing and validating assays through product development cycles. You will lead and support dedicated junior scientists and laboratory technicians to plan, execute and manage scientific studies under design control in a regulated environment to help improve and expand Natera's state-of-the-art product portfolios. PRIMARY RESPONSIBILITIES: Design development, verification, and validation studies with stakeholder input and coordinate efforts to achieve milestones within established timelines Collaborate closely with cross-functional teams, such as automation, engineering, R&D, bioinformatics, and lab operations, to develop robust, automated workflows Lead the integration testing of automated workflows with software LIMS systems. Support the design and execution of integration testing to ensure data integrity between automation and digital systems Plan, execute, analyze and present data for moderate to high complexity experiments with hands-on work on troubleshooting Identify the root cause of problems and develop solutions to resolve problems effectively Perform basic data analysis (e.g. Excel, JMP) and comfortable to utilize AI agents like Gemini and Claude. Coordinate the analysis of studies with biostatistics and bioinformatics teams Provide regular updates at project team and
At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. Staff Network Engineer Location: MPK/Bellevue/Dublin Snowflake's Enterprise Technology Network Services team is looking for a Senior Network Engineer to lead the design, operation, and optimization of our Zero Trust and secure-access platform. This role is Zscaler-centric — you will own the health, performance, and roadmap of our ZIA/ZPA deployment — while working across a modern, multi-cloud network stack that supports a global workforce of 10,000+ users. You'll be the escalation point for the most complex connectivity issues and a driver of automation and observability across the environment. What You'll Do Own and operate the Zscaler platform (ZIA, ZPA, ZDX, ZCC) end-to-end, including policy frameworks, app-segmentation models, PAC/traffic-forwarding standards, App Connector topology, and NSS/log-streaming design. Troubleshoot secure-access incidents like tunnel flapping, broker/connector health, SSL inspection edge cases, DNS/DTLS failures, and lead root-cause analysis for systemic issues. Manage Palo Alto firewalls, Panorama and GlobalProtect VPN, while planning migration toward Zscaler solutions. Support Aruba (Central) Wireless, Ekahau and Cisco Catalyst switches globally. Design, install, and configure network devices and ISP circuits at new offices. Build automatio
Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. As a Senior QA Engineer, you will be the first dedicated QA hire for the Safety Engineering Group, which is responsible for building the infrastructure and policies that make Roblox the safest online community in the world. You will report to the QA Engineering Manager for Universal Apps and collaborate across the Safety organization to own end-to-end test strategies for high-stakes, 24/7 incident response systems and parent-facing safety features. This role is a unique opportunity to shape the quality culture of a company-level mandate from the ground up. You will: Partner with Engineering and Product to define and maintain comprehensive, risk-based test coverage for Safety features and systems. Own the end-to-end test strategy for Safety initiatives, including functional, regression, integration, and edge-case validation. Leverage and expand internal automation frameworks to automate critical user flows and drive API-first validation strategies. Identify high-impact automation opportunities and incorporate industry best practices to design robust, abuse-resistant test scenarios. Develop, track, and report on quality metrics (e.g., defect trends, coverage gaps) to proactively surface relea
We're looking for a Senior Manager of SW Tools Development to lead an organization built on two closely connected pillars: AI-powered tools and agents, and the test infrastructure, data pipelines, and process automation that engineering and business teams rely on every day. You'll bring deep knowledge of large language models (LLMs) and applied AI, and use it not only to build new AI-driven products but to find where AI can meaningfully upgrade test infrastructure, data pipelines, and automation — the overlap between these areas is where some of your team's highest-leverage work happens. Beyond building the tools, you'll be the face of your organization's products internally — demoing capabilities, winning over new adopters, and growing the portfolio of tools your team owns. You will manage multiple engineering teams (including managers), partner cross-functionally with stakeholders across the business, and build the processes that let your tools ship safely and reliably at scale. In this role, you will: Lead and grow multiple engineering teams spanning AI-powered tools/agents and test infrastructure, data pipelines, and process automation, managing and mentoring managers and senior engineers, and holding your organization accountable for delivery and quality across both areas. Set a unified, prioritized roadmap across your organization that balances new AI agent/tool capabilities with test infrastructure, data pipeline, and process automation needs — with a sharp eye for where applying LLMs to automation, pipelines, or test systems creates outsized leverage. Design and enforce the architecture, quality gates, and release processes that ensure tools, pipelines, and AI agents are validated, secure, and reliable before reaching production. Partner cross-functionally with engineering, operations, and business leadership across the company to align priorities, scope integrations, and drive adoption of new tooling at an organizational leve
About the Team DoorDash Labs is an independent team within DoorDash. We explore robotics and automation to transform last-mile logistics in the long term. If you have a passion for applying autonomous aviation technologies in a service used by millions of people, then we want to talk to you! About the Role We are seeking a highly skilled FPV Pilot with advanced acro mode flight experience for visual line-of-sight operations (no goggles). This role focuses on hands-on drone testing and evaluation to support the development of next-generation UAS technologies. You’ll work closely with systems and flight engineers to provide actionable flight data and feedback that drive design improvements and system reliability. This position is fully on-site at our Bay Point, California test facility. Work hours are Monday through Friday, 8:00 a.m. to 4:30 p.m. You’re excited about this opportunity because you will... Operate small and mid-size multi-rotor and fixed-wing UAS platforms in acro mode within visual line of sight (VLOS) environments. Conduct test flights, calibration routines, and performance evaluations under engineering supervision. Collaborate closely with systems engineers to provide high-quality, data-driven feedback on flight performance, controls tuning, and system reliability. Maintain detailed logs of flight hours, aircraft condition, and observed anomalies. Support safety and compliance processes in accordance with FAA Part 107 and internal operating procedures. Participate in system validation efforts involving PX4, ArduPilot, Auterion, and Herelink control systems. Contribute to iterative design reviews, prototype evaluations, and test readiness reviews. We’re excited about you because you have... FAA Part 107 Remote Pilot Certificate (required; will be verified). 100+ hours of logged FPV flight time. 1+ year of consistent acro mode flight experience under visual line of sight (no goggles). Demonstrated experience with multi-rotor UAS operations (required). P
About the Team DoorDash Labs is an independent team within DoorDash. We explore robotics and automation to transform last-mile logistics in the long term. If you have a passion for applying autonomous aviation technologies in a service used by millions of people, then we want to talk to you! About the Role In this role as a UAS Ground Support Operator, you’ll be part of a hands-on field testing team supporting flight validation of new drone platforms. You’ll work closely with flight test operators to keep aircraft ready to fly, minimize turn around time and operate the accompanying ground systems safely and efficiently. You will be reporting to the Flight Test Lead. Support daily test readiness by managing batteries, preparing equipment, and spearheading on-site logistics. Operate in field environments with extended periods of standing, repetitive drone handling, and outdoor exposure to varying weather (heat, dust, cold, wind, etc.). Stay flexible and responsive to shifting schedules, including early mornings, late afternoons, and variable hours based on test conditions. Open to about 20% travel. Collaborate with cross-functional teams to surface observations, flag anomalies, and support iterative improvement cycles during testing. Please note: This is an onsite role based in Bay Point, CA. Only candidates who are local or within commuting distance will be considered. A Part 107 is required for this position. No UAV experience is required, but the part 107 licence is required. You’re excited about this opportunity because you will… Support flight testing , data collection, and troubleshooting for new drone systems. Work closely with the operations teams to provide feedback and improve operational performance . Gain hands-on experience in emerging technology, working with a team in a fast-paced, iterative environment. Contribute to building the future of drone delivery through curiosity , adaptability , and a proactive mindset. We’re excited about y
DoorDash Labs is an independent team within DoorDash. We explore robotics and automation to transform last mile logistics in the long term. If you have a passion for applying robotics solutions in a service used by millions of people, then we want to talk to you! We're hiring a Planning & Controls Engineer in our Autonomy Software team. In this role, you'll own and develop flight control, motion planning, and mission planning algorithms for robust, fault-tolerant drone delivery. This is a hands-on role: you will design controllers, implement them in C++ on embedded platforms, test them in flight, and iterate. You're excited about this opportunity because you will… Play an integral role on a small and focused team Develop and tune low-level flight control algorithms for overactuated multirotor and hybrid aircraft on embedded platforms Own the dynamics simulation and aerodynamics modeling of the aircraft Bring up and tune flight controllers on new drone platforms Develop, tune, and test fault-tolerant control (loss of one or more motors, safe landing, emergency behaviors) Build a trajectory motion planner for smooth flight and obstacle avoidance within the operating envelope Help develop the high-level mission route planner with fallback locations We're excited about you because… You have deep controls fundamentals: linear and nonlinear systems, stability analysis, controller synthesis and tuning, frequency domain analysis, optimization, and linear algebra You have excellent knowledge of C++ and embedded systems You bring dynamics modeling and simulation experience with aerodynamics knowledge You have experience developing and tuning flight controllers, interfacing with state estimation You have excellent knowledge of motion planning algorithms (trajectory optimization and nonlinear optimization, A*/D*/RRT variants) You have experience with sensorless brushless DC motor control You've built or owned a robot control stack end-to-end, from design through implementat
About the Team DoorDash Labs is an independent team within DoorDash. We explore robotics and automation to transform last mile logistics in the long term. If you have a passion for applying robotics solutions in a service used by millions of people, then we want to talk to you! About the Role We are hiring a Firmware Validation & Integration Engineer for our autonomy software team. This is a critical role to build robust and scalable validation for our firmware and systems to ensure reliability at every level. In this role, you will work with our electrical, firmware, and autonomy engineers to build the infrastructure and test suites required to validate the system. This includes designing and implementing our Hardware-in-the-Loop (HIL) simulation environments and automation frameworks from the ground up. You will report to the Autonomy Platform Lead on our Autonomy Platform Team at DoorDash Labs. We expect this role to be hybrid with some time in-office and some time remote. You’re excited about this opportunity because you will… Play an integral role on a small and focused team. Design and build Hardware-in-the-Loop (HIL) systems to simulate vehicle dynamics and sensor data for comprehensive firmware and system-level validation. Develop automated test infrastructure and software tools to exercise multiple embedded platforms throughout our robot system. Interface many layers of our control system including vehicle controls, power management, and motion control to ensure seamless system integration. Implement low-level test sequences and validation algorithms to safely stress-test vehicle components such as batteries, drive-train, and thermal management devices. Collaborate with cross-functional teams to identify edge cases and hardware-software corner cases that impact vehicle safety and performance. We’re excited about you because… BS/MS degree in Computer Science, Robotics, Electrical Engineering, or related technical field. 5+ years of experience in validati
Get new test automation handler engineer jobs by email
Daily job updates · Unsubscribe anytime