Senior Software Engineer Testing Frameworks Jobs

About the Role: Tubi is seeking a highly skilled and experienced Senior QA Automation Engineer to lead quality assurance initiatives for our cutting-edge streaming and AI-driven product features. This pivotal role involves ensuring exceptional end-to-end user experiences, robust streaming playback, and the accuracy and integrity of our AI/ML features across web, mobile, and OTT platforms. We're looking for a candidate with a strong background in streaming QA and deep technical knowledge of media workflows. You'll be instrumental in collaborating with engineering, product, and data science teams to define comprehensive QA strategies that guarantee both functional excellence and data-level quality. This is a hybrid role based out of our Toronto office. You must be willing to travel to our Toronto office three days/week. What You'll Do: Design and lead test strategies for streaming workflows, playback systems, and AI-powered features. Test across platforms (web, mobile, and connected TV) to ensure functional parity and playback stability. Validate streaming performance—including ABR logic, encoding pipelines, and DRM integrations—under diverse real-world conditions. Debug with precision using tools like Charles Proxy, Chrome DevTools, ADB, and Xcode. Collaborate with data and ML teams to validate AI model updates, recommendations, and personalization accuracy. Leverage AI-assisted QA tools to enhance regression coverage, UI validation, and anomaly detection. Contribute to automation and CI/CD frameworks, driving faster, more reliable releases. Help drive a shift-left testing approach by engaging early in the software development lifecycle, partnering with product managers, engineers, and data scientists to identify quality risks, define test strategies, and ensure testability during requirements and design phases. Oversee QA deliverables for multiple concurrent releases and ensure seamless sign-off for production launches. Monitor live environments for playback or reco

Title: Senior AI QA Engineer Location: Bengaluru (Bangalore) Opportunity: As a Senior AI QA Engineer for our Precision Patient Care Pipeline , you will go beyond traditional functional testing. You will be responsible for building the framework that ensures our clinical insights are accurate, safe, and reliable. This role requires a unique blend of high-level software testing and data engineering to validate complex, non-deterministic medical outputs using a hybrid of automated grading methodologies . Key Responsibilities: Architect Multi-Layered Validation Frameworks: Design and implement structured testing strategies that combine deterministic checks, semantic similarity metrics, and model-based evaluations. Automated Model Grading: Develop systems to evaluate clinical pipeline outputs for faithfulness, safety, and hallucination detection using various automated scoring techniques (e.g., BERTScore, ROUGE, or custom heuristics). Vibe-Driven Development: Leverage agentic AI tools to rapidly prototype complex test harnesses, "red-team" clinical logic, and build internal validation utilities at high velocity. Data Pipeline Integrity: Execute integration and regression tests for data-heavy backend processes, ensuring medical data remains consistent from ingestion to insight generation. Collaborative Strategy: Work closely with Data Scientists and Product Managers to define "Ground Truth" datasets and clinical evaluation rubrics. Root Cause Analysis: Deep-dive into complex system failures to identify whether issues stem from code logic, data drift, or model behavior. Requirements: 6+ years of technical experience in Quality Assurance, with a strong focus on system architecture and backend data validation. Advanced Python Proficiency: Expert-level skills in Python for building custom test scripts and working within AI/ML ecosystems. AI/ML Validation Experience: Proven experience testing model outputs using diverse metrics (e.g., Semantic Similarity, NLP metrics, an

At Affirm, we exist for the moments that matter—giving people a clear, predictable way to pay over time, with no hidden fees, no surprises, and no tradeoffs on what matters most. Site Reliability Engineering at Affirm is a small, yet crucial, team that helps our Engineering partners to “Operate What They Own” with excellence to protect their customers’ experience. SRE accomplishes this through defining frameworks and best practices for operating applications, building tooling, and providing training and consulting. Some of the many SRE responsibilities are: Providing data and visibility to teams and leadership on application performance Guiding the development of SLOs Driving the Incident Management and Analysis process Steering the implementation of Change Management and Deployment practices Engaging in service and architectural conversations Recommending observability and alerting configurations The SRE team benefits from experience across many domains including: infrastructure, platform, and distributed systems capacity management, load and chaos testing automation, observability, and configuration management development and product experience The SRE team is seeking motivated software and systems engineers with the experience to build, iterate on, and expand incident lifecycle, reliability, and resilience practices throughout Affirms Engineering organization and beyond. What You'll Do: You will be responsible for owning and delivering quarterly goals for your team, leading engineers on your team through ambiguity to solve open-ended problems, and ensuring that everyone is supported throughout delivery. You will support your peers and stakeholders in the product development lifecycle by collaborating with infrastructure, product management, developer experience & analytics by participating in ideation, articulating technical constraints, and partnering on decisions that properly consider risks and trade-offs. You will proactively identify technical solutions

At Affirm, we exist for the moments that matter—giving people a clear, predictable way to pay over time, with no hidden fees, no surprises, and no tradeoffs on what matters most. Site Reliability Engineering at Affirm is a small, yet crucial, team that helps our Engineering partners to “Operate What They Own” with excellence to protect their customers’ experience. SRE accomplishes this through defining frameworks and best practices for operating applications, building tooling, and providing training and consulting. Some of the many SRE responsibilities are: Providing data and visibility to teams and leadership on application performance Guiding the development of SLOs Driving the Incident Management and Analysis process Steering the implementation of Change Management and Deployment practices Engaging in service and architectural conversations Recommending observability and alerting configurations The SRE team benefits from experience across many domains including: infrastructure, platform, and distributed systems capacity management, load and chaos testing automation, observability, and configuration management development and product experience The SRE team is seeking motivated software and systems engineers with the experience to build, iterate on, and expand incident lifecycle, reliability, and resilience practices throughout Affirms Engineering organization and beyond. What You'll Do: You will be responsible for owning and delivering quarterly goals for your team, leading engineers on your team through ambiguity to solve open-ended problems, and ensuring that everyone is supported throughout delivery. You will support your peers and stakeholders in the product development lifecycle by collaborating with infrastructure, product management, developer experience & analytics by participating in ideation, articulating technical constraints, and partnering on decisions that properly consider risks and trade-offs. You will proactively identify technical solutions

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world. What you’ll be doing: Use and develop AI-powered tools to make software testing smarter, faster, and more effective! Improve test case generation, defect detection, flaky test analysis, regression testing, and test coverage optimization. Work with product, engineering, and cross-functional teams to review requirements and define test strategies. Build test plans, design and execute test cases, and report quality status, risks, bugs, and results. Perform functional, performance, fault-injection, reliability, and regression testing for cloud-native systems. Automate test cases and contribute to scalable test frameworks. Manage the bug lifecycle, reproduce customer issues, and verify fixes. What we need to see: MS or PhD in Computer Science, Engineering, or a related field. 5+ years of QA, test automation, or software testing experience. Hands-on experience using AI tools to improve QA workflows. Strong QA fundamentals, test strategy, test planning, and failure analysis skills. Proficiency with Unix/Linux and shell or Python programming. Exp

Here at Datadog, we think about offensive security a little bit differently. We embrace automation and AI to run adversary simulations continuously across a massive cloud-native environment, and we expect our offensive engineers to build the tooling that makes that possible. We're looking for a Senior Security Engineer who can execute sophisticated red team operations, write the code that scales them, and take an AI-first approach to offensive security engineering. At Datadog, we place value in our office culture - the relationships and collaboration it builds, and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You'll Do: Plan and execute red team engagements end-to-end, simulating real-world threat actors across cloud infrastructure (AWS, GCP), Kubernetes, CI/CD pipelines, and corporate environments Build and maintain custom offensive tooling, automation frameworks, and engagement infrastructure, treating offensive operations as a software engineering problem Develop custom payloads and evasion capabilities tailored to Datadog's environment and modern defensive controls (EDR, SIEM, network monitoring) Improve the efficiency of offensive operations through thoughtful use of automation and AI, accelerating reconnaissance, vulnerability analysis, and reporting workflows Partner with the Detection & Response team on purple team exercises to validate detection logic, improve alert fidelity, and influence threat models Translate offensive findings into concrete improvements by working directly with defensive security and engineering teams to close gaps Who You Are: You have 5+ years of hands-on experience in offensive security (red teaming, penetration testing, or adversary simulation) with a track record of operating against mature, well-defended environments You write production-quality code (Python, Go, or similar), can build your own tools, and automate your w

Overview: Guidepoint's Engineering team thrives on delivering innovative technology solutions that accelerate revenue growth, reduce costs and increase efficiency and productivity. As Guidepoint works to achieve its mission of making individuals, businesses, and the world smarter through personalized knowledge-sharing solutions, the engineering team is taking on challenges to create new products and improve existing platforms to optimize the seamless delivery of our services. This is a hybrid position based in Pune. What You’ll Do: Design, build, and maintain a test automation framework. Automate test cases and design, develop, and execute reusable and maintainable automated scripts. Analyze issues related to automated and/or load testing, research and propose solutions, and add, modify, or enhance previously recorded automated scripts. Analyze test results and determine root causes of issues. Determine severity and scope of issues to guide prioritization for resolution. Provide regular software defect tracking and regression updates and present status and technical reports as required. Assist in planning, developing, and delivering training related to automated test tools and frameworks. Review, establish, and maintain thorough documentation, templates, and process improvements and communicate technical issues to engineering leadership and business stakeholders. Work closely with other engineering team members and departments on technical issues and updates. Keep abreast of technology trends and advancements within areas of specialization and incorporate improvements into the overall testing process. What You Have: 7+ years of experience in QA Automation engineering is a must. Experience with writing test scripts from scratch for manual testing Strong experience in automated testing practices and tools — Playwright/Selenium/Cypress/Any Othe

Opportunity Overview: This is a unique opportunity to join a high-caliber software engineering team that is experiencing rapid growth. You’ll play a key role in building impactful healthcare technology on a modern technology stack, with a focus on our core data and AI platforms. Your work will focus on enhancing the platform's key features while also balancing scalability, reusability, and performance. As a Staff Engineer on the Application Engineering team, you’ll serve as a senior technical leader - responsible for designing and delivering high-quality, scalable software systems that power Cohere Health’s core platform. You’ll act as a multiplier, elevating the technical bar for the team, mentoring engineers, and partnering with product, data, design , clinical and payment teams to deliver solutions that meet compliance, quality, and performance standards. This role is ideal for engineers who thrive on solving complex problems in healthcare, have deep expertise in building distributed systems including data solutions, and want to influence architectural decisions for security and scale, drive cross-collaborations for alignment, establish technical standards for consistency and evolve both application and data engineering best practices at scale. What you’ll do: Technical Leadership & Architecture Define and drive the architecture of large-scale, distributed application systems across the Cohere platform. Ensure solutions are secure, performant, maintainable, and compliant with NCQA, CMS, and payer requirements. Champion platform engineering best practices in CI/CD, testing, release management, and observability. Hands-On Engineering Write clean, maintainable, and well-tested code, primarily in modern frameworks (e.g., Python, TypeScript/React, Java/Kotlin). Lead the development of core features and APIs that directly impact providers, payers, and patients. Partner with DevOps and Data teams to ensure seamless integration, scalability, and operati

About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount . With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. WHY JOIN CAPCO? You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry. MAKE AN IMPACT Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services. #BEYOURSELFATWORK Capco has a tolerant, open culture that values diversity, inclusivity, and creativity. CAREER ADVANCEMENT With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands. DIVERSITY & INCLUSION We believe that diversity of people and perspective gives us a competitive advantage. MAKE AN IMPACT Experience: 8–10 Years Location: Mumbai Job Summary We are seeking a highly skilled Senior QA Automation Engineer with 8–10 years of experience in software testing and automation. The ideal candidate should have strong expertise in UI and API test automation using Playwright with TypeScript and hands-on experience in Agentic AI testing, including AI-driven workflows, Large Language Models (LLMs), AI agents, and evaluation frameworks. The candidate will play a key role in designing, developing, and maintaining scalable automation frameworks while ensuring the quality of modern AI-powered applications. Key Responsibilities · Design, develop, and maintain robust UI

About Goods & Services Goods & Services is a product design and engineering company. We solve mission-critical challenges for some of the world’s largest enterprises, with deep expertise in highly regulated industries—including life sciences and financial services . Our design-led approach allows us to apply cutting-edge capabilities in AI, Data and Hardware Engineering to companies of any size. Headquartered in the United States , we operate regional development centers in Mexico and the United Kingdom . This global footprint—anchored by our nearshore model—enables us to deliver at scale with the speed, efficiency, and cultural alignment our clients expect. At Goods and Services, we value diversity and are committed to creating an inclusive workplace where everyone can thrive. We are proud to be an Equal Opportunity Employer and welcome qualified applicants from all backgrounds. About the job Goods & Services is looking for a Senior Software Engineer in Test who will deep into the challenging problems, come up with the solutions, and build innovative features which transform customers’ experience and bring efficiency by applying in the software build and delivery process. What you’ll do: Work closely with the Test automation engineers and cross functional product owners to translate the acceptance criteria to technical documents to write the automation scripts and integrate it with Test Automation framework and CI/CD pipeline. Provide the progress status update to Project manager and reporting manager. Ensure you work in align with the given project schedule for you and the team. Ensure all the functional requirements, business process flows are understood, and tested on the test, UAT env in adherence with the Quality assurance process and procedure . What you’ll need: Bachelor’s degree in computer science or related field. 5+ years of experience in manual testing, automated testing and test plan preparation.

CLEAR is building THE secure identity company of the future. Our mission is to make experiences safer and easier—physically and digitally. With more than 43 million Members and a growing network of partners across the world, CLEAR's secure identity platform is transforming the way people live, work, and travel. Whether it’s at the airport, stadium, or throughout your everyday life, CLEAR unlocks the magic of frictionless experiences. Today, CLEAR is well-known as a leader in digital and biometric identification, reducing friction for our members wherever an ID check is needed. We’re looking for a Senior Software Engineer to establish our Observability framework and foundations. You will join us to accelerate building and scaling our innovative systems that support our growing identity platform. You will drive on Observability best practices to find and fix gaps in our observability and our overall systems. You will also lead practices such as load testing, capacity planning, game days, chaos testing, and incident post-mortems. What You Will Do: Embed within the Engineering pillar to deeply understand the product and implement observability across all key flows Facilitate and build load testing cases, ensuring we understand the limits and scaling factors of our services and systems Contribute to observability and support the design of new services and systems, ensuring highly reliable and scalable concepts are implemented Build and lead practices such as game days, chaos engineering, and failure analysis Build long-term capacity plans, with an eye toward reliability and cost-efficiency Who You Are: 6+ experience writing production-grade software in a modern language, such as Java and Python. Strong knowledge of distributed systems concepts (think CAP theorem), microservices architecture, and distributed tracing . Experience with modern observability systems such as Datadog. Experience with performance debugging tools and patterns. You should be able to read a f

Atlas Stream Processing enables developers to continuously process streaming data alongside critical application data stored in their database. It builds on MongoDB’s integrated developer data platform, so developers can stand up a stream processor and database with just a few API calls and lines of code, all fully managed. Our product is quickly gaining traction, and we are adding core features that you will contribute to and own. The team owns the C++ stream processing engine that powers Atlas Stream Processing, built on top of MongoDB's Aggregation Framework. The team operates like a startup within the company, a small group with real autonomy, responsible for everything from the core execution engine and stream processing stages . We’re looking for a Senior Software Engineer to design, build, and evolve this execution engine. Position Expectations Design, build, and deliver core components of the system in collaboration with other stakeholders Help shape architecture, development practices, and escalation policies as the teams and the product grow Mentor fellow engineers and assume ownership and accountability of projects Qualifications Strong background in database internals or building core components for data processing systems (including query execution, storage engines, autotuning, and workload optimization) 5+ years of experience in building database services, distributed systems, and/or foundational cloud services at scale Proven success in designing, writing, testing, debugging, performance tuning, possessing a strong grip on the foundational material of computer science, and maintaining distributed and/or highly concurrent software systems in large, long-lived code bases Good verbal and written technical communication skills, desire to collaborate with colleagues, mentor fellow engineers, and assume project ownership and accountability Track record of identifying problems, implementing solutions, and delivering complex projects in distributed systems or

*Max notice period - 30 Days Technical Skills: Customize and extend Oracle Fusion modules. Experience on development of SaaS extensions using Oracle Visual Builder Cloud Service (VBCS) or Application Composer, Process Cloud Service (PCS) Knowledge on Oracle Financial Modules AP, GL- Familiar with tables, API's and interfaces. Should have expertise in Oracle Fusion Cloud tools such as FBDI, ADFdi, Application Security, Workflows, BPM Workflows, Page Customizations & Extensions, FSR, BI Publisher, OTBI, Alerts etc. Understanding of REST services Understanding on Oracle Cloud Infrastructure, Architecture and Network Topology Understand how to integrate multiple systems with Oracle Fusion using various integration patterns and technologies and OIC Basic skills in Shell scripting Additional knowledge on APEX. Expertise in SQL, PLSQL, Oracle Reports, WEBADI, Oracle Workflow, XML Publisher, and Oracle Application Framework. Expertise in Oracle Forms would be an added advantage Expertise in Github, CICD, Automation Testing would be an added advantage Good debugging skills using above mentioned technical tools. Should have experience in development/support/implementation of CEMLIs. Functional Skills Should have understanding of high-level functionalities of following modules General Ledger Payables Assets Expenses Procurement Soft Skills Able to influence multiple teams on technical considerations, increasing their productivity and effectiveness, by sharing deep knowledge and experience. Self-motivator and self-starter, Ability to own and drive things without supervision and works collaboratively with the teams across the organization.

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. You'll build the agentic AI system that powers creation for millions of Roblox creators. The Assistant team is converging Studio Assistant (desktop) and Build (mobile) into a single cloud-native architecture — one harness, one tool set, one eval framework. You'll work across the full stack: cloud orchestration, LLM integration and model routing, tool/skill execution, and the creator-facing client. The system orchestrates multi-step creation workflows end-to-end: planning, code generation, asset creation, and automated testing. You Will: Help and understand the needs of the community that uses our software, from beginning artists to professional scripters and designers. Take ownership and responsibility for designing, building, testing, and deploying services within the Roblox ecosystem. Work on a variety of unique technical challenges within complex systems. Be a technical bar-raiser for high code quality, architectural designs, and long-term planning. Develop fellow engineers on the team. You Have: 5+ years of experience shipping high-complexity software and supporting mission-critical applications at scale. Experience architecting, designing, and leading implementation across a wide range

Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates. We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused on creating an intelligent ecosystem across HP’s portfolio. Together, we’re developing intuitive, adaptive solutions that spark creativity, boost productivity, and make collaboration seamless. We create breakthrough solutions that make complex tasks feel effortless, teamwork more natural, and ideas more impactful—always with a human-centric mindset. By embedding AI advancements into every HP product and service, we’re expanding what’s possible for individuals, organisations, and the future of work. Join us as we reinvent work, so people everywhere can do their best work. About The Role HP IQ’s System Software team enables on-device experiences to take full advantage of our hardware capabilities. We collaborate with internal and external partners in a high-leverage environment that enables us to spend a majority of our time developing solutions that are unique to our hardware, sensors, algorithms, and interaction models. If you enjoy solving complex, interdisciplinary problems with a world-class team, we'd love to hear from you! What You Might Do Learn what it's like to be a part of a world-class embedded software team building a first-of-its-kind product in a startup environment Responsible for system design and architecture Develop low-level driver and framework software in C and C++ Develop device-focused infrastructure software in Python Debug issues at the interface between hardware and software Optimize software for better performance and lower power consumption Collaborate in the software engineering process with documentation, testing, and code review Essential Qualifications 8+ years of experience in system software engineering and embedded platf