Test Safety 201 in United States

About the Team The Human Data team at OpenAI is responsible for identifying and mitigating risks in advanced AI systems by designing evaluations, surfacing vulnerabilities, and collaborating closely with researchers to strengthen model reliability and public trust. About the Role As a Research Program Manager, you will lead initiatives that test the safety and robustness of OpenAI’s models through creative experimentation and structured evaluation. You’ll coordinate efforts across research and engineering teams to transform ambiguous risks into concrete research programs and influence future model development and deployment. We’re looking for people who are technically savvy, comfortable with ambiguity, and excited about shaping the future of safe AI. This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees. In this role, you will: Lead programs that explore unexpected model behaviors and identify failure modes. Translate vague or emergent risk signals into clear priorities and actionable research plans. Design and run creative evaluations, experiments, and red-teaming campaigns. Collaborate with research, product, and deployment teams to integrate findings into model training and deployment cycles. Develop repeatable systems for tracking model performance and understanding emerging behavior patterns. You might thrive in this role if you: Have strong experience in technical program management, with excellent organizational and communication skills. Are familiar with large language models, prompt engineering, or model evaluation techniques. Are comfortable managing fast-paced, high-uncertainty projects and shaping them from the ground up. Are creative and resourceful in devising new methods for testing model behavior and performance. Can effectively coordinate across technical and non-technical stakeholders to drive alignment and execution. About OpenAI OpenAI is an AI resear

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. As a Senior QA Engineer, you will be the first dedicated QA hire for the Safety Engineering Group, which is responsible for building the infrastructure and policies that make Roblox the safest online community in the world. You will report to the QA Engineering Manager for Universal Apps and collaborate across the Safety organization to own end-to-end test strategies for high-stakes, 24/7 incident response systems and parent-facing safety features. This role is a unique opportunity to shape the quality culture of a company-level mandate from the ground up. You will: Partner with Engineering and Product to define and maintain comprehensive, risk-based test coverage for Safety features and systems. Own the end-to-end test strategy for Safety initiatives, including functional, regression, integration, and edge-case validation. Leverage and expand internal automation frameworks to automate critical user flows and drive API-first validation strategies. Identify high-impact automation opportunities and incorporate industry best practices to design robust, abuse-resistant test scenarios. Develop, track, and report on quality metrics (e.g., defect trends, coverage gaps) to proactively surface relea

We’re building a world of health around every individual — shaping a more connected, convenient and compassionate health experience. At CVS Health®, you’ll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger – helping to simplify health care one person, one family and one community at a time. Position Summary We are seeking a Software Development Engineer In Test, to apply advanced software engineering skills to improve quality across the development lifecycle through scalable test frameworks, developer tooling, and reusable automation solutions. This is a senior individual contributor role for a developer who specializes in testing, testability, and quality engineering. This role combines hands-on engineering with technical leadership across teams. The individual will influence architecture, strengthen automation strategy, improve developer feedback loops, and help establish consistent quality engineering practices that scale across products and platforms. The role carries strong Software Development Engineer in Test expectations, with an emphasis on building engineering solutions that improve product quality, platform reliability, and development velocity. Primary Responsibilities Design, develop, and evolve scalable test frameworks, automation libraries, and developer-facing quality tools Understand how the broader software ecosystem works together and define quality engineering approaches that align to platform strategy Partner with Product, Architecture, and Engineering teams to define test strategy, coverage goals, and acceptance criteria Build reusable utilities, harnesses, mocks, stubs, and data solutions that improve system

Structures Lab Test Engineering Manager Company: The Boeing Company Boeing Test & Evaluation (BT&E) has an exciting opportunity for a Structures Lab Test Engineering Manager to join our team in Tukwila, WA . This manager will be responsible for managing day-to-day Structures Lab Test operations in support of multiple Boeing Commercial Airplanes (BCA) & Boeing Defense, Space and Security (BDS) development and sustaining programs, as well as defining the strategy and execution plan to position their team and lab for the future of our program partners’ testing needs. This role requires a determined commitment to safety, quality, and functional excellence that will drive increased efficiency and schedule performance. A true focus on people, understanding how they are the key to our success and a commitment to developing them individually is required, as well as a sincere commitment to Seek, Speak and Listen as a cultural norm. Position Responsibilities: Manage employees performing engineering and technical activities in the areas of Structures Test & Materials Verification Develop and execute project and process plans, implement policies and procedures and set operational goals Acquire resources for projects and processes, provide technical management of suppliers, and lead process improvements Manage capital investment projects and long-range planning for capital investments into the lab Develop and maintain relationships and partnerships with customers, stakeholders, peers, partners and direct reports Provide oversight and approval of technical approaches, products and processes Develop and engage employees through coaching, mentoring, and performance management, as well as id

Nondestructive Test (NDT) Technician - UT & RT Company: Boeing Defense, Space & Security (BDS) has exciting opportunities for Nondestructive Test (NDT) Technicians (Associate or Experienced) in St. Louis, MO! Join our dynamic and supportive Quality team! In this role, you will conduct Non-Destructive Testing (NDT) on aerospace products using cutting edge methods including ultrasonic (UT), eddy current (ET), and radiographic (RT). You will work with digital and automated inspection systems in an aerospace environment aligned with industry standards and regulations. Opportunities for rapid skill growth and progress depending on performance. Employees will be required to obtain Boeing NDT certification and pass a vision exam. Failure to achieve or maintain certification requirements may lead to termination of employment. Candidates must have documented evidence of NDT education and/or OJT hours in UT or RT available for Boeing Level 3 review. Work Environment: May be exposed to noise, dust, fumes, airborne particles, smoke (not over OSHA permissible exposure levels). This position requires the applicant to work in a radiation environment and involves exposure to radiation. Candidates must demonstrate a strong understanding of relevant safety and health regulations, protocols, policies, and procedures to ensure a safe working atmosphere for self and others. Safety training and equipment are provided by Boeing in accordance with applicable laws, industry standards, and company policies. Will be required to wear Personal Protective Equipment (PPE) applicable to the testing method being used. Able and willing

Work Flexibility: Onsite ​​​ Schedule 1st Shift: Mon – Fri, 8am – 5pm Overtime based on business needs What you will do As the Senior EMC & RF Test Technician, you will contribute to global regulatory compliance efforts through the execution of testing activities, development of in-house laboratory capabilities, and support of projects that ensure products meet evolving international product safety and EMC standards.​​ ​​​Perform and document electromagnetic compatibility (EMC) and radio frequency (RF) testing on new and existing medical devices to demonstrate compliance with applicable domestic and international standards. ​Operate, maintain, troubleshoot, and verify EMC and RF laboratory equipment, including shielded rooms, EMC chambers, antennas, receivers, signal generators, amplifiers, and associated test instrumentation. ​Configure, build, modify, and verify product test setups and support equipment to meet EMC and RF testing requirements. ​Support the development, expansion, and continuous improvement of in-house EMC and RF testing capabilities to meet evolving technology and compliance requirements. ​Collaborate with engineering teams to develop test strategies, execute compliance testing, and support product development activities. ​Investigate, troubleshoot, and document test failures, observations, and anomalies, communicating findings and recommendations to engineering and project teams. ​Create, update, and maintain test procedures, protocols, job-aids, work instructions, and laboratory documentation in accordance with quality system requirements. ​Evaluate, recommend, procure, and maintain laboratory equipment, software, and tools necessary to support current and future EMC and RF testing capabilities. ​Identify and implement improvements t

About the Team The Agent Safety team works to ensure that increasingly capable AI agents act safely, exercise sound judgment, and remain aligned with user intent. Our mission is to reduce the probability of severe unintended outcomes from increasingly capable AI agents while preserving their ability to act effectively and autonomously. Our work spans three areas: Training: Create training methods, environments and data that teach agents to make better decisions in consequential situations. We turn real-world failures into training signals that prevent similar incidents, and identify precursor behaviors and mitigations to address emerging risks. Measurements: Build evaluations and production metrics that identify emerging risks and measure whether our interventions work. Oversight : Develop oversight and system mitigation mechanisms that reduce harmful actions while preserving useful agent autonomy (for example future versions of auto-review ). About the Role This role focuses on oversight and system-level mitigations that enable increasingly capable agents to operate safely and autonomously in real environments. We prioritize building oversight systems that are used in practice today, both internally and externally (see our recent work on action monitoring for codex and former code review ). We also study longer-term questions about how increasingly capable agentis systems can be supervised, constrained, and corrected. We’re looking for a safety&security minded researcher or engineer who can reason rigorously about security boundaries and agent behavior, then build and test practical mitigations. A background in AI control or security is welcome but not required. This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees. In this role, you will: Design, build, and evaluate system-level controls for agent actions like agent-based review. Plan how they fit in a broader syste

Mid-Level or Senior Aerospace Systems Safety Engineer Company: The Boeing Company The Boeing Defense Air Dominance Division Systems Safety & Mission Assurance organization is looking for an Aerospace Systems Safety Engineer to join our team in Hazelwood, MO . Our teams are currently hiring for a broad range of experience levels including Experienced (Level 3) or Senior (Level 4) Aircraft Safety Engineers. A successful candidate will perform system software safety engineering work on a Proprietary Air Dominance program, drive hazard analyses, demonstrate compliance to MIL‑STD‑882E and other standards, and influence system architecture to reduce safety risk. The selected candidate will provide technical guidance and perform critical Software System Safety Engineering work. In addition to working with System Safety personnel, the individual will work extensively with design, development, and test to incorporate robust safety features and reduce project safety risk. Primary responsibilities: Analyzes the integration of complex airplane systems and their corresponding airplane-level effects, failure indications, and flight crew actions as part of a system of systems analysis Documents safety analyses, hazard mitigation, validation, and verification activities in compliance with relevant customer and regulatory safety standards such as MIL-STD-882E, MIL-HDBK-516C, AC-17-01, DO-178C, and DO-254. Demonstrates safety hazard risk mitigation and control methods to the customer and regulators Identifies safety issue systemic root causes and recommends corrective actions using industry best practices Collaborates with internal and external stakeholders to define, validate, and inte

Senior Nondestructive Test (NDT) Technician Company: Boeing Defense, Space & Security (BDS) has an exciting opportunity for a Senior Nondestructive Test (NDT) Technician - UT & RT to join our Quality Fabrication organization in St . Louis, MO! Join our dynamic and supportive Quality team! In this role, you will conduct Non-Destructive Testing (NDT) on aerospace products using cutting edge methods including ultrasonic (UT), eddy current (ET), and/or radiographic (RT). You will work with digital and automated inspection systems in an aerospace environment aligned with industry standards and regulations. Opportunities for rapid skill growth and progress depending on performance. Employees will be required to obtain Boeing NDT certification and pass a vision exam. Failure to achieve or maintain certification requirements may lead to termination of employment. Candidates must have documented evidence of NDT certification, education and/or OJT hours in UT or RT available for Boeing Level 3 review Work Environment : May be exposed to noise, dust, fumes, airborne particles, smoke (not over OSHA permissible exposure levels). This position requires the applicant to work in a radiation environment and involves exposure to radiation. Candidates must demonstrate a strong understanding of relevant safety and health regulations, protocols, policies, and procedures to ensure a safe working atmosphere for self and others. Safety training and equipment are provided by Boeing in accordance with applicable laws, industry standards, and company policies. Will be required to wear Personal Protective Equipment (PPE) applicable to the testi

This is where your work makes a difference. At Baxter, we believe every person—regardless of who they are or where they are from—deserves a chance to live a healthy life. It was our founding belief in 1931 and continues to be our guiding principle. We are redefining healthcare delivery to make a greater impact today, tomorrow, and beyond. Our Baxter colleagues are united by our Mission to Save and Sustain Lives. Together, our community is driven by a culture of courage, trust, and collaboration. Every individual is empowered to take ownership and make a meaningful impact. We strive for efficient and effective operations, and we hold each other accountable for delivering exceptional results. Here, you will find more than just a job—you will find purpose and pride. Your role at Baxter The Service Tech is responsible for performing repairs and/or electrical testing on the Spectrum Infusion Pump. Ensuring the highest level of quality, individuals in this role follow documented standard work instructions and document findings into the system of record. Individuals in this role may also assist other areas of the value stream such as packaging (for shipment), repair or testing, as needed. What you'll be doing Follow defined Quality Management Systems, all applicable written procedures, review maintenance records and complete all documentation as required and in accordance with Good Documentation Practices (GDP) Adhere to all environmental, health and safety standard operating procedures and policies, including any department specific requirements. <span style="font-size:inhe

About the Team Our Robotics team is focused on unlocking general-purpose robotics and pushing towards AGI-level intelligence in dynamic, real-world settings. Working across the entire model stack, we integrate cutting-edge hardware and software to explore a broad range of robotic form factors. We strive to seamlessly blend high-level AI capabilities with the constraints of physical systems to improve peoples’ lives. About the Role We are seeking an Electrical Engineer to build and own the electrical backbone of our robotic actuator dynamometer and test infrastructure. You will design, integrate, and operate the load motor drives, power distribution, instrumentation wiring, DAQ interfaces, and safety systems that make high-performance robotic actuator testing repeatable, safe, and scalable. This role spans hands-on lab execution and system architecture: selecting and commissioning power electronics, designing robust test-cell electrical systems, bringing up sensors and DAQ, and partnering with mechanical and software engineers to turn robotic actuator hardware into trustworthy data. In this role, you will Own the electrical architecture of dynamometer and actuator test cells, from mains distribution and protection through load motor drives, braking, and auxiliary power. Specify, integrate, commission, and tune motor drives and load machines for robotic actuator torque, speed, efficiency, thermal, and durability testing. Design power distribution, grounding, shielding, cable routing, and connectorization for high-current, high-voltage, and low-level measurement systems. Integrate torque, position, speed, temperature, voltage, current, vibration, and other instrumentation from robotic actuators into DAQ and control systems. Develop electrical schematics, wiring diagrams, panel layouts, harness documentation, and test-cell interface definitions. Build, debug, and maintain test-cell electrical hardware, rapidly diagnosing noise, EMI, grounding, drive, sensor, and power-q

About the team Preparedness is a critical Safety Research team at OpenAI, which is focused on mitigating AI threats to global security that could scale to an extreme level of severity. Our work involves: Measurement. Monitoring and predicting the evolving capabilities of frontier AI systems. Mitigation. Keeping misuse safeguards, alignment tools, and security measures on track to adequately address extreme threats that might arise in the future. Coordination. Setting mitigation targets by maintaining OpenAI’s preparedness framework , and partnering with other staff to achieve these targets. This is urgent, fast-paced work that has far-reaching implications for the company and for society. About the role As AI agents become more capable at software engineering, and automate more of our internal work, they could become a dangerous cyber threat. People in this role will help OpenAI prepare for security threats from advanced AI agent insiders. In this role, you will: Identify paths by which capable future internal AI agents could compromise OpenAI. Design security controls - focusing on measures with long lead times that benefit from advanced preparation. Stress-test defenses with AI agent evaluations and penetration tests You might thrive in this role if you: Are deeply technical across security and modern infrastructure, and are comfortable digging into the details of operating systems, cloud, containers, CI/CD, or distributed systems. Have strong software engineering skills and enjoy building prototypes yourself. Are interested in engaging with stakeholders and can do so effectively. Bonus: have experience securing cloud infrastructure, and are deeply familiar with core components of the AI stack. Compensation Range: $293K - $405K USD About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. Principal Technical Architect - AI/ML LEAD. STRATEGIZE. TRANSFORM. SUMMARY: Recognized expert and strategic technical advisor resolving critical, wide-ranging design matters for legacy modernization and Generative AI. WHY THIS ROLE? You act as the technical "North Star" for high-stakes migrations. You exercise wide latitude in determining objectives and approaches to critical assignments with high business impact. WHAT YOU’LL DO: Develop reusable solution patterns, global reference architectures, and practice-wide white papers. Modernize legacy stacks (Netezza, Teradata, Exadata) into Snowflake AI workloads using deep architectural knowledge. Act as a trusted technical advisor to C-suite stakeholders, bridging business strategy with AI execution. Solve for LLM robustness, including managing prompt safety, hallucinations, and latency at enterprise scale. Gen AI Robustness: Architect enterprise-grade guardrails for LLMs, ensuring safety and performance. Legacy Transformation: Facilitate high-complexity data migrations from on-prem legacy systems into AI-ready cloud environments. Strategic Risk Management: Determine technical approaches for assignments that impact regional or global design success. SNOWFLAKE-NATIVE TECH STACK: Vector Data Types, Snowflake Cortex, Advanced LLM

Work Flexibility: Onsite 1st Shift: Monday - Friday 8am-5pm What You Will Do: Own the operation, maintenance, and audit readiness of assigned laboratory areas, ensuring compliance with operational standards and safe laboratory practices. Serve as the primary asset owner for assigned lab equipment, overseeing maintenance, repairs, calibration, and contributing to equipment acquisition and retirement decision Provide day-to-day guidance, mentoring, and technical training to junior technicians, modeling best practices and safety-first behaviors. Lead the fabrication, qualification, verification, and validation (V&V) of complex test fixtures, providing expertise on components and construction processes. Independently execute development and verification testing with limited oversight, applying sound technical judgment to resolve test issues or deviations. Ensure accurate, compliant documentation by consistently following Good Documentation Practices (GDP) and clearly communicating test results. Manage laboratory logistics, including inventory control and proactive supply purchasing, balancing engineering needs, business priorities, and budget constraints. Continuously identify and implement opportunities to improve lab efficiency, expand testing capabilities, and enhance overall service offerings. What You Need: <span style="col

About the Role The Engineering Acceleration team builds and operates the foundational systems that engineers use to build, test, and ship ChatGPT, the API, and OpenAI's infrastructure. We are looking for an engineer to help evolve OpenAI's build and continuous integration systems for a fast-growing engineering organization. This role sits at the intersection of developer productivity, build systems, distributed infrastructure, and software quality. You will work on the systems that determine how quickly and confidently engineers can move: Bazel-based builds, Buildkite pipelines, test selection, remote caching and execution, CI observability, and tooling that helps engineers understand and fix failures quickly. Our mission is to make OpenAI one of the most productive engineering organizations in the world while preserving a high bar for correctness, reliability, and safety. The best version of this work is invisible when it succeeds: builds are fast, tests are trusted, CI failures are understandable, and engineers can focus on shipping useful systems instead of fighting infrastructure. In This Role, You Will Own and evolve Bazel-based build and test workflows across a large, polyglot monorepo. Design and maintain Starlark rules, macros, toolchains, and integrations that make builds reproducible, hermetic, and easy for product teams to adopt. Improve CI performance and reliability across Buildkite pipelines, including queue time, build time, cache hit rates, test sharding, retry behavior, and flake isolation. Build systems that reduce unnecessary CI work through affected-target detection, dependency graph analysis, test selection, caching, batching, and smarter scheduling. Improve local development workflows so engineers can reproduce CI behavior, debug build failures, and iterate quickly without learning every detail of the build stack. Operate and optimize build infrastructure across Docker/OCI images, Kubernetes-based runners, cloud resources, and remote cache/exec