Human Evaluator, Studio (Contract)

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. About the role: Roblox Studio is the creation engine behind millions of immersive 3D games built by creators around the world. We are entering a major platform transition, evolving Studio into an AI-Native IDE where intelligent systems plan, act, validate, and iterate alongside creators to amplify their output. We are seeking a Technical Director, Applied AI to own the technical direction of the agentic AI systems embedded deeply into Roblox Studio. This is a hands-on individual-contributor role operating at the intersection of platform engineering, AI systems, and developer experience, where you will set the technical direction, design the architecture, and write the code. You will: Design and build the agentic AI systems at the core of the AI-Native IDE (planning, execution, validation, evaluation) so they are production-grade and reliable. Decide how Studio uses coding models, agents, retrieval, tool calling, and context management across the Assistant and the broader creator workflow. Own the quality bar and evaluation strategy , standing up quantitative and qualitative eval pipelines, including human-in-the-loop, so we ship with confidence. Optimize these systems for latency, throughpu

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. Roblox's engineering team is expanding rapidly, and we're looking for a seasoned engineering leader to help us scale our AI-powered creation platform and team. As a Senior Engineering Manager within the Creator Group, you will lead the Studio Assistant team — driving the strategy and execution of our agentic AI system that powers creation for millions of Roblox creators. Your team owns everything end-end from the user experience in Studio, to the infrastructure underneath backend by a single cloud-native architecture: one harness, one tool set, one eval framework. Your work will empower millions of creators to plan, generate, and ship content faster than ever before. At Roblox we move fast and ship code to production daily; your leadership will increase productivity by removing obstacles and keeping processes lean. You will identify and mitigate risk and make sure the technology outpaces our growth. Roblox teams are inclusive, helpful, and have a strong sense of ownership over the things they build. If you have a desire to grow and learn, you will fit right in with our highly-skilled and ever-expanding engineering team. You Are: Battle ready: You have experience defining architecture for AI

Who We Are Notion is the collaborative AI workspace where teams and agents think together . We're building one place where your knowledge, projects, meetings, and AI tools live side by side, so work is faster, clearer, and less fragmented. Millions of individuals, small teams, and large companies run their work on Notion. Notinos (our employees) are customer zero in bringing this future of work to life. We care about craft, building things that last, and the belief that great work is still fundamentally human. Our goal isn’t to ship the next feature. Each and every team of Notinos is working to set the standard for how humans work together in the AI era. From building a business’s system of record to making and managing AI agents to automating away the busy work, we care deeply about giving our customers more time for their life’s work. About the Role: We’re seeking an experienced UX Researcher to define and scale how we evaluate Notion’s AI-powered experiences—focusing on what “good” looks like not only for model output quality, but for the end-to-end product experience where people discover, set goals, delegate work, review results, and build trust over time with AI. This role sits at the intersection of research craft and evaluation operations: you’ll run studies that uncover user mental models, expectations, and failure/recovery behaviors, then translate those insights into reusable rubrics, workflows, and measurement approaches that product, design, engineering, and data science can apply consistently. This role can be based in either San Francisco or New York City. We work from our offices on Mondays, Tuesdays and Thursdays (our Anchor Days) because we do our best thinking and building together in person. We’re looking for someone who’s excited to work alongside the team during those days. What You'll Achieve: Define what “good” looks like (frameworks & rubrics): Establish clear, reusable evaluation criteria that reflect real user expectations—helpfulness,

Test & Evaluation Lab Tech (Electrical/Electronic Equipment) Company: The Boeing Company The Boeing Company has an exciting opportunity for Test & Evaluation Lab Tech to join Boeing Defense, Space & Security (BDS) in Berkeley, MO. As a Boeing employee you’ll be part of a winning team that does great things every day BDS is a global leader in the development, production, maintenance and enhancement of fixed-wing and rotary wing aircraft, commercial and government satellites, human spaceflight programs and weapons. Key markets include aeronautics, space and weapons. Core capabilities are in development, production and mission enabling upgrades of integrated solutions. BDS delivers the most digitally advanced, simply and efficiently produced and intelligently supported solutions to its customers. Position Responsibilities: • Installing and maintaining Flight Simulation equipment consisting of computers, monitors, audio systems, visual systems, crew stations and rack equipment • Troubleshoot and resolve electronic hardware issues with minimum down time • Plans, conducts and documents tests on products, systems, components, materials, and manufacturing processes and technologies • Designs, fabricates, builds and analyzes test systems, materials, components, software and methodologies • Coordinates test requirements, determines test methods and capabilities • Conducts system test preparations by coordinating system integration, fabrication, modification, setup, checkout and tear-down • Troubleshoots and resolves laboratory and test-related problems • Coordinates test laboratory activities and maintenance and repairs • Coaches and trains others • Works under general direction </

Test & Evaluation Lab Tech (Electrical/Electronic Equipment) Company: The Boeing Company Job Description The Boeing Company has an exciting opportunity for Test & Evaluation Lab Tech to join Boeing Defense, Space & Security (BDS) in Berkeley, MO. As a Boeing employee you’ll be part of a winning team that does great things every day BDS is a global leader in the development, production, maintenance and enhancement of fixed-wing and rotary wing aircraft, commercial and government satellites, human spaceflight programs and weapons. Key markets include aeronautics, space and weapons. Core capabilities are in development, production and mission enabling upgrades of integrated solutions. BDS delivers the most digitally advanced, simply and efficiently produced and intelligently supported solutions to its customers. Position Responsibilities: • Installing and maintaining Flight Simulation equipment consisting of computers, monitors, audio systems, visual systems, crew stations and rack equipment • Troubleshoot and resolve electronic hardware issues with minimum down time • Plans, conducts and documents tests on products, systems, components, materials, and manufacturing processes and technologies • Designs, fabricates, builds and analyzes test systems, materials, components, software and methodologies <span style

About the Team The Human Data team turns human feedback into reliable signals for training and evaluation. We design and run end-to-end programs that capture the depth of human intent behind everyday and high-stakes uses of our models. Our remit spans bespoke data campaigns, scalable synthetic data generation, and product-embedded signals. We partner closely across all research teams to translate these signals into training datasets, novel evaluations, and feedback loops that push the frontier of our models and advance their applications. About the Role As a Program Manager (PGM) in the Human Data team you will partner with our research teams, operations and engineering to execute complex programs for collecting high-quality data. You will be a key interface between our external vendors and AI trainers, ensuring human data campaigns are successfully completed. Your work will play a key role in enabling OpenAI to train safe models that will land in the real world This role is based in our San Francisco HQ. In this role, you will: Work in a high velocity environment, where the outcome of your work will have a direct impact on the models that OpenAI deploy in the real world Work closely with external vendors, trainers and internal researchers to collect, review, and deliver high-quality data Gather requirements, write instructions, define success criteria, and calibrate the AI trainers Use internal tooling to assess labeled data and provide feedback to AI trainers Think critically and share recommendations on tooling and process improvements, optimizing for quality, throughput, and AI trainer experience You’ll thrive in this role if: You thrive in dynamic environments. You are comfortable navigating ambiguity, managing shifting priorities, and adapting to fast-paced changes without missing a beat. You’re curious about AI, LLMs, Agents. While not required, an interest or background in these areas will help you connect the dots in our broader mission. You have a can-do a