Human Evaluator in United States

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. As a Global Mobility Lead, you will report to the Global Mobility Manager who oversees Roblox’s worldwide immigration and relocation programs. As a member of Global Mobility team, this role will serve as a Subject Matter Expert for employees, managers, and internal stakeholders on complex immigration cases, implications, and relocation logistics. This role will ensure a seamless, compliant, and positive experience for employees and their families throughout their global mobility journey. You Will: Immigration Strategy & Compliance (Core Focus): Serve as Subject Matter expert on global immigration laws. Manage the full lifecycle of global work permit, visa, and residency applications, coordinating with external legal counsel. Conduct immigration assessments, determine eligibility, and identify risks. Ensure robust compliance, maintaining meticulous records and audit trails. Monitor regulatory changes and advise on impacts. Vendor Management & Collaboration: Manage relationships with global mobility service providers (immigration firms, relocation companies, tax consultants). Collaborate and advise HR Business Partners, Legal, Finance, and Payroll to ensure streamlined processes

What you'll do Run human-subjects recording sessions end-to-end: participant prep and fitting, sensor configuration and calibration, stimulus delivery, real-time signal monitoring, and session documentation. Own daily system QC for a one-of-a-kind sensing instrument: baseline noise recordings, per-sensor health checks, log review, and escalation of anomalies before they touch a dataset. Own participant operations: recruitment coordination, scheduling, screening, consent, and compliant handling of participant records. Stand up and maintain the operational backbone of the program: SOPs for acquisition, QC, and participant workflows — documentation that survives you. Handle first-pass data operations: file conversion, organization, metadata, and quality review in Python. Partner daily with the program lead to refine acquisition protocols and improve system performance over time. What we're looking for Hands-on experience acquiring physiological or imaging data from human participants in a clinical or research setting Obsessive consistency and attention to detail: you notice when something is off and you don't let it slide. Professional, patient, and calm with research participants — sessions succeed or fail on how people feel in the room. Basic scripting ability (Python and/or shell) for QC and data-handling tasks, or clear aptitude and motivation to build it. High ownership of the unglamorous parts: scheduling, documentation, tidy data hygiene. Discretion — parts of this program are not yet public. We'll walk you through the specifics, including the exact technology you'd be operating, in the first conversation. Useful experience Controlled or low-noise recording environments and highly sensitive instrumentation. Physiological signal-processing tools in Python. Human-subjects research administration (IRB protocols, consent workflows). Research studies involving structured tasks or sensory protocols with human participants.

Senior Product Manager - Search Datadog’s Search team helps users – both human and agents – find answers to their questions. Search is a critical function in Datadog, and touches many product surfaces: the query editors in product homepages and dashboards, search bars for finding relevant assets, the global cmd+k navigation search, and the MCP tools that our Bits AI agent uses to respond to natural language prompts. Search is a full-stack team: owning user-facing search components, backend search ranking systems, and machine learning models to produce recommendations. The Search team is relatively new, and still growing. We have recently built out agentic search tools, and we are looking for a leader to help us expand to ambitious orchestration systems that deliver accurate results, and proactive recommendations across both keyword and semantic search. Beyond this, you’ll have room to influence how Datadog thinks about Search as a strategic surface. What you’ll do: Define and deliver how Datadog's AI agents discover the right context and tools to answer natural-language questions accurately and at scale Stay on top of industry trends in UI and agentic search experiences and capabilities Collaborate with Applied AI teams to integrate ranking, personalization, and recommendation models that scale across both human and agentic users Define and monitor KPIs for search quality, adoption, and downstream impact on user productivity; use them to drive data-informed decision making Engage directly with customers and internal product teams to deeply understand search journeys across query editors, global navigation, and natural-language agent interfaces Who you are: You have experience with search, ranking, or recommendation systems You are familiar with or very interested in MCP servers and differences between human and agentic UX You have a sharp eye for design and strong opinions on the micro-interactions — keyboard navigation, autocomplete behavior, loading

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Get to know Okta Okta is The World’s Identity Company. We free everyone to safely use any technology, anywhere, on any device or app. Our flexible and neutral products, Okta Platform and Auth0 Platform, provide secure access, authentication, and automation, placing identity at the core of business security and growth. At Okta, we celebrate a variety of perspectives and experiences. We are not looking for someone who checks every single box - we’re looking for lifelong learners and people who can make us better with their unique experiences. The Customer First Team We are a team of Identity and Access Management experts. We help customers, businesses, and organisations maximise their Okta IAM platform investment, providing rapid time-to-value in adoption and usage and promoting scalability and agility. Our team sits within the Customer First area - focused on ensuring the long term success of our customers. Join our team! We’re building a world where Identity belongs to you. Role Summary Reporting to the Sr. Manager, Strategic Programs and Delivery Governance, the Program Manager, Services Solutions & Delivery Acceleration is a key operational and technical enablement leader within our Global Professional Services and Delivery Success organization. This role treats "services as a product"—transforming custom, highly complex implementation workflows into standardized, packaged service solutions and reusable delivery acceleration toolkits. Work

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Okta is the identity standard. The Okta Platform is an independent and neutral platform that securely connects the right people to the right technologies at the right time. We help organizations do two things - secure and manage their extended enterprise, and transform their users’ experiences. Okta's Core Engineering team is responsible for building and evolving shared infrastructure and services that lay the foundation for what other engineering teams build on. We're in charge of common shared services like search, cache, configuration management, frameworks for async job management, and email pipeline, to name a few. We're cloud native, where redundancy, multi-tenancy, scale, resource optimization and resiliency are first class citizens. With Okta's mantra of 'Always On!' there's never a dull moment. Our biggest asset is our team of passionate engineers and technically minded managers. We're looking for a staff level backend engineer to join a team of highly skilled and talented team players who're proud of what they own and deliver. Our elite team is fast, creative and flexible; with a weekly release cycle and individual ownership we expect great things from our engineers and reward them with stimulating new projects, new technologies and the chance to have significant equity in a company that is changing the cloud computing landscape forever. You will: Work with engineering teams to design, develop and deliver cloud based infrastructu

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. The Global Pricing Operations Team The Pricing Operations team works in a cross-functional, fast-paced, and dynamic environment with many moving pieces and evolving business needs. The team partners with Pricing Strategy Managers, Product Managers, Technology, Data & Intelligence, and various GTM teams to ensure Okta is operationally ready to bring new product pricing, buying programs, and strategic monetization initiatives to market. The Pricing Operations Principal Opportunity Okta is seeking a Pricing Operations Principal to lead initiatives that transform Okta's pricing strategy into successful go-to-market execution. A successful person in this role will be a strong collaborator, intensely curious, and supremely organized. They are known for connecting the dots, simplifying complexities, communicating clearly and proactively, and driving highly collaborative efforts to completion, even when the path forward isn't perfectly defined. In this role, you will serve as an operational leader for new pricing launches and a strategic buying-program implementation, establishing the integrated roadmap, operating cadence, decision-making framework, readiness criteria, and stakeholder communications required to bring these initiatives from concept through launch and sustained adoption. You will partner closely with senior cross-functional leaders to make complex tradeoffs, resolve dependencies, and ensure the business is ready to sell, quote,

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Senior Software Engineer (Federal) Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. The Okta Identity Governance Team Okta Identity Governance (OIG) is Okta's Identity Governance and Administration solution, responsible for some of the most critical and visible workflows in enterprise identity: how people request access, how approvers grant it, how entitlements are enforced, and how organizations prove to auditors that only the right people have the right access. OIG is the leading contributor to Okta's new product bookings, and it runs inside some of the largest enterprises in the world — the kind of accounts where a single tenant carries hundreds of thousands of identities across thousands of applications. OIG currently supports high-compliance public sector workloads and plans to expand our footprint to support the most secure, highly classified environments in government. The Senior Software Engineer (Federal) Opportunity As a Senior Fullstack Engineer on the OIG (Federal) team, your mission

VP, Product Insurance underwriting runs on human judgment, manual workflows, and knowledge locked in someone's head. It breaks when that person leaves and doesn't scale when the book doubles. Sixfold is building AI agents that understand risk the way a 20-year veteran underwriter does. Not summaries or flags, but systems that make real decisions on billions in premium for some of the world's largest carriers. AI is the product, the workflow, and the moat. If you think in systems, move fluidly from research to pixels, and are energized by designing AI-native experiences where the best practices haven't been written yet — this role was made for you. Who We Are 🏔 Product: Sixfold is the AI brain for underwriting. Our platform handles submissions at scale, assessing risk against appetite, surfacing cited insights, and deploying AI agents to handle research, referrals, and triage so underwriters can focus on building profitable portfolios. 💪 Team: A focused team of insurance operators, AI researchers, and engineers who love hard problems. We've pushed the boundaries of what AI can do with unstructured data — from teaching AI to understand that a bakery in Florida faces different risks than one in Montana, to knowing when a manufacturing company's pivot from toys to medical devices fundamentally changes their risk profile. We ship fast and stay close to customers. 📈 Traction: Processing billions in premium for some of the world's largest carriers. We know AI. We know underwriting. We're building what comes next. About the Role You'll inherit a strong product and a capable team, but that's the starting point, not the job. The job is figuring out what underwriting becomes once AI stops assisting and starts deciding, and getting there faster than the market expects. You prototype to find out, not to perform speed. You're drawn to this problem because the underwriter of the future is one of the more interesting design problems in software right now. In this role, you will:

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. About the role: The Customer Success Executive - Enterprise role will play a critical part in the exciting growth and retention trajectory of the Enterprise Sector at Okta. You will report to the Regional Manager, Customer Success and be responsible for complementing Okta’s innovations, best practices, and capabilities with our valued customers’ business objectives and priorities. As a strategic and trusted advisor, you will shift customer mindsets, create demand for our solutions, and drive higher business value and executive alignment between Okta and our customers. The ideal candidate embodies a high-performance mindset—consistently raising the bar, turning action into traction, thriving in change, and moving fast to simplify and repeat. It requires complementing Okta’s innovations, efficiencies and capabilities with our valued customers’ business objectives and priorities thereby driving higher business value and executive alignment between Okta and our customers, but it also demands a leader who can navigate these constraints with urgency and an obsession for concrete outcomes. Strong problem-solving, orchestration, and consultative skills are necessary for navigating challenges, finding innovative solutions, and winning as a team. In this role, you will: Deliver Customer Value: Develop and nurture strong customer and C-Level relationships to understand their business goals and needs, ensuring retention, happiness, and a significant return on inv

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Senior Solutions Engineer (Enterprise Pre-Sales) Secure Every Identity, from Human to AI Agent About the Role At Okta, we believe that identity is the foundation of security and digital transformation. As a Senior Solutions Engineer, you will be the trusted technical advisor to our largest, most complex enterprise customers and a critical driver of our sales organization. We are looking for a highly strategic Pre-Sales professional whose consultative expertise, emotional intelligence, and enterprise sales acumen are their defining strengths. While technical agility is required, your primary focus will be owning the technical sales cycle by anchoring technical features to positive business outcomes. You will partner closely with Enterprise Account Executives to uncover top-of-mind business challenges—specifically around mitigating risk, reducing costs, and driving operational efficiency. By establishing value-based conversations, you will prove how Okta’s independent, neutral, and end-to-end identity platform can transform their architecture and secure the "Tech Win" on large-scale deals. What You'll Be Doing Master the Discovery Process: Leverage exceptional active listening to dig deep into customer pain points. You will uncover the 'why' behind the initiative, focusing on how Okta's vast pre-built integrations and scalable architecture can solve their most complex, diverse environmental challenges. Navigate Complex Organizations: Translate highly technica

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Business Analyst Chicago, Illinois Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. The Customer First Team We are a team of Identity and Access Management experts. We help customers, businesses, and organizations maximize their Okta IAM platform investment, providing rapid time-to-value in adoption and usage and promoting scalability and agility. Our team sits within the Customer First area - focused on ensuring the long term success of our customers. Join our team! We’re building a world where Identity belongs to you. Role Summary The Business Analyst (BA) is a central figure on the Okta Professional Services team. Your mission is to serve as the bridge between customer business objectives and technical implementation, driving high-impact outcomes for Okta Identity and Access Management (IAM) deployments. You will own the requirements lifecycle—from initial discovery and stakeholder alignment to functional design and solution integrity—ensuring that the final delivery is secure, scalable,

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. The Customer First Team We are a team of Identity and Access Management experts. We help customers, businesses, and organisations maximise their Okta IAM platform investment, providing rapid time-to-value in adoption and usage and promoting scalability and agility. Our team sits within the Customer First area - focused on ensuring the long term success of our customers. Join our team! We’re building a world where Identity belongs to you. Role Summary The Business Analyst (BA) is an essential member of the Okta Professional Services team. This role offers a unique opportunity to learn Identity and Access Management (IAM) fundamentals from the ground up. You will serve as a bridge between customer business objectives and technical implementation, developing the skills to own the requirements lifecycle and ensuring final deliveries are secure, scalable, and aligned with strategic needs. Key Responsibilities Discovery & Requirements Facilitation: Facilitate stakeholder workshops to uncover requirements, map current-state IAM processes, and identify dependencies and pain points across IT, security, and application teams. Documentation & Solution Design: Translate business needs into detailed functional and non-functional requirements. Produce clear business process flows and solution design diagrams to visualize the "how" and "why" behind the technical configuration. Traceability & Solution Integrity: Support senior team members in maintaining

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. Why Roblox Studio? Roblox Studio is the creation engine behind millions of immersive 3D experiences built by creators around the world. It serves everyone from first-time developers to large professional studios, combining a powerful real-time engine with a deeply expressive toolchain. As creation on Roblox grows more sophisticated, Studio must continue evolving as a world-class development environment for interactive 3D experiences. That requires deep investment in the technical systems that underpin the IDE experience from scripting, debugging, architecture, and core IDE capabilities including performance. We are looking for a leader who can raise the bar on these foundational systems and help shape the future of Studio as a high-quality, extensible, and performant creation environment. Familiarity with creator tools is important, and experience with AI-assisted creation is a plus. The Role We are seeking a Director of Engineering for Studio Systems to lead a critical area of Roblox Studio’s technical foundation. In this role, you will be accountable for the architecture, execution, and long-term evolution of core systems that power Studio’s IDE and developer workflows. This includes area

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. Join some of the best Graphics Engineers in the world supporting the largest immersive 3D streaming environment deployed across console, desktop, mobile, and VR. Scalability: Roblox provides a platform that guarantees to the creators that their games will always and automatically run on different devices, with cross-platform play and minimal load times. Compatibility: Roblox games and assets made in the past, are still working today. Rendering has to have an eye to the past, and an eye to the future… Community: Roblox games are made by creators of all experience levels, from professionals who earn their living on the platform to kids who are learning to program using Roblox! As a Rendering Engineer, you will solve difficult challenges, while continuing to build a high-speed, completely dynamic environments connected on all devices. Many established rendering techniques do not trivially apply to our platform - novel solutions are needed as we push Roblox towards higher targets of visual fidelity. Even the simpler visuals we support on low-power devices are enabled by some creative rendering ideas, often centered around caching, incremental computation and graceful degradation. All of this is

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. As a Principal Security Software Engineer, you will be reporting to the Manager of Application Security leading the Security Design and Review pod. You will play a pivotal role in shaping the growth of Information Security's (InfoSec) Application Security team, collaborating with engineering teams early in their processes to provide secure design solutions and establish security standards. Your responsibilities will include threat modeling, secure system design, automation, and penetration testing. As a key member of the team, you will drive company-wide projects across diverse tech stacks, working with engineering leaders to remediate security challenges. You will define and evolve the technical vision for scaling application security practices across the organization. You will: Lead company-wide security initiatives to address critical security challenges. Build and nurture cross-company relationships to achieve security objectives. Provide guidance on product security processes and standards. Define and expand partnerships with key engineering teams across Roblox. Apply critical thinking and analytical skills to develop security protocols and communicate effectively with stakeholders. Re