Human Evaluator in San Francisco

About Scale AI Scale AI is the data foundation for AI, helping organizations build and deploy reliable production AI applications. We partner with the world's leading enterprises and government organizations to accelerate their AI transformation through frontier AI systems that solve real business problems. Every day, we work with organizations across finance, healthcare, manufacturing, media and telecommunications to build production AI agents that automate complex workflows, help humans, reason over enterprise knowledge, and operate safely at scale. The Opportunity Applied AI is moving faster than ever. New foundation models, reasoning techniques, agent architectures, and research papers emerge every week. Yet building AI systems that reliably solve real-world problems remains one of the hardest engineering challenges. As a Senior Frontier Agent Engineer (Applied AI) , you'll bridge the gap between cutting-edge AI research and production deployment. You'll work directly with enterprise customers to design, evaluate, and deploy intelligent systems that combine frontier models with structured knowledge, retrieval, traditional machine learning, and enterprise software. Unlike traditional ML roles that focus on a single model or product, you'll work across a diverse portfolio of AI challenges spanning multiple industries and use cases. You may build a multi-agent research system and then participate in designing a customer intelligence platform, a healthcare copilot, or an autonomous workflow for a Fortune 100 company. If you enjoy reading new AI papers, experimenting with the latest models, and shipping production systems that create measurable business impact, you'll fit right in. What You'll Build Frontier AI Systems Design and deploy production AI agents that leverage the latest advances in large language models, reasoning, retrieval, memory, and tool use. Architect intelligent systems that combine LLMs, traditional machine learning, structured knowledge, enterpri

Scale Labs, Research Scientist — Agent Robustness As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems. Building on this expertise, Scale Labs has launched a new team focused on policy research, to bridge the gap between AI research and global policymakers to make informed, scientific decisions about AI risks and capabilities. Our research tackles the hardest problems in agent robustness, AI control protocols, and AI risk evaluations to help governments, industry, and the public understand and mitigate AI risk while maximizing AI adoption. This team collaborates broadly across industry, the public sector, and academia and regularly publishes our findings. We are actively seeking talented researchers to join us in shaping this vision. As a Research Scientist working on Agent Robustness you will work on the fundamental challenges of building AI agents that are safe and aligned with humans. For example, you might: Research the science of AI agent capabilities with a focus on how they relate to safety, risk factors, and methodologies for benchmarking them; Design and build harnesses to test AI agents’ tendency to take harmful actions when pressured to do so by users or tricked into doing so by elements of their environment; Design and build exploits and mitigations for new and unique failure modes that arise as AI agents gain affordances like coding, web browsing, and computer use; Characterize and design mitigations for potential failure modes or broader risks of systems involving multiple interacting AI agents. Ideally you’d have: Commitment to our mission of promoting safe, secure, and trustworthy AI deployments in the industry as frontier AI capabilities continue to advance. Practical experience conducting technical research collaboratively. You should be comfortable building and leveraging agent scaffolding, designing evaluation harnesses, an

About Snorkel At Snorkel, we believe meaningful AI doesn’t start with the model, it starts with the data. We’re on a mission to help enterprises transform expert knowledge into specialized AI at scale. The AI landscape has gone through incredible changes since 2015, when Snorkel started as a research project in the Stanford AI Lab, to the generative AI breakthroughs of today. But one thing has remained constant: the data you use to build AI is the key to achieving differentiation, high performance, and production-ready systems. We work with some of the world’s largest organizations to empower scientists, engineers, financial experts, product creators, journalists, and more to build custom AI with their data faster than ever before. Excited to help us redefine how AI is built? Apply to be the newest Snorkeler! We’re looking for a Research Scientist to advance how high-quality data and environments for AI agents are created. You’ll build and optimize pipelines that combine real-world data, automated generation, and human expert input. Working with domain experts, academic partners, customers, and our product and engineering teams, you’ll scale these pipelines to target frontier model performance gaps and expand data and environment diversity. Your work will amplify human knowledge and judgement, enabling experts to create and refine data and agentic environments that strengthens Snorkel’s position as the frontier data lab. This role is ideal for someone who wants to advance frontier AI through data and environment creation and enjoys turning research into reusable, scalable systems. Location: San Francisco, New York, OR REMOTE Main Responsibilities Design, implement, and optimize reusable pipelines that combine AI capabilities with expert judgment to accelerate data and agentic environment creation. Design and run rigorous experiments to validate proof-of-concept approaches, measure their impact on data quality, pipeline efficiency, and model performance, and communic

About the Team DoorDash Labs is an independent innovation hub within DoorDash, focusing on developing automation and robotics solutions to enhance last-mile logistics. Our mission is to create technologies that support and augment human networks, aiming to improve efficiency for Dashers, merchants, and consumers alike. We are a highly senior team composed of former pioneers from a variety of different robotics industries. If you have a passion for applying AI and robotics solutions in a service used by millions of people, then we want to talk to you! Please Note: This role is based in San Francisco, CA, and requires being in-person 5 days a week. About the Role We are seeking a Senior RF Engineer to join our multidisciplinary team developing mission-critical RF/electrical systems for unmanned platforms.This role offers a rare opportunity to gain deep insight into RF design and validation, contributing across the full product lifecycle, from early concept and prototyping through production. In this role, you will apply deep expertise in electromagnetic theory and wireless system design to ensure autonomous platforms operate with exceptional reliability and precision. You will design, optimize and validate RF / mixed-signal PCBAs with a strong focus on interference mitigation, troubleshoot system-level desense, and leverage a thorough understanding of wireless technologies including LTE, 5G NR, Wi-Fi, GPS, and UWB. You’re excited about this opportunity because you will… Lead the development of innovative solutions that span across RF, Mixed signal and mechanical domain. Design RF hardware as well as wireless testbeds to support system validation, and lead the execution and documentation of system-level design and verification Provide expertise, mentorship to partner teams regarding EMI mitigation strategies, and cross-functional debug processes Characterize EMI caused by internal & external aggressors by tracing root causes using EMC probes

About Stitch Fix, Inc. Stitch Fix (NASDAQ: SFIX) Stitch Fix is redefining retail by combining human creativity with advanced data science and Generative AI. As we build the future of personalized shopping, we’re equally committed to building yours. We believe in investing in our team as much as our technology. Join us to be a trendsetter in the industry and help us redefine what’s possible for our clients, while we help you reach your full potential. About the Role The Women’s Technical Design team is committed to providing the best client experience by creating well-fitting, high-quality products across an inclusive size range (Core, Plus) by utilizing client feedback and data to inform fit choices every day. We are looking for a Senior Technical Designer who enjoys weaving creative problem solving with technical accuracy and a strong understanding of apparel fit, construction, pattern making and grading to own at least two product categories and ensure fit and quality standards are well-executed and consistent across all styles. This role serves as a technical expert and builds close relationships with cross-functional team members and external vendors, impacting the business by maintaining product consistency, driving speed to market, and translating client feedback into product action plans and long-term fit improvements. Senior Technical Designer will also use strong technical judgment to independently identify fit and construction issues, anticipate potential production risks, and drive solutions through to resolution. This site-based position at our headquarters in San Francisco, CA requires regular on-site presence (5–9 days/month). Responsibilities: Manage multiple/complex product category fit sessions, ensuring style and fit intent are executed to Brand guidelines across owned categories while maintaining category quality, construction standards, and fit/pattern blocks. Establish and maintain consistent fit standards, pattern bloc

Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates. We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused on creating an intelligent ecosystem across HP’s portfolio. Together, we’re developing intuitive, adaptive solutions that spark creativity, boost productivity, and make collaboration seamless. We create breakthrough solutions that make complex tasks feel effortless, teamwork more natural, and ideas more impactful—always with a human-centric mindset. By embedding AI advancements into every HP product and service, we’re expanding what’s possible for individuals, organisations, and the future of work. Join us as we reinvent work, so people everywhere can do their best work. About The Role As a Senior Platform Engineer at HP IQ, you will help build and evolve the infrastructure, tooling, and shared platform capabilities that enable our engineering teams to develop and operate reliable, secure, and scalable services across cloud and edge environments . You will work closely with application, services, AI/ML, and security teams to improve developer velocity, production readiness, reliability, and operational efficiency across a heterogeneous infrastructure footprint. What You Might Do Design, build, and maintain shared infrastructure and platform capabilities across cloud and edge environments. Build automation and self-service tooling that improves engineering velocity and operational consistency. Develop and maintain Infrastructure-as-Code, deployment workflows, and environment provisioning. Partner with engineering teams on production readiness, including reliability, security, observability, scalability, and recovery. Improve monitoring, alerting, incident response, and operational tooling across distributed environments. Automate repetitive operational t

Industrial Designer San Francisco, CA - Hybrid At IDEO, we use design to create new products, services, experiences; tangible strategies; and creative capabilities. IDEO San Francisco is in search of a new Industrial Designer to partner with interdisciplinary teams designing innovative and human-centered physical products and services. This role will own a hands-on workstream emphasizing creative problem solving, core industrial design skills, rapid prototyping and advanced visual storytelling. The ideal hire will champion hands-on making & prototyping, and collaborate fluidly with a wide variety of design professionals from communications design to UX researchers (and everything in between).This hire will have the unique opportunity to design cutting edge products, and grow as a Design Thinking practitioner within IDEO’s diverse network of Design Directors, Partners and Business Leaders. At IDEO, an Industrial Designer is responsible for independently executing components of highly complex client projects, showcasing advanced skills in user-centered physical product design . You will integrate form and function, while balancing user needs and technical considerations to create solutions that resonate with users and businesses alike. What makes a career at IDEO unique is our radical empathy and compassion for the user, always leading with creative confidence and collaborative rigor. You will work with world-class researchers, business designers, data scientists, and others disciplines outside of design, to push the edges of your craft, creating solutions that are as inclusive as they are transformative. We are especially excited to meet candidates with exceptional visual storytelling abilities, a drive to “get out from behind the screen” by prototyping in both digital and physical realms, and a grounding in design for manufacturing (DFM). This hire must be within a commutable distance of IDEO’s San Francisco studio. IDEO proudly supports flexible work. Onc

Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates. We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused on creating an intelligent ecosystem across HP’s portfolio. Together, we’re developing intuitive, adaptive solutions that spark creativity, boost productivity, and make collaboration seamless. We create breakthrough solutions that make complex tasks feel effortless, teamwork more natural, and ideas more impactful—always with a human-centric mindset. By embedding AI advancements into every HP product and service, we’re expanding what’s possible for individuals, organisations, and the future of work. Join us as we reinvent work, so people everywhere can do their best work. About The Role As a Wireless Systems Software Engineer , you will help build the core software libraries and system infrastructure that power the next generation of wireless experiences at HP IQ. You will work across hardware, firmware, embedded software, operating systems, and product teams to integrate and optimize multiple wireless technologies, including Bluetooth, Ultra-Wideband (UWB), NFC , and future connectivity solutions. You will play a key role in designing scalable software architectures that bridge hardware and software, enabling seamless communication across embedded devices and host platforms. This position offers the opportunity to work on challenging system-level problems, influence the architecture of a new wireless ecosystem, and help define technologies that will shape the future of work. What You Might Do Serve as a technic al expert across wireless technologies including Bluetooth, UWB, NFC , and related embedded communication interfaces. Architect, design, and develop reusable, scalable wireless software libraries with well-defined API

Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates. We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused on creating an intelligent ecosystem across HP’s portfolio. Together, we’re developing intuitive, adaptive solutions that spark creativity, boost productivity, and make collaboration seamless. We create breakthrough solutions that make complex tasks feel effortless, teamwork more natural, and ideas more impactful—always with a human-centric mindset. By embedding AI advancements into every HP product and service, we’re expanding what’s possible for individuals, organisations, and the future of work. Join us as we reinvent work, so people everywhere can do their best work. About The Role HP IQ is looking for a highly organized, detail-oriented Executive Business Partner to support to our SVP, Design & Innovation while also providing operational support to the Design team. In this role, you will act as a strategic partner to SVP of Design & Innovation by managing priorities, anticipating needs, and executing with precision, while also keeping all operational processes for the Design Team running smoothly. This role collaborates closely with the Chief of Staff and builds strong relationships to communicate and work effectively across the organization. Our ideal candidate is someone who is excited to make things happen, has a fastidious attention to detail, thrives in bringing structure to fast-paced environments, enjoys being part of a team and is genuinely motivated by this work. What You Might Do Manage complex calendars, scheduling, and prioritization for HP IQ’s SVP, Design & Innovation; independently prioritize and make decisions to resolve scheduling conflicts Prepare expense reports, route vendor invoices and purchase orders for approval,

Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates. We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused on creating an intelligent ecosystem across HP’s portfolio. Together, we’re developing intuitive, adaptive solutions that spark creativity, boost productivity, and make collaboration seamless. We create breakthrough solutions that make complex tasks feel effortless, teamwork more natural, and ideas more impactful—always with a human-centric mindset. By embedding AI advancements into every HP product and service, we’re expanding what’s possible for individuals, organisations, and the future of work. Join us as we reinvent work, so people everywhere can do their best work. We would love to hear from you! We are always looking to connect with people who are passionate about our Mission. If you don’t see an open role that matches your background and interests, please apply here and let us know what you are looking for in your next career move. We would love to hear from you! We will review your background and keep you in mind as we open future opportunities. Compensation & Benefits (Full-Time Employees) The salary range for this role is listed above. Final salary offered is based upon multiple factors including individual job-related qualifications, education, experience, knowledge and skills. At HP IQ, we offer a competitive and comprehensive benefits package, including: Health insurance Dental insurance Vision insurance Long term/short term disability insurance Employee assistance program Flexible spending account Life insurance Generous time off policies, including; 4-12 weeks fully paid parental leave based on tenure 11 paid holidays Additional flexible paid vacation and sick leave ( US benefits overview ) Why HP IQ? HP IQ is HP’s new AI innovation lab, bu

Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates. We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused on creating an intelligent ecosystem across HP’s portfolio. Together, we’re developing intuitive, adaptive solutions that spark creativity, boost productivity, and make collaboration seamless. We create breakthrough solutions that make complex tasks feel effortless, teamwork more natural, and ideas more impactful—always with a human-centric mindset. By embedding AI advancements into every HP product and service, we’re expanding what’s possible for individuals, organisations, and the future of work. Join us as we reinvent work, so people everywhere can do their best work. About The Role HP IQ’s System Software team enables on-device experiences to take full advantage of our hardware capabilities.Our team collaborates with internal and external partners to develop unique solutions using cutting edge hardware, sensors, algorithms, and interaction models. If you enjoy solving complex, interdisciplinary problems with a world-class team, we'd love to hear from you! What You Might Do Lead, grow and mentor a high-performing embedded software team in a startup environment Serve as a technical leader and escalation point for complex hardware/software integration issues Communicate technical vision, risks, and progress clearly to cross-functional and executive stakeholders Own system-level strategy, architecture, and technical direction across multiple products Drive execution of low-level driver and framework software development in C and C++ across multiple devices and operating systems Oversee integration between hardware and software, ensuring alignment across cross-functional teams Guide performance, power, and thermal optimization efforts Balance hands-on technical invol

Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates. We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused on creating an intelligent ecosystem across HP’s portfolio. Together, we’re developing intuitive, adaptive solutions that spark creativity, boost productivity, and make collaboration seamless. We create breakthrough solutions that make complex tasks feel effortless, teamwork more natural, and ideas more impactful—always with a human-centric mindset. By embedding AI advancements into every HP product and service, we’re expanding what’s possible for individuals, organisations, and the future of work. Join us as we reinvent work, so people everywhere can do their best work. About the Role We are looking for an experienced IT Support Lead to deliver exceptional technical support while helping scale and improve our IT operations. This is a hands-on role for someone who enjoys solving complex technical problems, improving processes, and creating a great employee experience. As the IT Support Lead, you will be the primary owner of day-to-day IT support operations, endpoint lifecycle management, onboarding and offboarding, inventory management, and knowledge management. You will serve as a senior technical resource for employees and help establish operational standards across the IT organization at HP IQ.. What you might do Provide hands-on technical support for employees across macOS, Windows, mobile devices, office technology, and SaaS applications. Act as the senior escalation point for complex support issues, driving problems through resolution while maintaining a high-quality employee experience. Identify recurring support trends and help improve processes, tooling, and self-service resources. Own and execute IT onboarding and offboarding workflows, including device se

Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates. We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused on creating an intelligent ecosystem across HP’s portfolio. Together, we’re developing intuitive, adaptive solutions that spark creativity, boost productivity, and make collaboration seamless. We create breakthrough solutions that make complex tasks feel effortless, teamwork more natural, and ideas more impactful—always with a human-centric mindset. By embedding AI advancements into every HP product and service, we’re expanding what’s possible for individuals, organisations, and the future of work. Join us as we reinvent work, so people everywhere can do their best work. About The Role The HP IQ Design team is dedicated to creating simple, delightful, and transformative user experiences. We're passionate about developing innovative yet familiar interfaces that feel like natural extensions of the human experience. We value collaboration across disciplines, from software engineering to hardware design, and we're excited to work with people who see technology as a tool to help solve real-world problems. As a Product Designer at HP IQ, you'll collaborate with a multidisciplinary team to explore and shape new possibilities in AI-powered digital experiences. The ideal candidate brings intense curiosity, a dedication to craft, and an openness to sharing, developing, and challenging ideas. You love to experiment, engage deeply in the design process, and continuously iterate on concepts until they feel "just right"—and even then, keep exploring ways to improve. As a member of the team, you'll have the opportunity to contribute across the digital design process, develop your craft alongside experienced designers and engineers, and help create new interfaces, interactions, and

Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates. We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused on creating an intelligent ecosystem across HP’s portfolio. Together, we’re developing intuitive, adaptive solutions that spark creativity, boost productivity, and make collaboration seamless. We create breakthrough solutions that make complex tasks feel effortless, teamwork more natural, and ideas more impactful—always with a human-centric mindset. By embedding AI advancements into every HP product and service, we’re expanding what’s possible for individuals, organisations, and the future of work. Join us as we reinvent work, so people everywhere can do their best work. About the Role HP IQ's Product Integrity & Developer Productivity team is responsible for building next-generation tools and systems that improve developer productivity and product quality at scale. We are specifically investing in agentic systems that automate complex workflows, from intelligent JIRA triage and root-cause analysis to test planning and quality automation. In this internship role, you will work directly with our hiring manager and team to design, build, and deploy agents that utilize pre-trained machine learning models to solve real problems for developers and quality engineers. This is an exceptional opportunity to be part of a team navigating the fundamental shift toward agentic development and to contribute meaningfully to tools that thousands of developers will rely on. What You Might Do As an intern on our team, you'll contribute to real-world engineering projects that explore how AI can improve the way software is built, tested, and maintained. Depending on business priorities and your team's needs, you may have the opportunity to: Design, build, and iterate on AI-powered t

Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates. We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused on creating an intelligent ecosystem across HP’s portfolio. Together, we’re developing intuitive, adaptive solutions that spark creativity, boost productivity, and make collaboration seamless. We create breakthrough solutions that make complex tasks feel effortless, teamwork more natural, and ideas more impactful—always with a human-centric mindset. By embedding AI advancements into every HP product and service, we’re expanding what’s possible for individuals, organisations, and the future of work. Join us as we reinvent work, so people everywhere can do their best work. About The Role The System Software team is responsible for firmware, operating system software, hardware-accelerated algorithms, and core developer frameworks supporting our products. We serve as the glue between our hardware teams and our higher-level software teams, and delight in finding creative solutions to complex, interdisciplinary problems as we bring our product visions to life. As a firmware engineer on our team, you will develop firmware for low-power embedded microcontrollers to coordinate sensors, ensure security and privacy, manage power subsystems, and more. You will also have plenty of opportunity to develop and grow your own management and leadership skills as you coordinate development efforts with vendors, consultants, and manufacturing partners. What You Might Do Design and develop firmware and embedded system architecture for leading-edge ARM-based MCUs in our prototypes and products Collaborate with the EE, RF, Security, Cloud Services, and AI models team to build high-performance, secure, reliable systems Bring up and debug new hardware in the lab and support