Ai Reimagination Engineer in San Francisco

Scale works with the industry's leading AI labs to provide high quality data and accelerate progress in GenAI research. We are looking for Research Scientists and Research Engineers with expertise in LLM post-training (SFT, RLHF, reward modeling) and evaluation. This role is on the evaluation pod within the GenAI Research Organization and will focus on building benchmarks and diagnosing model failure modes in both text and multimodal modalities. In this role, you will develop rigorous evaluations and diagnostic methods that reveal where frontier models fail and why. You will collaborate with researchers and engineers to define best practices in evaluation-driven AI development. You will also partner with top foundation model labs to translate failure analysis into technical and strategic input on the next generation of generative AI models. You will: Analyze model behavior to identify, characterize, and diagnose failure modes in frontier LLMs and Agents. You’ll identify everything from capability gaps and reasoning errors to robustness and alignment issues, all focusing on RCA. Design and build benchmarks and evaluation methods that measure LLM capabilities in both text and multimodal modalities. Apply post-training expertise (SFT, RLHF, reward modeling) to connect observed failures to the data and training interventions that address them. Publish research findings in top-tier AI conferences. Ideally you’d have: Ph.D. or Master's degree in Computer Science, Machine Learning, AI, or a related field. Deep understanding of deep learning, reinforcement learning, and large-scale model fine-tuning. Experience with post-training techniques such as RLHF, preference modeling, or instruction tuning, and with LLM evaluation or benchmark development. Excellent written and verbal communication skills. Published research in areas of machine learning at major conferences (NeurIPS, ICML, ICLR, ACL, EMNLP, CVPR, etc.) and/or journals. Previous experience in a customer facing r

About Scale AI Scale AI is the data foundation for AI, helping organizations build and deploy reliable production AI applications. We partner with leading enterprises and government organizations to accelerate their AI initiatives through our data annotation platform, generative AI solutions, and enterprise AI capabilities. Role Overview As a Forward Deployed AI Engineering Manager on our Enterprise team, you'll be the technical bridge between Scale AI's cutting-edge AI capabilities and our most strategic customers. You'll work with enterprise clients to understand their unique challenges, lead a team that architects specific AI solutions, and ensure successful deployment and adoption of AI systems in production environments. This is a Management role that combines deep engineering and AI expertise, leading a team, and working on customer-facing problems. You'll work directly with customer engineering teams to integrate AI into their critical workflows. Key Responsibilities Customer Integration & Deployment Partner directly with enterprise customers to understand their technical infrastructure, data pipelines, and business requirements Design and implement custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs) Build robust data connectors and ETL pipelines to ingest, process, and prepare customer data for AI workflows Deploy and configure AI models and agents within customer security and compliance boundaries AI Agent Development Develop production-grade AI agents tailored to customer use cases across domains like customer support, data analysis, content generation, and workflow automation Architect multi-agent systems that orchestrate between different models, tools, and data sources Implement evaluation frameworks to measure agent performance and iterate toward business objectives Design human-in-the-loop workflows and feedback mechanisms for continuous agent improvement Prompt Engineeri

Scale’s ML platform (RLXF) team builds our internal distributed framework for large language model training and inference. The platform has been powering MLEs, researchers, data scientists and operators for fast and automatic training and evaluation of LLM's, as well as evaluation of data quality. Scale is uniquely positioned at the heart of the field of AI as an indispensable provider of training and evaluation data and end-to-end solutions for the ML lifecycle. You will work closely across Scale’s ML teams and researchers to build the foundation platform that supports all our ML research and development. You will be building and optimizing the platform to enable our next generation of LLM training, inference and data curation. If you are excited about shaping the future AI via fundamental innovations, we would love to hear from you! You will: Build, profile and optimize our training and inference framework Collaborate with ML teams to accelerate their research and development and enable them to develop the next generation of models and data curation Research and integrate state-of-the-art technologies to optimize our ML system Ideally you’d have: Strong excitement about system optimization Experience with multi-node LLM training and inference Experience with developing large-scale distributed ML systems Strong software engineering skills, proficient in frameworks and tools such as CUDA, Pytorch, transformers, flash attention, etc. Strong written and verbal communication skills and the ability to operate in a cross functional team environment Nice to haves: Demonstrated expertise in post-training methods &/or next generation use cases for large language models including instruction tuning, RLHF, tool use, reasoning, agents, and multimodal, etc. Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the positi

Come join our legal team to work on the most exciting legal, policy, and operational issues at the leading edge of AI. We're seeking strong product lawyers with specialized expertise in intellectual property law. As product counsel, you will advise on all legal aspects of product development, launch, and operations - including regulatory compliance, user terms, and risk management - while bringing deep expertise in your specialized legal area. The ideal candidate will have deep subject matter expertise in intellectual property law, a technology background, and a demonstrable history of providing practical product counsel to solve complex, time-sensitive problems in close partnership with cross-functional teams. This role reoprts to the Associate General Counsel, IP & Product. You will: Strategic Product Advice: Lead IP strategy for product development, embedding IP protection into the full product lifecycle from conception to commercialization, while also advising on related product and regulatory matters in collaboration with the broader legal team. Cross-Functional Collaboration: Partner with Research, Product, Engineering, Operations, Communications, and Marketing teams to mitigate IP risks in product development, data licensing, and open-source governance. IP Counsel: Support management of Scale's worldwide IP portfolio including patents and trademarks; assist with patent prosecution and trademark registration and enforcement. Risk Mitigation: Advise on third-party, synthetic, and open-source data and models, ensuring compliance with licensing requirements; design open-source governance policies. Agreements: Support drafting and negotiation of commercial agreement provisions involving intellectual property. Specialized Expertise: Provide counsel on machine learning, robotics, and other technical areas, with ability to engage effectively with technical teams on complex engineering and product issues. Training: Develop and deliver IP and data licensing trainin

About Scale AI At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we’re accelerating the abundance of frontier data to pave the road to Artificial General Intelligence (AGI) and building upon our prior model evaluation work with enterprise customers and governments to deepen our capabilities and offerings for public and private evaluations. About Data Engine Our Generative AI Data Engine powers the world’s most advanced LLMs and generative models through world-class RLHF (Reinforcement Learning with Human Feedback), human data generation, model evaluation, safety, and alignment. The data we produce is some of the most critical work for how humanity will interact with AI. About Our FDE Team Generating high-quality data is the core problem our business solves. We aim to make producing and delivering high-quality data seamless and efficient for operators and customers. Our Team is building customer and operator-specific infrastructure to provide high-quality data with low turnaround time. You'll be exposed to the cutting edge of the Generative AI industry while directly interfacing with the leading model-building organizations in the space, including the top AI research labs and government agencies. Join us in shaping the future of Artificial General Intelligence. As a Forward Deployed Engineer, you'll be at the forefront of providing the critical data infrastructure that powers the most advanced AI models, directly influencing how humanity interacts with AI. You will work with the world’s leading AI companies and government agencies to solve their most complex AI data-related problems. Responsibilities: Drive Impact: Directly contribute to the advancement of AI by delivering critical data solutions for leading AI innovators and

At Scale, our mission is to develop reliable AI systems for the world's most important decisions. Our products provide the high-quality data and full-stack technologies that power the world's leading models, and help enterprises and governments build, deploy, and oversee AI applications that deliver real impact. Scale Frontier Data is the organization behind the training and evaluation data that frontier labs depend on. We build the systems, tooling, and expert workflows that turn hard human expertise into signals that models can learn from, across reasoning, coding, agentic tool use, and domain expertise. About our Customer Platform team: Our Customer Platform Team plays a pivotal role in integrating our platform with external systems and ensuring seamless, reliable connectivity for both internal users and customers. As the leader of this team, you’ll drive the strategy, architecture, and development of our connectivity solutions, focusing on API integration, distributed systems, and a robust data platform. Your role will be crucial in maintaining and enhancing our platform’s ability to meet the needs of both our internal and external stakeholders. Responsibilities: Own large areas within our product Comfortable working cross functionally, whether that be internal or external customers Build features end-to-end: front-end, back-end, system design, debugging and testing Deliver experiments at a high velocity and level of quality to engage our customers Work across the entire product lifecycle from conceptualization through production Influence the culture, values, and processes of a growing engineering team Inspire and mentor less experienced engineers Collaborating with cross-functional teams to define, design, and ship new product features and experiences. Requirements: At least 7-10 years of relevant experience is preferred Track record of shipping high-quality products and features at scale Desire to work in a very fast-paced environment Abil

Scale’s Generative AI business unit is experiencing historic growth. As the Community Manager, you will spearhead initiatives connecting hundreds of thousands of expert contributors on our platform. This is a strategic operational role requiring the execution of an operator, program manager, and creative writer. You’ll need an entrepreneurial mindset, operational rigor, and the ability to communicate effectively with diverse stakeholders across internal and external community channels. Scale’s mission is to develop reliable AI systems for the world’s most important decisions. Our Generative AI unit partners with the world's most advanced research teams to improve their models with human data. You will ensure that our global network of contributors stay engaged and informed so that they can do their best work. You will manage communications, execute virtual campaigns and events, and develop strategies to grow and retain our contributor base. This pivotal role shapes community culture, facilitates a thoughtful contributor experience, and harnesses the energy of our community in order to achieve high-level business goals. You must employ creative problem-solving to resolve complex operational challenges and manage the communications cadence across diverse stakeholders. In this role you will: Create strategies to increase participation and satisfaction, overseeing external platforms like Reddit and managing our internal Outlier Community Develop systems to efficiently channel questions, feedback, and disputes across our platforms and social channels Lead with vision: Set direction for multi-team areas and inspire clarity and alignment Organize virtual events to foster connection and monitor community sentiment in order to proactively mitigate risk and address concerns Leverage user feedback, insights, and quantitative metrics to drive improvement in product and operational strategies Enable the team: Instill ownership, drive cross-team collaboration, and remove structur

Overview Scale’s Finance Systems and Automation team is looking for a builder-oriented team member to help design and develop integrations, automations, and AI agents that streamline workflows across Finance, Accounting, People, and Recruiting. In this role, you will work closely with stakeholders across Finance, Accounting, People Operations, and Recruiting to understand their workflows and build integrations, automations, and agentic workflows that reduce manual effort and accelerate execution across these teams. You will leverage our internal data infrastructure, system integration tooling, and emerging AI platforms to architect scalable solutions — from traditional system integrations to intelligent agent-driven workflows — that serve as the foundation for long-term operational efficiency. We’re looking for someone who thrives on connecting systems, automating repetitive processes, and pushing toward more autonomous, AI-assisted operations. You should be comfortable navigating ambiguity, designing solutions that scale, and rigorously validating outcomes end to end. What You’ll Do Design and build agent-driven workflows and automation systems across People Operations, Recruiting, Finance, and Accounting Identify opportunities to replace manual or rules-based processes with agentic workflows Partner with stakeholders to translate business processes into scalable, automated solutions Lead the implementation of end-to-end workflows, from requirements through deployment and validation Automate candidate-to-employee transitions (e.g., Greenhouse → HRIS → provisioning systems) Build workflows to manage employee lifecycle events such as onboarding, transfers, and offboarding Automate approval flows and data synchronization across People, Finance, and Recruiting systems Support accounting and finance workflows through scalable integrations and automation Design and implement the underlying integrations and data flows that enable reliable automation and agent behavior Est

Head of Enterprise GTM Strategy & Operations Reports to VP, Enterprise Sales · SF or NY Reporting to the VP of Enterprise Sales, this role owns both halves of Scale AI’s enterprise revenue engine: the strategy that determines where we play and how we win, and the operating system - people, process, and systems - that makes that strategy executable, measurable, and repeatable. On the strategy side, you set the analytical foundation for enterprise growth: segment and account prioritization, coverage and territory design, pricing and packaging inputs, and the diagnostic work that explains why the funnel behaves the way it does. On the operations side, you own the RevOps stack, forecasting, compensation design, sales enablement, and the operating cadences that convert strategy into predictable quarterly execution. The ideal candidate is equally comfortable building a segmentation model from a blank page and running a Monday morning pipeline review. You will lead an established team, with the Head of Sales Enablement and the RevOps Manager as direct reports. Your first job is to raise the ceiling on what that team delivers: sharper analysis, tighter operating rhythm, and enablement that measurably shortens ramp and lifts win rates. This is a senior, highly visible role partnering with Enterprise Sales leadership, Finance, Marketing, Product, and Solutions Engineering, with regular exposure to the executive team and board materials. STRATEGY Define which segments, industries, and accounts Scale prioritizes, and build the analytical case behind those choices Build and maintain the market sizing, segmentation, and account-tiering models that drive coverage decisions and investment trade-offs Lead hypothesis-driven analyses of the enterprise funnel - win/loss patterns, conversion drivers, deal economics, coverage gaps - and translate findings into specific changes to how we sell Partner with Finance and Product on pricing, packaging, and deal-structure strateg

You will: Source and acquire quality candidates for high volume positions to meet hiring and activation goals Review applications and screen candidates Support candidates throughout the recruiting process Partner with other growth recruiters, ops leads and cross-functional leaders to understand Scale’s business needs, then devise and execute on the recruiting strategy needed to deliver on them. Follow and manage processes that will evolve over time as the company grows. Represent and champion the brand, promoting its value proposition to candidates and driving engagement. Represent Scale at occasional onsite growth recruiting events. Ideally you have: 2+ years of recruiting/sourcing experience in a fast-paced, high-growth environment. Excellent written and verbal communication skills, with the ability to tailor messaging to diverse audiences Experience sourcing candidates and filling high volume roles Experience acting as the primary candidate liaison, delivering white-glove service through timely updates and personalized support throughout the interview process Nice to have: Previous experience in a start-up. Either experience managing a full-cycle recruiting experience, or a passion and ability to learn to do so. Experience with various tools such as Linkedin Recruiter, Clay, Modernloop, Gem Extreme attention to detail AI builder, AI-forward operator, or strong interest in agentic coding and experimenting with AI tooling The hourly salary range for this position is $40 to $55/hr. This is a remote position with occasional travels required for onsite growth recruiting events. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position, determined by work location and additional factors, including job-related skills, experience, interview performance, and relevant education or training. PLEASE NOTE: Our policy requires a 90-day waiting period before reconsidering candidates for the same role. This allow

Owns day-to-day deal pricing execution for Enterprise, including pricing calculations, staffing inputs, and dashboard reporting that gives Sales and Deal Desk leadership visibility into deal status, pricing, and margin. Partners with the Deal Desk Manager on customer deal structuring and on identifying ways to accelerate the deal approval process. What You’ll Do Deal Pricing Execution Manages day-to-day deal pricing calculations for Enterprise deals, including ROI modeling and EPD staffing inputs Applies existing pricing frameworks consistently across Land, Expansion, and Framework deals Partners with the Deal Desk Manager to design customer-specific deal structures for non-standard or complex deals Pricing & Deal Status Reporting Builds and maintains a pricing dashboard tracking deal status, pricing, margin, and overall deal health across the Enterprise pipeline Updates pricing and trend reporting to keep leadership current on where deals stand and how pricing is trending against targets Process Optimization Identifies bottlenecks in the deal review & approval process and proposes ways to accelerate cycle time Helps standardize and streamline recurring pricing/approval steps into repeatable, lower-friction workflows Tracks deal approval cycle time and surfaces trends to inform process improvements Cross-Functional Deal Coordination Owns deal crafting end-to-end from initial pricing/modeling through contract review, coordinating with sales management, reps, and internal stakeholders Ensures the relevant stakeholders (Accounting, Finance, EPD, Legal) review and approve deals at the appropriate stage before they progress Routes deal packages to the correct reviewers and tracks open items so deals aren't stalled waiting on sign-off Strategic & GTM Support Tackles ambiguous, open-ended questions around Scale's go-to-market motion and iterates quickly on solutions that deliver measurable results Supports Sales and Finance leadership in quarterly strategy and

The Public Sector software engineers (SWEs) create the core product building blocks forward-deployed teams use to develop agentic capabilities that function across multiple domains. SWEs responsibilities include building the systems required to ingest and process federal datasets to support real-time decision-making in contested environments. We develop novel agentic enabling capabilities that includes: Create multi-layered guardrails around agents Optimize data retrieval for agents Orchestrate fleets of asynchronous agents Automatically alerts users to deviations in data Illustrating how an agent reached a decision As a Software Engineer, you will own the development of a vertical feature or a horizontal capability to include defining requirements with stakeholders and implementation until it is accepted by the stakeholders. You will: Design and implement scalable backend systems for Federal customers using cloud-native AI infrastructure. Build features for agentic systems including multi-layered guardrails and data retrieval optimization. Develop data pipelines and machine learning infrastructure to make data sources accessible by agents. Collaborate with cross-functional teams to execute backend solutions for secure environments. Participate in customer engagements to understand requirements and deliver technical solutions. Define requirements with stakeholders and implement features until they are accepted. Contribute to the platform roadmap and product strategy for the Federal business. Ideally you will have: Full Stack Development: Proficiency in front-end, back-end development and infrastructure, including experience with modern web development frameworks, programming languages, and databases Cloud-Native Technologies: Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and experience in developing and deploying applications in a cloud-native environment. Understanding of containerization (e.g., Docker) and container orchestration (e.g., Kubernetes

About Scale AI Scale AI is the data foundation for AI, helping organizations build and deploy reliable production AI applications. We partner with leading enterprises and government organizations to accelerate their AI initiatives through our data annotation platform, generative AI solutions, and enterprise AI capabilities. Role Overview As a Senior Staff Frontier Agents Engineer on our Enterprise team, you'll be the technical bridge between Scale AI's cutting-edge AI capabilities and our most strategic customers. You'll work with enterprise clients to understand their unique challenges, architect custom AI solutions, and ensure successful deployment and adoption of AI systems in production environments. This is a hands-on technical role that combines deep engineering expertise with customer-facing problem solving. You'll work directly with customer engineering teams to integrate AI into their critical workflows. Key Responsibilities Customer Integration & Deployment Partner directly with enterprise customers to understand their technical infrastructure, data pipelines, and business requirements Design and implement custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs) Build robust data connectors and ETL pipelines to ingest, process, and prepare customer data for AI workflows Deploy and configure AI models and agents within customer security and compliance boundaries AI Agent Development Develop production-grade AI agents tailored to customer use cases across domains like customer support, data analysis, content generation, and workflow automation Architect multi-agent systems that orchestrate between different models, tools, and data sources Implement evaluation frameworks to measure agent performance and iterate toward business objectives Design human-in-the-loop workflows and feedback mechanisms for continuous agent improvement Prompt Engineering & Optimization Create sophisticate

About Scale At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we’re accelerating the abundance of frontier data to pave the road to Artificial General Intelligence (AGI), and building upon our prior model evaluation work with enterprise customers and governments, to deepen our capabilities and offerings for both public and private evaluations. About the ACE team The Agent Capabilities & Environments (ACE) team, part of Scale’s Research organization, brings together customer-facing Researchers and Applied AI Engineers. Our core mission includes research on agent environments and RL reward signals, benchmarking autonomous agent performance across real-world scenarios and environments, creating robust data programs to improve Large Language Models (LLMs) agentic capabilities and building foundational tools and frameworks for evaluating models as agents. ACE focuses on autonomous agents that dynamically interact with diverse external environments, including code repositories, GUI interfaces, browsers, and more. About This Role This role is at the intersection of cutting-edge AI research and practical application, with a focus on studying the data types essential for building state-of-the-art agents, such as browser and SWE agents. The ideal candidate will explore the data landscape needed to advance intelligent, adaptable AI agents, guiding the data strategy at Scale to drive innovation. This position requires not only expertise in LLM agents and planning algorithms but also creativity in addressing novel challenges related to data, interaction, and evaluation. You will contribute to impactful research publications on agents, collaborate with customer researchers, and work alongside the engineering team to translate t

The Public Sector software engineers (SWEs) create the core product building blocks forward-deployed teams use to develop agentic capabilities that function across multiple domains. SWEs responsibilities include building the systems required to ingest and process federal datasets to support real-time decision-making in contested environments. We develop novel agentic enabling capabilities that includes: Create multi-layered guardrails around agents Optimize data retrieval for agents Orchestrate fleets of asynchronous agents Automatically alerts users to deviations in data Illustrating how an agent reached a decision As a Senior Software Engineer, you will lead the development of a vertical feature or a horizontal capability to include defining requirements with stakeholders and implementation until it is accepted by the stakeholders. You will: Lead the design and implementation of scalable backend systems and distributed architectures for Federal customers. Manage the full lifecycle of feature development from requirement definition to deployment on classified networks. Direct the orchestration of asynchronous agent fleets to meet mission requirements. Lead customer engagements to translate mission needs into technical requirements. Own the communication with stakeholders to ensure implementation meets defined acceptance criteria. Conduct technical reviews and identify risks within machine learning infrastructure and model serving. Drive the platform roadmap by providing technical specifications for Federal product offerings. Ideally you will have: Full Stack Development: Proficiency in front-end, back-end development and infrastructure, including experience with modern web development frameworks, programming languages, and databases Cloud-Native Technologies: Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and experience in developing and deploying applications in a cloud-native environment. Understanding of containerization (e.g., Docker) and contai