Ai Senior Systems Engineer in San Francisco

Scale works with the industry’s leading AI labs to provide high quality data and accelerate progress in GenAI research. We are looking for Research Scientists and Research Engineers with expertise in LLM post-training (SFT, RLHF, reward modeling). This role will focus on optimizing data curation and eval to enhance LLM capabilities in both text and multimodal modalities. In this role, you will develop novel methods to improve the alignment and generalization of large-scale generative models. You will collaborate with researchers and engineers to define best practices in data-driven AI development. You will also partner with top foundation model labs to provide both technical and strategic input on the development of the next generation of generative AI models. You will: Research and develop novel post-training techniques, including SFT, RLHF, and reward modeling, to enhance LLM core capabilities in both text and multimodal modalities. Design and experiment new approaches to preference optimization. Analyze model behavior, identify weaknesses, and propose solutions for bias mitigation and model robustness. Publish research findings in top-tier AI conferences. Ideally you’d have: Ph.D. or Master's degree in Computer Science, Machine Learning, AI, or a related field. Deep understanding of deep learning, reinforcement learning, and large-scale model fine-tuning. Experience with post-training techniques such as RLHF, preference modeling, or instruction tuning. Excellent written and verbal communication skills Published research in areas of machine learning at major conferences (NeurIPS, ICML, ICLR, ACL, EMNLP, CVPR, etc.) and/or journals Previous experience in a customer facing role. Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position and may be inclusive of several career levels at Scale; it will be determined du

Scale works with the industry's leading AI labs to provide high quality data and accelerate progress in GenAI research. We are looking for Research Scientists and Research Engineers with expertise in LLM post-training (SFT, RLHF, reward modeling) and evaluation. This role is on the evaluation pod within the GenAI Research Organization and will focus on building benchmarks and diagnosing model failure modes in both text and multimodal modalities. In this role, you will develop rigorous evaluations and diagnostic methods that reveal where frontier models fail and why. You will collaborate with researchers and engineers to define best practices in evaluation-driven AI development. You will also partner with top foundation model labs to translate failure analysis into technical and strategic input on the next generation of generative AI models. You will: Analyze model behavior to identify, characterize, and diagnose failure modes in frontier LLMs and Agents. You’ll identify everything from capability gaps and reasoning errors to robustness and alignment issues, all focusing on RCA. Design and build benchmarks and evaluation methods that measure LLM capabilities in both text and multimodal modalities. Apply post-training expertise (SFT, RLHF, reward modeling) to connect observed failures to the data and training interventions that address them. Publish research findings in top-tier AI conferences. Ideally you’d have: Ph.D. or Master's degree in Computer Science, Machine Learning, AI, or a related field. Deep understanding of deep learning, reinforcement learning, and large-scale model fine-tuning. Experience with post-training techniques such as RLHF, preference modeling, or instruction tuning, and with LLM evaluation or benchmark development. Excellent written and verbal communication skills. Published research in areas of machine learning at major conferences (NeurIPS, ICML, ICLR, ACL, EMNLP, CVPR, etc.) and/or journals. Previous experience in a customer facing r

About Scale AI Scale AI is the data foundation for AI, helping organizations build and deploy reliable production AI applications. We partner with leading enterprises and government organizations to accelerate their AI initiatives through our data annotation platform, generative AI solutions, and enterprise AI capabilities. Role Overview As a Forward Deployed AI Engineering Manager on our Enterprise team, you'll be the technical bridge between Scale AI's cutting-edge AI capabilities and our most strategic customers. You'll work with enterprise clients to understand their unique challenges, lead a team that architects specific AI solutions, and ensure successful deployment and adoption of AI systems in production environments. This is a Management role that combines deep engineering and AI expertise, leading a team, and working on customer-facing problems. You'll work directly with customer engineering teams to integrate AI into their critical workflows. Key Responsibilities Customer Integration & Deployment Partner directly with enterprise customers to understand their technical infrastructure, data pipelines, and business requirements Design and implement custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs) Build robust data connectors and ETL pipelines to ingest, process, and prepare customer data for AI workflows Deploy and configure AI models and agents within customer security and compliance boundaries AI Agent Development Develop production-grade AI agents tailored to customer use cases across domains like customer support, data analysis, content generation, and workflow automation Architect multi-agent systems that orchestrate between different models, tools, and data sources Implement evaluation frameworks to measure agent performance and iterate toward business objectives Design human-in-the-loop workflows and feedback mechanisms for continuous agent improvement Prompt Engineeri

Scale’s ML platform (RLXF) team builds our internal distributed framework for large language model training and inference. The platform has been powering MLEs, researchers, data scientists and operators for fast and automatic training and evaluation of LLM's, as well as evaluation of data quality. Scale is uniquely positioned at the heart of the field of AI as an indispensable provider of training and evaluation data and end-to-end solutions for the ML lifecycle. You will work closely across Scale’s ML teams and researchers to build the foundation platform that supports all our ML research and development. You will be building and optimizing the platform to enable our next generation of LLM training, inference and data curation. If you are excited about shaping the future AI via fundamental innovations, we would love to hear from you! You will: Build, profile and optimize our training and inference framework Collaborate with ML teams to accelerate their research and development and enable them to develop the next generation of models and data curation Research and integrate state-of-the-art technologies to optimize our ML system Ideally you’d have: Strong excitement about system optimization Experience with multi-node LLM training and inference Experience with developing large-scale distributed ML systems Strong software engineering skills, proficient in frameworks and tools such as CUDA, Pytorch, transformers, flash attention, etc. Strong written and verbal communication skills and the ability to operate in a cross functional team environment Nice to haves: Demonstrated expertise in post-training methods &/or next generation use cases for large language models including instruction tuning, RLHF, tool use, reasoning, agents, and multimodal, etc. Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the positi

Come join our legal team to work on the most exciting legal, policy, and operational issues at the leading edge of AI. We're seeking strong product lawyers with specialized expertise in intellectual property law. As product counsel, you will advise on all legal aspects of product development, launch, and operations - including regulatory compliance, user terms, and risk management - while bringing deep expertise in your specialized legal area. The ideal candidate will have deep subject matter expertise in intellectual property law, a technology background, and a demonstrable history of providing practical product counsel to solve complex, time-sensitive problems in close partnership with cross-functional teams. This role reoprts to the Associate General Counsel, IP & Product. You will: Strategic Product Advice: Lead IP strategy for product development, embedding IP protection into the full product lifecycle from conception to commercialization, while also advising on related product and regulatory matters in collaboration with the broader legal team. Cross-Functional Collaboration: Partner with Research, Product, Engineering, Operations, Communications, and Marketing teams to mitigate IP risks in product development, data licensing, and open-source governance. IP Counsel: Support management of Scale's worldwide IP portfolio including patents and trademarks; assist with patent prosecution and trademark registration and enforcement. Risk Mitigation: Advise on third-party, synthetic, and open-source data and models, ensuring compliance with licensing requirements; design open-source governance policies. Agreements: Support drafting and negotiation of commercial agreement provisions involving intellectual property. Specialized Expertise: Provide counsel on machine learning, robotics, and other technical areas, with ability to engage effectively with technical teams on complex engineering and product issues. Training: Develop and deliver IP and data licensing trainin

About Scale AI At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including generative AI, defense applications, and autonomous vehicles. With our recent Series F round, we’re accelerating the abundance of frontier data to pave the road to Artificial General Intelligence (AGI) and building upon our prior model evaluation work with enterprise customers and governments to deepen our capabilities and offerings for public and private evaluations. About Data Engine Our Generative AI Data Engine powers the world’s most advanced LLMs and generative models through world-class RLHF (Reinforcement Learning with Human Feedback), human data generation, model evaluation, safety, and alignment. The data we produce is some of the most critical work for how humanity will interact with AI. About Our FDE Team Generating high-quality data is the core problem our business solves. We aim to make producing and delivering high-quality data seamless and efficient for operators and customers. Our Team is building customer and operator-specific infrastructure to provide high-quality data with low turnaround time. You'll be exposed to the cutting edge of the Generative AI industry while directly interfacing with the leading model-building organizations in the space, including the top AI research labs and government agencies. Join us in shaping the future of Artificial General Intelligence. As a Forward Deployed Engineer, you'll be at the forefront of providing the critical data infrastructure that powers the most advanced AI models, directly influencing how humanity interacts with AI. You will work with the world’s leading AI companies and government agencies to solve their most complex AI data-related problems. Responsibilities: Drive Impact: Directly contribute to the advancement of AI by delivering critical data solutions for leading AI innovators and

At Scale, our mission is to develop reliable AI systems for the world's most important decisions. Our products provide the high-quality data and full-stack technologies that power the world's leading models, and help enterprises and governments build, deploy, and oversee AI applications that deliver real impact. Scale Frontier Data is the organization behind the training and evaluation data that frontier labs depend on. We build the systems, tooling, and expert workflows that turn hard human expertise into signals that models can learn from, across reasoning, coding, agentic tool use, and domain expertise. About our Customer Platform team: Our Customer Platform Team plays a pivotal role in integrating our platform with external systems and ensuring seamless, reliable connectivity for both internal users and customers. As the leader of this team, you’ll drive the strategy, architecture, and development of our connectivity solutions, focusing on API integration, distributed systems, and a robust data platform. Your role will be crucial in maintaining and enhancing our platform’s ability to meet the needs of both our internal and external stakeholders. Responsibilities: Own large areas within our product Comfortable working cross functionally, whether that be internal or external customers Build features end-to-end: front-end, back-end, system design, debugging and testing Deliver experiments at a high velocity and level of quality to engage our customers Work across the entire product lifecycle from conceptualization through production Influence the culture, values, and processes of a growing engineering team Inspire and mentor less experienced engineers Collaborating with cross-functional teams to define, design, and ship new product features and experiences. Requirements: At least 7-10 years of relevant experience is preferred Track record of shipping high-quality products and features at scale Desire to work in a very fast-paced environment Abil

Scale’s Generative AI business unit is experiencing historic growth. As the Community Manager, you will spearhead initiatives connecting hundreds of thousands of expert contributors on our platform. This is a strategic operational role requiring the execution of an operator, program manager, and creative writer. You’ll need an entrepreneurial mindset, operational rigor, and the ability to communicate effectively with diverse stakeholders across internal and external community channels. Scale’s mission is to develop reliable AI systems for the world’s most important decisions. Our Generative AI unit partners with the world's most advanced research teams to improve their models with human data. You will ensure that our global network of contributors stay engaged and informed so that they can do their best work. You will manage communications, execute virtual campaigns and events, and develop strategies to grow and retain our contributor base. This pivotal role shapes community culture, facilitates a thoughtful contributor experience, and harnesses the energy of our community in order to achieve high-level business goals. You must employ creative problem-solving to resolve complex operational challenges and manage the communications cadence across diverse stakeholders. In this role you will: Create strategies to increase participation and satisfaction, overseeing external platforms like Reddit and managing our internal Outlier Community Develop systems to efficiently channel questions, feedback, and disputes across our platforms and social channels Lead with vision: Set direction for multi-team areas and inspire clarity and alignment Organize virtual events to foster connection and monitor community sentiment in order to proactively mitigate risk and address concerns Leverage user feedback, insights, and quantitative metrics to drive improvement in product and operational strategies Enable the team: Instill ownership, drive cross-team collaboration, and remove structur

Overview Scale’s Finance Systems and Automation team is looking for a builder-oriented team member to help design and develop integrations, automations, and AI agents that streamline workflows across Finance, Accounting, People, and Recruiting. In this role, you will work closely with stakeholders across Finance, Accounting, People Operations, and Recruiting to understand their workflows and build integrations, automations, and agentic workflows that reduce manual effort and accelerate execution across these teams. You will leverage our internal data infrastructure, system integration tooling, and emerging AI platforms to architect scalable solutions — from traditional system integrations to intelligent agent-driven workflows — that serve as the foundation for long-term operational efficiency. We’re looking for someone who thrives on connecting systems, automating repetitive processes, and pushing toward more autonomous, AI-assisted operations. You should be comfortable navigating ambiguity, designing solutions that scale, and rigorously validating outcomes end to end. What You’ll Do Design and build agent-driven workflows and automation systems across People Operations, Recruiting, Finance, and Accounting Identify opportunities to replace manual or rules-based processes with agentic workflows Partner with stakeholders to translate business processes into scalable, automated solutions Lead the implementation of end-to-end workflows, from requirements through deployment and validation Automate candidate-to-employee transitions (e.g., Greenhouse → HRIS → provisioning systems) Build workflows to manage employee lifecycle events such as onboarding, transfers, and offboarding Automate approval flows and data synchronization across People, Finance, and Recruiting systems Support accounting and finance workflows through scalable integrations and automation Design and implement the underlying integrations and data flows that enable reliable automation and agent behavior Est

You will: Source and acquire quality candidates for high volume positions to meet hiring and activation goals Review applications and screen candidates Support candidates throughout the recruiting process Partner with other growth recruiters, ops leads and cross-functional leaders to understand Scale’s business needs, then devise and execute on the recruiting strategy needed to deliver on them. Follow and manage processes that will evolve over time as the company grows. Represent and champion the brand, promoting its value proposition to candidates and driving engagement. Represent Scale at occasional onsite growth recruiting events. Ideally you have: 2+ years of recruiting/sourcing experience in a fast-paced, high-growth environment. Excellent written and verbal communication skills, with the ability to tailor messaging to diverse audiences Experience sourcing candidates and filling high volume roles Experience acting as the primary candidate liaison, delivering white-glove service through timely updates and personalized support throughout the interview process Nice to have: Previous experience in a start-up. Either experience managing a full-cycle recruiting experience, or a passion and ability to learn to do so. Experience with various tools such as Linkedin Recruiter, Clay, Modernloop, Gem Extreme attention to detail AI builder, AI-forward operator, or strong interest in agentic coding and experimenting with AI tooling The hourly salary range for this position is $40 to $55/hr. This is a remote position with occasional travels required for onsite growth recruiting events. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position, determined by work location and additional factors, including job-related skills, experience, interview performance, and relevant education or training. PLEASE NOTE: Our policy requires a 90-day waiting period before reconsidering candidates for the same role. This allow

Owns day-to-day deal pricing execution for Enterprise, including pricing calculations, staffing inputs, and dashboard reporting that gives Sales and Deal Desk leadership visibility into deal status, pricing, and margin. Partners with the Deal Desk Manager on customer deal structuring and on identifying ways to accelerate the deal approval process. What You’ll Do Deal Pricing Execution Manages day-to-day deal pricing calculations for Enterprise deals, including ROI modeling and EPD staffing inputs Applies existing pricing frameworks consistently across Land, Expansion, and Framework deals Partners with the Deal Desk Manager to design customer-specific deal structures for non-standard or complex deals Pricing & Deal Status Reporting Builds and maintains a pricing dashboard tracking deal status, pricing, margin, and overall deal health across the Enterprise pipeline Updates pricing and trend reporting to keep leadership current on where deals stand and how pricing is trending against targets Process Optimization Identifies bottlenecks in the deal review & approval process and proposes ways to accelerate cycle time Helps standardize and streamline recurring pricing/approval steps into repeatable, lower-friction workflows Tracks deal approval cycle time and surfaces trends to inform process improvements Cross-Functional Deal Coordination Owns deal crafting end-to-end from initial pricing/modeling through contract review, coordinating with sales management, reps, and internal stakeholders Ensures the relevant stakeholders (Accounting, Finance, EPD, Legal) review and approve deals at the appropriate stage before they progress Routes deal packages to the correct reviewers and tracks open items so deals aren't stalled waiting on sign-off Strategic & GTM Support Tackles ambiguous, open-ended questions around Scale's go-to-market motion and iterates quickly on solutions that deliver measurable results Supports Sales and Finance leadership in quarterly strategy and

The Public Sector software engineers (SWEs) create the core product building blocks forward-deployed teams use to develop agentic capabilities that function across multiple domains. SWEs responsibilities include building the systems required to ingest and process federal datasets to support real-time decision-making in contested environments. We develop novel agentic enabling capabilities that includes: Create multi-layered guardrails around agents Optimize data retrieval for agents Orchestrate fleets of asynchronous agents Automatically alerts users to deviations in data Illustrating how an agent reached a decision As a Software Engineer, you will own the development of a vertical feature or a horizontal capability to include defining requirements with stakeholders and implementation until it is accepted by the stakeholders. You will: Design and implement scalable backend systems for Federal customers using cloud-native AI infrastructure. Build features for agentic systems including multi-layered guardrails and data retrieval optimization. Develop data pipelines and machine learning infrastructure to make data sources accessible by agents. Collaborate with cross-functional teams to execute backend solutions for secure environments. Participate in customer engagements to understand requirements and deliver technical solutions. Define requirements with stakeholders and implement features until they are accepted. Contribute to the platform roadmap and product strategy for the Federal business. Ideally you will have: Full Stack Development: Proficiency in front-end, back-end development and infrastructure, including experience with modern web development frameworks, programming languages, and databases Cloud-Native Technologies: Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and experience in developing and deploying applications in a cloud-native environment. Understanding of containerization (e.g., Docker) and container orchestration (e.g., Kubernetes

Scale Labs, Research Scientist — Safety Post Training As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and systems. Building on this expertise, Scale Labs has launched a new team focused on policy research, to bridge the gap between AI research and global policymakers to make informed, scientific decisions about AI risks and capabilities. Our research tackles the hardest problems in agent robustness, AI control protocols, and AI risk evaluations to help governments, industry, and the public understand and mitigate AI risk while maximizing AI adoption. This team collaborates broadly across industry, the public sector, and academia and regularly publishes our findings. We are actively seeking talented researchers to join us in shaping this vision. As a Research Scientist working on Safety Post-Training you will develop and apply post-training methods and interpretability techniques to make frontier AI systems safer, and better understood by researchers and policymakers.. For example, you might: Design and run post-training pipelines to study how training choices affect model safety, robustness, and alignment properties; Develop interpretability-informed evaluations that reveal how and why models produce unsafe, deceptive, or otherwise undesirable behaviors, and use those insights to guide targeted mitigations; Collaborate with policymakers, engineers, and other researchers to translate post-training and interpretability findings into actionable safety standards, evaluation benchmarks, and best practices. Ideally you’d have: Commitment to our mission of promoting safe, secure, and trustworthy AI deployments in the industry as frontier AI capabilities continue to advance. Experience with post-training and RL techniques such as RLHF, DPO, GRPO, and similar approaches. A track record of published research in machine learning, particularly in generati

Software is eating the world, but AI is eating software. We live in unprecedented times – AI has the potential to exponentially augment human intelligence. Every person will have a personal tutor, coach, assistant, personal shopper, travel guide, and therapist throughout life. As the world adjusts to this new reality, leading platform companies are scrambling to build LLMs at billion scale, while large enterprises figure out how to add it to their products. To make them safe, aligned and actually useful, these models need human eval and reinforcement learning through human feedback (RLHF) during pre-training, fine-tuning, and production evaluations. This is the main innovation that’s enabled ChatGPT to get such a large headstart among competition. At Scale, our products include the Generative AI Data Engine, SGP, Donovan, and others that power the most advanced LLMs and generative models in the world through world-class RLHF, human data generation, model evaluation, safety, and alignment. The data we are producing is some of the most important work for how humanity will interact with AI. At the foundation of these products is the Identity Engineering team. In this role, you will help support the design and development of core software systems specifically focused on identity, access management, authorization, and authentication. You’ll also get widespread exposure to the forefront of the AI race as Scale sees it in enterprises, startups, governments, and large tech companies. You will: Drive the design, and implementation of our identity infrastructure to ensure secure authentication and authorization across enterprise systems. Build software for authentication mechanisms such as Single Sign-On (SSO), Multi-Factor Authentication (MFA), and federated identity solutions (SAML, OAuth, OpenID Connect). Build software for authorization mechanisms such as Relation-based access control (ReBAC), Attribute-based access control (ABAC), Role-based access cont

At Scale, our mission is to develop reliable AI systems for the world's most important decisions. For 10 years, Scale has provided the high-quality data and full-stack technologies that power the world's leading models, and has helped enterprises and governments build, deploy, and oversee AI applications that deliver real impact. We work closely with industry leaders like Meta, Ernst & Young, Mayo Clinic, Time Inc., the Government of Qatar, and U.S. government agencies including the Army and Air Force. Scale's internship is not a side project. Interns own real, shipped work on the same roadmaps as full-time engineers, with mentorship from world-class talent and a culture that values ownership, speed, and truth-seeking. Many of our interns return as full-time Scaliens. Example Projects Build reinforcement learning and post-training data pipelines that power frontier model development Develop evaluation infrastructure that measures model reliability for enterprise and public sector customers Ship agentic AI applications and the tooling that makes them observable, testable, and safe to deploy Ship tools that accelerate the growth of new qualified contributors on Scale's platform Build fraud-detection systems that remove bad actors and keep Scale's contributor base safe and trusted Use models to estimate the quality of tasks and contributors, and guarantee quality on requests at large scale Devise advanced matching algorithms that pair contributors to customers for optimal turnaround and accuracy Create optimized and efficient UI/UX tooling, in combination with ML algorithms, for 100k+ contributors completing billions of complex tasks Develop new AI infrastructure products to visualize, query, and explore Scale data Requirements A graduation date in Fall 2027 or Spring 2028 with a Bachelor's degree (or equivalent) in a relevant field (Computer Science, EECS, Computer Engineering, Statistics) Available for a Summer 2027 internship (May/June start dates) in San Franci