Quality Assurance Lead in Canada

About Scale Scale’s mission is to develop reliable AI systems for the world’s most important decisions. As the leading AI data foundry, we provide the high-quality data and full-stack technologies that power the world’s most advanced models — fueling breakthroughs in generative AI, defense, and autonomous vehicles. We partner with leading enterprises and governments to bring AI into production that performs when it matters most, combining rigorous evaluation with full-stack deployment so our customers can build AI they can trust. About the Team Applied Intelligence Systems (AIS) is part of the Scale Generative AI Platform (SGP), focused on pushing the frontier of what agentic applications can do across diverse enterprise and government use cases. We build the infrastructure and tooling that power agentic AI in production, paired with applied ML research, design, and evaluation to ensure these systems perform reliably at the scale our customers demand. AIS spans multiple workstreams — agent evaluation and oversight, orchestration and tool-use infrastructure, model and systems optimization, and applied research on new agent capabilities — and this role is not scoped to any single one of them. We’re growing fast, with increasing traction across both commercial and public sector customers, and we’re just getting started — this team will define what dependable, production-grade agentic AI looks like. About the Role As a Staff Machine Learning Research Engineer, you will operate across the full breadth of AIS’s technical needs — wherever the hardest ML problem in agentic AI happens to be that quarter. This could mean training and fine-tuning models, designing evaluation and observability systems, building improvement loops from production data, prototyping novel agent architectures, or designing internal systems and tooling that boost productivity across teams. You’re not tied to one team’s roadmap; you’re expected to move to where the technical leverage is highest, and t

About Scale AI At Scale, our mission is to develop reliable AI systems for the world's most important decisions. Our products provide the high-quality data and full-stack technologies that power the world's leading models, and help enterprises and governments build, deploy, and oversee AI applications that deliver real impact. Scale Frontier Data is the organization behind the training and evaluation data that frontier labs depend on. We build the systems, tooling, and expert workflows that turn hard human expertise into signals that models can learn from, across reasoning, coding, agentic tool use, and domain expertise. Reinforcement learning environments are now the center of gravity for that work: the difference between a model that demos well and a model that reliably completes long-horizon work is almost always the quality of the environments and reward signals it was trained against. Responsibilities As a Staff Software Engineer, RL Environments, you'll own the technical foundation for how Scale builds, runs, verifies, and delivers RL environments at scale. An RL environment is a real piece of software: a containerized world with real dependencies, real state, real tools, and a grader that has to be correct even when the agent is creative about breaking it. Building one is a full-stack engineering problem. Building thousands of them reproducibly, cheaply, with trustworthy reward signals and throughput measured in millions of rollouts is a systems problem that very few people have solved. You'll work on both. You'll design the platform: sandboxed execution, environment packaging and versioning, rollout orchestration, trajectory capture, verifier frameworks, and the authoring surfaces that let engineers and domain experts produce environments without reinventing infrastructure each time. And you'll go deep on the environments themselves by instrumenting real applications, designing task suites that expose specific capability gaps, and building graders that

Scale's mission is to develop reliable AI systems for the world's most important decisions. We provide the high-quality data that powers the world's AI models, and we help enterprises and governments build, deploy, and oversee AI applications that create real impact. As Communications Manager, Corporate and Product, you will help shape how Scale shows up when it comes to our work building enterprise AI, spanning company narrative, product launches, partner communications, media presence, and executive visibility. This role is centered on translating complex enterprise AI deployments and partnerships into clear, compelling narratives that resonate with business and vertical industry audiences. A core focus of the role is pitching and positioning Scale's enterprise wins, product launches, and customer partnerships, including how organizations across industries are using Scale's Generative AI Platform to build, deploy, and oversee AI applications that create real impact. You will also work closely with communications counterparts at partner companies to align messaging and coordinate joint announcements. You will help tell the story of how Scale's enterprise business powers mission-critical AI programs for the world's most consequential organizations, from Fortune 500 companies to leaders across every major industry. In this role, you will partner closely with enterprise product leaders and go-to-market teams, as well as teams across communications, social, and marketing. You will play a key role in strengthening Scale's reputation with enterprise customers, industry analysts, and the broader technology ecosystem. This position reports directly to the Head of Corporate & Product Communications. You Will Support corporate and product communications initiatives with a strong emphasis on Scale's enterprise business, including customer and partnership announcements, product launches, executive visibility, and industry positioning. Help translate co

Scale’s ML platform (RLXF) team builds our internal distributed framework for large language model training and inference. The platform has been powering MLEs, researchers, data scientists and operators for fast and automatic training and evaluation of LLM's, as well as evaluation of data quality. Scale is uniquely positioned at the heart of the field of AI as an indispensable provider of training and evaluation data and end-to-end solutions for the ML lifecycle. You will work closely across Scale’s ML teams and researchers to build the foundation platform that supports all our ML research and development. You will be building and optimizing the platform to enable our next generation of LLM training, inference and data curation. If you are excited about shaping the future AI via fundamental innovations, we would love to hear from you! You will: Build, profile and optimize our training and inference framework Collaborate with ML teams to accelerate their research and development and enable them to develop the next generation of models and data curation Research and integrate state-of-the-art technologies to optimize our ML system Ideally you’d have: Strong excitement about system optimization Experience with multi-node LLM training and inference Experience with developing large-scale distributed ML systems Strong software engineering skills, proficient in frameworks and tools such as CUDA, Pytorch, transformers, flash attention, etc. Strong written and verbal communication skills and the ability to operate in a cross functional team environment Nice to haves: Demonstrated expertise in post-training methods &/or next generation use cases for large language models including instruction tuning, RLHF, tool use, reasoning, agents, and multimodal, etc. Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the positi

As a member of our Frontier Tech Consultant team, you will play a critical role in advancing cutting-edge AI innovations by conducting high-impact experiments and ensuring seamless execution at the highest quality standards. Your work will directly contribute to Scale AI’s growth, shaping the future of artificial intelligence. In this role, you will be working on various types of projects, including but not limited to: research experiments, dataset generation, data quality improvements, and in-depth technical analysis. You will tackle complex, technical and operational challenges while collaborating closely with Scale’s ML research scientists and SPM team. The ideal candidate is analytical, detail-oriented, and results-driven, with strong problem-solving abilities and excellent communication skills. We are looking for someone who thrives in a fast-paced environment, is proactive in overcoming challenges, and is committed to delivering exceptional outcomes. If you are eager to contribute to the forefront of AI innovation, we encourage you to apply. You will be responsible for: Design and execute research experiments Build and evaluate frontier LLM datasets Develop training and testing material for frontier pipelines Improve quality of existing and new products Ideally you’d have: Strong machine learning knowledge, either by being in the final years of a ML PhD career or having already graduated Strong writing and verbal communication skills An action-oriented mindset that balances creative problem solving with the scrappiness to ultimately deliver results Analytical, planning, and process improvement capability Experience working in a fast-paced, entrepreneurial environment Technical skills including familiarity with Python, GPU, AWS, API, LLM, ML, and SQL Pay: $60-80/hr Commitment: This is a fully remote, US-based part-time (10-20 hours per week), on-going contract position staffed via HireArt. HireArt values diversity and is an Equal Opportunity E

At Scale, our mission is to develop reliable AI systems for the world's most important decisions. For 10 years, Scale has provided the high-quality data and full-stack technologies that power the world's leading models, and has helped enterprises and governments build, deploy, and oversee AI applications that deliver real impact. We work closely with industry leaders like Meta, Ernst & Young, Mayo Clinic, Time Inc., the Government of Qatar, and U.S. government agencies including the Army and Air Force. Scale's internship is not a side project. Interns own real, shipped work on the same roadmaps as full-time engineers, with mentorship from world-class talent and a culture that values ownership, speed, and truth-seeking. Many of our interns return as full-time Scaliens. Example Projects Build reinforcement learning and post-training data pipelines that power frontier model development Develop evaluation infrastructure that measures model reliability for enterprise and public sector customers Ship agentic AI applications and the tooling that makes them observable, testable, and safe to deploy Ship tools that accelerate the growth of new qualified contributors on Scale's platform Build fraud-detection systems that remove bad actors and keep Scale's contributor base safe and trusted Use models to estimate the quality of tasks and contributors, and guarantee quality on requests at large scale Devise advanced matching algorithms that pair contributors to customers for optimal turnaround and accuracy Create optimized and efficient UI/UX tooling, in combination with ML algorithms, for 100k+ contributors completing billions of complex tasks Develop new AI infrastructure products to visualize, query, and explore Scale data Requirements A graduation date in Fall 2027 or Spring 2028 with a Bachelor's degree (or equivalent) in a relevant field (Computer Science, EECS, Computer Engineering, Statistics) Available for a Summer 2027 internship (May/June start dates) in San Franci

About the Team DoorDash’s GenAI Platform team sits within Machine Learning Platform and builds the shared infrastructure that helps DoorDash, Wolt, and Deliveroo teams safely bring GenAI-powered products, agents, automation, and personalization to production. Our mission is to increase the velocity of business impact from GenAI. A central pillar of that work is our evaluation platform — the unified evals backbone that lets teams measure, trace, and trust the quality of LLM and agent systems across the company, powering trace/score ingestion, LLM-as-judge workflows, agent simulations, and LLM observability for the tens of millions of daily requests flowing through our LLM Gateway. We also own core platform surfaces including the Agent Gateway, open-weights model serving and batch inference, guardrails, and cost attribution. About the Role You will join a small, high-leverage team building production infrastructure for Generative AI at DoorDash, with a primary focus on our evals and LLM observability platform: the systems that let teams evaluate, trace, and continuously improve the quality of LLM and agent products. You’ll work across evaluation frameworks and SDKs, OpenTelemetry-based trace/score ingestion, LLM-as-judge and offline/online eval pipelines, agent simulations, data pipelines, backend services, and observability. This role is ideal for an engineer who enjoys building reliable measurement and quality primitives in a fast-moving technical area where product needs, model capabilities, vendor ecosystems, and evaluation methodologies are evolving quickly. You’re excited about this opportunity because you will… Build the infrastructure that helps DoorDash teams move GenAI ideas from prototype to production, increasing the velocity of business impact from AI across the company. Work on our unified evals platform — evaluation SDKs, OpenTelemetry trace/score ingestion, LLM-as-judge, offline and online eval pipelines, and agent simulations — alongside the LLM Gatew

About the Team DashMart is a local-fulfillment center owned and operated by DoorDash, offering customers household essentials and other items to their doorsteps with speed, reliability, and quality. Customers order their convenience, grocery, retail, and prepared foods in the DoorDash app, and our team members fulfill orders in a real, brick-and-mortar store for Dashers to deliver. We’re open early and close late - some sites even run 24/7! About the Role DashMart is looking for a motivated and experienced individual that excels in fast-paced, physical environments and is excited to roll up their sleeves and actively engage in day-to-day operations. In this role, you will work within a local fulfillment center supporting Site Management running great shifts, and delegating tasks. As a Shift Lead, you will have shift responsibility for fulfilling orders in a warehouse environment and maintaining inventory, and in some locations, this involves preparing food in a light-prep kitchen. You’re excited about this opportunity because you will… Be an Owner: Take ownership of your assigned shifts, including warehouse and kitchen processes, safety/cleanliness, quality, and training. Maintain accountability for inventory, equipment, and other company assets to ensure they are properly handled, stored, and protected from loss or theft. Delight Customers: Ensure customer orders are delivered with high quality by executing orders accurately, communicating with customers when issues arise, and making sure Dasher pickups go smoothly. Lead: Guide Operations Associates through their shift by ensuring the team works safely and productively and serving as the point of escalation for daily operations. One Team One Fight: Support operations in both the warehouse and kitchen, assist with day-to-day tasks, and lead by example. You will be expected to engage in professional and respectful interactions with team members and customers, ensuring a positive and safe

About the Team Our team exists to empower DoorDash Mobile engineers. We are the champions of three core pillars: Quality, Velocity, and Efficiency. Ultimately, our goal is to build the supportive infrastructure that allows our fellow engineers to build, ship, and operate apps at massive scale—with confidence and ease. We believe that a great developer experience leads to a great customer experience. About the Role We are looking for an Engineering Manager to lead our Mobile Developer Experience team (also known internally as the Mobile Foundations team). In this role, you’ll not only set the technical vision but also nurture the culture required to build world-class mobile applications. Your team will concentrate on one vertical—ZeroKit, which enables rapid mobile prototyping via agents—and two horizontal infrastructure pillars: the iOS and Android monorepos. You will partner with senior engineers and stakeholders across the company to design systems that make our platform faster, more reliable, and more efficient. You will be a partner to your customers—your fellow engineers—working side-by-side to understand their hurdles and solve their immediate challenges. You’ll also look to the future, anticipating needs so we can deliver solutions before they become blockers. Crucially, this role will support our growing international engineering footprint and unified technology stack, meaning you and your team will work across our DoorDash, Wolt, and Deliveroo brands. This is a unique opportunity to lead a team through a mix of exciting greenfield initiatives and the refinement of established, successful tools. You must be located in the following locations for this opportunity: San Francisco, CA; Sunnyvale, CA; Seattle, WA; Los Angeles, CA; New York, New York. You’re excited about this opportunity because you will… Develop and maintain foundational components to enable DoorDash Engineers to excel at mobile engineering. Lead the development and strategy for ZeroKit to enabl

About the Team Merchant Analytics helps DoorDash make better product, business, and go-to-market decisions through high-quality analytics, predictive modeling, experimentation, and strategic thought partnership. We work across some of DoorDash’s most important merchant and marketplace priorities, building the measurement, insights, and decision frameworks that improve outcomes for merchants and drive company impact. About the Role We’re hiring two Data Science Managers, each to lead a pod within Merchant Analytics and help shape high-priority product and business decisions. In this role, you will lead a team of data scientists, partner closely with Strategy & Operations, Product, Engineering, and business leaders, and turn ambiguous questions into clear recommendations that influence roadmap and plan outcomes. Success in this role means building a high-performing team, raising the quality and speed of decision-making, and ensuring analytics work is tightly connected to measurable business impact. You will report into Director, Data Science on our Merchant Analytics team in our Analytics organization. You’re excited about this opportunity because you will… Lead and develop a team of data scientists responsible for high-impact analytics, predictive modeling, and decision support tied to DoorDash’s most important product, business, and GTM priorities. Partner closely with Strategy & Operations, Product, Engineering, and business leaders to shape decisions, influence roadmaps, and improve plan-critical metrics. Define success metrics, build measurement frameworks and predictive models, and use experimentation and analysis to connect product and operational levers to business outcomes. Build a high-performing pod that balances analytical rigor, strong prioritization, and clear storytelling in a fast-moving environment. Scale reusable analytics frameworks, tools, models, and best practices that make the broader organization more effective over time. We’re excited

About the Team As DoorDash continues to expand rapidly, our Core Consumer team plays a pivotal role in shaping the consumer experience through enhancing personalization, search relevance, merchandising strategy, app quality, and the overall ordering experience. Our mission is to implement scalable data solutions and provide insights that directly influence our strategic product direction. We are looking for an Analytics Senior Manager to lead our Discovery team. About the Role As a Senior Manager of Data Science/Analytics, you’ll be leading a team of data scientists who are working on improving the consumer experience. You will develop strategic insights and work closely with the product, engineering, strategy and operations teams to actively build and measure the impact of new features. You will oversee our metrics and analytics strategy to inform strategic product direction, offer technical leadership and build processes to support velocity, and partner with data and product engineers to build robust data foundations. You're excited about this opportunity because you will… Lead and develop a team of Data Scientists in investigating complex issues and uncovering key drivers of our business, along with your own contributions as an Individual Contributor Influence the Product and Operations roadmap by making actionable recommendations based on data Interface frequently with senior leadership to showcase your team’s work and tackle complex business problems Drive measurement strategy for the area under scope, defining success metrics and implementing best practices around experiment design and statistical analysis Develop a strategic learning roadmap based on data observations, strategic questions, and hypotheses We're excited about you because you have… A degree in Math, Physics, Statistics, Economics, Computer Science, or a similar domain Experience managing a team of data scientists, and a track record of delivering impactful analyses 8+ years of experience i

About Ramp Ramp is building the smart infrastructure for finance teams, embedded in the transaction flow of every dollar a business spends. We automate how over $200B in annualized spend flows in and out of 70,000+ companies: authorizing payments, flagging risk, categorizing spend, and closing books. The problems are high-stakes, data-dense, and unforgiving. We hire people with high agency and high urgency. We look for slope over intercept. We care less about where you trained and more about what you’ve built. At Ramp, everyone is a builder who owns problems end to end and makes consequential decisions that shape the outcome. The median Ramp customer saves 5% and grows revenue 16% in their first year – far in excess of businesses operating without Ramp. We believe every ambitious company deserves the same. If you want to build systems that directly shape how companies move and manage billions, Ramp is the place to do it. About the role As a Business Development Representative in our Toronto office, you will be focused on building Ramp’s presence in the Canadian market. In this high-velocity, high-impact outbound role, you will create qualified opportunities for Ramp’s Account Executives and bring in high-quality pipeline. Our sales organization is looking for someone who is hungry, highly coachable, self-motivated and has a natural inclination for selling – a builder who can perform in ambiguity. As part of our early-stage team, you’ll act as the initial point of contact in prospecting and qualifying leads. If you’re eager to make an impact, embrace challenges and are passionate about playing a key role in defining Ramp’s presence in Canada and accelerating growth in this new market, this role is for you. What you’ll do Source new business across Canada through outbound prospecting and outreach Identify the right finance, operations, and executive stakeholders within target accounts. Execute thoughtful, personalized multi-channel outbound campaigns Run confident col

A Test Program Manager (or Test Engineering Program Manager) leads cross-functional teams to define, plan, and execute product testing strategies, ensuring quality from development to launch. They manage test schedules, budgets, and vendor relations while driving bug resolution and reporting status to leadership. Apple +4 Key Responsibilities Strategy & Planning: Define comprehensive end-to-end testing strategies, covering functional, regression, and system testing. Cross-Functional Leadership: Coordinate with software, hardware, and RF test engineers to align testing with product development. Execution & Monitoring: Drive test readiness reviews, monitor test execution, and manage defect reporting. Vendor & Budget Management: Manage test suppliers, vendors, and development budgets. Risk Management: Proactively identify project risks, inter-dependencies, and bottlenecks to ensure on-time delivery. Apple +6 Required Skills & Qualifications Technical Proficiency: Familiarity with test technologies, CICD, and automation tools. Project Management: Experience with software development lifecycles (SDLC) and complex product testing. Communication: Excellent leadership, presentation, and conflict-resolution skills. Education/Experience: Often requires a degree in Engineering (Software/Electrical) and experience in testing or program management. Apple +4

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. About the Role: Okta is looking for a highly skilled Globalization Engineer to be the technical backbone of our global digital operations. You will be responsible for owning, building, and optimizing the automation and technology stack that powers our localization team. This is a hands-on role for an experienced technical expert who is passionate about building robust, scalable systems. You will leverage your deep expertise in APIs, AI, and internationalization to solve complex technical challenges and drive efficiency. As a subject matter expert, you will also act as a key technical consultant to internal teams, helping them prepare content for a global audience. What you'll be doing: Build and Own the Localization Automation Framework: Design, develop, and maintain the core automation workflows for our content lifecycle using agentic workflows, Python and APIs, connecting our TMS with content sources, repositories, and other internal tools. Spearhead AI and Technology Integration: Research, evaluate, and implement cutting-edge localization technologies, including AI/LLM-based solutions and advanced TMS features, to improve the quality, speed, and cost-effectiveness of our workflows. Provide Technical Oversight and Systems Integrity: Act as the authority for resolving high-impact architectural failures. Conduct deep-dive root cause analysis on complex integration issues, file parsing conflicts, and system-wide bottlenecks to ensure uninterrupte

Business Analyst (Product Operations Specialist) (3 month Fixed Term Role with scope to extend) New York/ Remote US (with 2 days per week office time in New York) Prolific Prolific is not just another player in the AI space – we are the architects of the human data infrastructure that's reshaping the landscape of AI development. In a world where foundational AI technologies are increasingly commoditized, it's the quality and diversity of human-generated data that truly differentiates products and models. The role Prolific for AI takes on a wide and fast-moving range of customer projects across our biggest AI accounts. Every project has its own requirements, systems, and stakeholders – and right now, that complexity lives in people's heads rather than on paper. We're looking for a Business Analyst / Product Operations Manager to fix that. You’ll get into the weeds of each project's requirements and systems, and turn that complexity into visual maps that the whole team can work from. You’ll be the person who steps back across them, spots the patterns, and tells us what's repeating, what's diverging, and what should become a reusable playbook. You'll also own how requests reach the product team in the first place, building the internal intake process that determines how we become aware of, understand, and prioritise customer asks. Impact: You'll bring order and visibility to a high-throughput, high-complexity part of the business. Every pilot you map makes the next one faster to run and easier to hand off. Experience: You’ll come from a Product or Delivery or Operations background and have cross-functional skills. Building the plane while flying it should excite you, not scare you. You're comfortable being the person who asks the detailed questions until the system actually makes sense – and you know how to represent what you've learned so that other people can act on it immediately, without a meeting. Domain: You'll sit within Prolific f