Quality Assurance Specialist in Canada

Scale’s ML platform (RLXF) team builds our internal distributed framework for large language model training and inference. The platform has been powering MLEs, researchers, data scientists and operators for fast and automatic training and evaluation of LLM's, as well as evaluation of data quality. Scale is uniquely positioned at the heart of the field of AI as an indispensable provider of training and evaluation data and end-to-end solutions for the ML lifecycle. You will work closely across Scale’s ML teams and researchers to build the foundation platform that supports all our ML research and development. You will be building and optimizing the platform to enable our next generation of LLM training, inference and data curation. If you are excited about shaping the future AI via fundamental innovations, we would love to hear from you! You will: Build, profile and optimize our training and inference framework Collaborate with ML teams to accelerate their research and development and enable them to develop the next generation of models and data curation Research and integrate state-of-the-art technologies to optimize our ML system Ideally you’d have: Strong excitement about system optimization Experience with multi-node LLM training and inference Experience with developing large-scale distributed ML systems Strong software engineering skills, proficient in frameworks and tools such as CUDA, Pytorch, transformers, flash attention, etc. Strong written and verbal communication skills and the ability to operate in a cross functional team environment Nice to haves: Demonstrated expertise in post-training methods &/or next generation use cases for large language models including instruction tuning, RLHF, tool use, reasoning, agents, and multimodal, etc. Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the positi

As a member of our Frontier Tech Consultant team, you will play a critical role in advancing cutting-edge AI innovations by conducting high-impact experiments and ensuring seamless execution at the highest quality standards. Your work will directly contribute to Scale AI’s growth, shaping the future of artificial intelligence. In this role, you will be working on various types of projects, including but not limited to: research experiments, dataset generation, data quality improvements, and in-depth technical analysis. You will tackle complex, technical and operational challenges while collaborating closely with Scale’s ML research scientists and SPM team. The ideal candidate is analytical, detail-oriented, and results-driven, with strong problem-solving abilities and excellent communication skills. We are looking for someone who thrives in a fast-paced environment, is proactive in overcoming challenges, and is committed to delivering exceptional outcomes. If you are eager to contribute to the forefront of AI innovation, we encourage you to apply. You will be responsible for: Design and execute research experiments Build and evaluate frontier LLM datasets Develop training and testing material for frontier pipelines Improve quality of existing and new products Ideally you’d have: Strong machine learning knowledge, either by being in the final years of a ML PhD career or having already graduated Strong writing and verbal communication skills An action-oriented mindset that balances creative problem solving with the scrappiness to ultimately deliver results Analytical, planning, and process improvement capability Experience working in a fast-paced, entrepreneurial environment Technical skills including familiarity with Python, GPU, AWS, API, LLM, ML, and SQL Pay: $60-80/hr Commitment: This is a fully remote, US-based part-time (10-20 hours per week), on-going contract position staffed via HireArt. HireArt values diversity and is an Equal Opportunity E

At Scale, our mission is to develop reliable AI systems for the world's most important decisions. For 10 years, Scale has provided the high-quality data and full-stack technologies that power the world's leading models, and has helped enterprises and governments build, deploy, and oversee AI applications that deliver real impact. We work closely with industry leaders like Meta, Ernst & Young, Mayo Clinic, Time Inc., the Government of Qatar, and U.S. government agencies including the Army and Air Force. Scale's internship is not a side project. Interns own real, shipped work on the same roadmaps as full-time engineers, with mentorship from world-class talent and a culture that values ownership, speed, and truth-seeking. Many of our interns return as full-time Scaliens. Example Projects Build reinforcement learning and post-training data pipelines that power frontier model development Develop evaluation infrastructure that measures model reliability for enterprise and public sector customers Ship agentic AI applications and the tooling that makes them observable, testable, and safe to deploy Ship tools that accelerate the growth of new qualified contributors on Scale's platform Build fraud-detection systems that remove bad actors and keep Scale's contributor base safe and trusted Use models to estimate the quality of tasks and contributors, and guarantee quality on requests at large scale Devise advanced matching algorithms that pair contributors to customers for optimal turnaround and accuracy Create optimized and efficient UI/UX tooling, in combination with ML algorithms, for 100k+ contributors completing billions of complex tasks Develop new AI infrastructure products to visualize, query, and explore Scale data Requirements A graduation date in Fall 2027 or Spring 2028 with a Bachelor's degree (or equivalent) in a relevant field (Computer Science, EECS, Computer Engineering, Statistics) Available for a Summer 2027 internship (May/June start dates) in San Franci

About the Team DashMart is a local-fulfillment center owned and operated by DoorDash, offering customers household essentials and other items to their doorsteps with speed, reliability, and quality. Customers order their convenience, grocery, retail, and prepared foods in the DoorDash app, and our team members fulfill orders in a real, brick-and-mortar store for Dashers to deliver. We’re open early and close late - some sites even run 24/7! About the Role DashMart is looking for a motivated and experienced individual that excels in fast-paced, physical environments and is excited to roll up their sleeves and actively engage in day-to-day operations. In this role, you will work within a local fulfillment center supporting Site Management running great shifts, and delegating tasks. As a Shift Lead, you will have shift responsibility for fulfilling orders in a warehouse environment and maintaining inventory, and in some locations, this involves preparing food in a light-prep kitchen. You’re excited about this opportunity because you will… Be an Owner: Take ownership of your assigned shifts, including warehouse and kitchen processes, safety/cleanliness, quality, and training. Maintain accountability for inventory, equipment, and other company assets to ensure they are properly handled, stored, and protected from loss or theft. Delight Customers: Ensure customer orders are delivered with high quality by executing orders accurately, communicating with customers when issues arise, and making sure Dasher pickups go smoothly. Lead: Guide Operations Associates through their shift by ensuring the team works safely and productively and serving as the point of escalation for daily operations. One Team One Fight: Support operations in both the warehouse and kitchen, assist with day-to-day tasks, and lead by example. You will be expected to engage in professional and respectful interactions with team members and customers, ensuring a positive and safe

About Ramp Ramp is building the smart infrastructure for finance teams, embedded in the transaction flow of every dollar a business spends. We automate how over $200B in annualized spend flows in and out of 70,000+ companies: authorizing payments, flagging risk, categorizing spend, and closing books. The problems are high-stakes, data-dense, and unforgiving. We hire people with high agency and high urgency. We look for slope over intercept. We care less about where you trained and more about what you’ve built. At Ramp, everyone is a builder who owns problems end to end and makes consequential decisions that shape the outcome. The median Ramp customer saves 5% and grows revenue 16% in their first year – far in excess of businesses operating without Ramp. We believe every ambitious company deserves the same. If you want to build systems that directly shape how companies move and manage billions, Ramp is the place to do it. About the role As a Business Development Representative in our Toronto office, you will be focused on building Ramp’s presence in the Canadian market. In this high-velocity, high-impact outbound role, you will create qualified opportunities for Ramp’s Account Executives and bring in high-quality pipeline. Our sales organization is looking for someone who is hungry, highly coachable, self-motivated and has a natural inclination for selling – a builder who can perform in ambiguity. As part of our early-stage team, you’ll act as the initial point of contact in prospecting and qualifying leads. If you’re eager to make an impact, embrace challenges and are passionate about playing a key role in defining Ramp’s presence in Canada and accelerating growth in this new market, this role is for you. What you’ll do Source new business across Canada through outbound prospecting and outreach Identify the right finance, operations, and executive stakeholders within target accounts. Execute thoughtful, personalized multi-channel outbound campaigns Run confident col

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. About the Role: Okta is looking for a highly skilled Globalization Engineer to be the technical backbone of our global digital operations. You will be responsible for owning, building, and optimizing the automation and technology stack that powers our localization team. This is a hands-on role for an experienced technical expert who is passionate about building robust, scalable systems. You will leverage your deep expertise in APIs, AI, and internationalization to solve complex technical challenges and drive efficiency. As a subject matter expert, you will also act as a key technical consultant to internal teams, helping them prepare content for a global audience. What you'll be doing: Build and Own the Localization Automation Framework: Design, develop, and maintain the core automation workflows for our content lifecycle using agentic workflows, Python and APIs, connecting our TMS with content sources, repositories, and other internal tools. Spearhead AI and Technology Integration: Research, evaluate, and implement cutting-edge localization technologies, including AI/LLM-based solutions and advanced TMS features, to improve the quality, speed, and cost-effectiveness of our workflows. Provide Technical Oversight and Systems Integrity: Act as the authority for resolving high-impact architectural failures. Conduct deep-dive root cause analysis on complex integration issues, file parsing conflicts, and system-wide bottlenecks to ensure uninterrupte

About the Team As DoorDash continues to expand rapidly, our Core Consumer team plays a pivotal role in shaping the consumer experience through enhancing personalization, search relevance, merchandising strategy, app quality, and the overall ordering experience. Our mission is to implement scalable data solutions and provide insights that directly influence our strategic product direction. We are looking for an Analytics Senior Manager to lead our Discovery team. About the Role As a Senior Manager of Data Science/Analytics, you’ll be leading a team of data scientists who are working on improving the consumer experience. You will develop strategic insights and work closely with the product, engineering, strategy and operations teams to actively build and measure the impact of new features. You will oversee our metrics and analytics strategy to inform strategic product direction, offer technical leadership and build processes to support velocity, and partner with data and product engineers to build robust data foundations. You're excited about this opportunity because you will… Lead and develop a team of Data Scientists in investigating complex issues and uncovering key drivers of our business, along with your own contributions as an Individual Contributor Influence the Product and Operations roadmap by making actionable recommendations based on data Interface frequently with senior leadership to showcase your team’s work and tackle complex business problems Drive measurement strategy for the area under scope, defining success metrics and implementing best practices around experiment design and statistical analysis Develop a strategic learning roadmap based on data observations, strategic questions, and hypotheses We're excited about you because you have… A degree in Math, Physics, Statistics, Economics, Computer Science, or a similar domain Experience managing a team of data scientists, and a track record of delivering impactful analyses 8+ years of experience i

About the Team Merchant Analytics helps DoorDash make better product, business, and go-to-market decisions through high-quality analytics, predictive modeling, experimentation, and strategic thought partnership. We work across some of DoorDash’s most important merchant and marketplace priorities, building the measurement, insights, and decision frameworks that improve outcomes for merchants and drive company impact. About the Role We’re hiring two Data Science Managers, each to lead a pod within Merchant Analytics and help shape high-priority product and business decisions. In this role, you will lead a team of data scientists, partner closely with Strategy & Operations, Product, Engineering, and business leaders, and turn ambiguous questions into clear recommendations that influence roadmap and plan outcomes. Success in this role means building a high-performing team, raising the quality and speed of decision-making, and ensuring analytics work is tightly connected to measurable business impact. You will report into Director, Data Science on our Merchant Analytics team in our Analytics organization. You’re excited about this opportunity because you will… Lead and develop a team of data scientists responsible for high-impact analytics, predictive modeling, and decision support tied to DoorDash’s most important product, business, and GTM priorities. Partner closely with Strategy & Operations, Product, Engineering, and business leaders to shape decisions, influence roadmaps, and improve plan-critical metrics. Define success metrics, build measurement frameworks and predictive models, and use experimentation and analysis to connect product and operational levers to business outcomes. Build a high-performing pod that balances analytical rigor, strong prioritization, and clear storytelling in a fast-moving environment. Scale reusable analytics frameworks, tools, models, and best practices that make the broader organization more effective over time. We’re excited

About the Team Our team exists to empower DoorDash Mobile engineers. We are the champions of three core pillars: Quality, Velocity, and Efficiency. Ultimately, our goal is to build the supportive infrastructure that allows our fellow engineers to build, ship, and operate apps at massive scale—with confidence and ease. We believe that a great developer experience leads to a great customer experience. About the Role We are looking for an Engineering Manager to lead our Mobile Developer Experience team (also known internally as the Mobile Foundations team). In this role, you’ll not only set the technical vision but also nurture the culture required to build world-class mobile applications. Your team will concentrate on one vertical—ZeroKit, which enables rapid mobile prototyping via agents—and two horizontal infrastructure pillars: the iOS and Android monorepos. You will partner with senior engineers and stakeholders across the company to design systems that make our platform faster, more reliable, and more efficient. You will be a partner to your customers—your fellow engineers—working side-by-side to understand their hurdles and solve their immediate challenges. You’ll also look to the future, anticipating needs so we can deliver solutions before they become blockers. Crucially, this role will support our growing international engineering footprint and unified technology stack, meaning you and your team will work across our DoorDash, Wolt, and Deliveroo brands. This is a unique opportunity to lead a team through a mix of exciting greenfield initiatives and the refinement of established, successful tools. You must be located in the following locations for this opportunity: San Francisco, CA; Sunnyvale, CA; Seattle, WA; Los Angeles, CA; New York, New York. You’re excited about this opportunity because you will… Develop and maintain foundational components to enable DoorDash Engineers to excel at mobile engineering. Lead the development and strategy for ZeroKit to enabl

About the Team DoorDash’s GenAI Platform team sits within Machine Learning Platform and builds the shared infrastructure that helps DoorDash, Wolt, and Deliveroo teams safely bring GenAI-powered products, agents, automation, and personalization to production. Our mission is to increase the velocity of business impact from GenAI. A central pillar of that work is our evaluation platform — the unified evals backbone that lets teams measure, trace, and trust the quality of LLM and agent systems across the company, powering trace/score ingestion, LLM-as-judge workflows, agent simulations, and LLM observability for the tens of millions of daily requests flowing through our LLM Gateway. We also own core platform surfaces including the Agent Gateway, open-weights model serving and batch inference, guardrails, and cost attribution. About the Role You will join a small, high-leverage team building production infrastructure for Generative AI at DoorDash, with a primary focus on our evals and LLM observability platform: the systems that let teams evaluate, trace, and continuously improve the quality of LLM and agent products. You’ll work across evaluation frameworks and SDKs, OpenTelemetry-based trace/score ingestion, LLM-as-judge and offline/online eval pipelines, agent simulations, data pipelines, backend services, and observability. This role is ideal for an engineer who enjoys building reliable measurement and quality primitives in a fast-moving technical area where product needs, model capabilities, vendor ecosystems, and evaluation methodologies are evolving quickly. You’re excited about this opportunity because you will… Build the infrastructure that helps DoorDash teams move GenAI ideas from prototype to production, increasing the velocity of business impact from AI across the company. Work on our unified evals platform — evaluation SDKs, OpenTelemetry trace/score ingestion, LLM-as-judge, offline and online eval pipelines, and agent simulations — alongside the LLM Gatew

About the Role: Tubi is one of the largest free streaming platforms in the US, serving a large-scale streaming audience across Web, iOS, Android, Roku, Fire TV, Apple TV, and game consoles. Quality at this scale isn't a checkbox — it's a competitive advantage. We're looking for an Automation Engineering Manager to lead the team responsible for building and operating Tubi's multi-platform test automation infrastructure. You will own the strategy, tooling, and execution quality across our client surfaces — from video playback and ad delivery to content discovery and onboarding. This role is for a hands-on technical leader who can set direction, influence cross-functional roadmaps, and stay close enough to the code to guide architecture, review critical implementation decisions, and unblock complex technical issues. You will build a team that ships reliable automation at speed — and you will help the team move toward AI-native automation practices: fluent in AI tooling, proactive about applying it, and disciplined about using it responsibly. This is a hybrid role based out of either our San Francisco or Toronto office. You must be willing to travel to either location at least 2 days a week. What You'll Do: Test Strategy & Quality Planning Define and own Tubi's multi-platform automation strategy — covering Web, iOS, Android, CTV (Roku, Fire TV, Apple TV, Smart TVs, game consoles), and API layers. Establish testing standards, coverage targets, and quality gate policies across the CI/CD pipeline to protect release confidence and production reliability. Design specialized test strategies for business-critical scenarios: video playback (HLS/DASH), ad insertion, content recommendation surfaces, and user authentication flows. Use AI-assisted analysis (e.g., failure pattern clustering, test gap detection) to continuously improve test strategy based on real production signal and defect trends — not gut instinct. Automation Framework & Infrastructure Lead the

At Scale, our mission is to develop reliable AI systems for the world's most important decisions. For 10 years, Scale has provided the high-quality data and full-stack technologies that power the world's leading models, and has helped enterprises and governments build, deploy, and oversee AI applications that deliver real impact. We work closely with industry leaders like Meta, Ernst & Young, Mayo Clinic, Time Inc., the Government of Qatar, and U.S. government agencies including the Army and Air Force. Public Sector engineers build the core product including the systems required to ingest and process federal datasets that support real-time decision-making in contested environments. As a New Grad Software Engineer on this team, you will own meaningful, mission-facing work from day one: shipping features, sitting with the government stakeholders who use them, and iterating fast. Example Projects Build multi-layered guardrails that keep agents safe and predictable in high-stakes federal environments Optimize data retrieval for agents, including RAG pipelines over large, heterogeneous federal datasets Build orchestration for fleets of asynchronous agents running long-horizon tasks Develop systems that automatically alert users to deviations and anomalies in incoming data Create interfaces that illustrate how an agent reached a decision, so operators can audit and trust its output Develop data pipelines and ML infrastructure that make previously siloed government data sources accessible to agents Build evaluation infrastructure that measures model reliability against mission requirements Ship full-stack tooling that lets analysts query, visualize, and explore mission data Deploy and harden applications into secure, air-gapped, and cloud-native government environments Requirements A graduation date in Fall 2026 or Spring 2027 with a Bachelor's degree (or equivalent) in a relevant field (Computer Science, EECS, Computer Engineering, Statistics) Product engineering expe

Business Analyst (Product Operations Specialist) (3 month Fixed Term Role with scope to extend) New York/ Remote US (with 2 days per week office time in New York) Prolific Prolific is not just another player in the AI space – we are the architects of the human data infrastructure that's reshaping the landscape of AI development. In a world where foundational AI technologies are increasingly commoditized, it's the quality and diversity of human-generated data that truly differentiates products and models. The role Prolific for AI takes on a wide and fast-moving range of customer projects across our biggest AI accounts. Every project has its own requirements, systems, and stakeholders – and right now, that complexity lives in people's heads rather than on paper. We're looking for a Business Analyst / Product Operations Manager to fix that. You’ll get into the weeds of each project's requirements and systems, and turn that complexity into visual maps that the whole team can work from. You’ll be the person who steps back across them, spots the patterns, and tells us what's repeating, what's diverging, and what should become a reusable playbook. You'll also own how requests reach the product team in the first place, building the internal intake process that determines how we become aware of, understand, and prioritise customer asks. Impact: You'll bring order and visibility to a high-throughput, high-complexity part of the business. Every pilot you map makes the next one faster to run and easier to hand off. Experience: You’ll come from a Product or Delivery or Operations background and have cross-functional skills. Building the plane while flying it should excite you, not scare you. You're comfortable being the person who asks the detailed questions until the system actually makes sense – and you know how to represent what you've learned so that other people can act on it immediately, without a meeting. Domain: You'll sit within Prolific f

Notice to applicants: We have seen a rise in recruitment scams. Please note that outreach from Khan Academy recruiters will only come from the @khanacademy.org domain. Our team does not use Gmail or other personal accounts for contacting potential candidates. Khan Academy will never solicit money, equipment fees, or sensitive financial information at any stage of the hiring process. We also do not work with external recruiting agencies, so outreach from headhunters presenting opportunities on behalf of Khan Academy is illegitimate. Please always check the email domain and cross-reference the position with the official Khan Academy Careers page to confirm an opening is valid. ABOUT KHAN ACADEMY Khan Academy is a nonprofit with the mission to deliver a free, world-class education to anyone, anywhere. Our proven learning platform offers free, high-quality supplemental learning content and practice that cover Pre-K - 12th grade and early college core academic subjects, focusing on math and science. We have over 181 million registered learners globally and are committed to improving learning outcomes for students worldwide, focusing on learners in historically under-resourced communities. ABOUT KHAN ACADEMY KIDS Khan Academy Kids is a free and fun learning program for children ages 2 to 8. Kodi Bear and a cast of animated characters lead children on a personalized education journey filled with fun, standards-aligned activities in early literacy, math, executive functioning and social emotional skills. Built by a small but mighty team, Khan Academy Kids is used by millions of children in homes and classrooms around the world. OUR COMMUNITY Our students, teachers, and parents come from all walks of life, and so do we. Our team includes people from academia, traditional/non-traditional education, big tech companies, and tiny startups. We hire great people from diverse backgrounds and experiences because it makes our company stronger. We value diversity, equity,

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. The autonomous transition is a transformational opportunity for Lyft. Our strategy focuses on becoming the preferred marketplace, fleet, and operational partner for the world's best Autonomous Vehicle (AV) providers. As AV deployments scale across new markets, the operational infrastructure that enables safe, compliant, and high-quality service becomes a critical competitive advantage. This role sits at the heart of that infrastructure - owning the systems, processes, and partner alignment that allow Lyft to operate at the standards our AV partners require and our riders expect. As a qualified candidate, you have a track record of building and running complex operational programs in highly regulated or standards-driven environments. You are energized by cross-functional complexity - comfortable leading structured implementation processes that span many teams while keeping a clear eye on compliance and quality outcomes. You bring a program management mindset, strong stakeholder communication skills, and the judgment to navigate ambiguity in a fast-moving industry. Responsibilities: Own execution of AV partner audits end-to-end. That includes evidence collection, submission, partner and third-party review, mitigation oversight, and closeout, across concurrent certification cycles for multiple markets and AV partners, domestic and international. Act as a strategic leader within the company to support cross-functional teams’ compliance controls and readiness for partner scrutiny Drive coordination across teams including EHS, Legal, Safety, HR, IT and Operations for every deliverable. Translate partner and regulatory requirements into concrete, assignable asks and ensure deadlines are met Maintain and continuously improve the audit tracking system, including the evidence library, audit trail, and submissi