Quality System Specialist in Canada

About Scale AI At Scale, our mission is to develop reliable AI systems for the world's most important decisions. Our products provide the high-quality data and full-stack technologies that power the world's leading models, and help enterprises and governments build, deploy, and oversee AI applications that deliver real impact. Scale Frontier Data is the organization behind the training and evaluation data that frontier labs depend on. We build the systems, tooling, and expert workflows that turn hard human expertise into signals that models can learn from, across reasoning, coding, agentic tool use, and domain expertise. Reinforcement learning environments are now the center of gravity for that work: the difference between a model that demos well and a model that reliably completes long-horizon work is almost always the quality of the environments and reward signals it was trained against. Responsibilities As a Staff Software Engineer, RL Environments, you'll own the technical foundation for how Scale builds, runs, verifies, and delivers RL environments at scale. An RL environment is a real piece of software: a containerized world with real dependencies, real state, real tools, and a grader that has to be correct even when the agent is creative about breaking it. Building one is a full-stack engineering problem. Building thousands of them reproducibly, cheaply, with trustworthy reward signals and throughput measured in millions of rollouts is a systems problem that very few people have solved. You'll work on both. You'll design the platform: sandboxed execution, environment packaging and versioning, rollout orchestration, trajectory capture, verifier frameworks, and the authoring surfaces that let engineers and domain experts produce environments without reinventing infrastructure each time. And you'll go deep on the environments themselves by instrumenting real applications, designing task suites that expose specific capability gaps, and building graders that

At Scale, our mission is to develop reliable AI systems for the world's most important decisions. For 10 years, Scale has provided the high-quality data and full-stack technologies that power the world's leading models, and has helped enterprises and governments build, deploy, and oversee AI applications that deliver real impact. We work closely with industry leaders like Meta, Ernst & Young, Mayo Clinic, Time Inc., the Government of Qatar, and U.S. government agencies including the Army and Air Force. Scale's internship is not a side project. Interns own real, shipped work on the same roadmaps as full-time engineers, with mentorship from world-class talent and a culture that values ownership, speed, and truth-seeking. Many of our interns return as full-time Scaliens. Example Projects Build reinforcement learning and post-training data pipelines that power frontier model development Develop evaluation infrastructure that measures model reliability for enterprise and public sector customers Ship agentic AI applications and the tooling that makes them observable, testable, and safe to deploy Ship tools that accelerate the growth of new qualified contributors on Scale's platform Build fraud-detection systems that remove bad actors and keep Scale's contributor base safe and trusted Use models to estimate the quality of tasks and contributors, and guarantee quality on requests at large scale Devise advanced matching algorithms that pair contributors to customers for optimal turnaround and accuracy Create optimized and efficient UI/UX tooling, in combination with ML algorithms, for 100k+ contributors completing billions of complex tasks Develop new AI infrastructure products to visualize, query, and explore Scale data Requirements A graduation date in Fall 2027 or Spring 2028 with a Bachelor's degree (or equivalent) in a relevant field (Computer Science, EECS, Computer Engineering, Statistics) Available for a Summer 2027 internship (May/June start dates) in San Franci

About the Role: Tubi is seeking a highly skilled and experienced QA Automation Engineer to lead quality assurance initiatives for our cutting-edge streaming and AI-driven product features. This pivotal role involves ensuring exceptional end-to-end user experiences, robust streaming playback, and the accuracy and integrity of our AI/ML features across web, mobile, and OTT platforms. We're looking for a candidate with a strong background in streaming QA and deep technical knowledge of media workflows. You'll be instrumental in collaborating with engineering, product, and data science teams to define comprehensive QA strategies that guarantee both functional excellence and data-level quality This is a hybrid role based out of our Toronto office. You must be willing to travel to our Toronto office two days/week. What You'll Do: Design and lead test strategies for streaming workflows, playback systems, and AI-powered features. Test across platforms (web, mobile, and connected TV) to ensure functional parity and playback stability. Validate streaming performance—including ABR logic, encoding pipelines, and DRM integrations—under diverse real-world conditions. Debug with precision using tools like Charles Proxy, Chrome DevTools, ADB, and Xcode. Collaborate with data and ML teams to validate AI model updates, recommendations, and personalization accuracy. Leverage AI-assisted QA tools to enhance regression coverage, UI validation, and anomaly detection. Contribute to automation and CI/CD frameworks, driving faster, more reliable releases. Oversee QA deliverables for multiple concurrent releases and ensure seamless sign-off for production launches. Monitor live environments for playback or recommendation anomalies post-release and escalate issues promptly. Continuously improve QA processes, metrics, and reporting for streaming and AI validation. Your Background: Bachelor’s degree in Computer Science, Software Engineering, or related field, or equivalent hands-on experi

About the Role: Tubi is seeking a highly skilled and experienced Senior QA Automation Engineer to lead quality assurance initiatives for our cutting-edge streaming and AI-driven product features. This pivotal role involves ensuring exceptional end-to-end user experiences, robust streaming playback, and the accuracy and integrity of our AI/ML features across web, mobile, and OTT platforms. We're looking for a candidate with a strong background in streaming QA and deep technical knowledge of media workflows. You'll be instrumental in collaborating with engineering, product, and data science teams to define comprehensive QA strategies that guarantee both functional excellence and data-level quality. This is a hybrid role based out of our Toronto office. You must be willing to travel to our Toronto office three days/week. What You'll Do: Design and lead test strategies for streaming workflows, playback systems, and AI-powered features. Test across platforms (web, mobile, and connected TV) to ensure functional parity and playback stability. Validate streaming performance—including ABR logic, encoding pipelines, and DRM integrations—under diverse real-world conditions. Debug with precision using tools like Charles Proxy, Chrome DevTools, ADB, and Xcode. Collaborate with data and ML teams to validate AI model updates, recommendations, and personalization accuracy. Leverage AI-assisted QA tools to enhance regression coverage, UI validation, and anomaly detection. Contribute to automation and CI/CD frameworks, driving faster, more reliable releases. Help drive a shift-left testing approach by engaging early in the software development lifecycle, partnering with product managers, engineers, and data scientists to identify quality risks, define test strategies, and ensure testability during requirements and design phases. Oversee QA deliverables for multiple concurrent releases and ensure seamless sign-off for production launches. Monitor live environments for playback or reco

Here at Appian, our values of Intensity and Excellence define who we are. We set high standards and live up to them, ensuring that everything we do is done with care and quality. We approach every challenge with ambition and commitment, holding ourselves and each other accountable to achieve the best results. When you join Appian, you’ll be part of a passionate team dedicated to accomplishing hard things, together. About the Team Appian Customer Success is obsessed with delivering exceptional customer outcomes and high-velocity business impact. Our Public Sector team acts as a trusted strategic partner to government agencies and organizations, bringing their most vital ideas to life. By joining this high-performing team, you will strengthen and evolve your technical consulting skills while accelerating the adoption of our AI-Powered Process Automation platform across critical public infrastructure. As a Senior Consultant, you will step into a pivotal leadership role at the intersection of public sector strategy and modern technical innovation. This is your opportunity to move beyond isolated coding tasks and own the end-to-end delivery of highly visible, complex enterprise systems. You will lead small engineering teams, architect robust integrations, and serve as a trusted technical advisor to client stakeholders - enabling enterprise organizations to achieve true Enterprise-Grade Orchestration . What You’ll Do Lead Project Delivery: Oversee and drive the entire project lifecycle to define, design, and implement custom automation solutions using the Appian platform. Mentor & Develop Talent: Actively lead, coach, and mentor junior consultants through fast-paced software implementations, fostering a culture of technical excellence. Architect Integrations: Build seamless data pipelines and robust APIs to integrate multiple external enterprise systems using REST, SOAP, and JDBC connections. Drive Data Modeling: Design and launch sophisticated relational data

Reddit is a community of communities. It’s built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 130 million daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit www.redditinc.com . Reddit’s Ads Data Science team is looking for a Senior Staff Data Scientist to lead the scientific strategy behind Reddit’s ads measurement and signal systems. This role sits at the center of how Reddit proves advertiser value, improves signal quality, builds privacy-aware measurement systems, and connects ads exposure to real advertiser outcomes. As a Senior Staff Data Scientist for Ads Measurement, you will be the principal architect of our technical vision and the driving force behind the next generation of our measurement ecosystem. In a landscape rapidly shifting due to privacy regulations, browser changes, and evolving platform dynamics, you will spearhead innovation across experimental design (incrementality/lift), identity, signals, and privacy-safe 1P/3P measurement. This is a high-visibility, high-impact role requiring a rare blend of deep experimentation & causal inference expertise, strategic foresight, and the ability to influence cross-functional executives and industry standards. You will not just adapt to the changing ad-tech environment, you will redefine how we measure value. Responsibilities Technical Vision & Strategy: Define the long-term data science vision & strategy across ads measurement, signal quality, identity, attribution, and privacy. Establish how Reddit should evaluate advertiser value, measurement quality, and signal utility across first-party and third-party products. Set the Cross-Pillar Measurement Science Strategy: Define the long-term data science strategy across a

About the Team DoorDash’s GenAI Platform team sits within Machine Learning Platform and builds the shared infrastructure that helps DoorDash, Wolt, and Deliveroo teams safely bring GenAI-powered products, agents, automation, and personalization to production. Our mission is to increase the velocity of business impact from GenAI. A central pillar of that work is our evaluation platform — the unified evals backbone that lets teams measure, trace, and trust the quality of LLM and agent systems across the company, powering trace/score ingestion, LLM-as-judge workflows, agent simulations, and LLM observability for the tens of millions of daily requests flowing through our LLM Gateway. We also own core platform surfaces including the Agent Gateway, open-weights model serving and batch inference, guardrails, and cost attribution. About the Role You will join a small, high-leverage team building production infrastructure for Generative AI at DoorDash, with a primary focus on our evals and LLM observability platform: the systems that let teams evaluate, trace, and continuously improve the quality of LLM and agent products. You’ll work across evaluation frameworks and SDKs, OpenTelemetry-based trace/score ingestion, LLM-as-judge and offline/online eval pipelines, agent simulations, data pipelines, backend services, and observability. This role is ideal for an engineer who enjoys building reliable measurement and quality primitives in a fast-moving technical area where product needs, model capabilities, vendor ecosystems, and evaluation methodologies are evolving quickly. You’re excited about this opportunity because you will… Build the infrastructure that helps DoorDash teams move GenAI ideas from prototype to production, increasing the velocity of business impact from AI across the company. Work on our unified evals platform — evaluation SDKs, OpenTelemetry trace/score ingestion, LLM-as-judge, offline and online eval pipelines, and agent simulations — alongside the LLM Gatew

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. The Driver team is dedicated to fostering a platform of high-quality service by empowering drivers to perform their best. We are looking for a product-minded engineer who wants to build and improve products that sit at the center of the core driver experience. Products you drive will solve pain points that matter most to drivers by streamlining key interactions, reducing friction, and creating systems that feel intuitive, fair, and supportive. As an engineer at Lyft, you'll collaborate with teams like product, data science, analytics, and operations on code that empower us to iterate quickly, while focusing on delighting our passengers and drivers. Responsibilities: Design and implement backend features end-to-end with clear ownership, delivering well-scoped work from technical design through to production with moderate guidance from senior engineers Write clean, reliable, well-tested code that meets team standards and holds up in code review Participate actively in code reviews, giving specific and constructive feedback while continuing to develop your own review instincts Debug and resolve issues across backend services including performance bottlenecks, reliability problems, and data integrity issues Collaborate with product managers, designers, and partner engineering teams to clarify requirements and surface technical constraints early Contribute to technical discussions and help evaluate implementation approaches for new features Write unit and integration tests for your own code and develop familiarity with the team's broader testing and observability practices Address technical debt and make incremental improvements to existing services as part of regular development work Participate in on-call rotations, respond to production incidents, and support teammates in mitigating custome

Scale GP (Scale Generative AI Platform) is an enterprise-grade Generative AI platform providing APIs for knowledge retrieval, inference, evaluation, and more. We are seeking a strong Senior Full-Stack Engineer to help us build, scale, and refine our rapidly growing product. The ideal candidate is deeply grounded in software engineering best practices and experienced in developing and scaling modern web applications end-to-end. You will work across the stack—from React/TypeScript frontends to Python-based backends—while integrating with LLMs and machine learning systems. You will solve complex challenges in scalability, reliability, and product experience while owning significant product areas in a fast-paced environment. What You’ll Do Own major full-stack product areas , driving features from design through production deployment. Build modern frontend experiences using React and TypeScript, ensuring performance, usability, and responsiveness. Develop reliable backend services in Python, working with distributed systems, data pipelines, and ML/LLM components. Integrate with LLMs, vector databases, and AI infrastructure to power intelligent product experiences. Deliver experiments and new features quickly , maintaining high quality and tight feedback loops with customers. Collaborate across product, ML, and infrastructure teams to shape the direction of Scale GP. Adapt quickly —learning new technologies, frameworks, and tools as needed across the stack. Ideal Experience 5+ years of full-time engineering experience , post-graduation. Strong experience developing full-stack applications using React, TypeScript, and Python . Experience scaling or shipping products at high-growth startups . Familiarity with LLMs, vector databases, embeddings, or other modern AI tooling (tinkering or production experience welcome). Proficiency with SQL and modern API development. Experience with Kubernetes , containerization, and microservice architectures. Experience working with at leas

About the Team Our team exists to empower DoorDash Mobile engineers. We are the champions of three core pillars: Quality, Velocity, and Efficiency. Ultimately, our goal is to build the supportive infrastructure that allows our fellow engineers to build, ship, and operate apps at massive scale—with confidence and ease. We believe that a great developer experience leads to a great customer experience. About the Role We are looking for an Engineering Manager to lead our Mobile Developer Experience team (also known internally as the Mobile Foundations team). In this role, you’ll not only set the technical vision but also nurture the culture required to build world-class mobile applications. Your team will concentrate on one vertical—ZeroKit, which enables rapid mobile prototyping via agents—and two horizontal infrastructure pillars: the iOS and Android monorepos. You will partner with senior engineers and stakeholders across the company to design systems that make our platform faster, more reliable, and more efficient. You will be a partner to your customers—your fellow engineers—working side-by-side to understand their hurdles and solve their immediate challenges. You’ll also look to the future, anticipating needs so we can deliver solutions before they become blockers. Crucially, this role will support our growing international engineering footprint and unified technology stack, meaning you and your team will work across our DoorDash, Wolt, and Deliveroo brands. This is a unique opportunity to lead a team through a mix of exciting greenfield initiatives and the refinement of established, successful tools. You must be located in the following locations for this opportunity: San Francisco, CA; Sunnyvale, CA; Seattle, WA; Los Angeles, CA; New York, New York. You’re excited about this opportunity because you will… Develop and maintain foundational components to enable DoorDash Engineers to excel at mobile engineering. Lead the development and strategy for ZeroKit to enabl

About Ramp Ramp is building the smart infrastructure for finance teams, embedded in the transaction flow of every dollar a business spends. We automate how over $200B in annualized spend flows in and out of 70,000+ companies: authorizing payments, flagging risk, categorizing spend, and closing books. The problems are high-stakes, data-dense, and unforgiving. We hire people with high agency and high urgency. We look for slope over intercept. We care less about where you trained and more about what you’ve built. At Ramp, everyone is a builder who owns problems end to end and makes consequential decisions that shape the outcome. The median Ramp customer saves 5% and grows revenue 16% in their first year – far in excess of businesses operating without Ramp. We believe every ambitious company deserves the same. If you want to build systems that directly shape how companies move and manage billions, Ramp is the place to do it. About the role As a Business Development Representative in our Toronto office, you will be focused on building Ramp’s presence in the Canadian market. In this high-velocity, high-impact outbound role, you will create qualified opportunities for Ramp’s Account Executives and bring in high-quality pipeline. Our sales organization is looking for someone who is hungry, highly coachable, self-motivated and has a natural inclination for selling – a builder who can perform in ambiguity. As part of our early-stage team, you’ll act as the initial point of contact in prospecting and qualifying leads. If you’re eager to make an impact, embrace challenges and are passionate about playing a key role in defining Ramp’s presence in Canada and accelerating growth in this new market, this role is for you. What you’ll do Source new business across Canada through outbound prospecting and outreach Identify the right finance, operations, and executive stakeholders within target accounts. Execute thoughtful, personalized multi-channel outbound campaigns Run confident col

Sr. Content Marketing Manager Location: San Francisco, CA · In-office 4 days/week Team: Strategic Marketing Reports to: Sr. Director, Strategic Marketing About the role Sigma produces a lot of content — blog, video, product launches, thought leadership — and this role is the editorial backbone that makes all of it sharper, faster, and on brand. You'll run the Sigma blog end-to-end, raise the quality bar on everything that ships, and build the systems and internal bench that let us scale content without losing voice or accuracy. This is a senior, hands-on editorial role for someone who edits with both technical judgment and taste. You'll work shoulder-to-shoulder with PMs and engineers to keep content accurate, coach employees and contractors to produce great work, and bring new thinking to how Sigma earns awareness. You'll join an established content team and won't have to do it all yourself — a Content Producer partners with you on publication and operations. This role reports to the Sr. Director of Strategic Marketing, with room to grow into people management as Sigma's content team scales. What you'll own Editorial standards and editing Edit a high volume of blog posts, balancing technical nuance with taste. You're comfortable editing in the data, analytics, apps, or AI space — you don't need to know everything, but you know what you don't know, flag it, and lean on PMs and engineers to keep content accurate and clear. Keep Sigma's content on brand across every channel and format. Reinforce the standards that contribute to great content: Clear positioning, high-quality imagery, and connected messages across multiple content pieces. Blog and AEO operations Run the Sigma blog end to end: calendar, editorial standards, and publication. Manage the AEO content calendar and the relationship with Sigma's AEO contractor, ensuring 5 AEO blogs are edited, SME-reviewed, and published each week. The team's Content Producer supports publication, with you s

Senior Software Engineer - Observability and Reliability About the Role We are growing the engineering team and looking for engineers who have the chops to build and deliver world-class technology. You will be part of a talented team of engineers with a shared mission to make data easily accessible. What You Will Be Doing Build observability tools and platforms, including: metrics, logging, distributed tracing, dashboarding, alerting, application performance management Build with modern tools and languages like Go, Open Telemetry and Kubernetes Participate in on-call rotation and ensure uptime of services Create runtime tools/processes that optimize cloud triaging and limit downtime Define best practices around making our systems and services measurable Collaborate with peers and stakeholders through design and code reviews to ensure best practices amongst available technologies. We expect successful candidates to be coding a majority of their time Qualifications We Need Strong Computer Science fundamentals 5+ years industry experience building and maintaining high-quality software, especially software other engineers use You apply a product mindset to infrastructure systems and feel accomplished enabling others Desire to be a great teammate and have fun at work Strong sense of craftsmanship, and a healthy academic curiosity Qualifications We Want (also, skills you’ll learn!) Experience building systems for data analytics Distributed systems monitoring and profiling skills Knowledge of cloud application security models Administered cloud service infrastructure (GCP, AWS, Azure) Startup experience Additional Job details Additional Job details The base salary range for this position is $170k - $240k annually. Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience. Base pay is one part of the Total Package that is provided to compensate and recognize e

Airtable is the no-code app platform that empowers people closest to the work to accelerate their most critical business processes. More than 500,000 organizations, including 80% of the Fortune 100, rely on Airtable to transform how work gets done. Airtable’s infrastructure is evolving to meet the needs of our fast growing engineering org. We are looking for infrastructure engineers to join our team to help improve critical product infrastructure, with a focus on building systems that have a great developer experience and will scale as we grow. We currently have openings on: Asynchronous Serving: The Asynchronous Serving team is scaling critical systems used by Airtable’s most essential and up-and-coming product features, especially AI features. Upcoming projects include refactoring our background task queue to track its tasks in DynamoDB, adding quality of service to the job queue, and revamping a streaming service to handle 10x scale while being more resilient. Compute: The compute pod builds and manages our Kubernetes-based platform that supports every service at Airtable, including all new AI services such as vector databases, AI evals store, and document extraction and understanding services. We have a lot of exciting foundational work in our roadmap, such as Overhauling our network stack and service discovery, to simplify service setup and strengthen security Region level disaster recovery, and bringing up compute platform from 0->1 in a new region Building custom Kubernetes operators for reliably managing some of our most critical workloads Developer Platform : The Developer Platform team sits at the intersection of all engineering at Airtable, focusing on building the internal tooling, frameworks, and CI/CD systems that power our product teams. We strive to streamline developer workflows - from build and test cycles to production deployments—and foster a best-in-class developer experience. Join us if you’re passionate about creating high-lever

Scale GP (Scale Generative AI Platform) is an enterprise-grade Generative AI platform that provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong engineer to join our team and help us build and scale our product in a fast-paced environment. The ideal candidate will have a strong understanding of software engineering principles and practices, as well as experience with large-scale distributed systems. You will be responsible for owning large new areas within our product, working across backend, frontend, and interacting with LLMs and ML models. You will solve hard engineering problems in scalability and reliability. You will: Own large new areas within our product Work across backend, frontend, and interacting with LLMs and ML models Deliver experiments at a high velocity and level of quality to engage our customers Work across the entire product lifecycle from conceptualization through production Be able, and willing, to multi-task and learn new technologies quickly Ideally you'd have: 7+ years of full-time engineering experience, post-graduation Experience scaling products at hyper growth startups Experience tinkering with or productizing LLMs, vector databases, and the other latest AI technologies Proficient in Python or Javascript/Typescript, and SQL Experience with Kubernetes Experience with major cloud providers (AWS, Azure, GCP) Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position and may be inclusive of several career levels at Scale; it will be determined during the interview process based on work location and additional factors, including job-related skills, experience, qualifications, interview performance, and relevant education or training. Scale employees in eligible roles are also granted equity based compensation, subject to Board of Director approval