About the Role: Tubi is one of the largest free streaming platforms in the US, serving a large-scale streaming audience across Web, iOS, Android, Roku, Fire TV, Apple TV, and game consoles. Quality at this scale isn't a checkbox — it's a competitive advantage. We're looking for an Automation Engineering Manager to lead the team responsible for building and operating Tubi's multi-platform test automation infrastructure. You will own the strategy, tooling, and execution quality across our client surfaces — from video playback and ad delivery to content discovery and onboarding. This role is for a hands-on technical leader who can set direction, influence cross-functional roadmaps, and stay close enough to the code to guide architecture, review critical implementation decisions, and unblock complex technical issues. You will build a team that ships reliable automation at speed — and you will help the team move toward AI-native automation practices: fluent in AI tooling, proactive about applying it, and disciplined about using it responsibly. This is a hybrid role based out of either our San Francisco or Toronto office. You must be willing to travel to either location at least 2 days a week. What You'll Do: Test Strategy & Quality Planning Define and own Tubi's multi-platform automation strategy — covering Web, iOS, Android, CTV (Roku, Fire TV, Apple TV, Smart TVs, game consoles), and API layers. Establish testing standards, coverage targets, and quality gate policies across the CI/CD pipeline to protect release confidence and production reliability. Design specialized test strategies for business-critical scenarios: video playback (HLS/DASH), ad insertion, content recommendation surfaces, and user authentication flows. Use AI-assisted analysis (e.g., failure pattern clustering, test gap detection) to continuously improve test strategy based on real production signal and defect trends — not gut instinct. Automation Framework & Infrastructure Lead the
Jobs in Canada
Lead Design And Analysis Engineer in Toronto
132 active opportunities · Updated October 2026
Showing
15 jobs
Explore current lead design and analysis engineer jobs in Toronto. Filter by work mode, employment type, experience, department, date posted and distance.
From C$96K/yr
At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. The vision of the Safety & Customer Care (SCC) team is to foster long-term loyalty to Lyft with every support interaction. If we are successful, a Lyft customer will rarely interact with Lyft Support. But when that interaction occurs, their issue is resolved quickly, effectively, and with true care. For a Lyft customer, their experience of Support should be that “Lyft cares about me and made the experience easy.” As a Data Analytics Lead, you’ll partner directly with cross-functional stakeholders to identify opportunities and design solutions for improving our customers’ support experience. You’ll leverage your analytical expertise to deliver actionable insights and recommendations to drive quality business decisions with customer-facing impact. The ideal candidate is a critical thinker and exceptional problem solver who can build strong relationships with different teams, and who is eager to serve as a leader within the broader Support organization to drive our business forward. Responsibilities Partner with Product, Engineering, Data Science & Analytics, Business Operations and other cross-functional stakeholders to achieve business goals Develop frameworks and scalable processes to drive decision-making and prioritization Define the metrics used to measure the success of strategic initiatives and health of our support platform; build dashboards to track metrics over time Design A/B tests and execute analyses to evaluate the impact of new product features and operational improvements Work closely with cross-functional partners to deliver data-driven insights and actionable recommendations for continuously improving the customer support experience Monitor and diagnose KPI performance and present findings to senior leadership Experience Degree in a quantitative field like statisti
From $96.4K/yr
Level Up Your Career with Zynga! At Zynga, we bring people together through the power of play. As a global leader in interactive entertainment and a proud label of Take-Two Interactive, our games have been downloaded over 6 billion times—connecting players in 175+ countries through fun, strategy, and a little friendly competition. From thrilling casino spins to epic strategy battles, mind-bending puzzles, and social word challenges, our diverse game portfolio has something for everyone. Fan-favorites and latest hits include FarmVille™, Words With Friends™, Zynga Poker™, Game of Thrones Slots Casino™, Wizard of Oz Slots™, Hit it Rich! Slots™, Wonka Slots™, Top Eleven™, Toon Blast™, Empires & Puzzles™, Merge Dragons!™, CSR Racing™, Harry Potter: Puzzles & Spells™, Match Factory™, and Color Block Jam™—plus many more! Founded in 2007 and headquartered in California, our teams span North America, Europe, and Asia, working together to craft unforgettable gaming experiences. Whether you're spinning, strategizing, matching, or competing, Zynga is where fun meets innovation—and where you can take your career to the next level. Join us and be part of the play! Position Overview We are seeking a Senior Product Manager with experience in Ad monetization or Ad Technology systems to shape, execute & distribute our Ad Technology SDK across 50+ Games at Zynga! This role specializes in key aspects of our product lifecycle, building customized ad formats for our games and delivering experiments, readouts and optimizations. This role requires a blend of product management and ad monetization experience. Ideal candidates should have experience working on monetization/payments systems and should be deeply familiar with how games balance engagement with IAA/IAP monetization. What You'll Do Lead experiments for our Advertising platform from experiment design through analysis and rollout -> fine-tuning supply and demand side features that impact how our players see ads
C$162K – C$420K/yr
About Sentry Software runs the world and the pace is faster than ever. Sentry helps developers fix errors and performance issues before users notice, so teams can spend less time firefighting and more time building. Trusted by 200,000+ organizations, Sentry is today’s application monitoring standard and our team is building its AI-native future. About the role The Events Analytics Platform (EAP) team is responsible for the infrastructure that powers all of Sentry's time-series data and searching capabilities across billions of events with sub-second latency. We started this initiative by building Snuba, the primary storage and query service for Sentry's event data powered by ClickHouse, and we are now focused on unlocking deeper visibility and reporting across the terabytes of event data our users generate. As a Senior Software Engineer, you will lead efforts to push the boundaries of data visibility at Sentry. You will do this by expanding the capabilities of our search infrastructure, building new capabilities on top of our state-of-the-art storage layer and increasing the performance and integrity of Sentry’s core data services. You will also help shape Infrastructure's technical direction at Sentry and collaborate with Product and other Engineering teams to turn that vision into a reality. If you want to solve the hard problems that come with scaling event data into the petabyte range, this could be the job for you. In this role you will: Expand EAP's ability to deliver data at world-class speed and reliability. Architect and automate services and systems to scale reliably under growing demand. Make architectural trade-offs that balance product requirements with engineering constraints. Maintain and grow the team's code quality initiatives by regularly reviewing code and contributing to design decisions. Lead design and discussions around deliverables the team is working towards. Improve the maintainability and developer experience of the codebases EAP owns. Exa
$129K – $161.3K/yr
At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. We are hiring a Marketing Technology Lead to own Lyft's B2B marketing technology stack, spanning marketing automation, content and web, lead routing, data enrichment, and attribution. As the senior technical owner of that stack, you will lead solution design, own the architecture and data model that carry a lead from first touch through to a qualified opportunity, and partner with Marketing Operations, Sales Operations, Sales Technology, Privacy, Legal, and Data to translate business needs into durable, scalable systems. This is a hands-on leadership role for someone who knows B2B marketing operations, can build the systems that run them, and is looking for ways to bring AI into how the stack works, not just what it produces. Responsibilities: Serve as the senior technical owner of the B2B marketing technology stack, from solution design through delivery, adoption, and ongoing support. Lead requirements gathering with Marketing Operations, Sales Operations, Sales Technology, and Data partners, and translate them into functional and technical designs. Remain hands-on, configuring and extending the marketing automation platform (HubSpot) across workflows, forms, lead scoring, and custom objects, and building the integrations that connect the stack. Own the marketing technology roadmap and architecture, including the lead and account data model, enrichment and routing logic, and integrations with the CRM, data platform, web, and advertising systems. Own the tracking and instrumentation layer, including tag management, site and campaign tracking, and the data capture behind attribution. Own the lead lifecycle systems, partnering with Sales Operations and Sales Technology on lead identity, deduplication, scoring, routing, MQL and SQL definitions, and funnel stage integrity. Identify where AI can im
From C$172K/yr
At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Lyft is looking for a Design Systems Manager to join Design Foundations, the infrastructure layer of Lyft's design organization. Design Systems at Lyft is an integral part of the overall user experience. Our design system spans product surfaces, marketing, and brand, officially known as the Lyft Product Language (LPL) and shipped directly to code. You'll own the craft and execution of that system, partner closely with design, engineering, and marketing, and lead Design systems work through a period of active global growth and capability expansion. This role reports to the Director of Design Foundations and works alongside a dedicated DPM and Engineering managers, and a tight-knit team of design systems practitioners. Responsibilities: Strategy & Vision Set the strategy and roadmap for Lyft Product Language (LPL) across product, marketing, and brand surfaces, in partnership with the Director of Design Foundations and engineering leadership and the Design Systems team Lead the AI transformation of the system: integrate AI into LPL tooling, adoption workflows, and the day-to-day designer experience at Lyft Represent Design Systems in reviews and other senior leadership forums People & Craft Manage and develop a team of design systems designers and illustrators working across iOS, Android, web, and brand Hold the quality bar for system-wide design: cross-platform coherence, accessibility (WCAG), road safety, localization, and brand consistency. Coach the team on making educated tradeoffs between flexibility, coherency, usability, and efficiency Execution & Partnership Partner closely with the Design Systems DPM and engineering managers to maintain system health, sequence work, and unblock teams Own the LPL component contribution and review process end-to-end, from intake through release Commu
From C$129K/yr
At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. We are hiring a Business Systems Lead to own the sales technology behind Lyft Ads. As the senior technical owner of the Lyft Ads CRM and commercial systems, you will lead solution design across Salesforce and the connected ad-sales stack and own the architecture for how ad deals move from opportunity through order management and billing. You will work alongside a team of Salesforce engineers and partner closely with Ads Sales, Sales Operations, Ad Operations, Finance, Legal, and the Media engineering teams. This is a hands-on leadership role for someone who knows ad-sales operations and can build the systems that run them. Responsibilities: Own the Salesforce architecture for the ad-sales lifecycle, from lead sourcing and opportunity creation through Order Management System (OMS) integration, contract execution, delivery reconciliation, and billing. Identify problems and opportunities across the Ads sales technology stack and shape them into scoped, funded initiatives. Lead requirements with Ads Sales, Sales Operations, Ad Operations, Finance, and Legal partners, and translate them into functional and technical designs. Own the integrations that connect Salesforce to the ad-sales ecosystem, including order management and contract systems, the ad server, and billing, through middleware such as Workato or Boomi. Drive AI best practices across the Sales Technology team, modeling effective usage and ensuring all AI-generated output meets Lyft's standards for quality, security, and performance. Guide the evolution of the Ads CRM platform, including the media-specific data model (agency, advertiser, and brand hierarchies, insertion orders, and flights) and own the Ad Sales Technology roadmap . Lead contract lifecycle management for Ads, including intake automation and Salesforce integration. Remain h
About the Role: The Machine Learning team at Tubi drives the innovation behind personalized user experiences. With the largest inventory in the industry and hundreds of millions of viewers, we tackle problems in the space of recommendations, search, content understanding and ads optimization that shape the future of streaming. We are seeking a highly skilled Staff Machine Learning Engineer to contribute to transformative projects in video personalization. In this role, you will design and implement advanced algorithms and systems to improve our personalization strategy. As a senior technical expert, you will tackle complex problems in machine learning at scale, collaborating closely with cross-functional teams to develop and optimize machine learning-driven solutions. This is a hybrid role in our Toronto office. What You'll Do: Lead the design, development, and implementation of advanced recommendation systems and algorithms for a global audience Conduct deep dives into algorithmic components and systems, ensuring that models are optimized for both performance and scalability across multiple regions and product areas Build and deploy high-impact robust ML pipelines, including data extraction, feature development, model training, testing, and deployment Continuously monitor, evaluate, and optimize the performance of deployed models, ensuring they meet business goals and provide high-quality user experiences. Work closely with Product, Engineering, and Data Science teams to align on product requirements, set expectations, and deliver machine learning-driven solutions that improve user engagement Your Background: 8+ years of industry experience building production Machine Learning systems MSc or Ph.D. in Computer Science, Machine Learning, Statistics, Mathematics, or a related field Experience with deep learning technologies for recommendation systems, including TensorFlow, PyTorch, or similar frameworks Proficiency in building and deploying full-stack machine le
C$110K – C$150K/yr
About Forma.ai: Forma.ai is a Series B startup that's revolutionizing how sales compensation is designed, managed and optimized. We handle billions in annual managed commissions for market leaders like Edmentum, Stryker, and Autodesk. Our growth has been fuelled by our passion for fundamentally changing and shaping how companies use sales intelligence to drive business strategy. We’re welcoming equally driven individuals who are excited about creating something big! The Role As a Senior Solutions Engineer, you will play a critical role at the intersection of data, technology, and customer impact. You will lead the design and delivery of scalable, reliable, and high-impact technical implementations for our enterprise clients. Working with diverse and complex datasets across industries, you’ll build and optimize end-to-end analytics solutions that directly influence how customers engage with the Forma platform. You’ll partner cross-functionally to identify opportunities, scope high-value solutions, and deliver outcomes that drive measurable business impact. This is a highly visible, client-facing role that combines hands-on technical expertise with strategic thinking. What You’ll Do Lead strategic technical engagements with enterprise clients, guiding solution design for complex business challenges using the Forma platform Design, build, and optimize scalable data architectures, pipelines, and workflows (e.g., PySpark, Databricks) Translate business requirements into robust, production-ready data solutions Design and deliver custom code and customer-specific integrations to extend the Forma platform for unique client requirements Partner with Professional Services to extract, transform, and analyze client data to optimize incentive compensation and sales performance strategies Collaborate with Product, Engineering, and Customer Success to deliver high-quality, actionable datasets and insights Drive improvements in data infrastructure, perfor
From C$908.4K/yr
About the Role: Tubi is seeking a highly skilled and experienced QA Automation Engineer to lead quality assurance initiatives for our cutting-edge streaming and AI-driven product features. This pivotal role involves ensuring exceptional end-to-end user experiences, robust streaming playback, and the accuracy and integrity of our AI/ML features across web, mobile, and OTT platforms. We're looking for a candidate with a strong background in streaming QA and deep technical knowledge of media workflows. You'll be instrumental in collaborating with engineering, product, and data science teams to define comprehensive QA strategies that guarantee both functional excellence and data-level quality This is a hybrid role based out of our Toronto office. You must be willing to travel to our Toronto office two days/week. What You'll Do: Design and lead test strategies for streaming workflows, playback systems, and AI-powered features. Test across platforms (web, mobile, and connected TV) to ensure functional parity and playback stability. Validate streaming performance—including ABR logic, encoding pipelines, and DRM integrations—under diverse real-world conditions. Debug with precision using tools like Charles Proxy, Chrome DevTools, ADB, and Xcode. Collaborate with data and ML teams to validate AI model updates, recommendations, and personalization accuracy. Leverage AI-assisted QA tools to enhance regression coverage, UI validation, and anomaly detection. Contribute to automation and CI/CD frameworks, driving faster, more reliable releases. Oversee QA deliverables for multiple concurrent releases and ensure seamless sign-off for production launches. Monitor live environments for playback or recommendation anomalies post-release and escalate issues promptly. Continuously improve QA processes, metrics, and reporting for streaming and AI validation. Your Background: Bachelor’s degree in Computer Science, Software Engineering, or related field, or equivalent hands-on experi
From C$1.2M/yr
About the Role: Tubi is seeking a highly skilled and experienced Senior QA Automation Engineer to lead quality assurance initiatives for our cutting-edge streaming and AI-driven product features. This pivotal role involves ensuring exceptional end-to-end user experiences, robust streaming playback, and the accuracy and integrity of our AI/ML features across web, mobile, and OTT platforms. We're looking for a candidate with a strong background in streaming QA and deep technical knowledge of media workflows. You'll be instrumental in collaborating with engineering, product, and data science teams to define comprehensive QA strategies that guarantee both functional excellence and data-level quality. This is a hybrid role based out of our Toronto office. You must be willing to travel to our Toronto office three days/week. What You'll Do: Design and lead test strategies for streaming workflows, playback systems, and AI-powered features. Test across platforms (web, mobile, and connected TV) to ensure functional parity and playback stability. Validate streaming performance—including ABR logic, encoding pipelines, and DRM integrations—under diverse real-world conditions. Debug with precision using tools like Charles Proxy, Chrome DevTools, ADB, and Xcode. Collaborate with data and ML teams to validate AI model updates, recommendations, and personalization accuracy. Leverage AI-assisted QA tools to enhance regression coverage, UI validation, and anomaly detection. Contribute to automation and CI/CD frameworks, driving faster, more reliable releases. Help drive a shift-left testing approach by engaging early in the software development lifecycle, partnering with product managers, engineers, and data scientists to identify quality risks, define test strategies, and ensure testability during requirements and design phases. Oversee QA deliverables for multiple concurrent releases and ensure seamless sign-off for production launches. Monitor live environments for playback or reco
From C$136K/yr
At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Our team is dedicated to creating a seamless and secure experience for our riders and drivers, ensuring their identity and data are protected at all times. As a Senior Product Designer, you'll lead the design of solutions that help drivers understand their earnings and get paid securely while protecting our communities from fraud. You will work closely with cross-functional teams, including product managers, designers, engineers, and data scientists, to create intuitive and effective designs on driver payments and complex security challenges. You’ll advocate for a customer-centric approach and thrive in a dynamic, fast-paced environment. From initial ideation through to launch, you'll support projects with interaction, visual, and product thinking skills, helping to define and deliver impactful experiences for our Payment, Identity and Integrity teams. The Opportunity Design features that help drivers understand their earnings, access their pay, and resolve payment issues efficiently Lead end-to-end design for driver earnings and identity verification experiences, from research and ideation through execution Play a critical role in designing solutions that protect our users and enhance their trust in our platform Collaborate with cross-functional partners to design intuitive and effective designs that address unique rideshare driver, identity and fraud challenges Responsibilities: Problem solve, think big, and explore divergent concepts/ideas while understanding how to converge and build iteratively towards your vision. Influence the shape of the product with research and data while executing design work using high quality wireframes, mockups, user journeys, and cross-platform interactive prototypes. Advocate for design by sharing your work and presenting cross-functionally, while being able to
From C$160K/yr
Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. The Streaming Foundations team builds services and operates data pipeline infrastructure to support event streaming, messaging, and analytics use cases. We are looking for a Software Engineer who is passionate about distributed systems, platform engineering, and solving data-intensive problems at scale. In this high-impact role, you will get to work with engineers throughout the organization to build foundational infrastructure that allows Auth0 to scale for years to come. What you’ll be doing Help set the technical direction for the team and influence the engineering roadmap for the Platform’s streaming capabilities Design and lead the implementation of our most complex and critical systems for data-intensive use cases. Research and champion new technologies and architectural patterns to solve strategic challenges and scale the platform. Lead and influence cross-functional initiatives, ensuring technical alignment and successful execution across multiple teams. Improve the operational posture of our systems by designing for observability, reliability, and scalability, and by mentoring others in operational best practices. Coach and mentor senior engineers and act as a technical leader across the engineering organization. Collaborate with different stakeholders like product teams whenever needed. What you’ll bring to our teams 7+ years of software development experience in a fast-paced, agile environment Experience working with Golang or Java is preferred H
From C$118K/yr
Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. The role At Okta, we believe AI will fundamentally transform how design, research, and product development happen. We are looking for a Senior Design Operations Program Manager, Agentic Design to lead the operationalization and enablement of internal AI agents, plug-ins, and automated workflows across our Design team — reimaging how designers create in the AI era through internal AI agents. In this role, you will bridge the gap between AI tooling capabilities and practical design ops execution. You will partner closely with design, product management and design systems to govern, evaluate, deploy, and scale AI-driven design capabilities — making our 60+ person design org dramatically faster, more consistent, and highly innovative. This is a tactical, execution-focused builder role for an operations leader who is deeply curious about AI tools, understands modern UX workflows, and excels at change management, team enablement, and operationalizing new frameworks. What you'll do AI & Agentic Design Enablement Serve as the operational connective tissue driving AI adoption, evaluation, and workflow integration across Product Design, UX Research, and Content Design. Manage the intake, evaluation, and approval process for design plug-ins, Model Context Protocol (MCP) integrations, and generative AI tools (e.g., custom content design assistants, design-to-code agents). Partner with internal engineering teams to operationalize, ship, and drive adopt
About the Role: As a Staff Software Engineer on the ML Infrastructure team, you will collaborate closely with the Machine Learning and Product teams to build world-class machine learning inference platforms. These platforms power essential services like personalized recommendations, search, and content understanding across Tubi. A core responsibility of this team is developing and maintaining low-latency ML model serving systems that support Deep Learning, LLM, and Search models. This involves building self-service infrastructure and critical components such as the inference engine, feature store, vector store, and experimentation engine. You will improve the way we deploy and operate our services and even contribute to open-source projects. This role grants the architectural freedom to explore new frameworks, lead critical cross-functional projects, and transform the capabilities of our ML and Product teams. Responsibilities: Design and build scalable, high throughput, and low latency distributed systems using Scala Build reusable components and services that serve various ML applications like Personalization, Search, Ads and Exploration Partner closely with ML engineers to understand their challenges and limitations and develop scalable solutions to address them. Proactively recommend solutions to keep our ML Inference stack state of the art. Take a data driven approach to identifying & optimizing latency, cost, and efficiency of our infra. Lead large scale cross functional refactorings if necessary Mentor other engineers on the team on system design, effective incident management, interviewing, leveraging LLMs for work, etc. Collaborate with ML, Product, and cross functional engineering teams to define the long term vision and architecture for ML Infrastructure at Tubi. Your Background: Experience designing and building scalable, distributed systems in any modern backend language (e.g., Scala, Java, Python, Go, C++); experience with Scala or JVM b
Other cities to consider
More places hiring for this role
Get new lead design and analysis engineer jobs in Toronto, Canada by email
Daily job updates · Unsubscribe anytime