Jobs in Canada

Lead Data Engineer in San Francisco

164 active opportunities · Updated October 2026

Explore current lead data engineer jobs in San Francisco. Filter by work mode, employment type, experience, department, date posted and distance.

A
📍 San Francisco, Canada· Full-time
✓ High-confidence listing

From $24K/yr

Quick readStrong listing-quality and freshness signals

Amplitude is the leading AI analytics platform, helping over 4,700 customers—including Atlassian, Burger King, NBCUniversal, and Square—build better products and digital experiences. With powerful AI Agents embedded across our platform, teams can analyze, test, and optimize user experiences faster than ever. Ranked #1 across multiple categories in G2’s Winter 2026 Report, Amplitude is the best-in-class solution for product, data, and marketing teams. Learn more at amplitude.com . As an organization, we deliver for our customers by living our values. We operate from a place of humility, take ownership of problems and successes, approach challenges with a growth mindset, and put our customers at the center of everything we do. Amplitude’s Commitment to Diversity Equity & Inclusion (DEI): Amplitude believes that diversity enables the creation of better products, improves the ability to solve complex problems, and drives more powerful solutions. We strive to create an environment of inclusion—one focused on psychological safety, empathy, and human connection—that will allow employees of all backgrounds to thrive. About the Role & Team We’re looking for an Engineering Manager to lead the Data Infrastructure team within Statsig Experiment at Amplitude. You will lead a multidisciplinary team of software engineers, data engineers, and data scientists responsible for the systems that power experimentation at scale. The team owns three critical areas: Data ingestion: Collecting and importing experiment exposures, custom events, OpenTelemetry data, and real user monitoring data across SDKs, streaming systems, cloud storage, and customer data warehouses. Data computation: Building distributed computation systems that transform raw data into accurate, timely experiment results. Stats engine: Developing and productionizing the statistical methods that help customers make trustworthy decisions from their experiments. This is not a traditional data engineering management ro

GitRestMachine LearningAI
DU
📍 San Francisco, Canada· Full-time
✓ High-confidence listing

From $1.6M/yr

Quick readStrong listing-quality and freshness signals

About the Team Data is at the foundation of DoorDash success. The Data Engineering team builds database solutions for various use cases including reporting, product analytics, marketing optimization and fi nancial reporting. Team serves as the foundation for decision-making at DoorDash. About the Role DoorDash is looking for a Sta ff Software Engineer,Data to be a technical lead and help architect and scale our data reliability, data infrastructure, automation and tools to meet growing business needs. You’re excited about this opportunity because you will... Own critical data systems that support multiple products/teams Develop, implement and enforce best practices for data infrastructure and automation Design, develop and implement large scale, high volume, high performance data models and pipelines for Data Lake and Data Warehouse Improve the reliability and scalability of our Ingestion, data processing, ETLs, Reporting tools and data ecosystem services Manage a portfolio of data products that deliver high-quality, trustworthy data Help onboard and support other engineers as they join the team We’re excited about you because... 8+ years of professional experience as a hands-on engineer and technical leader leading multiple projects 6+ years experience working in data platform and data engineering or a similar role You have proficiency in using AI coding tools (e.g., Claude Code, Codex, Cursor) in the full software development lifecycle, including designing, generating code, testing, monitoring and releasing software Pro fi ciency in programming languages such as Python/Kotlin/Scala 4+ years of experience in ETL orchestration and work fl ow management tools like Air fl ow Expert in database fundamentals, SQL, data reliability practices and distributed computing 4+ years of experience with the Distributed data/similar ecosystem (Spark, Presto) and streaming technologies such as Kaa/Flink/Spark Streaming Excellent communication skills and experience working

PythonSQLAWSGit
DU
📍 San Francisco, Canada· Full-time
✓ High-confidence listing
Quick readStrong listing-quality and freshness signals

About the Team DoorDash is a data driven organization and relies on timely, accurate and reliable data to drive many business and product decisions. Data is at the foundation of DoorDash success. The Data Engineering team builds database solutions for various use cases including reporting, product analytics, marketing optimization and financial reporting. By implementing data structures and data warehouse architecture, this team serves as the foundation for decision-making at DoorDash. The focus extends to enhancing the developer experience by creating tools that support the organization's high-velocity demands. To lead the growing team of Data engineers we are looking for managers who are passionate about Data and are thought leaders in coaching, guiding and leading teams to make Data a winning edge for DoorDash. About the Role DoorDash is looking for a Data Engineering Manager to guide the development of enterprise-scale data solutions. This manager will also act as a technical expert on all things related to data architecture to empower the greater community of data engineers, data scientists, and DoorDash partners. Your focus extends to fostering an engineering culture of excellence, empowering engineers to deliver reliable, flexible solutions at scale. Additionally, you'll play a pivotal role in building and nurturing a top-performing team, driving innovation and success in a dynamic, fast-paced environment. You must be located in San Francisco, CA, Sunnyvale, CA, or Seattle, WA for this hybrid position. You’re excited about this opportunity because you will… You are a people leader. You thrive in hiring, building, growing and nurturing impactful business focused data teams You are a technology leader. You drive the technical and strategic vision for the embedded pods and foundational enablers to meet current and future needs for scale and interoperability You strive for continuous improvement of data architecture and development process You think of quick wins

PythonSQLPostgreSQLAWS
T
📍 San Francisco, Canada
✓ High-confidence listingCompany trend -94.9%
Quick readStrong listing-quality and freshness signals

About Us Twitch is the world’s biggest live streaming service, with global communities built around gaming, entertainment, music, sports, cooking, and more. It is where thousands of communities come together for whatever, every day. We’re about community, inside and out. You’ll find coworkers who are eager to team up, collaborate, and smash (or elegantly solve) problems together. We’re on a quest to empower live communities, so if this sounds good to you, see what we’re up to on LinkedIn and X , and discover the projects we’re solving on our Blog . Be sure to explore our Interviewing Guide to learn how to ace our interview process. About the Role Twitch Security Platform builds and operates the technology at the intersection of security, privacy, software engineering, and data engineering. As a Senior Engineering Manager, Security Platform, you will guide a diverse group of software engineers to build critical tools and automation solutions used across Twitch. You will report to the Director of Security, Identity, and Privacy Platforms. You will manage engineers responsible for operating our security data platform handling billions of weekly events, a multi-petabyte data lake, and numerous analysis tools that provide critical data across the organization to support important security programs. You will also lead engineers responsible for writing software to accomplish security at scale through automation, libraries, and services. With this team, you will lead the full software development lifecycle from product discovery, roadmap prioritization, and execution. Programs you support will include Fraud, Service-to-Service Auth, Detection and Incident Response, Vulnerability Management, Engineering Intelligence, and Privacy. You are experienced in software and data engineering, you bring awareness of the industry's cutting edge, and you're passionate about security. If this sounds accurate, come join us! You can work from San Francisc

DU
📍 San Francisco, Canada· Full-time
✓ High-confidence listing

From $1.3M/yr

Quick readStrong listing-quality and freshness signals

About the Team The New Verticals Finance & Strategy team supports DoorDash’s expansion into categories beyond restaurants, which is a critical growth driver for the overall company. We enable our businesses to grow faster while becoming more profitable. We do this by creating quarterly and annual plans, holding our stakeholders accountable to goals, and providing strategic insights on our business to understand past trends and identify the best path forward. About the Role We're hiring a Senior Associate to help lead the day-to-day financial reporting and closing processes for our New Verticals business. In this role, you'll own recurring reporting cycles, including monthly close, weekly business reviews, and cross-team planning processes, partnering closely with Accounting, Data Engineering, and business teams to keep our financial reporting accurate and on time every cycle. This is a highly detail-oriented, execution-focused role: you'll spend most of your time working directly in the numbers, with real opportunities to build automation and process improvements along the way. You will report into a Manager on our New Verticals Finance team in our Finance & Strategy organization. You’re excited about this opportunity because you will… Own the monthly close and weekly reporting process for New Verticals, ensuring our financial data ties out accurately and on time every cycle. Build and maintain financial models and reporting tools that the broader Finance team relies on every week. Partner with Accounting, Data Engineering , and cross-functional business teams to investigate and resolve reporting discrepancies before they affect business decisions. Help modernize recurring reporting processes, including opportunities to use AI-powered tools to increase efficiency. Play a foundational role on a growing team, with room to take on more scope as you build expertise in the business. We’re excited about you because… You have 4+ years of experience in FP&A, cor

SQLAWSGitRest
DU
📍 San Francisco, Canada· Full-time
✓ High-confidence listing
Quick readStrong listing-quality and freshness signals

About the Team DoorDash’s Internal Audit team provides independent assurance that the company’s risk management, governance, and internal control processes are operating effectively. We are a small team that is looking to expand and bring on motivated professionals. We don’t think of ourselves as a typical audit function - we are obsessively focused on risks to the organizations which reflects in the type of projects we support and execute. DoorDash is rapidly growing - we are expanding in multiple geos and launching new products. This exciting growth allows us to drive creative analysis, strategy, and solutions. Our focus areas include financial, operational, regulatory, security, IT, and more. About the Role We are seeking a Senior Director, IT Internal Audit to lead the strategy, execution and evolution of DoorDash’s global IT audit function. In this highly visible role, you will help shape the technology risk management practices across DoorDash - you will oversee a broad portfolio of audits, including IT SOX, cybersecurity, data governance, AI governance, and operational technology. You will report directly to the Chief Audit Executive and serve as a strategic advisor to DoorDash’s technology, security, and engineering leaders. You will bring deep technical audit expertise, exceptional leadership skills, and a passion for innovation to build and lead a world-class IT audit organization that scales with the business. This role demands someone who can balance strategy with execution (and isn’t afraid to roll up their sleeves) — a leader who can anticipate emerging technology risks, foster strong cross-functional partnerships, translate complex technical concepts into meaningful business insights, and be ready to operate at the lowest level of detail. You will partner with teams across Security, Platform Engineering, Data Engineering, Privacy Legal, AI, Product, and Compliance to strengthen our risk posture and drive a data-driven approach

AWSGitRestMachine Learning
DU
📍 San Francisco, Canada· Full-time
✓ High-confidence listing
Quick readStrong listing-quality and freshness signals

About the Team As DoorDash continues to expand rapidly, our Core Consumer team plays a pivotal role in shaping the consumer experience through enhancing personalization, search relevance, merchandising strategy, app quality, and the overall ordering experience. Our mission is to implement scalable data solutions and provide insights that directly influence our strategic product direction. We are looking for an Analytics Senior Manager to lead our Discovery team. About the Role As a Senior Manager of Data Science/Analytics, you’ll be leading a team of data scientists who are working on improving the consumer experience. You will develop strategic insights and work closely with the product, engineering, strategy and operations teams to actively build and measure the impact of new features. You will oversee our metrics and analytics strategy to inform strategic product direction, offer technical leadership and build processes to support velocity, and partner with data and product engineers to build robust data foundations. You're excited about this opportunity because you will… Lead and develop a team of Data Scientists in investigating complex issues and uncovering key drivers of our business, along with your own contributions as an Individual Contributor Influence the Product and Operations roadmap by making actionable recommendations based on data Interface frequently with senior leadership to showcase your team’s work and tackle complex business problems Drive measurement strategy for the area under scope, defining success metrics and implementing best practices around experiment design and statistical analysis Develop a strategic learning roadmap based on data observations, strategic questions, and hypotheses We're excited about you because you have… A degree in Math, Physics, Statistics, Economics, Computer Science, or a similar domain Experience managing a team of data scientists, and a track record of delivering impactful analyses 8+ years of experience i

AWSGitRestAI
HI
📍 San Francisco, Canada· Full-time
✓ High-confidence listing

$190K – $270K/yr

Quick readStrong listing-quality and freshness signals

Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates. We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused on creating an intelligent ecosystem across HP’s portfolio. Together, we’re developing intuitive, adaptive solutions that spark creativity, boost productivity, and make collaboration seamless. We create breakthrough solutions that make complex tasks feel effortless, teamwork more natural, and ideas more impactful—always with a human-centric mindset. By embedding AI advancements into every HP product and service, we’re expanding what’s possible for individuals, organisations, and the future of work. Join us as we reinvent work, so people everywhere can do their best work. About The Role The AI team is building cutting-edge solutions that bring the power of AI directly to edge devices while seamlessly integrating with cloud infrastructure. We are looking for a Lead Software Engineer to design and develop high-performance, scalable services to support AI workloads across edge and cloud environments. What You Might Do Design, build, and maintain services that power AI-driven applications, ensuring scalability and performance. Develop APIs and microservices that facilitate seamless integration between cloud-based AI models and edge devices. Optimize data pipelines and storage solutions for real-time AI inference and processing. Implement security and privacy best practices for distributed AI systems. Work closely with AI researchers, infrastructure engineers, and frontend developers to deliver end-to-end AI-driven solutions. Build and optimize an agent orchestration runtime that enables tool use, memory management, and multi-step reasoning across LLMs, APIs, and edge-connected systems. Develop robust logging, monitoring, and alerting systems to ensure system reliability.

PythonJavaSQLRedis
SA
📍 San Francisco, Canada· Full-time
✓ High-confidence listing

From $252K/yr

Quick readStrong listing-quality and freshness signals

Software is eating the world, but AI is eating software. We live in unprecedented times – AI has the potential to exponentially augment human intelligence. Every person will have a personal tutor, coach, assistant, personal shopper, travel guide, and therapist throughout life. As the world adjusts to this new reality, leading platform companies are scrambling to build LLMs at billion scale, while large enterprises figure out how to add it to their products. To make them safe, aligned and actually useful, these models need human evaluation and reinforcement learning through human feedback (RLHF) during pre-training, fine-tuning, and production evaluations. This is the main innovation that’s enabled ChatGPT to get such a large headstart among competition. At Scale, our products include the Generative AI Data Engine, SGP, Donovan, and others that power the most advanced LLMs and generative models in the world through world-class RLHF, human data generation, model evaluation, safety, and alignment. The data we are producing is some of the most important work for how humanity will interact with AI. At the foundation of these products is the Platform Engineering team. In this role, you will lead the design and development of core data storage, streaming, caching, and indexing platforms and underlying systems. You’ll also get widespread exposure to the forefront of the AI race as Scale sees it in enterprises, startups, governments, and large tech companies. You will: Drive the architecture, design, implementation, and reliability of our foundational data platforms and systems, working closely with stakeholders and internal customers to understand and refine requirements. Collaborate with cross-functional teams to define, design, and deliver new features. Proactively identify opportunities for, and driving improvements to, current programming practices, including process enhancements and tool upgrades. Present technical information to teams and stakeholders, providing

MongoDBRedisAWSKubernetes
G
📍 San Francisco, Canada· Full-time
✓ High-confidence listing

$250K – $300K/yr

Quick readStrong listing-quality and freshness signals

About Glean: Glean is the Work AI platform that helps everyone work smarter with AI. What began as the industry’s most advanced enterprise search has evolved into a full-scale Work AI ecosystem, powering intelligent Search, an AI Assistant, and scalable AI agents on one secure, open platform. With over 100 enterprise SaaS connectors, flexible LLM choice, and robust APIs, Glean gives organizations the infrastructure to govern, scale, and customize AI across their entire business - without vendor lock-in or costly implementation cycles. At its core, Glean is redefining how enterprises find, use, and act on knowledge. Its Enterprise Graph and Personal Knowledge Graph map the relationships between people, content, and activity, delivering deeply personalized, context-aware responses for every employee. This foundation powers Glean’s agentic capabilities - AI agents that automate real work across teams by accessing the industry’s broadest range of data: enterprise and world, structured and unstructured, historical and real-time. The result: measurable business impact through faster onboarding, hours of productivity gained each week, and smarter, safer decisions at every level. Recognized by Fast Company as one of the World’s Most Innovative Companies (Top 10, 2025), by CNBC’s Disruptor 50, Bloomberg’s AI Startups to Watch (2026), Forbes AI 50, and Gartner’s Tech Innovators in Agentic AI, Glean continues to accelerate its global impact. With customers across 50+ industries and 1,000+ employees in more than 25 countries, we’re helping the world’s largest organizations make every employee AI-fluent, and turning the superintelligent enterprise from concept into reality. If you’re excited to shape how the world works, you’ll help build systems used daily across Microsoft Teams, Zoom, ServiceNow, Zendesk, GitHub, and many more - deeply embedded where people get things done. You’ll ship agentic capabilities on an open, extensible stack, with the craf

JavaScriptPythonJavaAWS
SA
📍 San Francisco, Canada· Full-time
✓ High-confidence listing

From $252K/yr

Quick readStrong listing-quality and freshness signals

About Scale AI Scale AI is the data foundation for AI, helping organizations build and deploy reliable production AI applications. We partner with leading enterprises and government organizations to accelerate their AI initiatives through our data annotation platform, generative AI solutions, and enterprise AI capabilities. Role Overview As a Forward Deployed AI Engineering Manager on our Enterprise team, you'll be the technical bridge between Scale AI's cutting-edge AI capabilities and our most strategic customers. You'll work with enterprise clients to understand their unique challenges, lead a team that architects specific AI solutions, and ensure successful deployment and adoption of AI systems in production environments. This is a Management role that combines deep engineering and AI expertise, leading a team, and working on customer-facing problems. You'll work directly with customer engineering teams to integrate AI into their critical workflows. Key Responsibilities Customer Integration & Deployment Partner directly with enterprise customers to understand their technical infrastructure, data pipelines, and business requirements Design and implement custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs) Build robust data connectors and ETL pipelines to ingest, process, and prepare customer data for AI workflows Deploy and configure AI models and agents within customer security and compliance boundaries AI Agent Development Develop production-grade AI agents tailored to customer use cases across domains like customer support, data analysis, content generation, and workflow automation Architect multi-agent systems that orchestrate between different models, tools, and data sources Implement evaluation frameworks to measure agent performance and iterate toward business objectives Design human-in-the-loop workflows and feedback mechanisms for continuous agent improvement Prompt Engineeri

PythonAWSAzureGCP
DU
📍 San Francisco, Canada· Full-time
✓ High-confidence listing
Quick readStrong listing-quality and freshness signals

About the Team DoorDash is looking for an Engineering Manager to lead our Discovery Experience team, which owns the Homepage - DoorDash’s front door. It’s the first screen millions of consumers see every day, and since every session starts there, it’s the highest-leverage surface in the consumer funnel: a more personalized recommendation, a faster render, or a cleaner layout can move the metrics the whole company watches. The Homepage spans restaurants, grocery, and emerging verticals across iOS, Android, and Web. We’re rebuilding it around LLM-generated recommendations, shifting discovery from static, rules-based feeds to generative, intent-driven experiences that respond to real-time signals in the moment. About the Role You will lead and grow a team of product-focused full stack engineers, owning both the product and technical direction for the discovery surface - deciding where discovery goes next and how it’s built. You’ll set the roadmap and drive execution alongside Product, Design, Data Science, and ML/Recommendation Platform partners, and you’ll own the quality, velocity, and consumer impact your team ships. It’s a role with real ownership and the room to grow both the product and the team behind it. You’re excited about this opportunity because you will… Own the Homepage end to end, the highest-traffic surface at DoorDash and where every consumer session begins Turn Homepage bets into company-level outcomes: real lift in conversion and order rate for millions of consumers Define discovery quality for DoorDash: getting the right store, restaurant, or item in front of the right consumer at the right moment Ship LLM-gen recommendations and intent-aware discovery that route consumers to the right experience across food, grocery, retail, and emerging verticals Partner across Product, Design, Data Science, and ML/Recommendation Platform teams to shape the discovery roadmap and ship the experiences behind it Build an inclusive, high-performing team by coaching en

AWSGitRestAI
SC
📍 San Francisco, Canada
✓ High-confidence listing

$140K – $170K/yr

Quick readStrong listing-quality and freshness signals

Technical Support Manager About the role: We are looking for a technically skilled, self-motivated, customer-focused manager to lead a team of high energy Support Engineers. In this role you will be responsible for hiring, developing and mentoring team members as well as delivering against key performance metrics. You'll lead process improvements for customer and partner growth, retention, and excellence, while fostering individual contributions and driving cross-functional projects that spark innovation and collaboration. You need to be comfortable working in a fast paced environment and continuously challenge the team to step outside their comfort zone. Minimum Education Requirement This position requires a U.S. Bachelor's degree (or foreign equivalent) in Computer Science, Software Engineering, Information Systems, Data Science, or a closely related technical field. This requirement is a minimum and cannot be substituted by work experience alone. What You Will Be Doing Become a product expert and stay technically close to complex and critical customer escalations. Lead a team of exceptional product experts providing the Sigma user base with an excellent customer experience. Hire, develop and train a strong team of Support Engineers on an ongoing basis. Own strategic areas of the Support organization end to end, from strategy through measurable outcomes. Partner across Engineering, Product, Customer Success, Sales, and Marketing to solve customer challenges and drive cross-functional outcomes. Drive performance against key Support metrics, including CSAT, Initial Response, SLA, and Time to Resolution. Continuously refine processes to optimize efficiency, elevating customer support operations. Uncover golden insights within Support data, translating them into actionable strategies that improve customer experience, operational efficiency, and business outcomes. Develop a reputation for excellence, high credibility and integrity with

PythonSQLAWSGCP
SA
📍 San Francisco, Canada· Full-time
✓ High-confidence listing

From $302.4K/yr

Quick readStrong listing-quality and freshness signals

Director of Engineering, Physical AI Role Overview The Director of Engineering will report to the General Manager of Physical AI, and will be responsible for leading a multi-disciplinary engineering organization. In this senior leadership role, you will own the execution of the Physical AI Data Engine — the platform powering the next generation of Physical AI/Embodied AI. You will collaborate closely with Operations and GTM to guide product direction and help solve the data bottleneck that stands between today's robotics research and real-world deployment. This role requires significant ownership in a fast-paced environment and you will motivate internal teams to set the pace for business growth. Travel will come into play. Key Responsibilities: Set and drive the technical vision across data collection infrastructure, teleoperation systems, ML training pipelines, model evaluation frameworks, annotation tooling, and research Lead a multidisciplinary engineering organization—spanning engineering managers, software engineers, ML engineers, and ML research scientists—while designing the organizational structure, talent strategy, and culture required to scale rapidly without compromising on quality or strategic alignment Maintain exceptional technical and operational excellence by deeply understanding team deliverables, asking incisive questions, identifying slipping standards early, and knowing precisely when to step in Drive cross-functional alignment across Engineering, Operations, and GTM on platform architecture, release processes, and shared priorities Collaborate with researchers and clients to architect and deliver scalable, production-grade data infrastructure tailored for complex robotics workloads Required Qualifications: Bachelor's degree in Engineering, Robotics, Computer Science, or a related technical field 8+ years of engineering experience in fast-paced environments, including 4+ years direct people management demonstrated history of recruiting, mentorin

TypeScriptPythonAWSKubernetes
SA
📍 San Francisco, Canada· Full-time
✓ High-confidence listing

From $216K/yr

Quick readStrong listing-quality and freshness signals

The Public Sector software engineers (SWEs) create the core product building blocks forward-deployed teams use to develop agentic capabilities that function across multiple domains. SWEs responsibilities include building the systems required to ingest and process federal datasets to support real-time decision-making in contested environments. We develop novel agentic enabling capabilities that includes: Create multi-layered guardrails around agents Optimize data retrieval for agents Orchestrate fleets of asynchronous agents Automatically alerts users to deviations in data Illustrating how an agent reached a decision As a Senior Software Engineer, you will lead the development of a vertical feature or a horizontal capability to include defining requirements with stakeholders and implementation until it is accepted by the stakeholders. You will: Lead the design and implementation of scalable backend systems and distributed architectures for Federal customers. Manage the full lifecycle of feature development from requirement definition to deployment on classified networks. Direct the orchestration of asynchronous agent fleets to meet mission requirements. Lead customer engagements to translate mission needs into technical requirements. Own the communication with stakeholders to ensure implementation meets defined acceptance criteria. Conduct technical reviews and identify risks within machine learning infrastructure and model serving. Drive the platform roadmap by providing technical specifications for Federal product offerings. Ideally you will have: Full Stack Development: Proficiency in front-end, back-end development and infrastructure, including experience with modern web development frameworks, programming languages, and databases Cloud-Native Technologies: Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and experience in developing and deploying applications in a cloud-native environment. Understanding of containerization (e.g., Docker) and contai

AWSAzureGCPDocker
🔔

Get new lead data engineer jobs in San Francisco, Canada by email

Daily job updates · Unsubscribe anytime