About the Team The Spark Platform team owns and operates DoorDash's Apache Spark ecosystem — the execution runtime, remote shuffle service, cluster scheduler, and reliability tooling that powers the company's data, analytics, and ML workloads. We run Spark across the company at significant scale and continue to expand the workloads, capabilities, and consumer base we serve. Orchestrating and operating thousands of Spark cluster deployments is a complex distributed system problem which the team invests heavily in runtime optimization, systems architecture, multi-tenant scheduling, and end-user tooling. About the Role As a Senior Software Engineer on Spark Platform, you will set the technical direction for our in-house Spark deployment and shape the architecture that will run DoorDash's data, analytics, and ML compute for the next five years and beyond. You will own the deep, cross-cutting problems that span the runtime, the shuffle service, the scheduler, and the overall service reliability — making the architectural calls that compound across the platform's lifetime. You will partner with the Engineering Manager on technical roadmap, hiring, and team shape, and act as the senior technical voice in cross-team partnerships with Data Engineering, ML Platform, and product engineering teams that depend on the platform. You must be located in San Francisco, Sunnyvale, Seattle, or New York City for this hybrid position. You will report into the Engineering Manager on our Spark Platform team. You're excited about this opportunity because you will… Set the multi-year technical direction for an in-house Spark-on-Kubernetes platform — runtime, shuffle, scheduler, reliability — and make the architectural calls that compound for years. Own the deepest distributed-systems problems on the team: shuffle architecture, multi-tenant scheduling, runtime performance, and the failure modes that only show up at scale. Partner with the Engineering Manager on technical roadmap, hiring, inte
Jobs in Canada
Senior Data Engineering Manager in San Francisco
15 active opportunities · Updated September 2026
Showing
15 jobs
Explore current senior data engineering manager jobs in San Francisco. Filter by work mode, employment type, experience, department, date posted and distance.
Hiring demand
56/100
steady · 42 related jobs
Hiring trend
-9.1%
Job postings compared with the previous 30 days
Remote options
2.4%
Share of matching jobs listed as remote
Typical salary
$2.3M – $2.3M/yr
Based on 17 salary observations
$250K – $2.4M/yr · Jobiba est.
At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. The Mapping team at Lyft is tasked with building a digital representation of the physical world - a map. We collect and serve the freshest and most accurate mapping data possible, along with algorithms, models, platform services, and map-based user experiences that power Lyft’s current and future transportation offerings. Mapping represents a huge opportunity for Lyft’s business, but also a big challenge. We build and scale systems that deal with large data storage, real-time data processing, machine / deep learning pipelines, routing and ETA models, driver and passenger location tracking, and more. We built beautiful and magical user experiences on top of all those services, and compete with companies that have been in the mapping business for decades. Our engineering team is growing rapidly, and we are looking for Engineering Managers to help us scale. Our engineers are smart, flexible, and love solving difficult challenges. They look to their managers for organizational transparency, career development, mentorship, and honest feedback. They move fast and ship code to production continuously, relying on their leadership to increase productivity by removing obstacles and keeping processes lean. Responsibilities: Manage a rapidly growing team of engineers developing user-facing Mapping experiences Mentor and guide the professional and technical development of your team members. Help develop their careers and assign them to projects tailored to their skill levels, personalities, work styles, and professional goals Build teams that are collaborative, inclusive, and respectful of each other Provide continuous feedback, address underperformance, and recognize the individual strengths and contributions of your team members Create plans for prioritizing technical and resourcing challenges in your organizat
$250K – $2.4M/yr · Jobiba est.
At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. The Luxury team builds rich and creative features that set the standard for the ride-sharing industry. We're looking for a motivated Senior Engineering Manager to lead the team building app experiences, UIs, and infrastructure for Black, Black SUV, and other upmarket modes where quality is uncompromising. As a Senior Engineering Manager, you'll set the technical direction for the team, making tradeoffs between technical investments and product work, and communicating strategy transparently to your team and to leadership. You'll act as a critical technical leader across backend, frontend, iOS, and Android, taking holistic ownership of complex systems, defining strategic roadmaps, and driving cross-functional alignment and engineering excellence to improve the luxury experience. Ownership is a key quality for this team. You should be driven to track projects to successful completion and beyond, taking initiative to work with other teams and functions to ensure your team's work reaches users and drives impact. You'll also help shape product direction by developing a deep understanding of the customer. You'll lead a group of talented engineers, helping the team deliver business impact while staying open to change through constant experimentation. You'll collaborate with engineering, product, data science, design, and operations on programs that empower the team to iterate quickly, delighting our passengers and drivers. If you enjoy collaborating with technical and nontechnical partners on a product with real-world impact, this is the role for you. Responsibilities: Lead a team of talented backend, frontend, and mobile engineers and engineering managers who like to ship code and tackle hard engineering problems Mentor and guide the professional and technical development of your team members. Help d
From $302.4K/yr
Director of Engineering, Physical AI Role Overview The Director of Engineering will report to the General Manager of Physical AI, and will be responsible for leading a multi-disciplinary engineering organization. In this senior leadership role, you will own the execution of the Physical AI Data Engine — the platform powering the next generation of Physical AI/Embodied AI. You will collaborate closely with Operations and GTM to guide product direction and help solve the data bottleneck that stands between today's robotics research and real-world deployment. This role requires significant ownership in a fast-paced environment and you will motivate internal teams to set the pace for business growth. Travel will come into play. Key Responsibilities: Set and drive the technical vision across data collection infrastructure, teleoperation systems, ML training pipelines, model evaluation frameworks, annotation tooling, and research Lead a multidisciplinary engineering organization—spanning engineering managers, software engineers, ML engineers, and ML research scientists—while designing the organizational structure, talent strategy, and culture required to scale rapidly without compromising on quality or strategic alignment Maintain exceptional technical and operational excellence by deeply understanding team deliverables, asking incisive questions, identifying slipping standards early, and knowing precisely when to step in Drive cross-functional alignment across Engineering, Operations, and GTM on platform architecture, release processes, and shared priorities Collaborate with researchers and clients to architect and deliver scalable, production-grade data infrastructure tailored for complex robotics workloads Required Qualifications: Bachelor's degree in Engineering, Robotics, Computer Science, or a related technical field 8+ years of engineering experience in fast-paced environments, including 4+ years direct people management demonstrated history of recruiting, mentorin
From $1.3M/yr
About the Team The New Verticals Finance & Strategy team supports DoorDash’s expansion into categories beyond restaurants, which is a critical growth driver for the overall company. We enable our businesses to grow faster while becoming more profitable. We do this by creating quarterly and annual plans, holding our stakeholders accountable to goals, and providing strategic insights on our business to understand past trends and identify the best path forward. About the Role We're hiring a Senior Associate to help lead the day-to-day financial reporting and closing processes for our New Verticals business. In this role, you'll own recurring reporting cycles, including monthly close, weekly business reviews, and cross-team planning processes, partnering closely with Accounting, Data Engineering, and business teams to keep our financial reporting accurate and on time every cycle. This is a highly detail-oriented, execution-focused role: you'll spend most of your time working directly in the numbers, with real opportunities to build automation and process improvements along the way. You will report into a Manager on our New Verticals Finance team in our Finance & Strategy organization. You’re excited about this opportunity because you will… Own the monthly close and weekly reporting process for New Verticals, ensuring our financial data ties out accurately and on time every cycle. Build and maintain financial models and reporting tools that the broader Finance team relies on every week. Partner with Accounting, Data Engineering , and cross-functional business teams to investigate and resolve reporting discrepancies before they affect business decisions. Help modernize recurring reporting processes, including opportunities to use AI-powered tools to increase efficiency. Play a foundational role on a growing team, with room to take on more scope as you build expertise in the business. We’re excited about you because… You have 4+ years of experience in FP&A, cor
From $127.1K/yr
About Us Twitch is the world’s biggest live streaming service, with global communities built around gaming, entertainment, music, sports, cooking, and more. It is where thousands of communities come together for whatever, every day. We’re about community, inside and out. You’ll find coworkers who are eager to team up, collaborate, and smash (or elegantly solve) problems together. We’re on a quest to empower live communities, so if this sounds good to you, see what we’re up to on LinkedIn and X , and discover the projects we’re solving on our Blog . Be sure to explore our Interviewing Guide to learn how to ace our interview process. About the Role For many of our creators, streaming on Twitch is a career, and our payment systems are central to making this possible. We're operating at a massive scale and you'll help millions of creators to earn a living doing what they love. As a key member of the engineering team, you will report to the Senior Engineering Manager of Payments team and have the opportunity to build and scale solutions that affect millions of users and broadcasters. You will take high ownership of your services - architecting, building and operating them. You will partner with other engineers, product managers, designers and data specialists to deliver solutions. Our team is based in San Francisco, CA You Will: Work with technical leads and other engineers to design and develop commerce/payments platform and services Contribute to customer-focused project deliveries Work with other teams to clarify product requirements Improve engineering processes Participate in design and code reviews You Have: Minimum of Bachelor’s degree in Computer Science or prior relevant engineering experiences Strong understanding of data structures, algorithms, data modeling and schema design 1+ years as an software engineer Experience creating detailed technical documentation Proficient experience level in one or more of the fol
About the Team As DoorDash continues to expand rapidly, our Core Consumer team plays a pivotal role in shaping the consumer experience through enhancing personalization, search relevance, merchandising strategy, app quality, and the overall ordering experience. Our mission is to implement scalable data solutions and provide insights that directly influence our strategic product direction. We are looking for an Analytics Senior Manager to lead our Discovery team. About the Role As a Senior Manager of Data Science/Analytics, you’ll be leading a team of data scientists who are working on improving the consumer experience. You will develop strategic insights and work closely with the product, engineering, strategy and operations teams to actively build and measure the impact of new features. You will oversee our metrics and analytics strategy to inform strategic product direction, offer technical leadership and build processes to support velocity, and partner with data and product engineers to build robust data foundations. You're excited about this opportunity because you will… Lead and develop a team of Data Scientists in investigating complex issues and uncovering key drivers of our business, along with your own contributions as an Individual Contributor Influence the Product and Operations roadmap by making actionable recommendations based on data Interface frequently with senior leadership to showcase your team’s work and tackle complex business problems Drive measurement strategy for the area under scope, defining success metrics and implementing best practices around experiment design and statistical analysis Develop a strategic learning roadmap based on data observations, strategic questions, and hypotheses We're excited about you because you have… A degree in Math, Physics, Statistics, Economics, Computer Science, or a similar domain Experience managing a team of data scientists, and a track record of delivering impactful analyses 8+ years of experience i
Employee Applicant Privacy Notice Who we are: Shape a brighter financial future with us. Together with our members, we’re changing the way people think about and interact with personal finance. We’re a next-generation financial services company and national bank using innovative, mobile-first technology to help our millions of members reach their goals. The industry is going through an unprecedented transformation, and we’re at the forefront. We’re proud to come to work every day knowing that what we do has a direct impact on people’s lives, with our core values guiding us every step of the way. Join us to invest in yourself, your career, and the financial world. The Role: As a Technical Program Manager within the Enterprise Data Governance team, you will drive strategic execution across our core data governance processes. Your primary focus is to protect member privacy safeguarding personal information through secure handling, processing, and storage to ensure trust, enforce compliance, and mitigate data exposure risks. You will bridge the gap between corporate data governance policy and operational engineering, leading high-visibility technical programs that secure, classify, and institutionalize data controls across key data platforms. As a leader, you will partner with engineering, the CIO organization, Legal, Privacy Compliance, and broader stakeholders to shield enterprise data frameworks while accelerating feature delivery. What you’ll do: Own the end-to-end strategy, roadmap, and execution of complex, multi-platform data privacy and data protection initiatives, driving the Privacy Rights Management (PRM) program as a primary priority. Partner with engineering and platform teams to translate abstract data governance and privacy policies into actionable technical execution. Own the requirements lifecycle by authoring comprehensive PRDs, defining functional data controls, and ensuring engineering teams have the clear technical specifications needed
About the Team At DoorDash, design means making experiences for the people who order, the people who prepare, and the people who deliver. As a Design Manager at DoorDash, you want to build things that matter to real people. You're at your best when you can move from idea to shipped product quickly, bringing experiences to life that reach and influence users at massive scale. You'll care about whether the product you make solved a real problem for real people, or changed how someone experiences their day. You'll work shoulder-to-shoulder with Engineering and Product Management, dig into the data, and use LLM-powered tools alongside traditional design tools. If the LLM powered tools don’t exist yet, you build them. About the Role Trust is the foundation of every interaction on DoorDash. We're looking for a design leader who can define and drive a vision for designing for integrity at scale. In this role, you will join the Integrity organization. You’ll lead a team of designers working across fraud prevention, trust, safety, and compliance — protecting millions of consumers, Dashers, and merchants while keeping the platform seamless and trustworthy. You will report into the Head of Design for our Customer Experience & Integrity organization. This role is hybrid- 1–2 days per week in one of our Design Hubs. You’re excited about this opportunity because you will… Set the technical direction for Design across your product area — decide what gets built, in what order, and why; connect multiple teams around shared platforms so the work compounds instead of duplicating Work on ambiguous problems and turn them into architecture decisions and working systems that teams actually use; earn trust with leadership not through decks, but through prototypes and shipped code that make your point for you Stay close to the code and the craft across multiple projects at once — you're not just reviewing, you're building; the work you ship will move real metrics across the product area
Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including frontier model training, enterprise adoption, defense applications, and autonomous vehicles. Our mission is to develop reliable AI systems for the world’s most important decisions. We’re looking for an AI Product Manager to own the Finance vertical within our Agents Data & Reinforcement Learning Environments team. In this role, you’ll own both the development of RL environments (the realistic, high-fidelity simulations of financial software and workflows that labs use to train and evaluate agents) and the “data as a product” strategy that powers them. You’ll understand where AI is being used in the Finance industry, decide what financial tasks are worth modeling, how to source and structure the underlying data, and how to turn deep domain knowledge into a defensible product. The ideal candidate has lived inside the Finance industry, and is able to pair that domain understanding with a sense for AI research and current agent capabilities in Finance workflows. You’ll translate that expertise into environments and datasets that teach AI agents to perform real financial work, and you’ll be the domain expert Scale’s most important customers and their leading researchers turn to. A strong entrepreneurial & go-to-market mindset will be necessary. What You’ll Do Own the Finance AI roadmap & data strategy: Set product direction for the Finance agents training stack and the data strategy behind it. Establish a vision for where AI is continuing to transform the Finance industry (including investment banking, private equity, public markets, corporate finance, FP&A, etc), driving execution across engineering, operations, and go-to-market teams. Build partnerships with research teams at frontier labs: Work directly with researchers at leading AI labs to understand where their Finance agentic capabilities fall short and shape new product lines and competit
From $200K/yr
AI only answers correctly when it can trust the data underneath it. This role owns two connected parts of how Sigma shows up in that world: where Sigma's experience lives outside its own product (MCP, a CLI, the Claude and ChatGPT marketplaces, integrations like Slack, Teams, and Glean), and the semantic layer that makes every one of those surfaces trustworthy. The first mandate is Sigma's AI ecosystem: defining Sigma's approach to MCP, giving external agents structured, governed access to Sigma's data model; owning the CLI, giving developers a fast way to work with Sigma outside the UI; and building Sigma's presence in the Claude and ChatGPT marketplaces, plus integrations for Slack, Teams, Glean, and similar surfaces, so people can reach Sigma's data wherever they already work. This is some of the most visible, fastest-growing surface area in the product. The second mandate is the semantic layer underneath it all. Every agent, chat answer, and integration is only as reliable as the data model behind it — get a metric definition wrong here, and every surface built on top inherits the mistake. This includes setting the roadmap for how semantic views connect across data platforms and how the model evolves as new AI capabilities emerge. What you'll do Define Sigma's approach to MCP, giving external agents and tools structured, governed access to Sigma's data model. Own the CLI roadmap, giving developers a fast, scriptable way to work with Sigma outside the UI. Build Sigma's presence in the Claude and ChatGPT marketplaces, along with integrations for Slack, Teams, Glean, and similar surfaces, so people can reach Sigma's data wherever they're already working. Set the roadmap for Sigma's data modeling strategy, including how semantic views connect across data platforms and how the semantic layer evolves as new AI capabilities emerge. Partner with engineering and design to ship integration and semantic modeling capabilities that hold up at enterprise scale.
About the Team DoorDash Ads will become the most transparent and effective advertising channel for merchants, brands, and ad buyers/agencies of all sizes to market their offerings to engaged local audiences. We build a variety of products that are easy to use and confidently generate incremental value for advertisers, while also helping consumers discover and engage with brands they love and save money. As the analytics team our goal is to advance product development, understanding of the business, and identify opportunities for the team to drive towards our north stars. About the Role As the leader of a large, high-performing team of data scientists, you’ll own the analytics strategy for DoorDash Ads for Restaurants—one of the company’s fastest-growing and most dynamic businesses. You’ll guide a team spanning multiple levels of seniority to drive insights and decisions across a multi-sided marketplace, optimizing across consumer and merchant outcomes . In your first few months, you’ll establish clear priorities, align cross-functional partners in product, engineering, sales, and strategy, and set the analytical vision for sustainable growth. Success in this role means delivering measurable business impact, elevating the quality of analytics across the organization, and building systems that balance advertiser ROI, consumer experience, and platform health. You will report into the Senior Director of Analytics on our Ads team in our Ads & Promos organization. You’re excited about this opportunity because you will… Lead and develop a high-performing analytics team, providing mentorship, feedback, and clear career development pathways. Define and drive the analytical and product roadmap by setting measurable goals and aligning cross-functional teams around success metrics. Partner closely with product, engineering, and go-to-market teams to uncover insights, optimize funnels, and inform high-impact decisions. Apply advanced analytical methods—such as co
At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Lyft Infrastructure builds the systems engineers depend on to ship stable, scalable, and efficient services. We're hiring a Senior Technical Program Manager to run cross-functional programs across our infrastructure and data platform teams. This role blends program delivery with product sense: you'll own the roadmap for your area, set priorities, and act as the voice of the customer back into how we build. Responsibilities Run infrastructure programs end to end, from kickoff through delivery Own the roadmap for your platform area: shape the strategy, sequence the work, and make the prioritization calls Drive data platform migration and modernization work, coordinating across engineering, data, and platform teams to keep dependencies and timelines under control Be the voice of the customer: partner with engineering teams across Lyft, surface their pain points, and feed that back into priorities and roadmaps Define success metrics and adoption goals, gather and document customer requirements, and make sure what ships actually solves the problem Build feedback loops with customer teams and turn what you hear into concrete improvements Partner with engineering and infrastructure leads to build plans, call out risks early, and keep stakeholders aligned Own program health: track milestones, surface blockers before they slip, and keep decision-makers in the loop Use your technical background in distributed systems and data infrastructure to ask sharp questions and build plans the team believes in Share in the team's release oncall rotation Experience 5+ years in Technical Program Management or a TPM/PM hybrid role A background in software, data, or systems engineering, enough to go deep with engineers Experience owning a roadmap: setting strategy, prioritizing across competing demands, and defining what suc
At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Lyft connects people to transportation to change the way we live and get around our communities. We are looking for product managers who bring exceptional creative and analytical skills to drive forward a best in class product. Product management at Lyft leads the integration of engineering, data science, and design to achieve the company's vision for reinventing transportation. We are looking for entrepreneurial and passionate Product Managers to innovate and execute across a rapidly growing, fast paced company and industry from our San Francisco and New York offices. The Customer Care team makes sure that every time Lyft enters a new market, launches a new mode, or works with a new partner, riders and drivers get the support experience they expect from day one. Some of Lyft's biggest growth bets run straight through this work: expanding into new countries, putting riders into autonomous vehicles with partners like Waymo and May Mobility, and standing up entirely new lines of business. This role owns customer care across these initiatives: shaping the support experience for each, and building the platform, playbooks, and standards that let us launch the next one faster than the last. You'll work hand in hand with the internal & external teams leading each initiative, bringing a strong, independent point of view on what great customer care takes. It's high-visibility work tied directly to where Lyft is growing next. Responsibilities: Own the customer care and support experience for Lyft's highest-priority growth initiatives—spanning international expansion, autonomous vehicles, and new lines of business Partner closely with the internal teams leading each initiative, folding customer care into the broader launch and bringing a strong, independent point of view on what great support requires
$115K – $188K/yr
Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates. We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused on creating an intelligent ecosystem across HP’s portfolio. Together, we’re developing intuitive, adaptive solutions that spark creativity, boost productivity, and make collaboration seamless. We create breakthrough solutions that make complex tasks feel effortless, teamwork more natural, and ideas more impactful—always with a human-centric mindset. By embedding AI advancements into every HP product and service, we’re expanding what’s possible for individuals, organisations, and the future of work. Join us as we reinvent work, so people everywhere can do their best work. About the Role HP IQ is shaping the future of next‑generation experience for HP Customers, and we’re looking for a Program Manager who can help drive that mission. This role sits at the heart of how our teams build, validate, and deliver AI‑powered experiences with exceptional quality and developer efficiency. You’ll lead programs that strengthen QA processes, enhance developer workflows, and accelerate engineering velocity across HP’s AI product portfolio. Success in this role requires a blend of technical fluency, structured program leadership, and the ability to communicate clearly across—and up—the organization. Responsibilities Program Leadership & Execution Drive end‑to‑end planning, execution, and delivery of QA and Developer Experience programs within the HP IQ organization. Build and maintain program roadmaps, milestones, and KPIs that align with organizational priorities. Identify risks, dependencies, and cross‑team impacts early, and lead mitigation strategies. Ensure consistent alignment across engineering, QA, product, data science, and partner teams. Quality & Developer
Higher-paying openings
Jobs with higher listed pay
Engineering Manager, Data Warehouse and Integrations
Amplitude · San Francisco, Canada
$2.7M – $4.1M/yr
Senior Engineering Manager, Global Growth
Lyft · San Francisco, CA
$2.5M – $3.4M/yr
Senior Engineering Manager, Mapping
Lyft · San Francisco, CA
$2.5M – $3.1M/yr
Engineering Manager, Global Growth
Lyft · San Francisco, CA
$2.1M – $2.6M/yr
Engineering Manager, Rider
Lyft · San Francisco, CA
$2.1M – $2.6M/yr
Other cities to consider
More places hiring for this role
Get new senior data engineering manager jobs in San Francisco, Canada by email
Daily job updates · Unsubscribe anytime