Lead Data Engineer Jobs

At Datadog, we’re on a mission to build the best platform in the world for engineers to understand and scale their systems, applications, and teams. We operate at high scale, enabling seamless collaboration and problem-solving among Dev, Ops, and Security teams globally for tens of thousands of companies. Our engineering culture values pragmatism, honesty, and simplicity to solve hard problems the right way. The Observability Data Platform (ODP) is the backbone of everything Datadog delivers – powering how data is ingested, stored, routed, and surfaced across every product at planet scale. As a Senior Product Manager for ODP, you will work with world-class engineers and cross-functional partners to shape how the platform is deployed, controlled, and operated. You will define product direction across the control plane and data layer, translate complex infrastructure trade-offs into clear roadmap decisions, and help customers get the most from their observability investment – regardless of architecture, topology, or scale. At Datadog, we place value in our office culture – the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You Will Do: Develop a deep understanding of the Observability Data Platform customers – platform engineers, SREs, and product managers that own the product verticals – their infrastructure challenges, deployment topologies, and cost-to-serve trade-offs. Define product direction across multiple ODP surfaces, including the control plane and data layer, by articulating clear problem statements and desired outcomes, and partnering with engineering on technical approach and sequencing Lead conversations with design partners and strategic customers to understand real-world platform pain points, validate product assumptions, and guide solutions from early prototypes through General Availability Develop a co

As a TPM for SRE, you will partner with SRE leaders and engineers to scale the platform that underpins all of MongoDB’s cloud products. You will drive program execution, strengthen production reliability practices, and coordinate cross-functional efforts across US and EMEA teams. Success in this role means smoother launches, clearer roadmaps, stronger reliability metrics and an SRE organization that's better-equipped to deliver predictability at scale. This role can be based out of our Dublin or Cork office or remotely in Ireland. What You'll Do Drive Program Planning & Execution – Define program scope, milestones, and success criteria with SRE engineers and leaders. Manage dependencies across platform teams, keep work clearly tracked in Jira, and deliver on time Strengthen Production Reliability – Lead change management and launch readiness programs. Partner with SREs and product teams to define and operationalize SLOs/SLIs, and use incident data, metrics, and capacity signals to drive prioritization and continuous improvement Lead Cross-Functional Coordination – Align SRE with Security, Compliance, Cloud platform, and other engineering teams. Coordinate cross-team incident response, ensure clear follow-through, and build trust as the go-to driver of complex, multi-team efforts Build Scalable Systems & Processes – Design lightweight frameworks and communication patterns that help SRE deliver reliably at scale. Work yourself out of the "hero" role by leaving teams better-equipped to execute independently Requirements 8+ years in technical program management, engineering management, or a comparable technical role partnering with software engineering teams Proven track record leading large-scale, cross-team platform initiatives through ambiguity and change Strong knowledge of production change management, software development lifecycle, and reliability metrics (SLOs, SLIs) Skilled at shaping roadmaps and managing dependencies Able to query and interpret

Atlas Search is a multi-cloud service that allows users to execute complex full text and vector search queries using the MongoDB Query Language . Our users are free to focus on relevance and data retrieval instead of the machinery needed to search data at scale. Our team is building the cloud-based distributed systems software responsible for the lifecycle of search indexes including: data ingestion, index building, partitioning, performance, availability, and backup management. Our product is quickly gaining traction with customers and we are making core architectural improvements that you will contribute to. This role is based in Toronto, ON hybrid. Successful candidates will have the following qualities: 2+ years of hands-on experience designing, building, testing, and maintaining industrial-strength backend software in a complex codebase Experience developing distributed systems and cloud services Experience with at least one modern statically typed programming language, and interest in working with Java Excellent verbal and written technical communication skills and enthusiasm for collaborating closely with colleagues A growth mindset and the desire to learn quickly through taking on challenges, reflecting on outcomes, and incorporating feedback A strong sense of ownership over their work, from initial design all the way through maintaining code in production You will: Contribute to the design, implementation, and support of projects that improve the scalability of Atlas Search to make using it a seamless experience for even the largest workloads Work with a collaborative team that prioritizes sound technical decision-making and building systems that our customers love and that we are proud of as engineers Have the opportunity to lead projects and own subsystems Provide input on the team’s roadmap and help determine the architecture of our system Success measures: In 3 months you’ll have a solid high-level understanding of what our team does and how we operate.

Atlas Search is a multi-cloud service that allows users to execute complex full text and vector search queries using the MongoDB Query Language . Our users are free to focus on relevance and data retrieval instead of the machinery needed to search data at scale. Our team is building the cloud-based distributed systems software responsible for the lifecycle of search indexes including: data ingestion, index building, partitioning, performance, availability, and backup management. Our product is quickly gaining traction with customers and we are making core architectural improvements that you will contribute to. We are looking to speak to candidates who are based in San Francisco, CA for our hybrid working model. Successful candidates will have the following qualities: 2+ years of hands-on experience designing, building, testing, and maintaining industrial-strength backend software in a complex codebase Experience developing distributed systems and multithreaded applications Experience with at least one modern statically typed programming language, and interest in working with Java Excellent verbal and written technical communication skills and enthusiasm for collaborating closely with colleagues A growth mindset and the desire to learn quickly through taking on challenges, reflecting on outcomes, and incorporating feedback A strong sense of ownership over their work, from initial design all the way through maintaining code in production You will: Contribute to the design, implementation, and support of projects that improve the scalability of Atlas Search to make using it a seamless experience for even the largest workloads Work with a collaborative team that prioritizes sound technical decision-making and building systems that our customers love and that we are proud of as engineers Have the opportunity to lead projects and own subsystems Provide input on the team’s roadmap and help determine the architecture of our system Success measures: In 3 months you’ll have a

We are looking to speak to candidates who are based in Gurugram for our hybrid working model. About the Role We are looking for a Staff Integration Engineer (Workato & API Integration) to join our GTMTech team. This strategic role will lead the design, implementation, and governance of enterprise-grade integrations that power our core business processes across GTM systems, with a primary focus on Workato-based integrations and modern API management patterns. You will own the architecture for critical integration domains such as Quote-to-Cash and other high-impact GTMTech programs, ensuring our integration landscape is scalable, secure, observable, and aligned with best practices for event-driven and API-first designs. You will partner with engineering, architecture, security, and business stakeholders to define standards, mentor other integration engineers, and drive continuous improvement in how we connect systems and data. The GTMTech team is focused on high-impact, large-scale technology programs, such as Quote-to-Cash. Our mission is to enhance company efficiency, boost profitability, and enable data-driven decision-making by streamlining systems, optimizing processes, and minimizing manual, low-value work through automation and AI. Key Responsibilities Lead the end-to-end architecture, design, and implementation of Workato-based integrations and APIs across GTM systems (e.g., Salesforce, NetSuite, HRIS, Google Workspace) with a focus on scalability, reliability, and security Define and evolve integration standards, patterns, and best practices, including canonical integration patterns, error-handling strategies, observability, and operational runbooks Design and review complex, event-driven integration workflows leveraging technologies such as Kafka or equivalent messaging platforms, ensuring robust handling of topics, producers/consumers, durability, and retry mechanisms Drive API-first and MCP-native design for GTM integrations, leveraging RESTful APIs al

MongoDB’s Storage Layer Services (SLS) team is re-architecting the MongoDB cloud storage layer and sits at the heart of our next-generation cloud storage architecture. This relatively new team is building performant, multi-tenant distributed storage services that both enhance today’s Atlas storage stack and enable more customer workloads to run more efficiently. We are looking for a talented Senior Software Engineer to join our team as we execute on a multi-year roadmap and prepare to launch and rapidly scale services that handle petabytes of data. Come do some of the most interesting work of your career as we Think Big and Go Far for our customers! This role can be based out of our New York City office (hybrid working model) or remotely in the North America region. What you’ll do Design, build, and operate control plane services powering an elastic and multi-tenant storage layer for thousands of database instances. Solve problems around maintaining high availability and performance during load spikes, hardware failures, cloud provider outages, and other disruptions. Contribute to a culture of operational excellence through dashboards, playbooks, and on-call improvements. Lead complex technical projects from planning through successful deployment with clear stakeholder updates. Partner closely with peers across database, cloud, and infrastructure engineering teams as well as project management to investigate incidents and develop long-term roadmaps. Mentor junior engineers and foster a collaborative team environment. We’re looking for someone with 5+ years of professional software development experience building, deploying, and operating multi-tenant cloud services with a focus on operational excellence. Experience with large backend/compiled codebases, such as Rust or C/C++. Experience with containerization and orchestration platforms (e.g. Kubernetes). Experience with observability tooling (e.g. time series metrics, dashboards). Experience with distributed systems

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Required Skills: 9+ years in Python and its libraries (e.g., Pandas, Boto3) for data manipulation, ETL processes, and developing serverless functions to interact with foundational AI services on platforms like AWS Bedrock . 6+ years with modern front-end frameworks (e.g., React, Next.js, TypeScript), and an ability to collaborate effectively with Product & Design. Deep hands-on experience with AWS solutioning , including designing and deploying production applications using core services such as AWS EC2, AWS Lambda, Amazon S3, Amazon RDS, and API Gateway . Familiarity with Infrastructure as Code (IaC) tools like CloudFormation or Terraform is essential. Proven experience building and deploying production-grade AI applications and services. Experience with agentic frameworks like LangChain, LangGraph, and LangSmith is a strong plus. Strong background in building distributed systems, microservices, and resilient APIs (REST/GraphQL) on cloud platforms (AWS/GCP/Azure). Demonstrated ability to influence technical strategy and lead architecture decisions across global teams. Excellent communication skills with experience working effectively across time zones and cultures. Working experience with foundational AI services, with a desire to use a unified platform like AWS Bedrock for Generative AI development and deployment Education and Certifications A Bachelor’s degree in Computer Science, Information Systems, or equivalent years of industry experience AWS cl

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible. At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI. Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here . The Conversion Visibility pod enables a performant ads marketplace and helps prove value to advertisers by connecting on-Pinterest intent with offsite conversions in a privacy-preserving way. We are hiring a Staff Software Engineer to lead the backend architecture and implementation of a GenAI-powered Conversion Health agent, using Event Quality Scores and conversion data to proactively detect issues, recommend and automate fixes, and demonstrate measurable performance impact for advertisers. What you’ll do: You’ll operate in a forward-deployed style , partnering directly with internal downstream teams that consume our conversion signal data to understand their workflows, build tailored solutions, and own them end-to-end from design through integration and iteration. Own the design and implementation of the Conversion GenAI agent: se

Join us in building the future of finance. Our mission is to democratize finance for all. An estimated $124 trillion of assets will be inherited by younger generations in the next two decades. The largest transfer of wealth in human history. If you’re ready to be at the epicenter of this historic cultural and financial shift, keep reading. About the team + role The Robinhood Legend team builds and owns our advanced desktop trading platform, designed to meet the needs of active and sophisticated traders. The team works across real-time data infrastructure, advanced charting, options and futures trading tools, and highly customizable workspace experiences. Their mission is to deliver a professional-grade platform that combines the power of institutional trading tools with Robinhood's signature approachable design. As a Staff Web Engineer , performance is your mandate. You'll set the standard for what a web-based trading platform can be — going deep on JavaScript internals, browser rendering pipelines, and real-time data optimization to make Legend the fastest, most responsive platform of its kind. For active traders, milliseconds matter, and you'll own the work that ensures Legend never gets in their way. This is a performance-first role. You'll lead the initiatives that make Legend faster and more efficient, while also contributing to feature development across core trading surfaces where your performance expertise has the greatest impact. The work balances deep technical execution with meaningful cross-functional partnership. This role is based in our Menlo Park, CA or New York, NY office(s), with in-person attendance expected at least 3 days per week. At Robinhood, we believe in the power of in-person work to accelerate progress, spark innovation, and strengthen community. Our office experience is intentional, energizing, and designed to fully support high-performing teams. What you’ll do Lead web performance across Legend — profiling, diagnosing, and shipping meas

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. The Luxury team builds rich and creative features that set the standard for the ride sharing industry. We are looking for a motivated software engineer to join us building features for Black, Black SUV, and other upmarket modes where quality is uncompromising, where we work on balancing and growing these unique marketplaces within the wider Lyft ecosystem and influencing driver behavior to facilitate highest-quality rides. Ownership is a key quality for this team; this person should be driven to track a project to successful completion and beyond, taking initiative to work with other teams and functions to ensure the code they write reaches users and drives impact. You'll collaborate with engineering, product, data science, analytics, and operations on programs that empower us to iterate quickly, delighting our passengers and drivers. Preferred applicants intend to work regularly from our CDMX office, where team members collaborate together in person. Responsibilities: Help establish roadmap and architecture based on technology and understanding of customer needs Write well-crafted, well-tested, readable, maintainable code Participate in code reviews to ensure code quality and distribute knowledge Share your knowledge by giving brown bags, tech talks, and promoting appropriate tech and engineering best practices Can help lead large projects from idea to positive execution Unblock, support and communicate with internal partners to achieve results Experience: Engineering industry experience Experience with object-oriented programming Experience in distributed systems Experience working with databases, relational or NoSQL Write clear, scalable and clear design documentation Design, build and improve a set of team owned components Please submit your resume in English.

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. On the Rider team, we are growing our team with people who want to enrich the lives of our community through technology. You'll collaborate with highly cross-functional teams such as Product, Design, Data science, and Analytics, as well as other organizations like Driver, Partners, and Marketplace, to deliver on that promise. As the Senior Engineering Manager for the Rider Loyalty, Partnerships, and Rider Pay (PLP) group, you will lead multiple managers and Staff ICs with end-to-end teams, consisting of iOS, Android, and Server, to make Riders into Members and to build a robust network of partners that our Riders love. It is your responsibility to sweat the details by being customer-obsessed with specific Rider needs and to build innovative product solutions to address them. Responsibilities: Set the technical vision and team strategy for the PLP group and communicate that downwards, with peers, and upwards with ELT Coach and guide an organization of managers and engineers in their people and technical development Collaborate with cross-functional stakeholders to deliver high business impact Work closely with the Lyft recruiting team to hire high-potential candidates from diverse backgrounds Experience: BS/MS or equivalent in Computer Engineering, Computer Science, or a related field, or relevant work experience 3+ years of experience managing engineering teams of 20+ members, including teams across iOS, Android, and Server platforms, as well as experience in managing managers Ability to thrive in a heavily cross-functional environment and drive projects to completion regardless of the organizational structure Passion for building scalable and extensible solutions that enable others and ensure a high-quality product Experience launching and supporting consumer-facing products at scale Strong technica

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. As a Frontend Software Engineer on the Operator Core Tooling pod, you'll play a vital role in building the robust services that power our critical operations tooling platform. Your work will directly empower our micromobility operations teams by providing them with intuitive and efficient tools, significantly improving their daily workflows as they manage our fleet. You'll collaborate closely with business leaders, front-end developers, and data scientists across Lyft to achieve this impact. Responsibilities: Help define the roadmap and architecture based on technology and business needs Write well-crafted, well-tested, readable, maintainable code Have a good grasp and ability to explain the various tradeoffs made in decisions Participate in code reviews to ensure code quality and distribute knowledge Lead projects from idea to positive execution Incorporate considerations for business context and failure modes in your work Proactively participate in resolving ongoing incidents Unblock, support, effectively communicate and obtain buy-in across teams to achieve results Share your knowledge by giving brown bags, tech talks, and evangelizing appropriate tech and engineering best practices See the direct impact of your work on the efficiency of our operating teams Experience: 3+ years of software engineering industry Advanced knowledge of JavaScript Experience working with modern JavaScript frameworks, like React Experience working with NodeJS and Express applications Experience working with design systems (e.g. Bootstrap, Salesforce Lightning, GitHub Primer) Good understanding of web performance and how browsers and DOM work Experience with unit, integration, and end-to-end testing Experience designing, building and improving a set of team owned components Culture of investigating and solvin

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Marketplace teams are at the heart of our products and decision-making, owning everything from rider pricing to driver earnings, incentives, and efficient matching. We’re looking for passionate, driven engineers to build systems that empower our riders and drivers to have the best transportation experience possible through prediction, adaptivity, and personalization. We’re looking for someone who is excited about working in a fast-paced, innovative, and impactful environment to create reliable solutions to distributed computing, ML, and data problems. The Pricing team is a centerpiece of Lyft’s Marketplace org, determining prices for all rideshare products and supporting new initiatives. We work with Product & Science to solve and implement complex pricing requirements, balancing the needs of riders, drivers, and the business goals. As an owner of one of the most critical flows in the company, you will work on a wide array of challenges such as latency-sensitive concurrency problems, large scale distributed systems, and experimentation. If you’re interested in playing a large part in demand / supply management and improving the Lyft customer experience, this could be a great fit for you. Responsibilities: Help define the roadmap and architecture based on technology and business needs Unblock, support, effectively communicate, and obtain buy-in across teams to achieve results Lead projects of multiple people from idea to positive execution Write clear, scalable and clear design documentation Write well-crafted, well-tested, readable, maintainable code Utilize your expertise in Python, Golang, AWS to deliver robust and scalable solutions Participate in code reviews to ensure code quality and distribute knowledge Proactively participate in resolving ongoing incidents Share your kno

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Our core corporate finance functions are critical to Lyft’s success. The health and sustainability of our applications, systems, tooling and processes are critical for daily operations and for Lyft’s ability to grow. The Oracle EPM Engineer possesses both business and technical acumen. This engineering role provides support for Lyft’s Corporate consolidations systems, managing their daily performance and incidents, creating automated workflows, building customer solutions, configuring applications, providing end user training and protecting all system related information assets. In this pivotal role, you will leverage your deep expertise in FCCS, ARCS, Data Exchange and EDMCS to drive innovation across our financial consolidation, reporting, reconciliation, and planning processes. Working at the intersection of finance, technology, and strategy, you'll collaborate with key stakeholders to architect solutions that enhance accuracy, efficiency, and compliance while positioning our organization for continued growth and adaptability in a dynamic business environment. Responsibilities: Strategic Leadership & Expertise Lead all aspects of the front-end administration of the FCCS, ARCS, Data Exchange, EDMCS systems including maintaining metadata, rules, forms, developing reports, creating locations, mappings, and granting user access. Serve as the support person and subject matter expert for FCCS, Data Exchange and ARCS configurations, setting technical standards and driving continuous improvement initiatives Strong understanding of complex EPM implementation projects from conception to completion, ensuring on-time, within-budget delivery while exceeding stakeholder expectations Advanced System Configuration & Development Design and implement sophisticated FCCS business rules, incl

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Lyft is a global company that connects people to transportation to change the way we live and get around our communities. Our drivers and passengers entrust Lyft with their personal information and travel details to get where they are going and expect us to keep that data safe. Lyft's Privacy team is composed of engineers and analysts dedicated to ensuring appropriate data protections are applied to our drivers' and passengers' data. Our goal is to make privacy the default setting for our internal engineers and our customers. We help design architectures, build a scalable data platform, and define policies to reduce the exposure of user data and ensure appropriate privacy and security protections are applied across the company. We are looking for a highly motivated, collaborative, team-focused and technically strong Senior Software Engineer to join our Privacy team. As a member of this team, you will design and build systems that make privacy the default at Lyft. Every day, you'll partner with engineering, product, legal, and compliance stakeholders on high-impact projects — from building data redaction pipelines to enabling users to exercise their privacy rights to deploying data management systems across a diverse set of Lyft services. You'll bring strong engineering instincts, a passion for privacy, and the ability to lead large projects from idea to execution. Responsibilities: Design, build, and maintain systems that enhance privacy across the organization Independently lead large projects from idea to execution Advocate for user privacy throughout the organization, consulting engineering teams throughout the software development lifecycle and escalating potential privacy concerns Write well-crafted, well-tested, readable, and maintainable code Participate in code reviews to ensure code quality