Lead Data Engineer Jobs

About the Role Anyscale is seeking a Senior / Staff Product Manager to lead Ray Data, our scalable data processing library for ML and AI workloads. This is a uniquely challenging role that requires balancing open source growth with commercial differentiation - driving rapid adoption in the open source Ray Data ecosystem while building compelling proprietary features for Anyscale RunTime, our high-performance commercial engine. You'll own the entire Ray Data product roadmap in a competitive landscape, working closely with the engineering team, the field team, enterprise customers, and the open source community. Success requires: Deeply ingraining yourself into the end-user experience to understand the nature of the product and its gaps and tradeoffs Working closely with customers and open source users to draw the subtle line between growth and commercialization Strategic thinking about which parts of the ML/Data lifecycle to focus on, identifying opportunities where our architectural strengths create the most value. Thinking deeply about and clearly articulating the product strategy to stakeholders Key Responsibilities Drive the Ray Data product roadmap - Balance open source Ray Data feature development with Anyscale Runtime commercial differentiation to ensure that both Ray Data becomes the open source standard for AI data processing and Anyscale Runtime remains sufficiently compelling. Drive open source Ray Data adoption - Focus on community growth, developer experience, and ecosystem integrations Market Positioning & Enablement - Work closely with Product Marketing on strategic market positioning, field enablement, and competitive analysis to maintain differentiation. Customer engagement - Drive key customer engagements assisting sales and field engineering teams. Required Qualifications 4+ years of product management experience with technical products Strong technical background in distributed systems, ML infrastructure, or data processing Experience working

About the Team The Stargate team is responsible for building the physical infrastructure that powers large-scale AI systems. We design and deliver next-generation data centers optimized for dense compute clusters, advanced networking, and rapidly evolving hardware platforms. This work sits at the intersection of hardware engineering, systems architecture, and infrastructure execution—translating cutting-edge compute roadmaps into scalable, production-ready environments. Our teams partner across silicon vendors, server and storage OEMs, networking teams, and data center engineering organizations to bring new capacity online quickly, reliably, and at global scale. About the Role We are seeking a CPU & Storage Technical Lead to define and drive the server compute and storage architecture strategy for Stargate infrastructure. In this role, you will own technical direction across CPU platforms, memory configurations, local and disaggregated storage systems, and their integration into large-scale AI clusters. You will evaluate vendor roadmaps, lead platform tradeoff decisions, and ensure compute and storage systems are optimized for training, inference, and supporting services. You will work cross-functionally with hardware engineering, performance modeling, networking, supply chain, and deployment teams, as well as external partners such as AMD, Intel, OEMs, ODMs, and storage vendors. This is a highly strategic role for someone who can operate deeply at the component level while also driving long-range infrastructure decisions. Key Responsibilities Own CPU and storage technical strategy for Stargate compute infrastructure across current and future generations. Evaluate CPU platforms across performance, efficiency, memory bandwidth, PCIe topology, cost, and roadmap alignment. Define storage architectures for AI environments, including boot media, local NVMe, shared storage, caching tiers, metadata services, and high-performance data pipelines. Drive server platform de

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. The Snowhouse Foundation team builds our globally distributed data warehouse. We manage a vast array of petabyte scale data sets that are continuously ingested, processed and replicated from across all Snowflake environments and external data sources. Snowhouse powers all of Snowflake’s core business, engineering and data science needs and provides customers with full visibility into their account activities, usage, and resource consumption from all their global environments. The team is investing in multiple critical areas, including a pipeline authoring platform, high performance/high efficiency data export, ingestion and data layout. Our team is also responsible for a fundamental product for Snowflake’s customers: the Snowflake system database/application that provides customers with all usage insights they need to reason about their global Snowflake footprint as well as 1st party business logic such as ML powered functions and Budgeting applications. AS A PRINCIPAL SOFTWARE ENGINEER IN SNOWHOUSE FOUNDATION, YOU WILL: Design and implement innovative highly available distributed platforms and pipelines and enhance the overall Snowflake data infrastructure Lead and drive projects from idea formulation to design, implementation and successful productionization. Collaborate

About us Graphcore is one of the world’s leading innovators in artificial intelligence compute. We are developing hardware, software and systems infrastructure that will unlock the next generation of AI breakthroughs and support the widespread adoption of AI solutions across every industry. As part of the SoftBank Group, Graphcore is a member of a family of companies responsible for some of the world’s most transformative technologies. Together, we share a bold vision to enable advanced artificial intelligence and ensure its benefits are accessible to everyone. Graphcore brings together AI researchers, silicon designers, software engineers and systems architects to solve complex technical challenges and deliver innovative computing solutions. Job Summary The Principal Electrical Engineer will be a technical authority within Data Center Engineering, leading the architecture and delivery of safe, resilient and scalable electrical infrastructure for high-density AI computing environments. Working with internal teams, data center developers, utilities, consultants and equipment partners, this role will guide projects from early technical studies through design, construction, commissioning, operation and lifecycle improvement. The successful candidate must reside in, or be willing to relocate to, Austin, Texas. Approximately 10% travel may be required. The Team The Data Center Engineering team is responsible for defining and enabling the infrastructure needed to deploy and operate Graphcore’s computing systems at scale. The team works across electrical, mechanical, thermal, controls, systems and operational disciplines, collaborating with external engineering and construction partners to deliver reliable, efficient and maintainable data center environments. Responsibilities and Duties Act as the technical authority for electrical engineering across data center infrastructure projects, from the utility or on-site power source through to the IT rack. Lead electrical archit

Instawork is on a mission to create meaningful economic opportunities for skilled hourly professionals in communities around the globe. Our AI-powered labor marketplace helps local businesses scale, and enables global technology companies to push the frontiers of robotics and AI. Backed by world-class investors like Benchmark, Spark Capital, Craft Ventures, Greylock, Y Combinator, and others, we’re looking for exceptional talent to reimagine the way the world works. About IRL (Instawork Robotics Labs) Researchers at UC Berkeley have identified a “100,000-year data gap” - the gulf between what trained AI language models and what physical robots actually have to learn from. Closing that gap is the defining infrastructure challenge of the physical AI era. IRL is Instawork’s answer to it. We deploy skilled workers into real commercial and residential environments - kitchens, warehouses, hotel floors, homes - to capture the high-fidelity task data that the world’s leading Robotics labs use to train their foundation models. Read more here . What you’ll do Lead Workforce & Operations: Drive day-to-day workforce management for Clippers, Graders, Regraders, SMEs, and ICs across shifts/sites, optimizing staffing, capacity planning, and throughput against SLA targets. Implement Quality Systems & Methods: Maintain the QMS and apply structured methods (RCA, CAPA, FMEA, 8D, SPC) to address recurring defects, calibration drift, gold-sample injections, and consensus checks. Own SOPs & Process Standards: Build, version-control, and continuously iterate SOPs for existing and new program launches, ensuring floor adoption and structured QA onboarding/re-calibration paths. Bridge Cross-Functional Teams: Translate engineering data requirements into floor-executable QA criteria, report field issues back with evidence, and represent QA in program launches and crisis calls. Drive Data-Led Quality: Monitor and analyze key QA metrics—defect/reject rates, inter-grader agreement (ka

This is Adyen Adyen provides payments, data, and financial products in a single solution for customers like Meta, Uber, H&M, and Microsoft - making us the financial technology platform of choice. At Adyen, everything we do is engineered for ambition. For our teams, we create an environment with opportunities for our people to succeed, backed by the culture and support to ensure they are enabled to truly own their careers. We are motivated individuals who tackle unique technical challenges at scale and solve them as a team. Together, we deliver innovative and ethical solutions that help businesses achieve their ambitions faster. Senior Procurement Manager - Data Centers We are looking for a fast learner and hands-on Procurement Manager to join Adyen's Procurement team, a dynamic global team within our Finance function. The goal of the team is to contribute to Adyen’s 10x ambition through sustainable commercial decisions, risk mitigation, contract and vendor management, ultimately empowering stakeholders to deliver their strategies. You will work in the data center category, alongside another category manager and a supply chain manager, but as Adyen grows, and the Procurement team with it, this scope might change and increase in the future. What you'll do Act as a business partner to stakeholders such as Infrastructure, Data Center Engineering, Legal and Sustainability, delivering value and enabling their strategies. Lead and initiate commercial negotiations, including but not limited to contract renewals and setting up new agreements. Be responsible for the supplier selection process, RFx and screening. Work with the Infrastructure team on roadmaps, including our DC expansion plans. Do vendor monitoring on performance and contractual agreements. Be tracking and reporting on industry trends. Build and maintain relationships with key vendors. Who you are 7+ years of relevant experience, including category management or sourcing. Deep knowledge and exper

GitLab is the intelligent orchestration platform for DevSecOps. GitLab enables organizations to increase developer productivity, improve operational efficiency, reduce security and compliance risk, and accelerate digital transformation. More than 50 million registered users and more than 50% of the Fortune 100* trust GitLab to ship better, more secure software faster. The same principles built into our products are reflected in how our team works: we embrace AI as a core productivity multiplier, with all team members expected to incorporate AI into their daily workflows to drive efficiency, innovation, and impact. GitLab is where careers accelerate, innovation flourishes, and every voice is valued. Our high-performance culture is driven by our values and continuous knowledge exchange, enabling our team members to reach their full potential while collaborating with industry leaders to solve complex problems. Co-create the future with us as we build technology that transforms how the world develops software. * Fortune 500® is a registered trademark of Fortune Media IP Limited, used under license. Claim based on GitLab data. Fortune 100 refers to the top 20% ranked companies in the 2025 Fortune 500 list, published in June 2025. Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of GitLab. An overview of this role You will lead the product strategy for GitLab's next generation of engineering insight, helping software leaders, engineering managers, CTOs, and CPOs understand not just what their teams shipped, but why, and what to do next. As Principal Product Manager, Engineering Intelligence & Insights, you will shape how GitLab turns engineering data into decision-ready intelligence: the core data infrastructure and knowledge graph integrations that connect it, the out-of-the-box dashboards customers rely on today, and the conversational AI experiences that let leaders simply ask a question and get an answer in

Employee Applicant Privacy Notice Who we are: Shape a brighter financial future with us. Together with our members, we’re changing the way people think about and interact with personal finance. We’re a next-generation financial services company and national bank using innovative, mobile-first technology to help our millions of members reach their goals. The industry is going through an unprecedented transformation, and we’re at the forefront. We’re proud to come to work every day knowing that what we do has a direct impact on people’s lives, with our core values guiding us every step of the way. Join us to invest in yourself, your career, and the financial world. Role Description As the Director of Corporate Infrastructure, you will drive efforts to oversee the design, implementation, and operation of our corporate networks. This includes the IT Infrastructure DevOps, Security and SRE teams. You have a deep understanding of infrastructure as code, configuration as code & networking technologies, strong business acumen, lead through data and metrics, and operate with a high level of rigor and accountability. You are responsible for the reliability, scalability, sustainability, and efficiency of SoFi’s network infrastructure. As a member of the Corporate Infrastructure leadership team, you are directly accountable for the teams that are responsible for driving efforts to evolve and build our next-generation corporate network (to include infrastructure and wifi). This includes managing all aspects of our network - engineering and operations to improve user experience and performance, and also supporting the multi-terabit backbone network that interconnects edge PoPs, corporate offices, data centers, and cloud gateways. You will lead a diverse team through highly technical problems to achieve our overall strategic, operational, and financial goals. You will build and lead a high-performance team, displaying technical proficiency to support and scale the

Everpure (NYSE: P) has evolved from storage pioneer to data platform, closing fiscal 2026 with $3.7 billion in revenue, its first billion-dollar quarter, and accelerating growth into FY27. Our strategic agenda spans the companies defining the next era of technology - hyperscalers, AI labs, the AI hardware supply chain, data platform providers, and the broader AI ecosystem. This type of work—work that changes the world—is what the tech industry was founded on. So, if you're ready to seize the endless opportunities and leave your mark, come join us. THE ROLE As a Senior Technical Architect on our Advanced Services team, you will bridge pre-sales strategy and post-sales delivery to architect enterprise data migration, disaster recovery, and hybrid-cloud storage solutions. In this dual consultative and hands-on role, you will collaborate closely with Sales, Engineering, and enterprise customers to translate complex business needs into resilient, automated IT infrastructure. You will drive revenue growth and project success by serving as the trusted technical authority across high-impact data center transformations. WHAT YOU'LL DO Architect & Scope High-Impact Solutions: Partner with Sales, Product Marketing, and customer leadership to evaluate complex enterprise environments, design high-availability storage architectures (replication, clustering, cloud integration), and scope Professional Services engagements that drive sales conversion and solution adoption. Lead Enterprise Data Migrations & Implementations: Own end-to-end technical execution of complex data center consolidations and block/file migrations using specialized appliances (e.g., Cirrus Data) and native toolsets, ensuring seamless cutovers with zero data loss and minimal operational disruption. Automate & Modernize Storage Operations: Develop custom scripts (Python, PowerShell, Shell) and integration workflows to automate replication, disaster recovery, and cloud-bursting processes within client

About the Team OpenAI's Industrial Compute organization is building and operating the infrastructure foundation for the next generation of AI. Infrastructure Operations works across facilities, hardware, network operations, incident management, data center engineering, delivery teams, and external partners to bring capacity online safely, understand its operational state, and improve it over time. As OpenAI's data center portfolio grows across first-party and partner-delivered capacity, the organization needs clear goals, trusted data, repeatable processes, and systems that make ownership, risk, readiness, and performance visible. This role will help build the operating mechanisms that allow Infrastructure Operations to scale with rigor. About the Role We are seeking a Technical Program Manager to own the systems, data, reporting, governance, and program-management backbone for Infrastructure Operations. Reporting to the Delivery & Operations Lead, you will translate strategy into executable goals and operating cadences, turn operational needs into software and data solutions, and create the mechanisms that keep a rapidly evolving organization aligned and accountable. This role will also own the current 1P+3P delivery-tracking layer within Operations: milestones, delivery timelines, quantity forecasts, risks, decisions, and executive reporting. You will partner closely with 1P Delivery Program Management, Compute TPMs, Data Center Engineering, construction, commissioning, and operations leaders to ensure that delivery information becomes complete, usable input for readiness, handover, and ongoing operations. You will own program health and the operating system around it: the goals, data definitions, workflows, reporting, decision paths, and follow-through that help functional DRIs execute. The ideal candidate is comfortable in ambiguity, technically fluent enough to implement real systems, and relentless about converting scattered information into durable mechan

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career. About the team Our Product Marketing team’s mission is to generate customer insights that inform Stripe’s product strategy, and lead go-to-market for our suite of products. Product Marketing is a highly cross-functional role at Stripe, partnering closely with Product and Engineering, Sales, Partnerships, Demand Generation and Campaigns to name a few. Different from many other Product Marketing teams, our team works across the entire product lifecycle, from helping shape the product, to driving launch and commercialization, to growing product adoption post-launch. We are looking for experienced product marketers to shape the roadmap, drive launches, and grow adoption for critical products such as Payments Intelligence, Payouts, Tax, Billing, and Link; and develop our go-to-market strategy for key user segments such as Enterprises and Startups. In this role, you will develop messaging and positioning, craft the narrative for how our products deliver value to customers, and engage teams across sales, campaigns, demand generation, and product to drive overall awareness, pipeline, and revenue across Stripe’s existing customer base and prospects. What you’ll do Be a storyteller: You have deep empathy for users and are able to adapt how you communicate to best reach and engage your audience and differentiate Stripe. You have excellent verbal and written communication skills Lead with data: You like working with data and insights and pair that with you

About THG Ingenuity THG Ingenuity is a fully integrated digital commerce ecosystem, designed to power brands without limits. Our global end-to-end tech platform is comprised of three products: THG Commerce, THG Studios, THG Fulfilment. Each represents a single, unified solution, overcoming challenges and taking brands direct-to-consumer. Our client portfolio includes globally recognised brands such as Coca-Cola, Nestle, Elemis, Homebase, and Proctor & Gamble. Database Platform Manager Company: THG Ingenuity Location: Manchester (Head Office) Reports to: Director of Data Role Overview We are looking for a strong technical leader to run our database platform. Our estate runs on Google Cloud Platform following a recent migration to self-managed services, and there is a real opportunity here to shape the next phase. How we consolidate and modernise the estate, where managed and cloud-native services earn their place, which new technologies are worth adopting, and how the platform scales with the business are all live questions. You will lead the thinking on them and work with stakeholders across the business to agree and deliver the roadmap. You will lead our DBA team, who own every database across the group regardless of the application running on it and who run the platform as a 24/7 service. You will work hand in hand with our Data Reliability Engineering team, whose Principal Engineer is your peer and whose focus is automation, fleet reliability and SLOs. This role is weighted toward hands-on technical depth. You should be as credible in a design review or an incident bridge as you are in a planning session with senior stakeholders. Key Responsibilities Technical direction The technical roadmap for the estate. We want someone genuinely interested in emerging database technologies who evaluates them on merit and can articulate the pros and c

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. NVIDIA has a rapidly expanding ecosystem of data center platform designs. From single node HGX/DGX systems all the way up to large multi-node NVLink domain rack architectures. These designs have become core to NVIDIA's rapidly growing enterprise and cloud provider businesses. Each brings together the full power of NVIDIA GPUs, NVIDIA NVLink, NVIDIA InfiniBand networking, NVIDIA Grace CPUs, and a fully optimized NVIDIA AI and HPC software stack. We are searching for a highly motivated engineer to lead performance benchmarking and optimization efforts for our data center products. You will be instrumental in ensuring our data center solutions deliver industry-leading performance for accelerated computing workloads. What you will be doing: Design and execute comprehensive performance benchmarking strategies for our data center platforms and products Characterize real-world AI training, inference, and HPC workloads at scale Define, track, and report key performance indicators (throughput, latency, efficiency, scaling) Build automation tools and frameworks for performance monitoring and analysis Identify and analyze performance bottlenecks across compute, memory, network and storage subsystems Work closely with architecture, hardware,

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. As the Engineering Manager for the Lakehouse Foundation team, you will lead a group of engineers responsible for the foundational data layer that all of Lyft's data systems and emerging AI workloads are built on. The team owns catalog and metadata management, table formats and storage, and the access patterns and gateways through which other engineering teams interact with Lyft's data. As Lyft converges on a unified lakehouse architecture, this team builds and operates the single source of truth that powers analytics, machine learning, experimentation, and every business decision made from data. You will play a key role in shaping the team's technical direction, partnering with peer Data Platform teams on a multi-year platform evolution, and developing engineers who operate with autonomy on systems of significant scale and complexity. Lyft's Infrastructure teams build the foundational systems that the rest of engineering depends on to move fast, ship reliably, and scale efficiently. These are high-leverage roles where the work you and your team do has a multiplicative effect across the company. We're looking for experienced leaders who can balance the discipline of operating critical infrastructure with the curiosity to keep evolving how Lyft builds. Engineering at Lyft is a place where managers and engineers operate with high ownership and strong technical judgment. Our engineers expect their managers to be honest, available, and focused on the work that matters: developing their teams, removing obstacles, and giving people the support they need to do their best work. We build teams that are inclusive, technically rigorous, and have a strong sense of ownership for what they build. Responsibilities: Lead a team responsible for Lyft's foundational data layer, including catalog and metadata management,

About the Team The Online Data team builds and operates the core online database and indexing services for OpenAI’s production AI applications, including supporting the explosive growth of ChatGPT, the #1 AI app in the world, and Codex, the fastest growing agentic development toolset in the world. Our mission is to ensure the reliability, correctness, and scalability of our online data stack and to curate a comprehensive portfolio of services that matches the relentless ambition of OpenAI, enabling our product and research teams to build 0-100 without getting bogged down in the minutiae of multi-region, multi-cloud, exabyte-scale data infrastructure. About the Role We are seeking an Engineering Manager to lead our Online Data Systems team, responsible for our in-house database and indexing technology. This role is about shepherding a team of world-class engineers tasked with building and operating hyperscale data storage and retrieval technology. You’ll be overseeing the delivery of extremely challenging engineering work in areas like distributed query execution, multi-region federation, self-orchestrating and self-healing services, low-level performance optimization, and more. There are few companies in the world building this kind of technology in-house at this scale where you’ll still be getting in on the ground floor. Instead of being a cog in the machine spending months chasing small optimizations, you’ll play a major part of shaping our future. In this role, you will: Build, lead, and grow high-performing infrastructure engineering teams. Drive the evolution of OpenAI’s in-house online data technologies, our core, hyper-scale database systems, indexing technologies, and vector search. Anchor delivery around measurable reliability goals (SLOs, etc) to ensure system performance and resiliency is above reproach. Champion pragmatic use of agent technology to amplify execution velocity. Reduce operational toil and incident frequency through better abstractions, gua