Lead Data Engineer Jobs

Role: Senior Cloud Engineer Location: Hyderabad, India (Hybrid) Department: Product Development About GHX: GHX (Global Healthcare Exchange) is a leading healthcare technology company on a mission to simplify the business of healthcare and improve patient outcomes. Founded in 2000, GHX has built the GHX Global Network — the world’s largest cloud-based supply chain community connecting healthcare providers, suppliers, distributors, and partners to automate key processes, reduce costs, and increase operational efficiency. Its solutions span electronic trading, procurement automation, inventory and contract management, business intelligence, and data synchronization, helping healthcare organizations improve productivity and focus more on patient care. Over the years, GHX has enabled significant cost savings for the industry and continues to innovate with intelligent automation and AI-driven capabilities. Website: https://www.ghx.com/ LinkedIn: https://www.linkedin.com/company/ghx/ About Role: The Senior Cloud Engineer leads the design, implementation, and operations of the organization’s cloud infrastructure. This role is responsible for complex projects, high-level architectural planning, and making strategic technology decisions that support scalability, performance, security, and cost optimization. Acting as a technical leader, the Senior Cloud Engineer provides mentorship to junior and mid-level engineers while driving innovation, resiliency, and compliance in cloud environments. Key Responsibilities: Design and Implementation Lead the design and implementation of cloud-native architectures and hybrid cloud solutions. Oversee cloud engineering projects, ensuring solutions are secure, resilient, and cost-effective. Contribute to high-level architectural planning and strategic decision-making around technology adoption. Review and approve design proposals, Infrastructure as Code (IaC) tem

Agents have changed the game for software delivery and efficacy. Diligent is the leading GRC platform in the world, and we are racing ahead to take the agents show on the road and work with the customers where they work . The FDE function will lead the change on how we embed AI agents into some of the world’s most complex governance, risk and compliance environments. This is not a support or consultancy role. It is a builder role, for someone who is equally comfortable reading a failing agent trace, running a discovery workshop with a bank’s internal audit team, and translating what they find into a production-grade agentic solution. You will be building AI agents for GRC professionals , not assistants that surface suggestions, but agents that own complex, multi-step workflows end to end . Agents that customers can hand a task to and trust it will come back done. Closing the gap between a promising prototype and something a company Board and ELT depends on is a completely . Here’s a breakdown of what you’ll do Embed directly with major enterprise customers (global banks, regulated corporates) across EU and US ; sitting wi th internal audit teams, risk functions, compliance and governance professionals to understand their real workflows and devise agentic solutions to intelligently automate them creating tremendous efficacy and efficiencies for our customers. Run agent-focused discovery workshops, rapidly prototype agentic solutions, and test them with practitioners; distinguishing between workflows that need an agent and those that need a button. Source, integrate, and move data between enterprise systems as part of live customer implementations — understanding the real data landscape customers operate in and building reliable pipelines to support it . Take agents from prototype t

At Scale, we develop reliable AI systems for the world’s most important decisions. Scale’s product marketing team is responsible for developing and executing strategies that drive awareness and engagement for Scale’s offerings amongst our core audiences. We take a data-driven approach to understand our customers’ needs and challenges, ensuring that their voices are reflected in product development and messaging. We partner closely with product, engineering, research, sales, comms, and the broader marketing team to create a cohesive customer experience across all our channels. We aim to provide valuable insights and resources that help our customers execute on their AI transformation journey. This role will focus on developing and optimizing vertical-specific messaging and content for Scale’s applications business to ensure our messaging resonates with core buyers across verticals. The ideal candidate combines strategic thinking with hands-on execution. You will: Develop clear, compelling messaging for enterprise offerings tailored to key personas within target verticals Create marketing assets, including slide decks, videos, blog posts, and one-pagers, that effectively communicate our value propositions to vertical leaders and support our sales team’s pursuits Lead positioning and sales enablement efforts to drive awareness and engagement for Scale’s offerings. Drive cross-functional marketing programs around target verticals, in conjunction with product, engineering, sales, and growth marketing to create a cohesive customer experience and contribute to pipeline targets Collaborate with field marketing and events teams to develop vertical-specific event strategies, content, and experiences that drive engagement within customer and target accounts Drive customer marketing efforts, creating both strategy and tactics to maximize the value Scale and customers get from our shared success, including case studies, testimonials, visual assets and event particip

Scale's LLM post-training platform team builds our internal distributed framework for large language model training. The platform powers MLEs, researchers, data scientists, and operators for fast and automatic training and evaluation of LLMs. It also serves as the underlying training framework for the data quality evaluation pipeline. Scale is uniquely positioned at the heart of the field of AI as an indispensable provider of training and evaluation data and end-to-end solutions for the ML lifecycle. You will work closely with Scale’s ML teams and researchers to build the foundation platform which supports all our ML research and development works. You will be building and optimizing the platform to enable our next generation LLM training, inference and data curation. If you are excited about shaping the future AI via fundamental innovations, we would love to hear from you! You will: Build, profile and optimize our training and inference framework. Collaborate with ML and research teams to accelerate their research and development, and enable them to develop the next generation of models and data curation. Research and integrate state-of-the-art technologies to optimize our ML system. Ideally you’d have: Passionate about system optimization Experience with multi-node LLM training and inference Experience with developing large-scale distributed ML systems Experience with post-training methods like RLHF/RLVR and related algorithms like PPO/GRPO etc. Strong software engineering skills, proficient in frameworks and tools such as CUDA, Pytorch, transformers, flash attention, etc. Strong written and verbal communication skills to operate in a cross functional team environment. Nice to haves: Demonstrated expertise in post-training methods and/or next generation use cases for large language models including instruction tuning, RLHF, tool use, reasoning, agents, and multimodal, etc. Compensation packages at Scale for eligible roles include base salary, equity,

OUR MISSION At Redwood, we empower our customers with lights-out automation for their mission-critical business processes. ABOUT US Redwood Software is the leading orchestration platform for the autonomous enterprise, driving business transformation at the lowest total cost of ownership. Redwood empowers organizations to intelligently automate and orchestrate mission-critical business and IT processes across complex ERP, hybrid cloud, data and emerging agentic AI systems. Through its SaaS-first automation fabric—with AI embedded across the automation lifecycle—Redwood accelerates the path to autonomous operations. Backed by 30 years of experience and trusted by more than 50% of the Fortune 50, Redwood helps organizations unlock human potential to focus on innovation, growth and what’s next. CORE VALUES One Team. One Redwood Make Your Own Weather Obsess over Customer Success Work the Problem Be Curious Own the Outcome Respect Each Other YOUR IMPACT We are looking for a Software Engineer, Platform & Integrations . Working closely with senior and lead engineers, you will design, develop, and maintain high-quality features that power enterprise data exchange for more than 1,000 customers worldwide. This is an incredible opportunity to deepen your expertise in cloud-native architectures, enterprise security, and modern DevOps practices in a fast-growing product environment. Feature Development & Design: Write clean, maintainable, and well-tested code using Java and Spring Boot to deliver scalable backend services and microservices. Platform Reliability: Contribute to enhancing the monitoring, logging, and observability of our core platform to ensure high availability and performance. Security & Compliance: Implement secure coding practices to safeguard data exchange and maintain compliance across our cloud infrastructure. Collaborative Execution: Work within an agile team, collaborating closely with QA, Product, and fellow engineers to deliver high-qual

CLEAR is building THE secure identity company of the future. Our mission is to make experiences safer and easier—physically and digitally. With more than 43 million Members and a growing network of partners across the world, CLEAR's secure identity platform is transforming the way people live, work, and travel. Whether it’s at the airport, stadium, or throughout your everyday life, CLEAR unlocks the magic of frictionless experiences. We are seeking a technical, data-driven Product Management leader to own CLEAR's Marketing Technology platform. This role is responsible for the systems, data, and measurement capabilities that power member acquisition from first touch through enrollment. You will own CLEAR's MarTech ecosystem, including attribution and tracking, audience data infrastructure, CRM and lifecycle marketing platforms, and the integrations that connect marketing signals to actionable insights. Partnering closely with Marketing, Engineering, and Data teams, you'll ensure CLEAR has the tools and intelligence needed to scale growth across paid, organic, and partner channels. What You'll Do: Own the vision, roadmap, and performance of CLEAR's MarTech ecosystem, including CRM, audience activation, tracking, attribution, and marketing data infrastructure. Build best-in-class measurement capabilities across paid, organic, and partner channels, creating a trusted source of truth for acquisition performance. Partner with Marketing to improve audience targeting, lifecycle messaging, SEO/SEM performance, and channel optimization. Drive strategy for audience segmentation, activation, suppression, and first-party data utilization using platforms such as Snowflake and Hightouch. Own the digital enrollment experience, ensuring it is optimized for conversion, personalization, and growth. Define success metrics, manage vendor relationships, and prioritize investments that maximize marketing effectiveness and ROI. What We're Looking For: 8+ years of Product Management experie

About the Team Come help us build and develop tools serving hundreds of engineers internally! We’re looking for a Fullstack Software Engineer to join our Developer Insights team. About the Role Our mission is to improve the developer experience of engineers at DoorDash by building various internal products, including our internal developer portal, Developer Insights. Our success as a platform team depends on the success of the product teams we serve. Because of this, we invest in building a strong community that encourages participation and promotes best practices. You’re excited about this opportunity because you will… Introduce cutting edge technologies to our engineering organization, including tools built on LLMs Build new features for Developer Insights (using Backstage.io) Improve the developer experience for all of our engineers Work and collaborate across team boundaries. Contribute features and bug fixes to upstream open-source projects. Mentor and educate your peers. Lead the team in a technical fashion and assist in roadmap planning and measurement of existing features. Represent the team at large in OKR and engineering all-hands presentations. Context switch from frontend to backend to data depending on the need that arises. We’re excited about you because… You have at least 2 years of experience in web technologies using Typescript with React on the frontend with Java, Kotlin, Python or Go backend experience. You have a product mindset and apply that to how you would build out platform services. You love systems and software, and you're proficient in both. You’re curious and dive deep into different system architectures. You are an organized and excellent written and verbal communicator. You have proficiency in using AI coding tools (e.g., Claude Code, Codex, Cursor) in the full software development lifecycle, including designing, generating code, testing, monitoring and releasing software Compensation The successful candidate’s starti

About the Team The Merchant (Mx) AI/ML team is a cornerstone of DoorDash’s merchant organization. We empower our restaurant partners to thrive on DoorDash by building intelligent, scalable AI systems that simplify operations, elevate their digital presence, and enhance customer engagement. Our world-class machine learning engineers develop production-grade AI solutions that power the entire merchant lifecycle — from onboarding and store setup to menu management, growth, and real-time order operations. The team is deeply customer-obsessed and impact-driven, focused on turning cutting-edge research in LLMs, multimodal learning, generative AI, and agentic automation into products that make our merchants more successful every day. About the Role We’re looking for an Engineering Manager to lead the Mx AI/ML team, driving the design and deployment of next-generation AI product solutions that power our merchant experiences. This is a highly cross-functional leadership role — you’ll collaborate with product, design, operations, and data science teams to define the AI roadmap, guide technical direction, and deliver end-to-end AI/ML solutions at massive scale. You’ll lead a team of talented ML engineers who are building real AI products delivered to merchants’ fingertips, helping them become more successful on DoorDash. You’re excited about this opportunity because you will… Lead and grow a team of exceptional AI/ML engineers developing production-grade machine learning and generative AI solutions for the merchant ecosystem. Define a multi-year strategy and execute the AI roadmap across key Mx pillars — Onboarding, Menu Media Understanding & Generation, Menu Metadata Intelligence, and Agentic Task Automation. Partner with product and operations to translate merchant pain points into scalable AI-powered solutions. Own the end-to-end lifecycle of ML systems — from ideation and experimentation to productionization and continuous improvement. Drive innovation in multimodal AI

About the Team The Consumer Devices team at OpenAI builds end-to-end hardware and software systems that bring AI into the physical world. We work at the intersection of custom silicon, embedded systems, operating systems, cloud services, mechanical engineering, electrical engineering, and product design to deliver reliable, production-ready devices at scale. Within Consumer Devices, Hardware Engineering eXperience, or HEX, is a new bootstrapped team building the environments, applications, compute, product-data systems, and workflows that let hardware engineers do their work without needing to troubleshoot the machinery underneath. HEX owns virtual engineering environments, HPC/GPU compute, storage, networking, licensing, MCAD/ECAD/CAE applications, PLM, product data, automation, validation, and support as one connected system. About the Role As a Staff PLM & Engineering Applications Engineer, you will be one of the first technical builders of HEX and the primary counterpart to the HEX lead. You will own the engineering-application and product-data side of the hardware engineering experience, with an initial focus on NX, Teamcenter, licensing, parts import, integrations, packaging, validation, and user workflows. This is not a traditional Teamcenter administration role and not a Corporate IT application-support role. You will take complex, fragile workflows and turn them into reliable engineering systems. This role is highly hands-on and systems-oriented. You will not inherit a mature environment and support queue. You will help build a fresh one, replacing manual setup guides, tribal knowledge, repeated support issues, and team handoffs with tested automation and reliable workflows. In This Role, You Will Own the technical architecture, deployment, configuration, integration, validation, and long-term operation of NX and Teamcenter. Build reliable workflows for parts import, product-data migration, metadata quality, BOMs, revisions, lifecycle states, and releas

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. With a billion rides per year and counting, Lyft is solving hard problems in a rapidly growing domain with a lot of data and creative solutions in Rider, Driver, Marketplace, and beyond. While traditional approaches to optimization and problem decomposition are sufficient to disrupt transportation, building a next-generation platform for low-cost, ultra-immersive transportation to improve people's lives warrants modern ML utilizing petabyte-scale data. Our highly motivated Machine Learning Engineers work on these challenging problems and define solutions to directly impact various aspects of our core business. The Fulfillment group, within the Marketplace at Lyft, is responsible for determining what inventory can be reliably offered for a given rider session and fulfilling rider requests. The group comprises several sub-teams that generate feasible offers for riders, match rider requests with drivers, and maintain a distributed state machine to track rides and drivers from request through completion. We are seeking a Machine Learning Engineer to join the Fulfillment team and lead the design, development, and deployment of state-of-the-art machine learning systems. This role requires a strategic thinker who can balance high-level system architecture with hands-on technical implementation. You will collaborate across teams to shape the future of ride-sharing by leveraging machine learning and data science. Responsibilities: Design, build, and deploy machine learning models for real-time applications, including translating state-of-the-art research into production-ready solutions Design and implement feature pipelines, model training workflows, and serving infrastructure using Lyft's ML platform Evaluate ML system performance against business KPIs, run experiments, and drive continuous model improvement

At Vanta, our mission is to help businesses earn and prove trust. We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. Vanta's App Primitives team owns the shared building blocks that span data structures to UI: comments, notifications, event logs, feature flags, and task management. We own the general infrastructure; product teams own the logic built on top. Getting this layer right unlocks velocity for every team at Vanta. As the Engineering Manager, App Primitives at Vanta, you'll lead the team building the shared product primitives that every Vanta product team depends on, owning the infrastructure layer that makes collaboration, communication, and core workflows possible across the entire platform. Our Engineering Managers develop and grow high-performing teams that deliver significant value to our customers and enable our business to scale. This role sits at the intersection of technical architecture and team development, with real authority to set direction and grow a world-class platform team. Visit our Vanta Engineering Blog to learn more about what our team is working on! What you’ll do as an Engineering Manager at Vanta: Lead and grow the App Primitives team, owning hiring, team health, delivery, and the development of senior engineers and technical leads Own the strategy and roadmap for Vanta's shared product primitives: comments infrastructure, notifications platform, event log, feature flag system (Statsig), and task management Define and steward the interface model between App Primitives systems and product teams, ensuring product teams can build on top of shared infrastructure quickly and safely, without owning the underlying systems themselves Partner closely with product engineering leaders across Vanta to surface developer ne

At Vanta, our mission is to help businesses earn and prove trust. We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. Vanta's App Primitives team owns the shared building blocks that span data structures to UI: comments, notifications, event logs, feature flags, and task management. We own the general infrastructure; product teams own the logic built on top. Getting this layer right unlocks velocity for every team at Vanta. As the Engineering Manager, App Primitives at Vanta, you'll lead the team building the shared product primitives that every Vanta product team depends on, owning the infrastructure layer that makes collaboration, communication, and core workflows possible across the entire platform. Our Engineering Managers develop and grow high-performing teams that deliver significant value to our customers and enable our business to scale. This role sits at the intersection of technical architecture and team development, with real authority to set direction and grow a world-class platform team. Visit our Vanta Engineering Blog to learn more about what our team is working on! What you’ll do as an Engineering Manager at Vanta: Lead and grow the App Primitives team, owning hiring, team health, delivery, and the development of senior engineers and technical leads Own the strategy and roadmap for Vanta's shared product primitives: comments infrastructure, notifications platform, event log, feature flag system (Statsig), and task management Define and steward the interface model between App Primitives systems and product teams, ensuring product teams can build on top of shared infrastructure quickly and safely, without owning the underlying systems themselves Partner closely with product engineering leaders across Vanta to surface developer ne

Who We Are At Justworks, you’ll enjoy a welcoming and casual environment, great benefits, wellness program offerings, company retreats, and the ability to interact with and learn from leaders in the startup community. We work hard and care about our most prized asset - our people. We’re helping businesses get off the ground by enabling them to focus on running their business. We solve HR issues. We’re data-driven and never stop iterating. If you’d like to work in a supportive, entrepreneurial environment, are interested in building something meaningful and having fun while doing it, we’d love to hear from you. We're united by shared goals and shared motivations at Justworks. These are best summed up in our company values, which are reflected in our product and in our team. Our Values If this sounds like you, you’ll fit right in. Who You Are As a Senior IT Systems Engineer, you possess extensive expertise in entrepreneurial, startup, or enterprise settings. You provide top-tier, "white-glove" support for stakeholders tailored to their specific needs. You excel in researching technical problems and solutions with a high level of professionalism. In this role, you take charge of the technical design, planning, implementation, and performance tuning for critical enterprise application systems. While you are the primary architect and owner for our core collaboration stack, you are a versatile engineer capable of managing a broad and diverse ecosystem of tools. You lead by example as a technical expert and serve as a mentor to junior systems engineers. Your Success Profile What You Will Work On Core Platform Architecture : Act as the primary architect and administrator for our core enterprise platforms: Atlassian suite (Jira & Confluence), Google Workspace, and Slack. SaaS and AI Enablement : Lead the technical strategy for enterprise-wide SaaS adoption and optimization. You will drive the roadmap for enabling AI-native capabilities across our ecosystem (e.g., Slack A

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career. About the team The Storage Abstractions (STAX) team builds the software layer through which Stripe services access stored data. We own the database SDKs that hundreds of Ruby and Java services use to read and write data safely, reliably, and efficiently without needing to understand the underlying database, routing, or operational complexity. Our work creates leverage across Stripe: by providing stable interfaces and safeguards at the storage layer, we help teams build products with confidence while enabling Stripe’s data architecture to evolve. Alongside engineers, we are designing for AI agents as customers of this foundation, making storage capabilities discoverable, interoperable, and safe to use across languages and storage backends. What you’ll do As a Staff Software Engineer on STAX, you will set technical direction and lead multi-year initiatives at the intersection of developer infrastructure, data access, and AI. You will work hands-on with engineers across Stripe to make storage access simpler, safer, and more interoperable, while helping product and infrastructure teams evolve their systems without fleet-wide migrations. You will help turn Stripe’s AI strategy into practical developer infrastructure by treating AI agents as customers of the storage layer. This is an opportunity to build frameworks and interfaces that make complex storage operations discoverable, interoperable, and safe for both human developers and agentic workflows, while rais

About the Team The Core Services organization builds and runs the mission-critical online services that product teams rely on in production. We own foundational distributed systems and platform capabilities that enable reliable execution, high-performance services, and large-scale file/data needs across our products. This team is distinct from developer infrastructure and data infrastructure—our focus is production service foundations and core runtime services. About the Role We’re hiring an Engineering Manager, Core Services to help lead teams responsible for highly reliable, high-scale distributed systems that sit on the critical path for OpenAI products. Your team will own foundational production systems that OpenAI’s product engineering teams build on. You’ll collaborate closely with product and infrastructure partners to ship reliable services quickly, and help scale systems and teams as OpenAI grows. You’ll partner closely with senior engineering leaders to scale the org, mature operations, and drive major platform initiatives. This role requires strong technical ability. You’ll be responsible for: Managing and growing a high-performing team of infrastructure engineers. Leading teams building and operating large, critical production platforms, including cluster reliability, scaling, and rollout safety. Building and operating mission-critical distributed systems with strong operational rigor (SLOs, incident response, capacity planning, reliability). Setting technical direction for platform foundations such as workflow/orchestration capabilities, large-scale file/blob/storage services, and core service foundations. Partnering with a broad set of stakeholders, including product engineering, adjacent infrastructure teams, and (where relevant) finance/cost partners. Coaching, mentoring, and developing engineers and emerging leaders. You might thrive in this role if you: Have significant experience leading teams that run mission-critical infrastructure in production