Lead Data Engineering Manager Jobs

Data Engineering – Technical Lead About Us: Paytm is India’s leading digital payments and financial services company, which is focused on driving consumers and merchants to its platform by offering them a variety of payment use cases. To merchants, Paytm offers acquiring devices like Soundbox, EDC, QR and Payment Gateway where payment aggregation is done through PPI and also other banks’ financial instruments. To further enhance merchants’ business, Paytm offers merchants commerce services through advertising and Paytm Mini app store. Operating on this platform leverage, the company then offers credit services such as merchant loans, personal loans and BNPL, sourced by its financial partners. About the Role: This position requires someone to work on complex technical projects and closely work with peers in an innovative and fast-paced environment. For this role, we require someone with a strong product design sense & specialized in Hadoop and Spark technologies. Requirements: 4 to 8 years of experience in Big Data technologies. The position Grow our analytics capabilities with faster, more reliable tools, handling petabytes of data every day. Brainstorm and create new platforms that can help in our quest to make available to cluster users in all shapes and forms, with low latency and horizontal scalability. Make changes to our diagnosing any problems across the entire technical stack. Design and develop a real-time events pipeline for Data ingestion for real-time dash- boarding.Develop complex and efficient functions to transform raw data sources into powerful, reliable components of our data lake. Design & implement new components and various emerging technologies in Hadoop Eco- System, and successful execution of various projects. Be a brand ambassador for Paytm – Stay Hungry, Stay Humble, Stay Relevant! Skills that will help you succeed in this role: Fluent with Strong hands-on experience with Hadoop, MapReduce, Hive, Spark, PySpark etc.Excellent progr

Who We Are Notion is the collaborative AI workspace where teams and agents think together . We're building one place where your knowledge, projects, meetings, and AI tools live side by side, so work is faster, clearer, and less fragmented. Millions of individuals, small teams, and large companies run their work on Notion. Notinos (our employees) are customer zero in bringing this future of work to life. We care about craft, building things that last, and the belief that great work is still fundamentally human. Our goal isn’t to ship the next feature. Each and every team of Notinos is working to set the standard for how humans work together in the AI era. From building a business’s system of record to making and managing AI agents to automating away the busy work, we care deeply about giving our customers more time for their life’s work. About the Role: Notion’s Data Foundations team builds and operates the batch and streaming infrastructure behind our product features, analytics, search, and AI experiences. We’re looking for a hands-on technical leader to shape the next generation of this platform as Notion serves larger customers, expands globally, and supports more data-intensive products. You’ll identify the highest-leverage problems, set direction, build and develop a high-performing team, and lead multi-quarter initiatives across our data lake, streaming, distributed-compute, governance, and reliability systems. You’ll stay close to critical technical decisions while creating clear ownership, growing engineers and technical leaders, and helping the team execute as one—partnering closely with Data Engineering, Data Product, Search, AI, Infrastructure, and Security. This role can be based in either San Francisco or New York City. We work from our offices on Mondays, Tuesdays and Thursdays (our Anchor Days) because we do our best thinking and building together in person. We’re looking for someone who’s excited to work alongside the team during those days. What You

Data & AI Lead will enable data driven decision making, advanced analytics, and AI led value creation across the organization by transforming raw data into trusted insights, predictive intelligence, and scalable AI solutions. The primary purpose of this role is to design, build, deploy, and govern data platforms, analytics, machine learning, computer vision, operations research and generative AI capabilities that directly support business strategy, operational excellence, and innovation. By working closely with business leaders, Business Technology, Software Engineering, Architecture, IT, and Cybersecurity teams, Data & AI role translate business problems into analytical and AI use cases, develop scalable and responsible AI solutions, and ensure adoption through explainability, trust, and governance. This role plays a critical role in institutionalizing data driven culture, embedding AI into core processes, and enabling faster, better, and more consistent decisions at scale. Source: Adani Group | Job ID: 52726

About the Team OpenAI’s Financial Engineering (FinEng) team powers how revenue flows through our products—pricing & packaging, checkout, payments, subscriptions, and the financial infrastructure behind them. We partner with Product, Engineering, Risk, Finance, and Go-to-Market to make paying for OpenAI products seamless, reliable, and efficient worldwide. About the Role As a Data Scientist on FinEng, you’ll own the analytics and experimentation that improve our checkout and payments , subscriptions , and pricing & monetization systems. You’ll define the metrics that matter, build the source-of-truth data assets, and design experiments that increase conversion, reduce churn and payment failures, and expand global payment method coverage. Your work will directly influence revenue, customer experience, and how we scale internationally. This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees. In this role, you will Own checkout & payments analytics and experimentation across methods and locales (e.g., bank transfers, emerging rails), improving conversion while monitoring risk and latency. Build and run the experimentation program for in-house checkout—define success metrics and guardrails, execute staged rollouts, and use offline incrementality when online tests aren’t feasible. Create operational visibility and source-of-truth data with FinEng Data Engineering—land team-level metrics, SLAs, and self-serve dashboards that drive proactive action. Lead subscription, retention, and monetization analytics—ship launch-readiness for new subscription features, reduce involuntary churn (e.g., targeted retrials/nudges), and develop elasticity/FX frameworks toward pricing optimality. You might thrive in this role if you have 5+ years in a quantitative role (data science, product analytics, or experimentation) in high-growth or fintech environments Fluency in SQL and Python ,

InMobi Advertising is a global technology leader helping marketers win the moments that matter. Our advertising platform reaches over 2 billion people across 150+ countries and turns real-time context into business outcomes, delivering results grounded in privacy-first principles. Trusted by 30,000+ brands and leading publishers, InMobi is where intelligence, creativity, and accountability converge. By combining lock screens, apps, TVs, and the open web with AI and machine learning, we deliver receptive attention, precise personalization, and measurable impact. Through Glance AI, we are shaping AI Commerce, reimagining the future of e-commerce with inspiration-led discovery and shopping. Designed to seamlessly integrate into everyday consumer technology, Glance AI transforms every screen into a gateway for instant, personal, and joyful discovery. Spanning diverse categories such as fashion, beauty, travel, accessories, home décor, pets, and beyond, Glance AI delivers deeply personalized shopping experiences. With rich first-party data and unparalleled consumer access, it harnesses InMobi’s global scale, insights, and targeting capabilities to create high impact, performance driven shopping journeys for brands worldwide. Recognized as a Great Place to Work, and by MIT Technology Review, Fast Company’s Top 10 Innovators, and more, InMobi is a workplace where bold ideas create global impact. Backed by investors including SoftBank, Kleiner Perkins, and Sherpalo Ventures, InMobi has offices across San Mateo, New York, London, Singapore, Tokyo, Seoul, Jakarta, Bengaluru and beyond. At InMobi Advertising , you’ll have the opportunity to shape how billions of users connect with content, commerce, and brands worldwide. To learn more, visit www.inmobi.com Role Overview: We are hiring a Tech Lead / SDE IV to anchor and grow our Data Engineering capability within our Demand-Side Platform (DSP). This is a high-impact, technically hands-on leadership

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible. At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI. Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here . Millions of people across the world come to Pinterest to find new ideas every day. It’s where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. We are looking for a Director of Engineering to lead the strategic vision and execution for Pinterest’s core and ads serving platforms, overseeing the infrastructure that enables high-scale, low-latency delivery of content and ads across all Pinterest surfaces. They will define the multi-year architecture to ensure our serving systems are reliable, performant, and cost-efficient while enabling rapid innovation for product and ML teams. What you’ll do: Set the long-term technical and operational vision for the Core and Ads Serving Platform, aligning infrastructure investme

Replit is the agentic software creation platform that enables anyone to build applications using natural language. With millions of users worldwide, Replit is democratizing software development by removing traditional barriers to application creation. About the Role We're looking for an AI-native product growth lead to own Replit's entire paid acquisition and lifecycle marketing engine as the single DRI. This is an IC role for someone who builds systems, not just campaigns. Someone who uses AI and automation aggressively to do what traditionally requires an entire team. You don't need an engineering background. You need the instinct to build: when you see a repetitive task, you reach for Replit or an API before you reach for a spreadsheet. You'll have data science and data engineering partners for infrastructure and modeling, and brand marketing will set creative direction. Your job is to turn that direction into a closed-loop optimization system: a self-improving system that turns performance data into better creative, optimizes spend across channels in near-real-time, and compounds every insight so nothing learned is ever lost. Each cycle, the system gets smarter. That's the engine you'll build and own. The ideal candidate has deep channel expertise across paid search, paid social, and lifecycle, but their real edge is building AI-powered workflows that scale creative production, automate measurement, and compound institutional knowledge. You Will Own full-funnel performance marketing across paid search & social, ASO, and lifecycle Build a self-improving creative engine: AI-driven ad generation, testing, and iteration that scales without scaling headcount Maintain a persistent knowledge layer so every experiment, result, and creative insight compounds automatically into the next cycle Own conversion signal quality end-to-end: right events, right audiences, right attribution, partnering with DE on the infrastructure Run a structured experimentation program wher

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible. At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI. Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here . Pinterest is seeking a Staff Software Engineer, Capacity Engineering. The team is responsible for efficiently managing one of the largest-scale cloud-native infrastructures in the world. This role is highly impactful, as efficiency is an ongoing strategic priority for Pinterest. The role has direct visibility across Pinterest Engineering and with Engineering and company leadership. The team is looking for a candidate with a strong background in implementing performance and efficiency projects on large scale distributed systems. In this individual-contributor role you will own and drive performance and efficiency for a core area of Capacity Engineering, partnering with the company-wide efficiency lead and collaborating with performance and efficiency leaders across the organization. What you’ll do: Drive efficiency in large-scale shared environme

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. As a Data Center Engineer , you'll help us scale our Core/Edge Data Centers and hardware infrastructure at a time of incredible growth for our business. At Roblox, you'll have boundless opportunities to shape the future of the Imagination Platform™ and demonstrate your passion for delivering thoughtful solutions in front of a global audience. If you know what it takes to build and operate hardware infrastructure that can sustain millions of concurrent players year-round and you take play as seriously as we do, you'll fit right into our highly experienced and ever-expanding engineering team. You will report to the Technical Lead Data Center Engineer. You will: Develop and maintain the Core/Edge Data Center and hardware infrastructure to meet the large scale and real-time requirements of our Imagination Platform™ to ensure our community has an awesome experience anywhere in the world. This includes all aspects of the server, network infrastructure, power, and environmental life cycles. Own efforts to track and mitigate systemic issues preventing hosts from returning to service. Identify and solve critical problems and prevent them from re-occurring via root cause analysis and giving rec

To lead the enterprise data architecture and data platform engineering initiatives for Adani Airport Holdings Limited, driving the digital transformation of airport operations. This role focuses on designing highly available, secure, and scalable data analytics platforms leveraging Databricks on Microsoft Azure cloud to enable real-time situation awareness, data-driven decision-making, optimize passenger flow, and support the strategic growth of AAHL’s aviation ecosystem. Source: Adani Group | Job ID: 53636

At ClickUp, we're building the future of work: the first truly converged AI workspace unifying tasks, docs, chat, calendar, and enterprise search, all supercharged by context-driven AI. We are an AI-native company. Every team member is expected to leverage AI daily, and we evaluate AI fluency as part of our hiring process. Join us and help redefine what's possible. 🚀 We're looking for a Staff Data Engineer to own the architecture and technical vision of our data platform. This is a high-leverage, high-autonomy role where you'll set the technical bar for the team, drive cross-functional alignment on data infrastructure strategy, and solve our hardest engineering problems. You'll operate across AWS serverless technologies, Snowflake, dbt, and Terraform, but your impact goes well beyond any single tool: you'll shape how we think about reliability, scalability, cost, and developer experience at the platform level. This role is for someone who doesn't just build great systems, but makes the engineers around them better. The Role: Own the technical architecture of ClickUp's data platform, making design decisions that balance scalability, cost, reliability, and velocity. Define and drive the technical roadmap for data infrastructure in partnership with leadership. Design systems at scale : build frameworks, abstractions, and patterns that other engineers use daily. Lead complex, cross-team technical initiatives spanning data engineering, analytics engineering, data science, and data analytics. Drive cost optimization across cloud infrastructure and compute, turning efficiency into a competitive advantage. Build and evolve our data pipelines using AWS serverless (Lambda, Fargate, Step Functions, Kinesis, S3, DynamoDB, Aurora), Snowflake, and dbt. Establish and champion engineering standards : observability, testing, CI/CD, code review, and documentation practices. Design and maintain infrastructure for AI/ML workloads , including LLM frameworks, feature pipelines, training

Principal Data Privacy Architect Description - Job Summary - Role Purpose • Lead and oversee complex, cross-functional privacy and data protection programs from strategy through implementation, ensuring alignment across business, technical, legal, and compliance stakeholders. • This role will design and implement scalable, AI-ready data privacy architecture across enterprise data environments, applications, and AI-enabled workflows. • The Principal Data Privacy Architect will serve as a hands-on subject matter expert responsible for embedding privacy-by-design, consent enforcement, data sovereignty, data loss prevention, and compliance controls into large, complex global data environments. • The architect will partner closely with Data Engineering, Cybersecurity, Legal, Privacy, AI Governance, Product, and Enterprise Architecture teams to ensure customer, employee, partner, and sensitive enterprise data is accessed, processed, shared, retained, and protected in a compliant, secure, and trustworthy manner. - Why This Role Matters • Architect for Trust & Scale: Build reusable privacy architecture patterns that enable secure, compliant, and scalable data usage across platforms, products, and regions. • Enable Responsible AI: Design privacy guardrails for AI agents, generative AI, RAG pipelines, model inputs and outputs, embeddings, vector stores, and automated data workflows. • Reduce Risk While Enabling Innovation: Translate privacy, consent, regulatory, and data sovereignty obligations into practical engineering controls that accelerate business outcomes. Responsibilities - Think Customer First • Embed customer trust, transparency, and privacy-by-design principles into enterprise data platforms and customer-facing applications. • Design consent-aware data access and usage p

Become a part of our caring community Humana is seeking a Lead Cloud Architect – NoSQL Databases to provide strategic leadership, architecture direction, and engineering oversight for enterprise NoSQL database platforms across Humana’s cloud environments. This role will focus on the design, implementation, modernization, and governance of NoSQL database solutions, including MongoDB, Azure Cosmos DB, Neo4j, and vector database technologies. The successful candidate will help define and advance Humana's enterprise NoSQL strategy, support platform rationalization initiatives, and ensure database solutions are secure, scalable, resilient, automated, and aligned with enterprise architecture standards. This role requires hands-on technical depth, strong cloud architecture experience, and the ability to collaborate across security, engineering, quality, application, and business teams. Key Responsibilities Develop, document, and maintain enterprise-wide NoSQL database standards, reference architectures, design patterns, and best practices. Lead architecture and engineering efforts for NoSQL platforms including MongoDB, Azure Cosmos DB, Neo4j, and vector databases. Support NoSQL platform rationalization and modernization initiatives, including migration planning and execution from Cosmos DB to MongoDB where appropriate. Architect secure, highly available, scalable, and performant NoSQL database solutions across cloud environments, including Azure and/or Google Cloud Platform. Define database architecture patterns for document databases, graph databases, key-value workloads, and vector search use cases. Guide application teams on NoSQL data modeling, partitioning, indexing, query patterns, performance optimization, and operational readiness. Oversee automation of NoSQL provisioning, configuration, monit

Data Engineer-6336 itD is seeking an experienced Data Engineer to build and modify high-complexity data pipelines, monitoring, and alerting systems supporting a legal-focused infrastructure team. The ideal candidate will bring deep expertise in SQL, Python, ETL/data pipelines, and data warehousing , along with a proven track record of leading complex, cross-functional data engineering initiatives from planning through delivery. Location: Remote, with preference for candidates based in California and ideally the Bay Area. Candidates open to occasional onsite work in San Francisco should indicate this in their skills matrix. Contract: 3Months Pay Rate: depending on experience and market rate. We provide comprehensive medical benefits, a 401k plan, paid holidays, and more. Please note that we are only considering direct W2 candidates at this time, as we are unable to offer sponsorship. Responsibilities Build and modify high-complexity ETL and data pipelines to efficiently extract, transform, and process data from large-scale datasets. Develop and maintain monitoring and alerting systems that proactively identify data, infrastructure, and workflow issues. Design data warehousing solutions and optimize queries and pipelines for large-scale data processing. Collaborate with attorneys, data scientists, engineers, and other technical and non-technical stakeholders to understand data requirements, sources, dependencies, and timelines. Lead end-to-end data engineering initiatives across cross-functional teams, including planning, documentation, stakeholder coordination, system design, and execution. Identify potential data and system issues early and implement solutions that improve reliability, efficiency, and operational visibility. Communicate technical concepts and project status clearly and concisely to both technical and non-technical audiences. Internal Responsibilities Attend regular internal practice community meetings. Collaborate with your itD practice team on indu

About the Role OpenAI's ads platform is experiencing rapid global scale. As the Lead Data Scientist for SMB Ads Growth, you will architect the analytics function end-to-end—driving strategy across targeting, funnel optimization, and performance forecasting. You will work directly with the SMB Ads Marketing team and your insights will be the primary catalyst for high-stakes decisions across marketing, product, and sales engineering. What You'll Do Full-Funnel Analytics Establish the foundational growth metrics and North Star KPIs for the SMB Ads ecosystem, optimizing the journey from lead acquisition to long-term retention. Diagnose funnel friction points through advanced behavioral analysis and quantify the incremental revenue impact of proposed optimizations. Partner cross-functionally to transform complex data findings into actionable, high-priority roadmaps for product and marketing stakeholders. Targeting, Segmentation & Propensity Modeling Engineer sophisticated propensity models and look-alike frameworks to identify and capture high-LTV SMB advertisers. Own the lifecycle of target list construction, including advanced data enrichment, multi-dimensional prioritization, and granular performance tracking. Develop robust segmentation architectures that power hyper-personalized outreach across paid, partnership, and outsourced (BPO) channels. Synthesize market signals to refine our value proposition, ensuring OpenAI remains a key platform for SMB business growth. Campaign Analytics & Measurement Design and implement rigorous multi-touch attribution and incrementality frameworks to evaluate channel efficacy. Lead the experimental roadmap: formulate hypotheses, execute A/B and multivariate tests, and communicate results to executive leadership. Automate business-critical reporting and dashboards to provide real-time visibility during weekly operating reviews. Forecasting & Planning Build high-fidelity revenue and advertiser growth models to project perfor