Senior Data Engineering Technical Lead Jobs

We believe that the way people interact with their finances will drastically improve in the next few years. We’re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with thousands of companies like Venmo, SoFi, several of the Fortune 500, and many of the largest banks to make it easy for people to connect their financial accounts to the apps and services they want to use. Plaid’s network covers 12,000 financial institutions across the US, Canada, UK and Europe. Founded in 2013, the company is headquartered in San Francisco with offices in New York, Washington D.C., London and Amsterdam. Making data-driven decisions is key to Plaid's culture. To support that, we need to scale our data systems while maintaining correct and complete data. We provide golden datasets and tooling to teams across engineering, product, and business and help them explore our data quickly and safely to get the data insights they need, which ultimately helps Plaid serve our customers more effectively. In addition, Plaid will not be successful if we can't move quickly. We build the data systems and tools that enable everyone at Plaid to be data-driven, making analytics easy, obvious, and proactive across the company. Data Engineers heavily leverage SQL and Python to build data workflows that integrate with our Golang applications. We use tools like DBT, Airflow, Redshift, Atlan, and Retool to orchestrate data pipelines and define workflows. We work with engineers, product managers, business intelligence, data analysts, and many other teams to build Plaid's data strategy and a data-first mindset. You will be in a high impact role that will directly enable business leaders to make faster and more informed business judgements based on the datasets you build. You will have the opportunity to carve out the ownershi

The Data Engineering team’s mission is to ensure high-quality data to enable data-informed decision-making across Asana. You will build data artifacts that are leveraged by Product and Business Data Science teams to optimize our user adoption, growth, and experience. In this role, you will partner with the Infrastructure team to build a self-service analytics platform for the company. This role is based in our Vancouver office with an office-centric hybrid schedule. The standard in-office days are Monday, Tuesday, and Thursday; most Asanas have the option to work from home on Wednesdays. Working from home on Fridays depends on the type of work you do and the teams with which you partner. If you're interviewing for this role, your recruiter will share more about the in-office requirements. What you’ll achieve Design, implement, and scale end-to-end data products that support growing data processing and analytical needs Transform raw data into actionable insights to drive product strategy and power in-depth analyses and reporting Leverage AI to build self-serve tools and accelerate Data/GTM workflows Partner with data scientists, domain experts, and engineering teams to develop a roadmap that aligns with our business goals Implement systems that guarantee data quality, governance, and availability About you 5+ years of experience in Data Engineering or Software Engineering Experience in data modeling and building scalable data pipelines involving complex transformations Proficiency in data processing and storage technologies like Databricks, AWS/S3, Python/Scala/Java, SQL, Spark, and Airflow Proactive and innovative in identifying and addressing performance bottlenecks in existing workflows Motivated to work closely with cross-functional partners to evolve our analytical data model Demonstrates curiosity about AI tools and emerging technologies, with a willingness to learn and leverage them to enhance productivity, collaboration, or decision-making At Asana, we're com

We're transforming the grocery industry At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible earnings opportunities to Instacart Personal Shoppers. Instacart has become a lifeline for millions of people, and we’re building the team to help push our shopping cart forward. If you’re ready to do the best work of your life, come join our table. Instacart is a Flex First team There’s no one-size fits all approach to how we do our best work. Our employees have the flexibility to choose where they do their best work—whether it’s from home, an office, or your favorite coffee shop—while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work. Overview Our backend systems power the clients used by millions of customers every year to buy their groceries online. These systems must also support tight integration with the largest retailers in the US and Canada. Engineering at Instacart provides the opportunity to work on challenging scaling problems while also designing the features that will define our industry. You will learn how to build in an open collaborative environment serving millions of requests daily. Finance data engineering is part of the Data Infrastructure team, working closely with accounting, billing & revenue teams to support the monthly/quarterly book close, retailer invoicing and internal/external financial reporting. The team plays a critical role in defining how financial data is modeled and standardized for uniform, reliable, timely and accurate reporting. This is a high impact, hi

We’re building a world of health around every individual — shaping a more connected, convenient and compassionate health experience. At CVS Health®, you’ll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger – helping to simplify health care one person, one family and one community at a time. Position Summary The Senior Data Engineer will be responsible for delivering high quality modern data solutions through collaboration with our engineering, analysts, data scientist, and product teams in a fast-paced, agile environment leveraging cutting-edge technology to reimagine how Healthcare is provided. You will be instrumental in designing, integrating, and implementing solutions on-premise as well supporting migrations of existing workloads to the cloud. The Senior Data Engineer is expected to have extensive knowledge of modern programming languages, designing and developing data solutions. The position is open in a data engineering team that is responsible for processing payer files into our Data Warehouse. Required Qualifications 6&#43; years of experience working with SQL and relational database management systems 3&#43; years of experience in Cloud Data Engineering Platforms such as AWS, GCP, Azure, Databricks, Snowflake etc. 3&#43; years of experience in on-prem Data Engineering Platforms such as Microsoft SQL Server, Oracle, Teradata etc. Programming and modifying code in languages like SQL, Python, and PySpark to support and implement Cloud based and on-prem data warehousing services.</spa

Sigmoid Analytics is a leading Data solutions company backed by Sequoia Capital. We offer best in- end-to-end data value chain spanning across Data Science, Data Engineering and Data Ops. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modelled around expertise and mutual respect with a team first mindset. You’ll work with teams that push the boundaries of what-is-possible and build solutions that energize and inspire. Offices : New York | Dallas | San Francisco | Lima | Bengaluru The below role is for our Bengaluru office. About the Role : You will work on a broad range of cutting-edge data science and machine learning problems across a variety of industries. You will be engaging with clients to understand their business context. If you are passionate to work on complex unstructured business problems that can be solved using data science and machine learning we would like to talk to you. Function : Data Science and Analysis → Data Science / Machine Learning Desired Skills & Competencies: Strong learning acumen Team Management High sense of ownership Ability to work in a fast-paced and deadline-driven environment Loves technology Highly skilled at Data Interpretation Problem solver Good exposure to machine learning concepts and algorithms Must be fluent with any one of Python, R, Java Strong in statistical & machine learning concepts Knowledge of Python Libraries - SciPy, NumPy, Pandas, I Python, Scikit-learn Knowledge of distributed big data processing (PySpark, Jupyter, Linux, AWS) Responsibilities: Hypothesis testing, insights generation, root cause analysis, factor analysis Statistical model (predictive & prescriptive) development using various statistical & machine learning techniques/algorithms Test/train the model, Improve Model accuracy, Monitor model performance Data Extraction from EDW/Big Data Platform, Dataset Preparation (creation of base data, aggregation

We're transforming the grocery industry At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible earnings opportunities to Instacart Personal Shoppers. Instacart has become a lifeline for millions of people, and we’re building the team to help push our shopping cart forward. If you’re ready to do the best work of your life, come join our table. Instacart is a Flex First team There’s no one-size fits all approach to how we do our best work. Our employees have the flexibility to choose where they do their best work—whether it’s from home, an office, or your favorite coffee shop—while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work. Overview Our backend systems power the clients used by millions of customers every year to buy their groceries online. These systems must also support tight integration with the largest retailers in the US and Canada. Engineering at Instacart provides the opportunity to work on challenging scaling problems while also designing the features that will define our industry. You will learn how to build in an open collaborative environment serving millions of requests daily. Finance data engineering is part of the Data Infrastructure team, working closely with accounting, billing & revenue teams to support the monthly/quarterly book close, retailer invoicing and internal/external financial reporting. The team plays a critical role in defining how financial data is modeled and standardized for uniform, reliable, timely and accurate reporting. This is a high impact, hi

Job Title: Senior Data Analyst Role Overview We are looking for a Senior Data Analyst to work on a broad range of data analytics, data visualization, and business intelligence initiatives across multiple industries. The role requires strong analytical skills, frequent client interaction, and the ability to translate business problems into effective analytical and BI solutions while collaborating closely with Data Engineering teams. Key Responsibilities Work on a wide range of data analytics, data visualization, and business intelligence problems across various industries. Engage with clients and business stakeholders to understand business context, objectives, and challenges. Analyze and document business processes, mapping end-to-end workflows using visual formats such as process flow diagrams. Translate business problems into analytical solutions by defining metrics, KPIs, dashboards, and reports. Develop, publish, and maintain interactive dashboards and visualizations to support business decision-making. Perform storyboarding to structure analytical insights and present clear, compelling narratives to stakeholders. Collaborate closely with Data Engineering teams by providing clear and detailed requirements. Ensure data accuracy, consistency, and adherence to best practices in reporting and analytics delivery. Perform quality checks (QC) and validation of reports and dashboards before client delivery. Participate in regular client and internal meetings and prepare clear MoM (Minutes of Meeting) documentation. Maintain proper documentation for dashboards, metrics, data logic, and business rules. Track work items, enhancements, and issues using JIRA . Mandatory Skills & Requirements (Must-Have) Strong hands-on experience with Tableau (mandatory), including: Dashboard development and publishing Calculated fields, filters, parameters, and LOD calculations Data blending and joins Row-Level Security (RLS) implementation Replacing and managing data sources Exp

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Auth0 is an easy-to-implement, authentication and authorization platform designed by developers for developers. We make applications’ login boxes safe, secure, and seamless for anyone logging in. The Auth0 Data Engineering Team Within Auth0, the Data Engineering team builds solutions to support analytics needs for the whole organization and is in charge of the Data Platform. It is divided into 3 groups: Pipeline team , sitting closer to the Platform team and data producers and in charge of the efficient data ingestion and provision of quick access to unmodeled data Warehouse team sitting closer to the business teams and data consumers and in charge of modeling the data in the data warehouse to abstract away the complexity for data consumers, simplifying the organization’s analysis, reporting and decision-making Interface team responsible for creating and managing connections between the data platform and various external systems (internal or external facing), making sure everyone has access to consistent and reliable data The Senior Data Engineer Opportunity Reporting to the manager of the Data Engineering Pipeline team, the senior data engineer will be a key player in ensuring the reliability and efficiency of our core data platform. This role is crucial, providing the stable data foundation that not only 'runs the business' day-to-day but also directly empowers the organization to unlock growth and build innovative new products. We are looking for an auto

At Vanta, our mission is to help businesses earn and prove trust. We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. As a Data Engineer, you’ll be responsible for laying the foundation for a best-in-class analytics function. You’ll partner closely with our engineering team and business stakeholders to ensure that our analytics stack and processes meet the business needs today with an eye towards the future. Visit our Vanta Engineering Blog to learn more about what our team is working on! What you’ll do as a Senior Data Engineer at Vanta: Design and deploy data infrastructure needed to drive data-driven decision-making solutions Design and implement complex data orchestration models, modeling metadata, scaling reporting tools for data science and ML products users Be the company’s expert on data administration, data management and scalable data systems Write highly tuned, scalable SQL queries running over large-scale, heterogeneous data warehouses Work with the Product and Enterprise Engineering system teams to structure source systems for reporting consumption across the enterprise Help maintain CDC pipelines to power customer reporting Help develop front end applications to expose analytical data sets enterprise wide How to be successful in this role: Have at least four years of experience working with data and two years of experience in Software Engineering or a related field. Have experience with common analytics tooling (e.g. Stitch/Fivetran, Snowflake/BigQuery/Redshift, dbt, Airflow, Dagster). Have good working knowledge of AWS data infra systems and Terraform. Bring a system-oriented and software engineering mindset to the Data Engineering practice. We’re looking to build frameworks that manage data, and minimize bespoke queries Deep kn

WPP is the trusted growth partner for the world’s leading brands. We unite cutting-edge media intelligence and data solutions, world-class creativity, next-generation production, transformative enterprise solutions and expert strategic counsel in a single company – powered by exceptional talent and our agentic marketing platform, WPP Open, to help our clients navigate change, capture opportunity and deliver transformational growth. We work with the world's most valuable brands and have global reach across 100+ markets, with deep local expertise. Our people are the key to our success. We're committed to fostering a culture of creativity, belonging and continuous learning, attracting and developing the brightest talent, and providing exciting career opportunities that help our people grow. For more information, visit WPP.com. Why we're hiring: Our organization is embarking on a transformative journey to unify our global data landscape through a new central initiative. We are moving away from fragmented systems to a standardized, cloud-agnostic, and AI-ready data platform built on a modern tech stack: dbt, Databricks, Python (dlt), and GitHub Actions. As a foundational member of our central platform team in Chennai, you will be a hands-on builder responsible for bringing our strategic data blueprint to life. This is a role for an execution-focused engineer who loves building high-quality, governed, and reusable data assets that will be deployed across our global markets and wants to make a tangible impact on a global scale. This role combines data engineering along with an opportunity to enable next-generation AI. What you'll be doing: Develop, test, and deploy robust, scalable, and optimized data transformation pipelines using dbt and SQL on the Databricks platform. Design and maintain scalable dimensional models (SCD1/SCD2), implement advanced partitioning, and ensure high-performance query executio

Overview: We are looking for a Senior Data Engineer with deep expertise in Lakehouse architecture, real-time data streaming, cloud data infrastructure, and microservices development on Azure Kubernetes Service (AKS). You will play a central role in designing and delivering next-generation data pipelines, BI solutions, AI/ML platforms, streaming APIs, and scalable microservices that power Guidepoint's research and analytics products. This is a high-impact, hands-on engineering role. You will work closely with data architects, data scientists, analysts, frontend engineers, QA, and DevOps teams to translate complex business requirements into scalable, reliable, and observable data systems. This is a Hybrid role from our Pune office. What You'll Do: Data Engineering & Lakehouse Design, build, and maintain ETL pipelines, data ingestion workflows, and table schemas on Azure Databricks to support BI, analytics, and AI/ML use cases Architect and optimize the Lakehouse using Delta Lake on Databricks, ensuring reliability, performance, and cost efficiency Build and support data pipelines from business applications such as Salesforce, NetSuite, and other enterprise systems Develop and maintain Knowledge Graph models, entity relationship structures, and NLP-based insight pipelines Maintain data governance, data privacy standards, and compliance best practices throughout the data lifecycle Perform root cause analysis on data and processes to identify opportunities for improvement Collaborate with data architects, scientists, and business consumers to populate and optimize the data warehouse for reporting and analytics Microservices & AKS Development Develop and support scalable web APIs and microservices using Python and Azure Platform Services Build new applications, services, and platforms; optimize existing solutions and refactor legacy components using modern, scalable architec

About the Job: LaunchDarkly is looking for a Data Analyst to join our Data & Analytics team in either India or Ireland. In this role, you will focus on building and scaling reliable data models, automating reporting, and supporting global analytics delivery. You will partner closely with the Senior Data Analyst (Revenue & Metrics), Data Engineering, and business stakeholders to translate business logic into clean, scalable datasets. This role plays a key part in ensuring that defined metrics (e.g., ARR, NRR ) are consistently implemented, automated, and delivered across the organization. Responsibilities: Data Modeling & Transformation Build and maintain scalable data models using modern tools (e.g., Snowflake, dbt). Translate defined business logic (e.g., ARR calculations) into clean and reusable datasets. Metrics Implementation Implement and maintain standardized metrics (e.g., ARR, NRR , churn) in the data layer. Ensure consistency across dashboards and reports. Automation & Pipeline Support Work with Data Engineering to automate data pipelines and reduce manual reporting processes. Dashboarding & Reporting Develop and maintain dashboards that provide consistent and reliable visibility into business performance. Data Quality & Validation Validate data outputs, identify inconsistencies, and support reconciliation efforts across systems (e.g., Salesforce, billing systems). Global Collaboration Partner with teams across the US and EMEA to deliver timely and high-quality analytics outputs. Qualifications: Typically requires a minimum of 5 years of related experience in data analytics, business intelligence, or analytics engineering Strong SQL skills and experience working with structured and large datasets Experience with modern data tools (e.g., Snowflake, dbt, Looker or similar) Experience building and maintaining data models and dashboards Experience implementing business logic into data transformations Strong attention to detail and abilit

SPECIFIC JOB RESPONSIBILITIES Pipeline Management: Maintain high-throughput streaming pipelines to ingest logs from various sources (Firewalls, Cloud, Endpoints) to a central destination. Log Normalization: Write parsers to convert raw, messy logs into standard schemas (e.g., OCSF or ECS) for consistent querying. Cost Optimization: Implement routing logic to send "high-value" data to the SIEM and "bulk" data to low-cost Object Storage (Data Lake). Data Preparation: Clean and structure data to enable AI/ML detection models and advanced analytics. EXPERIENCE REQUIRED Data Engineering: Proficiency in Python (for ETL) and SQL (for complex querying). Streaming Tech: Experience with Message Queues (e.g., Kafka, Pub/Sub) and stream processing concepts. Log Handling: Mastery of Regex and log parsing strategies for standard formats (Syslog, CEF, JSON). Storage Architecture: Understanding of Data Lake principles (Parquet/Avro formats) vs. Data Warehouses. QUALIFICATIONS, SKILLS, & KNOWLEDGE Experience with Vector Databases for storing embeddings. Knowledge of Log Observability/Routing tools (middleware that routes logs). Familiarity with Big Data frameworks (e.g., Spark, Flink). PROFESSIONAL DEVELOPMENT EXPECTATIONS Ability to embrace Clearwater's CLEAR core values (Commitment to Client Success, Lead with Accountability, Integrity & Collaboration, Excellence in All That We Do, Advance Colleague Success, Respect & Transparency) and culture. The base salary range for this role is 35,000- 45,000]. Base salary is part of our total rewards package which also includes the opportunity for merit-based salary increases, eligibility for our 401(k) plan, medical, dental, vision, life and disability insurances and leaves provided in line with your work state. Our robust time-off policy includes flexible paid time off, 11 paid holidays, and paid sick time. Total compensation, including base salary to be offered, will depend on elem

Biohub is the first large-scale initiative bringing frontier AI models, massive compute, and frontier experimental capabilities under one roof. We're building a general-purpose system to accelerate scientific discovery, integrating frontier AI models, biological foundation models, and lab capabilities, with the ultimate goal of curing disease. Our technology powers scientists around the world, translating AI capabilities into tools that accelerate research everywhere. The Team Biohub is a 501(c)(3) biomedical research organization building the first large-scale scientific initiative combining frontier AI with frontier biology to solve disease. We build the technology to help scientists around the world use AI-powered biology to study how cells operate, organize, and work as part of systems to understand why disease happens and how to correct it. With our compute capacity, AI research and engineering, and state-of-the-art technology for measuring, imaging, and programming biology, we are enabling scientists worldwide to use AI-powered biology to advance our understanding of human health. The Opportunity The role is part of the Data Engineering team, which focuses on owning the strategy, sourcing and implementation for data supporting AI research and development. Our goal is to maximize the speed, agility, and capability of biological AI research by connecting public data resources and Biohub's experimental platforms to AI systems. The data that trains biological frontier models comes in dozens of modalities (sequences, images, spatial coordinates, time series, molecular structures, metadata, publication artifacts) each with its own noise characteristics, biases, and information content. The question of how to represent this data for learning is one of the most important open problems in biological AI. As a Senior Staff Data Engineer at Biohub, you'll be designing systems that ingest data from public repositories, transform heterogeneous biological formats into AI-rea

Everpure (NYSE: P) has evolved from storage pioneer to data platform, closing fiscal 2026 with $3.7 billion in revenue, its first billion-dollar quarter, and accelerating growth into FY27. Our strategic agenda spans the companies defining the next era of technology - hyperscalers, AI labs, the AI hardware supply chain, data platform providers, and the broader AI ecosystem. This type of work—work that changes the world—is what the tech industry was founded on. So, if you're ready to seize the endless opportunities and leave your mark, come join us. The Role We are seeking a strategic Senior Analyst - Data & Analytics to champion our people analytics function and shape data-driven talent decisions. This is a high-impact, hands-on role where you will design, build, and deploy AI-augmented analytics products that drive workforce effectiveness and organizational performance. You bring deep HR domain fluency, a flair for compelling data storytelling, and proven experience turning complex workforce data into strategies that senior leaders actually act on. You will be a key partner to HRIS, IT, and global business leaders — sitting at the intersection of data engineering, business insight, and AI-powered tooling. What You'll Do Lead the full lifecycle of people analytics projects — from gathering stakeholder requirements to delivering scalable, validated, and actionable insights that guide business and talent strategy. Design, build, and deploy executive-ready analytics dashboards by leveraging AI and GenAI tools (including Claude) to rapidly prototype and implement custom web-based solutions — delivering intelligent, self-serve analytics experiences without the constraints of traditional BI platforms. Explore, prototype, and deploy AI powered analytics solutions to support workforce planning, attrition prediction, and people insights at scale. Partner with HRIS, IT, and business leaders to drive data integrity, governance, and seamless integration across core HR system