Senior Data Engineer (Databricks)

Senior Azure Data Engineer ( Databricks ) Location: London (Hybrid) | Practice Area: Technology & Engineering | Type: Permanent Engineer advanced data solutions at scale in a world-class consulting environment. The Role As a Senior Azure Data Engineer ( Databricks ) at Capco, you will play a hands-on role in designing, building, and deploying scalable and secure data engineering pipelines using the Databricks platform on Azure . You'll partner with clients to understand their data needs and develop innovative solutions that drive business transformation. You'll also contribute to engineering best practices and continuous improvement across cross-functional teams. Databricks platform on Azure . You'll embrace AI-enabled ways of working, using approved AI and automation tools where appropriate to improve engineering productivity, accelerate delivery, and enhance solution quality while applying sound engineering judgement and responsible AI practices. What You'll Do Design and develop robust data pipelines using Delta Lake, Spark Structured Streaming, Unity Catalog, and Azure -native services. Build real-time, event-driven solutions using technologies such as Kafka and Azure Event Hubs, applying AI-enabled engineering approaches where appropriate to improve delivery efficiency. Develop and maintain CI/CD pipelines using Azure DevOps, Jenkins, GitHub Actions, and modern DevOps practices to support reliable deployments. Collaborate with clients and multidisciplinary teams to translate business requirements into scalable, production-ready data solutions. Champion clean code, data lifecycle optimisation, engineering best practices, and the responsible use of approved AI tools and automation to improve collaboration and delivery. What We're Looking For Proven hands-on experience with the Databricks platform, including orchestration and enterprise-scale Azure data engineering solutions. Strong technical skills in Python , PySpark , and SQL, with experience wor

WPP is the trusted growth partner for the world’s leading brands. We unite cutting-edge media intelligence and data solutions, world-class creativity, next-generation production, transformative enterprise solutions and expert strategic counsel in a single company – powered by exceptional talent and our agentic marketing platform, WPP Open, to help our clients navigate change, capture opportunity and deliver transformational growth. We work with the world's most valuable brands and have global reach across 100+ markets, with deep local expertise. Our people are the key to our success. We're committed to fostering a culture of creativity, belonging and continuous learning, attracting and developing the brightest talent, and providing exciting career opportunities that help our people grow. For more information, visit WPP.com. Why we're hiring: We are seeking a highly skilled and experienced Senior Data Engineer to join our growing data team. In this critical role, you will be instrumental in designing, building, and optimizing our scalable data lakehouse platform using Google BigQuery or Databricks. You will be a key player in developing robust data pipelines that ingest data from various sources, including Google Analytics 4 (GA4), and transform it into reliable, analysis-ready datasets within the lakehouse environment. This role requires deep expertise in modern lakehouse platforms – Google BigQuery and/or Databricks – together with strong skills in SQL, Python, and Apache Spark (PySpark), along with strong hands-on experience across Azure, AWS, and GCP cloud environments, as our data ecosystem spans multiple cloud platforms. You will be responsible for the entire data lifecycle within the lakehouse, from ingestion and transformation to governance and optimization, ensuring data quality and performance. You should be adept at analyzing performance bottlenecks in Spark jobs and BigQuery workloads, providing enhancement re

About the Role: As a Senior Data Engineer at Tubi, you'll be instrumental in developing and maintaining robust data processing pipelines that underpin our reporting, analytics, and performance insights. You'll operate as an embedded data engineer within a specific data product vertical, shaping the culture, best practices, and overall approach to data engineering within the team. Our diverse product verticals, such as Viewer Growth, Ad Product Sales, and Marketing Analytics, are all highly data-driven. In this role, you will also be responsible for supporting Tubi’s Growth vertical with the creation and curation of CRM and Growth related pipelines, datasets, and scripting in the Databricks environment and leveraging the Braze CRM platform. Additionally tasks related to general pipeline creation, SQL optimization, data-related automation,, and contributing to the strategic direction of data engineering for the Growth organization. Each product team presents unique big data challenges, requiring you to be adaptable, curious, and possess a strong foundation in big data and engineering principles. Your responsibilities will span from constructing efficient pipelines and facilitating data access for data scientists and analysts, to building specialized data products that empower non-engineering teams with deeper insights into their datasets. This is a hybrid role based out of our Toronto office. You must be willing to travel to our Toronto office two days/week. What You'll Do: Be the primary owner of the data needs of a specific product vertical. That means everything from raw-data ingestion to end-user analysis. Build intuitive, easy-to-use, and high quality datasets using Spark and DBT Track down data quality issues when they arise, and then set appropriate data quality monitors and alerts to help prevent future incidents Participate in the occasional on-call rotation (12-hr day time shifts, ~1-2/month) Understand your product vertical's datase

We’re building a world of health around every individual — shaping a more connected, convenient and compassionate health experience. At CVS Health®, you’ll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger – helping to simplify health care one person, one family and one community at a time. Position Summary The Senior Data Engineer will be responsible for delivering high quality modern data solutions through collaboration with our engineering, analysts, data scientist, and product teams in a fast-paced, agile environment leveraging cutting-edge technology to reimagine how Healthcare is provided. You will be instrumental in designing, integrating, and implementing solutions on-premise as well supporting migrations of existing workloads to the cloud. The Senior Data Engineer is expected to have extensive knowledge of modern programming languages, designing and developing data solutions. The position is open in a data engineering team that is responsible for processing payer files into our Data Warehouse. Required Qualifications 6&#43; years of experience working with SQL and relational database management systems 3&#43; years of experience in Cloud Data Engineering Platforms such as AWS, GCP, Azure, Databricks, Snowflake etc. 3&#43; years of experience in on-prem Data Engineering Platforms such as Microsoft SQL Server, Oracle, Teradata etc. Programming and modifying code in languages like SQL, Python, and PySpark to support and implement Cloud based and on-prem data warehousing services.</spa

We’re building a world of health around every individual — shaping a more connected, convenient and compassionate health experience. At CVS Health®, you’ll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger – helping to simplify health care one person, one family and one community at a time. POSITION SUMMARY CVS Health is seeking a highly skilled Senior Data Engineer, Observability Engineering to join the Enterprise Observability Platform organization and help advance the next generation of observability, infrastructure, and security data capabilities. The Senior Data Engineer, Observability Engineering will play a critical role in designing, building, and operating scalable data pipelines and data products that power enterprise observability, operational intelligence, and security analytics across the organization. The Senior Data Engineer, Observability Engineering is a senior individual contributor responsible for developing and optimizing Databricks-based data engineering solutions that ingest, transform, govern, and deliver high-volume telemetry, infrastructure, application, and security data. This role combines deep hands-on technical execution with ownership of engineering excellence, operational reliability, performance optimization, and data platform best practices. Working closely with Observability Engineering, Security Engineering, Infrastructure Engineering, and Data Platform teams, the Senior Data Engineer, Observability Engineering will contribute to the evolution of the enterprise observability lakehouse by building resilient ingestion frameworks, establishing data quality standards, enhancing governance controls, and driving efficient, scalable data processing patter

WPP is the trusted growth partner for the world’s leading brands. We unite cutting-edge media intelligence and data solutions, world-class creativity, next-generation production, transformative enterprise solutions and expert strategic counsel in a single company – powered by exceptional talent and our agentic marketing platform, WPP Open, to help our clients navigate change, capture opportunity and deliver transformational growth. We work with the world's most valuable brands and have global reach across 100+ markets, with deep local expertise. Our people are the key to our success. We're committed to fostering a culture of creativity, belonging and continuous learning, attracting and developing the brightest talent, and providing exciting career opportunities that help our people grow. For more information, visit WPP.com. Why we're hiring: Our organization is embarking on a transformative journey to unify our global data landscape through a new central initiative. We are moving away from fragmented systems to a standardized, cloud-agnostic, and AI-ready data platform built on a modern tech stack: dbt, Databricks, Python (dlt), and GitHub Actions. As a foundational member of our central platform team in Chennai, you will be a hands-on builder responsible for bringing our strategic data blueprint to life. This is a role for an execution-focused engineer who loves building high-quality, governed, and reusable data assets that will be deployed across our global markets and wants to make a tangible impact on a global scale. This role combines data engineering along with an opportunity to enable next-generation AI. What you'll be doing: Develop, test, and deploy robust, scalable, and optimized data transformation pipelines using dbt and SQL on the Databricks platform. Design and maintain scalable dimensional models (SCD1/SCD2), implement advanced partitioning, and ensure high-performance query executio