Senior Data Engineer (Databricks)

Senior Azure Data Engineer ( Databricks ) Location: London (Hybrid) | Practice Area: Technology & Engineering | Type: Permanent Engineer advanced data solutions at scale in a world-class consulting environment. The Role As a Senior Azure Data Engineer ( Databricks ) at Capco, you will play a hands-on role in designing, building, and deploying scalable and secure data engineering pipelines using the Databricks platform on Azure . You'll partner with clients to understand their data needs and develop innovative solutions that drive business transformation. You'll also contribute to engineering best practices and continuous improvement across cross-functional teams. Databricks platform on Azure . You'll embrace AI-enabled ways of working, using approved AI and automation tools where appropriate to improve engineering productivity, accelerate delivery, and enhance solution quality while applying sound engineering judgement and responsible AI practices. What You'll Do Design and develop robust data pipelines using Delta Lake, Spark Structured Streaming, Unity Catalog, and Azure -native services. Build real-time, event-driven solutions using technologies such as Kafka and Azure Event Hubs, applying AI-enabled engineering approaches where appropriate to improve delivery efficiency. Develop and maintain CI/CD pipelines using Azure DevOps, Jenkins, GitHub Actions, and modern DevOps practices to support reliable deployments. Collaborate with clients and multidisciplinary teams to translate business requirements into scalable, production-ready data solutions. Champion clean code, data lifecycle optimisation, engineering best practices, and the responsible use of approved AI tools and automation to improve collaboration and delivery. What We're Looking For Proven hands-on experience with the Databricks platform, including orchestration and enterprise-scale Azure data engineering solutions. Strong technical skills in Python , PySpark , and SQL, with experience wor

WPP is the trusted growth partner for the world’s leading brands. We unite cutting-edge media intelligence and data solutions, world-class creativity, next-generation production, transformative enterprise solutions and expert strategic counsel in a single company – powered by exceptional talent and our agentic marketing platform, WPP Open, to help our clients navigate change, capture opportunity and deliver transformational growth. We work with the world's most valuable brands and have global reach across 100+ markets, with deep local expertise. Our people are the key to our success. We're committed to fostering a culture of creativity, belonging and continuous learning, attracting and developing the brightest talent, and providing exciting career opportunities that help our people grow. For more information, visit WPP.com. Why we're hiring: We are seeking a highly skilled and experienced Senior Data Engineer to join our growing data team. In this critical role, you will be instrumental in designing, building, and optimizing our scalable data lakehouse platform using Google BigQuery or Databricks. You will be a key player in developing robust data pipelines that ingest data from various sources, including Google Analytics 4 (GA4), and transform it into reliable, analysis-ready datasets within the lakehouse environment. This role requires deep expertise in modern lakehouse platforms – Google BigQuery and/or Databricks – together with strong skills in SQL, Python, and Apache Spark (PySpark), along with strong hands-on experience across Azure, AWS, and GCP cloud environments, as our data ecosystem spans multiple cloud platforms. You will be responsible for the entire data lifecycle within the lakehouse, from ingestion and transformation to governance and optimization, ensuring data quality and performance. You should be adept at analyzing performance bottlenecks in Spark jobs and BigQuery workloads, providing enhancement re

We’re building a world of health around every individual — shaping a more connected, convenient and compassionate health experience. At CVS Health®, you’ll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger – helping to simplify health care one person, one family and one community at a time. Position Summary The Senior Data Engineer will be responsible for delivering high quality modern data solutions through collaboration with our engineering, analysts, data scientist, and product teams in a fast-paced, agile environment leveraging cutting-edge technology to reimagine how Healthcare is provided. You will be instrumental in designing, integrating, and implementing solutions on-premise as well supporting migrations of existing workloads to the cloud. The Senior Data Engineer is expected to have extensive knowledge of modern programming languages, designing and developing data solutions. The position is open in a data engineering team that is responsible for processing payer files into our Data Warehouse. Required Qualifications 6&#43; years of experience working with SQL and relational database management systems 3&#43; years of experience in Cloud Data Engineering Platforms such as AWS, GCP, Azure, Databricks, Snowflake etc. 3&#43; years of experience in on-prem Data Engineering Platforms such as Microsoft SQL Server, Oracle, Teradata etc. Programming and modifying code in languages like SQL, Python, and PySpark to support and implement Cloud based and on-prem data warehousing services.</spa

We’re building a world of health around every individual — shaping a more connected, convenient and compassionate health experience. At CVS Health®, you’ll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger – helping to simplify health care one person, one family and one community at a time. POSITION SUMMARY CVS Health is seeking a highly skilled Senior Data Engineer, Observability Engineering to join the Enterprise Observability Platform organization and help advance the next generation of observability, infrastructure, and security data capabilities. The Senior Data Engineer, Observability Engineering will play a critical role in designing, building, and operating scalable data pipelines and data products that power enterprise observability, operational intelligence, and security analytics across the organization. The Senior Data Engineer, Observability Engineering is a senior individual contributor responsible for developing and optimizing Databricks-based data engineering solutions that ingest, transform, govern, and deliver high-volume telemetry, infrastructure, application, and security data. This role combines deep hands-on technical execution with ownership of engineering excellence, operational reliability, performance optimization, and data platform best practices. Working closely with Observability Engineering, Security Engineering, Infrastructure Engineering, and Data Platform teams, the Senior Data Engineer, Observability Engineering will contribute to the evolution of the enterprise observability lakehouse by building resilient ingestion frameworks, establishing data quality standards, enhancing governance controls, and driving efficient, scalable data processing patter

WPP is the trusted growth partner for the world’s leading brands. We unite cutting-edge media intelligence and data solutions, world-class creativity, next-generation production, transformative enterprise solutions and expert strategic counsel in a single company – powered by exceptional talent and our agentic marketing platform, WPP Open, to help our clients navigate change, capture opportunity and deliver transformational growth. We work with the world's most valuable brands and have global reach across 100+ markets, with deep local expertise. Our people are the key to our success. We're committed to fostering a culture of creativity, belonging and continuous learning, attracting and developing the brightest talent, and providing exciting career opportunities that help our people grow. For more information, visit WPP.com. Why we're hiring: Our organization is embarking on a transformative journey to unify our global data landscape through a new central initiative. We are moving away from fragmented systems to a standardized, cloud-agnostic, and AI-ready data platform built on a modern tech stack: dbt, Databricks, Python (dlt), and GitHub Actions. As a foundational member of our central platform team in Chennai, you will be a hands-on builder responsible for bringing our strategic data blueprint to life. This is a role for an execution-focused engineer who loves building high-quality, governed, and reusable data assets that will be deployed across our global markets and wants to make a tangible impact on a global scale. This role combines data engineering along with an opportunity to enable next-generation AI. What you'll be doing: Develop, test, and deploy robust, scalable, and optimized data transformation pipelines using dbt and SQL on the Databricks platform. Design and maintain scalable dimensional models (SCD1/SCD2), implement advanced partitioning, and ensure high-performance query executio

Capco, a Wipro company, is a global technology and management consultancy specializing in driving digital transformation in the financial services industry. With a growing client portfolio comprising of over 100 global organizations, Capco operates at the intersection of business and technology by combining innovative thinking with unrivalled industry knowledge to deliver end-to-end data-driven solutions and fast-track digital initiatives for banking and payments, capital markets, wealth and asset management, insurance, and the energy sector. Capco’s cutting-edge ingenuity is brought to life through its Innovation Labs and award-winning Be Yourself At Work culture and diverse talent. Role Summary We are seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines and infrastructure that support analytics, AI/ML, and business intelligence use cases for BankX's digital banking platform. What You’ll Do Design, develop, and maintain scalable data pipelines for batch and real-time data processing. Build and optimize data ingestion, transformation, and loading (ETL/ELT) workflows. Work with Azure Data Services, Databricks, and Delta Lake to implement Lakehouse architecture. Ensure data quality, reliability, and availability across all data products. Collaborate with Data Architects to implement data models and architecture standards. Support data governance, metadata management, and lineage tracking. Ensure pipelines comply with PDPA, data classification, and security requirements. Monitor pipeline performance and troubleshoot data issues in production environments. Work closely with Data Scientists and Analysts to deliver model-ready datasets. Participate in code reviews and promote engineering best practices. What We’re Looking For 5+ years of experience in data engineering or related roles. Strong proficiency in SQL and Python for data transformation and processing. Hands-on experience with Azure Data Services, Databricks, and D