Senior Data Engineer – AWS Location: London (Hybrid) | Practice Area: Technology & Engineering | Type: Permanent Engineer future-ready data platforms that power financial transformation. The Role We’re looking for a Senior Data Engineer with AWS to join our growing team of engineering experts driving next -generation transformation for Tier 1 financial services clients. You’ll play a pivotal role in designing, building, and deploying cloud-based data pipelines. Working across greenfield projects and enterprise-scale platforms, your work will directly impact how data is ingested, transformed, and served at scale across the financial services industry. You'll also embrace AI-enabled ways of working, using approved AI and automation tools where appropriate to improve engineering productivity, accelerate delivery, and enhance solution quality while applying sound engineering judgement and responsible AI practices. What You’ll Do Design and build end-to-end data pipelines leveraging AWS -native services and modern data architectures. Collaborate with clients to gather requirements, define technical solutions, and deliver production-grade systems that meet business needs. Apply AWS Well-Architected Principles, CI/CD practices, and AI-enabled engineering approaches to deliver scalable, secure, resilient, and high-quality solutions. Develop robust, tested, and fault-tolerant data engineering solutions while promoting engineering best practices and data governance. Mentor junior engineers, contribute to knowledge sharing, and encourage the responsible use of approved AI tools and automation to improve collaboration and delivery. What We’re Looking For Strong proficiency in Python , Scala , or Java with hands-on experience in Big Data technologies including Spark , Hadoop , or similar distributed processing frameworks. Practical experience building real-time event streaming pipelines using technologies such as Kafka , Spark Streaming, or Amazon Kinesis within AWS en
S
Salary not disclosed
Check market pay for comparable Data Engineer roles before applying.
Role overview
Job description
The Platform team creates the technology that enables Spotify to learn quickly and scale easily, enabling rapid growth in our users and our business around the globe. Spanning many disciplines, we work to make the business work; creating the infrastructure, tooling, frameworks, and capabilities needed to welcome a billion customers.
The Data Platform team develops and maintains the infrastructure that supports Spotify’s data ecosystem. Within Data Platform, the Data Collection product area builds infrastructure that makes it easier to collect and consume data at scale. You’ll join a team focused on making user behaviour data seamless and reliable for data teams across Spotify.
What You'll Do
Collaborate with product and engineering teams to build and support critical data infrastructure and datasets.
Build systems that collect and process user behaviour data at scale.
Help power Spotify’s personalization and recommendation systems, as well as the tools teams use to build and test new features.
Design and evolve data architectures that support high data volumes and a broad range of internal users.
Improve the reliability, scalability, and usability of our data infrastructure.
Work across disciplines to solve complex data challenges and make an impact across Spotify.
Who You Are
You are an experienced Data Engineer, and proficient in backend development using Java.
You are comfortable working with large-scale datasets using SQL and platforms such as BigQuery.
You have experience with JVM-based data processing frameworks such as Flink, Beam, Dataflow, or Spark.
You are familiar with DevOps practices, cloud infrastructure, containerized applications, and Kubernetes fundamentals.
You have experience with data modeling and schema design.
You care about high-quality code and engineering practices such as continuous delivery and automated testing.
You value experimentation, iterative development, and collaborative software development practices.
You are comfortable navigating ambiguity and open-ended problems, using data and sound judgment to make decisions.
Where You'll Be
This role is based in London
We offer you the flexibility to work where you work best! There will be some in person meetings, but still allows for flexibility to work from home.
Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens.
At Spotify, we are passionate about inclusivity and making sure our entire recruitment process is accessible to everyone. We have ways to request reasonable accommodations during the interview process and help assist in what you need. If you need accommodations at any stage of the application or interview process, please let us know - we’re here to support you in any way we can.
What they are looking for
Skills & requirements
Department · Engineering
S
Hiring company
Spotify
Technology
Spotify is a digital music service that gives you access to millions of songs, podcasts, and audiobooks. Listen to your favorites online now.
Related opportunities
Similar active roles
Relevant, currently active roles for this market.
C
London, UK, United Kingdom
PythonJavaAWSAI
W
4mo ago
London, London, United Kingdom
PythonAWSAzureGCP
C
London, UK, United Kingdom
PythonJavaSQLAzure
D
London, England, United Kingdom
JavaScriptTypeScriptPythonAWS
D
London, United Kingdom - Deliveroo, United Kingdom
PythonAWSGCPKubernetes
S
London, England, United Kingdom· Full-time· Remote
PythonSQLAI
🔔 Get job alerts
New Senior Data Engineer - Data Platform jobs in London, straight to your inbox.
No spam · Unsubscribe anytime