Data Platform Engineer Jobs

SPECIFIC JOB RESPONSIBILITIES Pipeline Management: Maintain high-throughput streaming pipelines to ingest logs from various sources (Firewalls, Cloud, Endpoints) to a central destination. Log Normalization: Write parsers to convert raw, messy logs into standard schemas (e.g., OCSF or ECS) for consistent querying. Cost Optimization: Implement routing logic to send "high-value" data to the SIEM and "bulk" data to low-cost Object Storage (Data Lake). Data Preparation: Clean and structure data to enable AI/ML detection models and advanced analytics. EXPERIENCE REQUIRED Data Engineering: Proficiency in Python (for ETL) and SQL (for complex querying). Streaming Tech: Experience with Message Queues (e.g., Kafka, Pub/Sub) and stream processing concepts. Log Handling: Mastery of Regex and log parsing strategies for standard formats (Syslog, CEF, JSON). Storage Architecture: Understanding of Data Lake principles (Parquet/Avro formats) vs. Data Warehouses. QUALIFICATIONS, SKILLS, & KNOWLEDGE Experience with Vector Databases for storing embeddings. Knowledge of Log Observability/Routing tools (middleware that routes logs). Familiarity with Big Data frameworks (e.g., Spark, Flink). PROFESSIONAL DEVELOPMENT EXPECTATIONS Ability to embrace Clearwater's CLEAR core values (Commitment to Client Success, Lead with Accountability, Integrity & Collaboration, Excellence in All That We Do, Advance Colleague Success, Respect & Transparency) and culture. The base salary range for this role is 35,000- 45,000]. Base salary is part of our total rewards package which also includes the opportunity for merit-based salary increases, eligibility for our 401(k) plan, medical, dental, vision, life and disability insurances and leaves provided in line with your work state. Our robust time-off policy includes flexible paid time off, 11 paid holidays, and paid sick time. Total compensation, including base salary to be offered, will depend on elem

Our Mission You call. You wait. You call again. In every other part of your life, you book in seconds. In healthcare, you’re blocked. We’re here to give power to the patient. For nearly 20 years, we’ve built the leading healthcare marketplace - helping tens of millions of people find and book the care they need. Now, we’re going further: building our infrastructure beyond Zocdoc’s marketplace to power access to care wherever patients search, from provider websites and insurance directories to search engines, AI platforms, and more. Healthcare still lacks something every other major consumer industry takes for granted: a seamless way to go from seeking to getting . We don’t want to own the front door to care; there isn't one. We want to make sure all of those doors open when patients are knocking. Fixing healthcare starts with fixing access to it. And we're still just getting started. Your Impact on our Mission We are looking for a Principal/ Senior Staff Engineer, Experimentation Platform to elevate the systems that power trusted decision-making at Zocdoc. In this high-impact role, you will define platform standards, lead complex cross-domain initiatives, and shape the future of our analytics and data infrastructure. Your work will ensure our data ecosystem is secure, reliable, compliant, performant, and cost-efficient—enabling teams across Product, Engineering, Operations, and Leadership to move confidently with trusted insights. This is a senior individual contributor role open to remote candidates across the United States. You’ll enjoy this role if you are… Motivated by designing scalable data platforms that serve hundreds of stakeholders. Passionate about building clean, governed, and secure data systems. Known for improving reliability, performance, and cost efficiency. Comfortable operating as a technical authority without formal management. Energized by raising standards across analytics, infrastructure, and governance. Interested in

The worldwide data management software market is massive. At MongoDB we are transforming industries and empowering developers to build amazing apps that people use every day. We are the leading modern data platform and the first database provider to IPO in over 20 years. Join our team and be at the forefront of innovation and creativity. MongoDB is seeking a Software Engineer 3 to join the Atlas Clusters Platform team. The team is responsible for building MongoDB Atlas, our database as a service offering and fastest growing product. Atlas allows users to deploy fault-tolerant, secure, globally distributed MongoDB clusters in just minutes. The Atlas Clusters Platform team develops the foundational orchestration platform behind MongoDB Atlas. Our systems drive cluster planning and execution, evolve the Atlas control plane toward service-oriented architecture, and provide critical infrastructure that help Atlas run safely and efficiently across cloud environments. We are looking to speak to candidates who are based in New York City for our hybrid working model. What you’ll do Build and design new features for MongoDB Atlas Contribute to and lead complex technical projects Work closely with product and design teams, considering the user’s perspective while building technical solutions Work with customers and support engineers to fix issues Collaborate with team members to develop our codebase, best practices, and design principles Learn from and mentor other team members We’re looking for someone who Has at least 3 years of professional software development experience Is skilled at writing large-scale, distributed backend systems in a compiled language (Java, C#, Go, etc.) Is comfortable working across the stack of a modern web application (e.g. React, TypeScript, Kubernetes) Has experience with at least one major cloud provider technology (AWS, Azure, GCP) Has led the launch of a new feature and maintained it in production Is eager to solve tough problems Has excellent

Who We Are Addepar is a global data and AI platform empowering investment professionals to turn complex financial information into actionable intelligence. Addepar unifies portfolio, market and client data in a total portfolio view and delivers AI-powered insights within investment and client workflows. More than 1,500 firms in 60 countries use Addepar to manage and advise on nearly $10 trillion in assets. Its open platform integrates with 650 software, data and consulting partners to power end-to-end investment operations across firms of all sizes and levels of complexity. Addepar supports clients worldwide with offices in New York City, Salt Lake City, São Paulo, London, Edinburgh, Geneva, Warsaw, Dubai, Pune and Singapore. The Role Join Addepar’s innovative data and intelligence initiatives! We're seeking a Senior Software Engineer to craft and build a Data Analytics Platform, enabling our teams to make data driven decisions every day Applicants must be legally authorized to work in the United States for any employer without requiring current or future visa sponsorship (for example, employment-based visas such as H-1B, F-1/OPT, or similar), and must be authorized to begin work in the U.S. on their first day of employment. What You’ll Do Build and scale a comprehensive platform, formalizing and optimizing data analytics across teams Collaborate with product managers and engineers to understand requirements, and architect solutions for sophisticated data and workflow challenges Use core Addepar systems like the Data Lakehouse to advise and strategize Ops and Data Governance infrastructure Simplify processes by promoting strategic data architecture and optimized workflows Who You Are 5+ years of relevant work experience that shows proficiency in platform development, particularly in enabling data engineering outcomes Must have strong experience with Java or Python Proficient in one or more cloud platforms (AWS, GCP, Azure), with hands-on experience in cloud infrastr

Staff Software Engineer, AI-Native Web Platform P-1579 About Us: The Web Platform team at Databricks builds and owns the public-facing web experiences that represent Databricks to the world. We are rebuilding the platform from the ground up, AI-native from the start, and pioneering an agentic SDLC as our operating model. The Role: As Staff Software Engineer on the Web Platform team, reporting to the Director of Engineering, you will own the platform layer that the rest of the team builds on: web framework, design system, CMS, infrastructure, CI/CD pipelines, AI-enabled translation, and SDLC agents. This is a rare opportunity to design a web platform for an AI-native world from the ground up. The north star architecture is being defined now and you will be a primary author of it. You will partner with technical leaders across web and marketing engineering, and set the standard for what AI-native platform engineering looks like in practice. The impact you’ll have : Define the technical roadmap for the web platform: component systems, rendering architecture, CMS, CI/CD pipelines, and developer tooling, built AI-native from the start. Influence technical leaders across the organization on shared architectural decisions and contribute to the broader north star for AI-native engineering at Databricks. Pioneer an AI-native SDLC by applying agentic unlocks across code generation, testing, review, deployment, and production monitoring. Define the evaluation frameworks, guardrails, and feedback loops that make agentic workflows reliable and production-grade. Mentor and grow engineers on the team, setting the standard for what AI-native thinking and execution looks like in practice. What we look for: 12+ years of software engineering experience, with a strong track record of technical leadership and impact. 3+ years of engineering leadership experience, serving as the technical owner for the software systems owned by your team. Proven track record

GitLab is the intelligent orchestration platform for DevSecOps. GitLab enables organizations to increase developer productivity, improve operational efficiency, reduce security and compliance risk, and accelerate digital transformation. More than 50 million registered users and more than 50% of the Fortune 100* trust GitLab to ship better, more secure software faster. The same principles built into our products are reflected in how our team works: we embrace AI as a core productivity multiplier, with all team members expected to incorporate AI into their daily workflows to drive efficiency, innovation, and impact. GitLab is where careers accelerate, innovation flourishes, and every voice is valued. Our high-performance culture is driven by our values and continuous knowledge exchange, enabling our team members to reach their full potential while collaborating with industry leaders to solve complex problems. Co-create the future with us as we build technology that transforms how the world develops software. * Fortune 500® is a registered trademark of Fortune Media IP Limited, used under license. Claim based on GitLab data. Fortune 100 refers to the top 20% ranked companies in the 2025 Fortune 500 list, published in June 2025. Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of GitLab. An overview of this role As Engineering Manager at GitLab, you’ll manage and grow a high-performing engineering team within the Data Foundations group, working on a core data platform that ingests, processes, persists, and queries data streams generated across GitLab. We are looking for a leader who can leverage AI to drive non-linear productivity gains across the platform, accelerating our ability to deliver value to our customers. We’re looking for someone with deep distributed systems knowledge. You’ll need to be comfortable going well beyond people management and into the architecture of high-throughput, multi-component data

Everpure (NYSE: P) has evolved from storage pioneer to data platform, closing fiscal 2026 with $3.7 billion in revenue, its first billion-dollar quarter, and accelerating growth into FY27. Our strategic agenda spans the companies defining the next era of technology - hyperscalers, AI labs, the AI hardware supply chain, data platform providers, and the broader AI ecosystem. This type of work—work that changes the world—is what the tech industry was founded on. So, if you're ready to seize the endless opportunities and leave your mark, come join us. THE ROLE As a Data Scientist on the Digital Experience Insights team, you'll lead high-impact analytics initiatives, turning complex data, platform, and time-series data into rigorous predictive models, causal inferences, and strategic product metrics. You'll also apply advanced statistical and quantitative research methods to some of our most complex datasets, but the core of the role is turning that analysis into decisions leadership can act on. This role sits within a fast-moving analytics organization where the specific problems shift over time, so we're looking for someone with strong research rigor who can adapt it to whatever question is in front of them. WHAT YOU'LL DO Advanced Predictive & Statistical Modeling: Develop ML models spanning predictive modeling, time-series prediction, clustering, churn reduction, anomaly detection, and recommendation systems. Quantitative Research: Apply advanced computational methods and statistical techniques, including multilevel models and Statsmodels, to massive datasets. Executive Visualization: Create executive-level visual analytics that make complex findings accessible to senior stakeholders. Stakeholder Collaboration: Partner directly with Product, Engineering, and Business leaders to translate complex analytical findings into actionable strategy. We are primarily an in-office environment and therefore, you will be expected to work from the Santa Clara office in complia

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career. About the team Product and Risk Data Engineering is Stripe's single source of truth data engineering layer for Payments, Risk, and Product — we enable Stripe to confidently run, measure, and grow the business by making accurate information easy to access. We curate and maintain high-quality data warehouses and pipelines that serve as the authoritative foundation for product and financial activity across Stripe, powering analytics, ML capabilities, agentic workflows, and merchant-facing data interfaces. Beyond building data, we act as the internal experts in data technologies and partner with Data Platform to deliver high-quality, low-friction data processing frameworks. We also serve as the bridge between data producers and data consumers — championing best-in-class data engineering practices and guiding product teams on event-driven data API modeling — so that every team at Stripe can build, decide, and grow from a trusted, well-engineered data foundation. What you’ll do We're looking for a person who could contribute to the team by solving high-impact, cutting-edge data problems. The ideal candidate will be someone that has built data pipelines for large scale volume, is deeply knowledgeable of key tools including Airflow/Spark/Kafka/Flink, is empathetic, excels at building strong relationships, and collaborates effectively with other Stripe teams to understand their use cases and unlock new capabilities. Responsibilities Lead the technical outcomes for

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world's largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone's reach while doing the most important work of your career. About the team We're experts in data, working to make it cost-effective, understandable, and trustworthy. We build pipelines processing billions of events a day and are stewards of canonical data warehouses and datasets delivering products for Stripe Users while embedding with teams to build their data products. We're experts in using the Stripe Data Platform and to scale we lead the data culture and data education to enable product teams to own their data. We invest in AI Data Ops to scale incident handling and serve as an escalation path for data incidents to minimize their impact. The Data Engineering Solutions team works closely with product teams delivering trustworthy data, backend code, and innovative AI tools, platforms, and services for data. What you'll do We're looking for a person who drives the Data Engineering Solutions Team in solving high-impact, cutting-edge data problems. The ideal candidate is someone who has built data pipelines for large-scale volume, is deeply knowledgeable of Data Engineering tools including Airflow, Spark, Kafka, and Flink, is empathetic, excels at building strong relationships, and collaborates effectively with other Stripe teams to understand their use cases and unlock new capabilities. • Lead the technical outcomes for a team of ambitious, talented engineers, providing mentorship, guidance, and support to ensure their success • Partner with our recruiting team to attract and hire top talent. • Deliver cutting-edg

Everpure (NYSE: P) has evolved from storage pioneer to data platform, closing fiscal 2026 with $3.7 billion in revenue, its first billion-dollar quarter, and accelerating growth into FY27. Our strategic agenda spans the companies defining the next era of technology - hyperscalers, AI labs, the AI hardware supply chain, data platform providers, and the broader AI ecosystem. This type of work—work that changes the world—is what the tech industry was founded on. So, if you're ready to seize the endless opportunities and leave your mark, come join us. The Role Everpure Data Intelligence (formerly 1touch.io) enables enterprises to discover, classify, and contextualize data across cloud, on-premises, and edge environments, improving AI accuracy, building trust in AI outcomes, reducing risk, and delivering measurable business impact. The Consulting Systems Engineer on our data management team provides strategic and tactical pre-sales leadership to support the sales organization. This role is responsible for delivering technical expertise throughout the customer journey, including technical discovery, demonstrations, proof-of-concept execution, solution design, partner enablement, and technical validation. The ideal candidate combines deep data management expertise with strong business acumen and executive presence. They are comfortable navigating complex enterprise sales cycles, engaging technical and business stakeholders, and translating customer challenges into innovative solutions. This role partners cross-functionally with Product Management, R&D, Marketing, Customer Success, Leadership, Account Executives, Account Managers, specialists, and channel partners to ensure alignment between market needs, customer outcomes, and product direction. What You'll Be Doing Serve as a technical advisor and trusted partner to enterprise customers, prospects, and channel partners throughout the sales process. Lead technical discovery sessions to understand customer environments,

About LeafLink LeafLink is the largest unified B2B cannabis platform, providing licensed cannabis businesses a suite of tools to manage their business more effectively, sell or order from their favorite brands and accelerate growth. We are one platform, one solution and we’re defining the way thousands of cannabis brands, distributors, and retailers streamline their operations. With thousands of brands and retailers across 30+ markets in North America, we are setting the industry standard for how cannabis businesses grow together. LeafLink processes more than $5 billion in wholesale cannabis orders annually. Our team, backed by funding from leading VC's, including Founders Fund, Thrive Capital, Nosara Capital, and Lerer Hippeau is poised to define the cannabis supply chain through technology. LeafLink was named one of Inc. 5000’s ‘Top 5000 Fastest-Growing Private Companies’; one of Fast Company's 'Top 10 Most Innovative Companies in Enterprise for 2020', joining the ranks of Amazon, Slack, and VMWare; one of Built In NYC's 'Best Places to Work in 2021'; 2024 Fast Company’s Best WorkPlaces for Innovators for Banking, Finance, and Fintech category; 2024 Green Market Report Award for Best Fintech in cannabis - and we're just getting started! The Role LeafLink is seeking a Staff Data Engineer to help lead the evolution of our data platform and analytics infrastructure. This role will design and scale systems that power analytics, reporting, and operational insights across the organization. Staff Data Engineers influence how data is modeled, moved, and consumed across the company. This role partners with engineering, finance, product, and operations teams to ensure the data platform remains reliable, scalable, and capable of supporting critical decision-making. What You’ll Be Doing Design and lead development of scalable data pipelines using Airflow, dbt, and Python. Guide architecture and evolution of the company data platform. Build integrations across modern dat

This is Adyen Adyen provides payments, data, and financial products in a single solution for customers like Meta, Uber, H&M, and Microsoft - making us the financial technology platform of choice. At Adyen, everything we do is engineered for ambition. For our teams, we create an environment with opportunities for our people to succeed, backed by the culture and support to ensure they are enabled to truly own their careers. We are motivated individuals who tackle unique technical challenges at scale and solve them as a team. Together, we deliver innovative and ethical solutions that help businesses achieve their ambitions faster. The Opportunity We are looking for a Platform Engineer for the Container Services team in Chicago. This team owns and operates Adyen's core container orchestration infrastructure, the foundation that keeps our global payment platform running. In this role, you will design, build, and operate critical infrastructure systems, drive automation and reliability improvements, and help scale Adyen's platform as we continue to grow globally. What You'll Do Build and operate core infrastructure: Design, implement, and maintain container orchestration (Kubernetes) and supporting infrastructure across our global private cloud. Drive automation and reduce toil: Develop tooling and automation that improves provisioning, configuration management, and operational workflows, enabling self-service for engineering teams and reducing manual effort. Ensure reliability at scale: Own the availability and performance of critical platform systems, participate in on-call rotations, and drive incident response and postmortem processes that continuously improve our operational posture. Collaborate across teams and time zones: Work closely with platform engineers in Chicago, contributing to a global team that operates 24/7 infrastructure across multiple regions and datacenters. Shape platform evolution: Contribute to architectural decisions, evaluate new

This is Adyen Adyen provides payments, data, and financial products in a single solution for customers like Facebook, Uber, H&M, and Microsoft - making us the financial technology platform of choice. At Adyen, everything we do is engineered for ambition. For our teams, we create an environment with opportunities for our people to succeed, backed by the culture and support to ensure they are enabled to truly own their careers. The people of Adyen are motivated individuals who tackle unique technical challenges at scale and solve them as a team. Together, we deliver innovative and ethical solutions that help businesses achieve their ambitions faster. Senior Platform Engineer - Observability We are looking for an experienced Observability Infrastructure Engineer to join our Platform Engineering organization. You will be part of the team responsible for building and running Observability pillars on premise and on Kubernetes. Our systems collect, process, and store the logs, metrics, and traces that allow hundreds of product teams to monitor their services in real time. This is a role for a builder and a problem solver who enjoys deep technical troubleshooting across distributed systems and then turns recurring issues into automated, repeatable solutions. You will work in a large-scale environment where we manage petabytes of data and thousands of servers. We are currently in the middle of a major transformation: focusing on automation of operations and enabling self service for our users. What you will do Build the next generation of our platform: Design and implement the future architecture of our logging and metrics systems. You will play a key role in redesigning our infrastructure to support new global regions, ensuring data isolation and regulatory compliance in different geographies, and more. Own infrastructure operations: You will take full ownership of our hybrid infrastructure, managing the lifecycle of over 1,500 servers across both bare-metal

About the Team Data Platform at OpenAI owns the foundational data stack powering critical product, research, and analytics workflows. We operate some of the largest Spark compute fleets in production; design, and build data lakes and metadata systems on Iceberg and Delta with a vision toward exabyte-scale architecture; run high throughput streaming platforms on Kafka and Flink; provide orchestration with Airflow; and support ML feature engineering tooling such as Chronon. Our mission is to deliver reliable, secure, and efficient data access at scale and accelerate intelligent, AI assisted data workflows. Join us to build and operate these core platforms that underpin OpenAI products, research, and analytics. We’re not just scaling infrastructure – we’re redefining how people interact with data. Our vision includes intelligent interfaces and AI-assisted workflows that make working with data faster, more reliable, and more intuitive. About the Role This role focuses on building and operating data infrastructure that supports massive compute fleets and storage systems, designed for high performance and scalability. You’ll help design, build, and operate the next generation of data infrastructure at OpenAI. You will scale and harden big data compute and storage platforms, build and support high-throughput streaming systems, build and operate low latency data ingestions, enable secure and governed data access for ML and analytics, and design for reliability and performance at extreme scale. You will take full lifecycle ownership: architecture, implementation, production operations, and on-call participation. You’ve supported Spark, Kafka, Flink, Airflow, Trino, or Iceberg as platforms. You’re well-versed in infrastructure tooling like Terraform, experienced in debugging large-scale distributed systems, and excited about solving data infrastructure problems in the AI space. This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per wee

About Us Tamara is a leading fintech platform in Saudi Arabia and the GCC region with a mission to help people own their dreams built on being simple, trusted, and everywhere our customers need us. Today, more than 25 million customers and over 130,000 partner merchants depend on Tamara every day for reliable financial solutions across retail, travel, education, healthcare, and beyond. Tamara is backed by Sanabil Investments, a wholly owned company of the Public Investment Fund (PIF), and SNB Capital, among others. Your Role We are looking for a Senior Data Engineer to join the team building Tamara's next-generation data core - a multi-cloud data platform spanning Event Streaming, Data Warehousing, and Experimentation. You will be hands-on; designing and operating petabyte-scale streaming and batch systems that run across clouds. This role is ideal for engineers who love solving complex data challenges at scale, think with a platform mindset, and are excited to raise the technical bar of the team around them. Your Responsibilities Lead the design and build of platform components that run across multiple clouds — addressing portability, cross-cloud replication, HA/DR, and data residency requirements of a regulated fintech environment, and designing against single-cloud lock-in. Build and operate large-scale event streaming infrastructure on Kafka, including configuration tuning and cross-cluster replication between cloud environments. Build and maintain real-time and batch data pipelines using tools like Kafka, Spark, and Airflow. Drive the development of a scalable LakeHouse architecture using modern open table formats such as Iceberg or Delta Lake. Own reliable, cost-aware operation of multi-cloud data infrastructure — SLO-based observability, data quality, and lineage. Enable Analytics and Product teams through self-serve data products, well-modeled warehouse foundations and marts, and reusable ingestion (inbound) and consumption (outbound) patterns. Provid