Senior Data Engineer Jobs

Everpure (NYSE: P) has evolved from storage pioneer to data platform, closing fiscal 2026 with $3.7 billion in revenue, its first billion-dollar quarter, and accelerating growth into FY27. Our strategic agenda spans the companies defining the next era of technology - hyperscalers, AI labs, the AI hardware supply chain, data platform providers, and the broader AI ecosystem. This type of work—work that changes the world—is what the tech industry was founded on. So, if you're ready to seize the endless opportunities and leave your mark, come join us. THE ROLE Everpure Cloud Azure Native is a generally available service that brings enterprise-grade block storage natively to Azure. With the first version already live, we are expanding the service into new use cases and markets while improving its reliability, operability, and customer experience. Our Foundation team owns a Go-based control-plane service that coordinates how customers provision and use storage in Azure. Around it, we work with a modern cloud stack including Temporal and other platform services for workflows, automation, and observability. This is a production cloud service: the code you write directly shapes how customers deploy, scale, and operate storage in their Azure environments. You’ll work on a core storage service in a major public cloud , as part of a joint effort between Everpure and Microsoft. You’ll design and evolve APIs and service behavior in the critical path of real customer workloads, collaborating closely with engineers across both companies. Clear API contracts, long-lived interfaces, test automation, and CI/CD are fundamental to how we build. You’ll have the opportunity to own services end to end and solve complex distributed-systems problems in the public cloud. WHAT YOU'LL DO Own and evolve a production cloud service that powers Everpure Cloud Azure Native, taking features from idea and design through deployment and operation in Azure for real customers. Build new capabilities and i

DataHub is an AI & Data Context Platform adopted by over 3,000 enterprises, including Apple, CVS Health, Netflix, and Visa. Innovated jointly with a thriving open-source community of 13,000+ members, DataHub's metadata graph provides in-depth context of AI and data assets with best-in-class scalability and extensibility. The company's enterprise SaaS offering, DataHub Cloud, delivers a fully managed solution with AI-powered discovery, observability, and governance capabilities. Organizations rely on DataHub solutions to accelerate time-to-value from their data investments, ensure AI system reliability, and implement unified governance, enabling AI & data to work together and bring order to data chaos. About the job DataHub is an AI & Data Context Platform adopted by over 3,000 enterprises, including Apple, CVS Health, Netflix, and Visa. Innovated jointly with a thriving open-source community of 13,000+ members, DataHub's metadata graph provides an in-depth context of AI and data assets with best-in-class scalability and extensibility. The company's enterprise SaaS offering, DataHub Cloud, delivers a fully managed solution with AI-powered discovery, observability, and governance capabilities. Organizations rely on DataHub solutions to accelerate time-to-value from their data investments, ensure AI system reliability, and implement unified governance, enabling AI & data to work together and bring order to data chaos. In this role, you will Build core capabilities for our SaaS Platform across multiple clouds Drive development of functional enhancements for Data Discovery, Observability & Governance for both OSS and SaaS offering Lead efforts around non functional aspects like performance, scalability, reliability Lead and mentor junior engineers Work closely with PM, Customers and OSS community Requirements Over 8+ years of experience building and scaling backend systems, preferably in cloud-first or SaaS environments. Solve complex tech

About Scale AI Scale AI is the data foundation for AI, helping organizations build and deploy reliable production AI applications. We partner with leading enterprises and government organizations to accelerate their AI initiatives through our data annotation platform, generative AI solutions, and enterprise AI capabilities. Role Overview As a Senior Staff Frontier Agents Engineer on our Enterprise team, you'll be the technical bridge between Scale AI's cutting-edge AI capabilities and our most strategic customers. You'll work with enterprise clients to understand their unique challenges, architect custom AI solutions, and ensure successful deployment and adoption of AI systems in production environments. This is a hands-on technical role that combines deep engineering expertise with customer-facing problem solving. You'll work directly with customer engineering teams to integrate AI into their critical workflows. Key Responsibilities Customer Integration & Deployment Partner directly with enterprise customers to understand their technical infrastructure, data pipelines, and business requirements Design and implement custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs) Build robust data connectors and ETL pipelines to ingest, process, and prepare customer data for AI workflows Deploy and configure AI models and agents within customer security and compliance boundaries AI Agent Development Develop production-grade AI agents tailored to customer use cases across domains like customer support, data analysis, content generation, and workflow automation Architect multi-agent systems that orchestrate between different models, tools, and data sources Implement evaluation frameworks to measure agent performance and iterate toward business objectives Design human-in-the-loop workflows and feedback mechanisms for continuous agent improvement Prompt Engineering & Optimization Create sophisticate

About Scale AI Scale AI is the data foundation for AI, helping organizations build and deploy reliable production AI applications. We partner with the world's leading enterprises and government organizations to accelerate their AI transformation through frontier AI systems that solve real business problems. Every day, we work with organizations across finance, healthcare, manufacturing, media and telecommunications to build production AI agents that automate complex workflows, help humans, reason over enterprise knowledge, and operate safely at scale. The Opportunity Applied AI is moving faster than ever. New foundation models, reasoning techniques, agent architectures, and research papers emerge every week. Yet building AI systems that reliably solve real-world problems remains one of the hardest engineering challenges. As a Senior Frontier Agent Engineer (Applied AI) , you'll bridge the gap between cutting-edge AI research and production deployment. You'll work directly with enterprise customers to design, evaluate, and deploy intelligent systems that combine frontier models with structured knowledge, retrieval, traditional machine learning, and enterprise software. Unlike traditional ML roles that focus on a single model or product, you'll work across a diverse portfolio of AI challenges spanning multiple industries and use cases. You may build a multi-agent research system and then participate in designing a customer intelligence platform, a healthcare copilot, or an autonomous workflow for a Fortune 100 company. If you enjoy reading new AI papers, experimenting with the latest models, and shipping production systems that create measurable business impact, you'll fit right in. What You'll Build Frontier AI Systems Design and deploy production AI agents that leverage the latest advances in large language models, reasoning, retrieval, memory, and tool use. Architect intelligent systems that combine LLMs, traditional machine learning, structured knowledge, enterpri

Datadog Notebooks provide customers with a collaborative surface for ad-hoc data analysis, technical documentation, incident postmortems and runbooks. The power and flexibility of Notebooks also makes it the perfect place to integrate AI tools that can augment user workflows. Our vision is that in Notebooks users can collaborate with each other and with AI agents seamlessly. We are looking for a product-oriented Senior Software Engineer to help build the AI-assisted workflows that are becoming central to how customers use Notebooks. In this role you will work closely with product and design, and own platforms for analysis workflows and context discovery. There is a real opportunity for impact here: turning Notebooks into the tool that helps customers go from uncertainty to answer, and making that knowledge retrievable and reusable across Datadog products. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do Lead the design and delivery of AI-powered product experiences for Notebooks and adjacent surfaces Develop systems that combine deterministic product capabilities with LLM-powered experiences to deliver trustworthy and explainable customer outcomes Partner closely with Product: Work hand-in-hand with the Product Manager to translate customer problems, adoption signals, and roadmap goals into concrete technical decisions and iterations Build experiences that enable Datadog capabilities to operate within third-party AI platforms, agents, and conversational environments Provide technical leadership and mentorship while helping establish AI engineering best practices Own production systems: Build and operate reliable backend services that run in the critical path of customer deployments, and be on-call for those services Who You Are You have exper

Datadog Notebooks provide customers with a collaborative surface for ad-hoc data analysis, technical documentation, incident postmortems and runbooks. The power and flexibility of Notebooks also makes it the perfect place to integrate AI tools that can augment user workflows. Our vision is that in Notebooks users can collaborate with each other and with AI agents seamlessly. We are looking for a product-oriented Senior Software Engineer to help build the AI-assisted workflows that are becoming central to how customers use Notebooks. In this role you will work closely with product and design, and own platforms for analysis workflows and context discovery. There is a real opportunity for impact here: turning Notebooks into the tool that helps customers go from uncertainty to answer, and making that knowledge retrievable and reusable across Datadog products. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do Lead the design and delivery of AI-powered product experiences for Notebooks and adjacent surfaces Develop systems that combine deterministic product capabilities with LLM-powered experiences to deliver trustworthy and explainable customer outcomes Partner closely with Product: Work hand-in-hand with the Product Manager to translate customer problems, adoption signals, and roadmap goals into concrete technical decisions and iterations Build experiences that enable Datadog capabilities to operate within third-party AI platforms, agents, and conversational environments Provide technical leadership and mentorship while helping establish AI engineering best practices Own production systems: Build and operate reliable backend services that run in the critical path of customer deployments, and be on-call for those services Who You Are You have exper

Atlas Stream Processing enables developers to continuously process streaming data alongside critical application data stored in their database. It builds on MongoDB’s integrated developer data platform, so developers can stand up a stream processor and database with just a few API calls and lines of code, all fully managed. Our product is quickly gaining traction, and we are adding core features that you will contribute to and own. The team owns the C++ stream processing engine that powers Atlas Stream Processing, built on top of MongoDB's Aggregation Framework. The team operates like a startup within the company, a small group with real autonomy, responsible for everything from the core execution engine and stream processing stages . We’re looking for a Senior Software Engineer to design, build, and evolve this execution engine. Position Expectations Design, build, and deliver core components of the system in collaboration with other stakeholders Help shape architecture, development practices, and escalation policies as the teams and the product grow Mentor fellow engineers and assume ownership and accountability of projects Qualifications Strong background in database internals or building core components for data processing systems (including query execution, storage engines, autotuning, and workload optimization) 5+ years of experience in building database services, distributed systems, and/or foundational cloud services at scale Proven success in designing, writing, testing, debugging, performance tuning, possessing a strong grip on the foundational material of computer science, and maintaining distributed and/or highly concurrent software systems in large, long-lived code bases Good verbal and written technical communication skills, desire to collaborate with colleagues, mentor fellow engineers, and assume project ownership and accountability Track record of identifying problems, implementing solutions, and delivering complex projects in distributed systems or

Datadog Notebooks provide customers with a collaborative surface for ad-hoc data analysis, technical documentation, incident postmortems and runbooks. The power and flexibility of Notebooks also makes it the perfect place to integrate AI tools that can augment user workflows. Our vision is that in Notebooks users can collaborate with each other and with AI agents seamlessly. We are looking for a product-oriented Senior Software Engineer to help build the AI-assisted workflows that are becoming central to how customers use Notebooks. In this role you will work closely with product and design, and own platforms for analysis workflows and context discovery. There is a real opportunity for impact here: turning Notebooks into the tool that helps customers go from uncertainty to answer, and making that knowledge retrievable and reusable across Datadog products. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do Lead the design and delivery of AI-powered product experiences for Notebooks and adjacent surfaces Develop systems that combine deterministic product capabilities with LLM-powered experiences to deliver trustworthy and explainable customer outcomes Partner closely with Product: Work hand-in-hand with the Product Manager to translate customer problems, adoption signals, and roadmap goals into concrete technical decisions and iterations Build experiences that enable Datadog capabilities to operate within third-party AI platforms, agents, and conversational environments Provide technical leadership and mentorship while helping establish AI engineering best practices Own production systems: Build and operate reliable backend services that run in the critical path of customer deployments, and be on-call for those services Who You Are You have experience with Go,

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role Substrate is the team responsible for Palantir’s core production infrastructure — 100s of K8s clusters — from on-prem to the major cloud hyperscalers, whether they are internet-connected or air-gapped, small hardware footprint or large. As a Senior Software Engineer on Substrate, you will design and build Palantir’s managed Kubernetes product offerings across all these environments. You and your team will be responsible for bootstrapping and operating the entire fleet of K8s clusters with zero manual steps by building industry leading tooling and contributing to core CNCF components. You will also be responsible for ensuring scale, stability and security across a matrix of compliance regimes and hosting infrastructure types. Your team culture emphasizes engineering rigor and operational excellence at scale. This means issues in production should be pre-empted and deeply root-caused, and investments in automation and self-healing systems are key. If you’re excited about infrastructure at scale and working with Kubernetes, this is the right role for you.

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role As a Senior Software Engineer on Network Infrastructure you will be joining a team whose mission is to make a highly dynamic and intricate Kubernetes networking tech stack a pleasure to interact with, in addition to being legible, robust and secure. The Network Infrastructure team owns the tech responsible for north-south and east-west traffic flows across 100s of zero-trust K8s clusters running variable workloads. The team solves the novel technical challenges emergent at the intersection of scale, usability and security: enabling dynamic control over ephemeral infrastructure (10s of thousands of firewall rules targeting 1000s of short-lived pods) across multiple compliance regimes, using CNCF tools like envoy, cilium with K8s controllers to operate them. In this role, you will be working in one of the most technically challenging spaces at Palantir.

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role As a Senior Software Engineer on Network Infrastructure you will be joining a team whose mission is to make a highly dynamic and intricate Kubernetes networking tech stack a pleasure to interact with, in addition to being legible, robust and secure. The Network Infrastructure team owns the tech responsible for north-south and east-west traffic flows across 100s of zero-trust K8s clusters running variable workloads. The team solves the novel technical challenges emergent at the intersection of scale, usability and security: enabling dynamic control over ephemeral infrastructure (10s of thousands of firewall rules targeting 1000s of short-lived pods) across multiple compliance regimes, using CNCF tools like envoy, cilium with K8s controllers to operate them. In this role, you will be working in one of the most technically challenging spaces at Palantir.

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role As a Senior Software Engineer, you will be directly responsible for Palantir’s observability platform. This includes everything from log/metric/trace ingestion and processing, monitoring and alerting solutions, and all other workflows on top of the observability data. This role will have a direct impact on Palantir’s ability to scale our engineering efforts through these investments. You have a deep systems background and value technical excellence, and consistently raise the bar for your team’s technical execution. You know how to balance providing value to your users while building defensive systems that are operationally sound and easy to maintain.

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role We are seeking a Senior Software Engineer to join a customer-facing product engineering team focused on developing advanced Command and Control (C2) and Agentic Autonomy Software for Autonomous Systems for use in operational and tactical missions. This role involves building, integrating, and deploying state-of-the-art software solutions that combine sensors, actuators, unmanned vehicles, and intelligent decision-making systems including self-hosted and commercial LLMs to enable users to employ and manage robotic and autonomous systems across a variety of mission sets. You will work alongside other experts in sensing, artificial intelligence, physics and simulations, user experience, and edge system engineering to build and deliver solutions that redefine complex military and civilian mission scenarios in the real world. As a part of this team, you will contribute directly to the development of cloud and edge software to command and control autonomous systems, including interfacing with onboard sensors (radar, cameras, RF, and other modalities) and real-time kinetic and non-kinetic systems for individual and swarms of systems. You will work alongside other experts in sensing, artificial intelligence, and systems engineering to shape solutions that redefine complex area defense scenarios.

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role Substrate is the team responsible for Palantir’s core production infrastructure — 100s of K8s clusters — from on-prem to the major cloud hyperscalers, whether they are internet-connected or air-gapped, small hardware footprint or large. As a Senior Software Engineer on Substrate, you will design and build Palantir’s managed Kubernetes product offerings across all these environments. You and your team will be responsible for bootstrapping and operating the entire fleet of K8s clusters with zero manual steps by building industry leading tooling and contributing to core CNCF components. You will also be responsible for ensuring scale, stability and security across a matrix of compliance regimes and hosting infrastructure types. Your team culture emphasizes engineering rigor and operational excellence at scale. This means issues in production should be pre-empted and deeply root-caused, and investments in automation and self-healing systems are key. If you’re excited about infrastructure at scale and working with Kubernetes, this is the right role for you.

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role We are seeking a Senior Software Engineer to join a customer-facing product engineering team focused on developing advanced Command and Control (C2) and Agentic Autonomy Software for Autonomous Systems for use in operational and tactical missions. This role involves building, integrating, and deploying state-of-the-art software solutions that combine sensors, actuators, unmanned vehicles, and intelligent decision-making systems including self-hosted and commercial LLMs to enable users to employ and manage robotic and autonomous systems across a variety of mission sets. You will work alongside other experts in sensing, artificial intelligence, physics and simulations, user experience, and edge system engineering to build and deliver solutions that redefine complex military and civilian mission scenarios in the real world. As a part of this team, you will contribute directly to the development of cloud and edge software to command and control autonomous systems, including interfacing with onboard sensors (radar, cameras, RF, and other modalities) and real-time kinetic and non-kinetic systems for individual and swarms of systems. You will work alongside other experts in sensing, artificial intelligence, and systems engineering to shape solutions that redefine complex area defense scenarios.