Data Engineer Jobs

About the Team Compute Foundations builds the software that manages OpenAI’s GPU compute infrastructure across sites, data centers, and infrastructure providers, supporting model training and inference. Our systems turn large, heterogeneous fleets of machines into dependable compute for research and products. We build Kubernetes-based control planes, controllers, services, and APIs that coordinate the lifecycle of machines and clusters. We connect global infrastructure management with the realities of bare-metal systems, giving clients consistent interfaces across differences in hardware, topology, and provider behavior. About the Role You will build distributed systems that provision, configure, and manage compute throughout its lifecycle. Your work will connect global services and Kubernetes controllers with the systems that bring machines online, update them safely, and recover them when something goes wrong. This role combines software architecture with an understanding of how machines and data centers work. You might design a lifecycle API, improve controller performance under high concurrency and provider rate limits, or trace a provisioning failure from an API through reconciliation to network boot or host configuration. You will help these systems remain reliable as the fleet expands across sites and generations of GPU hardware. We value depth in relevant systems and the ability to connect layers. You do not need to arrive as an expert in every component of the stack. In this role, you will: Design, build, and operate Kubernetes-based controllers and distributed services that coordinate infrastructure across sites, isolate failures, and scale as GPU capacity grows. Define APIs and resource models that let clients request and track lifecycle operations through consistent interfaces across hardware platforms and providers. Build provisioning and configuration services that coordinate network boot, hardware management interfaces, and the deployment of firmware,

About the Role OpenAI’s Industrial Compute organization is responsible for ensuring our compute infrastructure scales efficiently to support millions of users and increasingly sophisticated AI models. We’re looking for a Data Scientist to partner closely with Capacity Systems Engineering, Infrastructure, Product, and Research to optimize inference capacity across our global GPU fleet. This role combines statistical modeling, large-scale data analysis, forecasting, and systems thinking to drive critical decisions around infrastructure investments, performance-efficiency trade-offs, and customer experience. You’ll transform complex operational data into actionable insights that directly influence how OpenAI allocates and scales one of the world’s largest AI compute environments. Key Responsibilities Build statistical and machine learning models to profile and improve GPU utilization, latency, throughput, and overall fleet efficiency. Develop forecasting models for inference demand across products, regions, and model families. Analyze production workloads to identify latency bottlenecks and capacity constraints, highlighting optimization opportunities. Partner with Capacity Systems Engineering to inform infrastructure planning and long-term GPU investment strategies. Design experiments and simulations to evaluate scheduling policies, serving strategies, and infrastructure tradeoffs. Build dashboards and operational metrics that enable leadership to make data-driven capacity decisions. Collaborate with Product, Research, Finance, and Infrastructure teams to align compute planning with business growth and model roadmaps. Communicate technical findings clearly to both engineering teams and executive leadership. Qualifications MS or PhD in Statistics, Computer Science, Operations Research, Applied Mathematics, Economics, or related quantitative discipline (or equivalent industry experience). 5+ years of experience working in the infrastructure data science space. Strong ex

This position will be responsible for facilitating sales operations in bunkering through effective interdepartmental liaison, client relationship management, contract management, data reporting, and strategic digitization and automation initiatives Source: Adani Group | Job ID: 57285

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role We’re looking for Forward Deployed Infrastructure Engineers who can help us build, operate, and maintain high-performance, scalable, and reliable services for Palantir platforms, products, and deployments. You'll get to use your creativity to develop novel solutions to evolving challenges and automate processes wherever possible, using whichever tools are best for the job including industry-leading LLM and AI technology! As a Forward Deployed Infrastructure Engineer, every day is different! You will be developing software and providing high-quality support for software systems that are critical to solving our government’s greatest challenges. We strongly believe in engineering teams being responsible for the operations of their services in production. As such, you’ll work closely with forward deployed teams and product teams to participate in sensible, scalable, systems design and share responsibility with them in diagnosing, resolving, and preventing production issues.

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Data Science is at the heart of Lyft’s products and decision-making. Data Scientists at Lyft operate in dynamic environments, moving quickly to build the world’s best transportation solutions. We tackle a wide range of challenges - from shaping long-term business strategy with data, to making critical short-term decisions, to developing algorithms and models that power both internal systems and customer-facing products. Driver Incentives Science owns the algorithms and systems behind incentive design, influencing driver engagement and marketplace efficiency — from real-time supply positioning to longer-horizon earnings and engagement programs. The team is responsible for designing pay and incentive mechanisms that are efficient and good for driver experience over the long run. As a Data Scientist specializing in Algorithms, you'll partner closely with product, engineering, and operations leaders to build and scale incentive systems, shape long-term mechanism design strategy, and deliver on critical business goals tied to marketplace efficiency and driver earnings. Candidates with strong optimization backgrounds — think mathematical programming, control theory, or operations research — are a great fit, though we welcome strong candidates from machine learning or causal inference as well. The ideal candidate thrives in a fast-paced environment and brings a hands-on, entrepreneurial mindset to drive results. Responsibilities: Collaborate with engineering and product teams to design, implement, and iterate on new features and algorithmic improvements for driver incentives and pay mechanisms. Design, develop, and deploy optimization models, algorithms, and systems for problems such as budget allocation, multidimensional cost-curve development, and incentive targeting. Write production model code; collabor

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Data Science is at the heart of Lyft’s products and decision-making. Data Scientists at Lyft operate in dynamic environments, moving quickly to build the world’s best transportation solutions. We tackle a wide range of challenges - from shaping long-term business strategy with data, to making critical short-term decisions, to developing algorithms and models that power both internal systems and customer-facing products. Driver Incentives Science owns the algorithms and systems behind incentive design, influencing driver engagement and marketplace efficiency — from real-time supply positioning to longer-horizon earnings and engagement programs. The team is responsible for designing pay and incentive mechanisms that are efficient and good for driver experience over the long run. As a Data Scientist specializing in Algorithms, you'll partner closely with product, engineering, and operations leaders to build and scale incentive systems, shape long-term mechanism design strategy, and deliver on critical business goals tied to marketplace efficiency and driver earnings. Candidates with strong optimization backgrounds — think mathematical programming, control theory, or operations research — are a great fit, though we welcome strong candidates from machine learning or causal inference as well. The ideal candidate thrives in a fast-paced environment and brings a hands-on, entrepreneurial mindset to drive results. Responsibilities: Collaborate with engineering and product teams to design, implement, and iterate on new features and algorithmic improvements for driver incentives and pay mechanisms. Design, develop, and deploy optimization models, algorithms, and systems for problems such as budget allocation, multidimensional cost-curve development, and incentive targeting. Write production model code; collabor

Join the MongoDB Networking & Observability team and help build the core of a distributed database! Our team focuses on creating and enhancing components which facilitate communication between distributed processes and make these processes, and their communication, easily observable. Networking Observability’s responsibilities include improving MongoDB networking, improving the efficiency of resource utilization, and building low-overhead observability features. Our team includes engineers located in New York City and fully remote engineers. We operate close to the bottom of the stack, and have a lot of influence over the availability, performance, and robustness of our open source database. Recently, we’ve improved connection handling, explored new networking architectures, and integrated OpenTelemetry to make issues easier to diagnose and connect MongoDB to modern observability tools. We are planning to further improve our networking’s stack performance, availability and scalability as well as further enhance our observability stack using open observability frameworks. Are you excited to help the MongoDB engineering team build a better database? We are! Join us today, and we can build a faster, more reliable, exceptionally observable, database system together. This role can be based out of our New York City office or remotely within the United States and Canada. Candidate Profile 3+ years of experience building distributed systems Passionate about delivering and deploying a product with cross-team stakeholders Solid computer science fundamentals, with strong competencies in data structures, algorithms, and software design/architecture Hands-on experience with building production-level code. Experience in C++ is required Interest in furthering their knowledge of networking, observability and how computer architecture and internals impact the availability of SaaS Solid verbal and written communication skills and highly motivated to collaborate with colleagues Po

Join the MongoDB Networking & Observability team and help build the core of a distributed database! Our team focuses on creating and enhancing components which facilitate communication between distributed processes and make these processes, and their communication, easily observable. Networking Observability’s responsibilities include improving MongoDB networking, improving the efficiency of resource utilization, and building low-overhead observability features. Our team includes engineers located in New York City and fully remote engineers. We operate close to the bottom of the stack, and have a lot of influence over the availability, performance, and robustness of our open source database. Recently, we’ve improved connection handling, explored new networking architectures, and integrated OpenTelemetry to make issues easier to diagnose and connect MongoDB to modern observability tools. We are planning to further improve our networking’s stack performance, availability and scalability as well as further enhance our observability stack using open observability frameworks. Are you excited to help the MongoDB engineering team build a better database? We are! Join us today, and we can build a faster, more reliable, exceptionally observable, database system together. This role will be based remotely in Canada. Candidate Profile 3+ years of experience building distributed systems Passionate about delivering and deploying a product with cross-team stakeholders Solid computer science fundamentals, with strong competencies in data structures, algorithms, and software design/architecture Hands-on experience with building production-level code. Experience in C++ is required Interest in furthering their knowledge of networking, observability and how computer architecture and internals impact the availability of SaaS Solid verbal and written communication skills and highly motivated to collaborate with colleagues Position Expectations Understand and improve the current funct

The Shift Engineer - Cluster - IPQA conducts in-process quality inspections during shifts, monitoring production processes and identifying quality deviations. This role records and analyzes quality data, assists in implementing corrective actions, provides training on in-process quality procedures, and supports continuous improvement initiatives to enhance process quality. Source: Adani Group | Job ID: 56134

Who We Are Notion is the collaborative AI workspace where teams and agents think together . We're building one place where your knowledge, projects, meetings, and AI tools live side by side, so work is faster, clearer, and less fragmented. Millions of individuals, small teams, and large companies run their work on Notion. Notinos (our employees) are customer zero in bringing this future of work to life. We care about craft, building things that last, and the belief that great work is still fundamentally human. Our goal isn’t to ship the next feature. Each and every team of Notinos is working to set the standard for how humans work together in the AI era. From building a business’s system of record to making and managing AI agents to automating away the busy work, we care deeply about giving our customers more time for their life’s work. This internship will take place from January 25 - April 16 and you will need to be able to work out of our SF office during this time. What You'll Achieve: Conduct data analyses to gain insights about Notion and use these insights to uncover opportunities for improvements in our product and business. Communicate these insights with actionable recommendations to cross-functional teams (insights are useful, impact is even better!). Work with cross-functional partners across the product and business to learn about their functions and use data to advance their respective areas. Create metrics and build dashboards to monitor the growth and health of Notion. Communicate insights and recommendations effectively to leadership and have an impact on strategic decision-making. Qualifications: Pursuing a bachelor's or master's in a quantitative field such as Economics, Statistics, Applied Math, Engineering, Computer Science, or Natural Sciences. Must graduate before December 2027. This internship will take place from January 25 - April 16 and you will need to be able to work out of our SF office during this time. Previous research or internship

At Vanta, our mission is to help businesses earn and prove trust. We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. As a Senior Analytics Engineer, you’ll be responsible for laying the foundation for a best-in-class analytics function. You’ll partner closely with our data science team and business stakeholders to ensure that our analytics stack and processes meet the business needs today with an eye towards the future. What you’ll do as an Senior Analytics Engineer at Vanta: Design and implement complex data models to enable dashboards, self-serve analytics, and data science teams. Write highly tuned, scalable SQL queries running over large-scale, heterogeneous data warehouses. Enable AI tooling with semantic layers and observability, guiding analytics functions on best practices. Manage and improve data infrastructure needed to drive data-driven decision-making solutions. Help develop front end applications to expose analytical data sets enterprise wide Work with the Product and Corporate Engineering system teams to structure source systems for reporting consumption across the enterprise. How to be successful in this role: Have at least four years of experience working with data and two years of experience in Software Engineering or a related field. Have experience with common analytics tooling (e.g. dbt is a must, Stitch/Fivetran, Snowflake/BigQuery/Redshift, Airflow, Dagster, Looker/Mode/Sigma). Bring a system-oriented and software engineering mindset to the Analytics Engineering practice. We’re looking to build frameworks that manage data, and minimize bespoke queries. Deep knowledge of crafting dimensional and fact models in modern data fashion. Have a passion for enabling the developer experience of data, and being obsessed with giving

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. Palantir Year We've had surging demand from undergrads who want to get into the arena faster. You've told us you can't sit in lectures while the biggest story of our lifetime is written around you. It's clearer every day, it's being written faster than ever. If that's your spirit, you'll feel right at home here. Come join us for a year. Do real, critical work with the engineers and customers building the future. Many of our interns find they want to stay - perhaps you will too. The Role Build software and deliver customer outcomes. You'll work on real problems: helping customers deploy AI-powered solutions, building the software platforms of the future, and transforming how organizations operate. You'll be held to the same performance standards as any Palantir engineer, and your career progression will be based purely on merit and impact. Every incentive we have points toward putting our best people in the highest-leverage positions, as fast as possible. You’ll have the rare opportunity to gain deep insight into and directly influence some of the world’s most critical industries and institutions. By building on Palantir’s powerful platforms leveraging integrated cutting-edge AI, you’ll help organizations unlock the full potential of their data to make smarter, faster decisions.

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role Software Engineers at Palantir build software at scale to transform how organizations use data. Our Software Engineers are involved throughout the product lifecycle, from idea generation, design, prototyping, and production delivery. You will collaborate closely with technical and non-technical teammates to understand our customers' problems and build products that solve them. We encourage movement across teams to share context, skills, and experience, so you'll learn about many different technologies and aspects of each product. Engineers work autonomously and make decisions independently, within a community that will support and challenge you as you grow and develop, becoming a strong technical contributor and engineering leader. Our Product Development organization is made up of small teams of Software Engineers. Each team focuses on a specific aspect of a product. Our infrastructure teams are responsible for the lowest layers of our software stack, often focused on database technologies, distributed systems, large scale data systems, security, and application infrastructure. As a Software Engineer on infrastructure working on our Foundry platform, you'll contribute high-quality code to underpin Palantir Foundry and Gotham with performant, secure, and scalable building blocks, enabling products deployed to the most important institutions in the public and private sector. You'll build the foundational capabilities that power our products used by research scientists, aerospace engineers, intelligence analysts, and economic forecasters, in countries around the world. We’re hiring engineers who are passionate about solving real-world problems and empowerin

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role As a Senior Identity Security Engineer on Palantir's Identity Security team, you will own the security posture of the identity infrastructure that Palantirians, customers, and services rely on every day. The Identity Security team is responsible for all identity types at Palantir - workforce, customer, workload, and agentic - giving you the rare ability to architect, threat model, and drive security outcomes across the full identity surface. You will help shape the technical direction for identity security at Palantir, reduce standing access, lead identity threat modeling, and contribute to the next generation of identity primitives including agent identity, JIT-native governance, and unified policy enforcement across workforce and customer IAM. As part of Palantir's best-in-class Information Security organization, you will research, architect, and scale solutions that help Palantir stay ahead of a dynamic identity threat landscape.

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role Software Engineers at Palantir build software at scale to transform how organizations use data. Our Software Engineers are involved throughout the product lifecycle, from idea generation, design, prototyping, and production delivery. You will collaborate closely with technical and non-technical teammates to understand our customers' problems and build products that solve them. We encourage movement across teams to share context, skills, and experience, so you'll learn about many different technologies and aspects of each product. Engineers work autonomously and make decisions independently, within a community that will support and challenge you as you grow and develop, becoming a strong technical contributor and engineering leader. Our Product Development organization is made up of small teams of Software Engineers. Each team focuses on a specific aspect of a product. Our infrastructure teams are responsible for the lowest layers of our software stack, often focused on database technologies, distributed systems, large scale data systems, security, and application infrastructure. As a Software Engineer on infrastructure working on our Foundry platform, you'll contribute high-quality code to underpin Palantir Foundry and Gotham with performant, secure, and scalable building blocks, enabling products deployed to the most important institutions in the public and private sector. You'll build the foundational capabilities that power our products used by research scientists, aerospace engineers, intelligence analysts, and economic forecasters, in countries around the world. We’re hiring engineers who are passionate about solving real-world problems and empowerin