Senior Data Engineer Jobs

MongoDB is looking for an outstanding person to join our newly created Forward Deployed Engineering team and take on a key role in our extended R&D organization. Forward Deployed Engineering is linking the work of teams engaged on application modernization roles with our Product and Engineering teams. We are looking to speak to candidates who are based in Dublin or Cork for our hybrid working model. Many organizations have built up large estates of legacy applications. Lack of scalability and resilience, long development times, operating cost, and inability to run on cloud are common issues with these applications. To address these issues, organizations are engaging in large transformational Application Modernisation programs. MongoDB is recognized as the developer data platform of choice for transactional systems that provide the best scalability, resiliency and developer experience in the cloud as well as on premises. Organizations are continuously migrating workloads from these legacy applications to new platforms, often based on microservices, using MongoDB. Such transformations are time intensive and often risky. Tooling based on generative AI promises to accelerate these transformations in a way never seen before. Forward Deployed Engineering is responsible for exploring the possibilities of Generative AI technologies and providing invaluable feedback to MongoDB’s R&D teams to drive future capabilities of MongoDB and the MongoDB ecosystem. Application Modernization Engineers will work alongside project teams that are executing Application Modernisation projects with customers. The successful candidate will be responsible for evaluation, build, and applying tools in modernization projects, facilitating the usage of such tools and processes across the different project teams, identifying opportunities for tooling deployment, selecting potential 3rd party tools, contributing to the development of tooling prototypes and helping to shape t

The MongoDB Database Experience team is a diverse group of contributors working together to help our users manage MongoDB at global scale. This includes building tools for MongoDB Atlas: our database as a service offering and fastest growing product which allows users to deploy fault-tolerant, globally distributed MongoDB clusters in just minutes. We're seeking a Senior Software Engineer to join our Developer Tools Team within the Database Experience department. The team is responsible for tools which allow users to interact with their data and to understand the health and performance of their MongoDB deployments. The Developer Tools Team works on a variety of APIs and customer-facing UIs empowering MongoDB users to interact with their stored data, whether that’s on desktop via MongoDB Compass or in the browser via Atlas Data Explorer. This role is fully remote for a candidate based in the United States with US citizenship. We're looking for someone who Is a full stack engineer with a willingness to take on both frontend tasks and backend tasks Has experience with the design and architecture of a modern, scalable, high availability web application Has experience working with databases Enjoys collaboration and being part of a team Is approachable, curious, and intellectually honest Would enjoy chasing down difficult problems in a distributed environment Always strives to expand their knowledge Nice to Haves Knowledge of database internals and tuning mechanisms, particularly indexing Previous work in TypeScript, React, and Node.js, particularly maintaining an ecosystem of dependencies Experience working with websocket based client to server communication Familiarity with developing and supporting microservice based architectures using Kubernetes About MongoDB MongoDB is built for change, empowering our customers and our people to innovate at the speed of the market. We have redefined the data platform for the AI era, enabling builders to create, transform, and d

MongoDB is growing its team in Sydney, focusing on building intelligent tools that help customers understand and modernise their application codebases. The Application Modernisation Platform (AMP) guides customers through the entire journey of modernising their applications — from legacy relational platforms to modern, scalable systems built on MongoDB. The App Analysis & Modelling team owns the critical first stage of this journey: building the context that powers everything downstream. The team builds code analysis tools that construct code dependency graphs and generate deep insights for codebases, giving customers a clear understanding of their existing applications before transformation begins. The team also designs schema recommendation engines that analyse signals such as existing relational schemas and query patterns to inform data modelling decisions. Our work sits at the intersection of analysis, data modelling, and AI — helping developers make confident, data-driven decisions as they transition to MongoDB. We are looking for a Senior Software Engineer who is passionate about building scalable backend systems and applications. As we expand our use of AI to power smarter analysis and recommendations, the ideal candidate will bring strong backend engineering fundamentals with the ability to contribute across the full stack. You will collaborate closely with product management and other engineering teams to design and deliver cutting-edge features that guide customers through complex modernisation journeys. We are looking to speak to candidates who are based in Sydney for our hybrid working model. The ideal candidate will have 5+ years of commercial software development experience with strong proficiency in Python and/or Java Extensive Experience designing and building scalable, high-performance APIs and backend services Solid understanding of relational data modelling and SQL (Oracle, PostgreSQL, MySQL, or similar), including schema design and query opti

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. About Okta & the TDI Dev Prod Engineering Team : Technology, Data, and Insights (TDI) is on a mission to accelerate Okta's scale and growth. We bring world-class business acumen and technology expertise to every interaction. We also drive cross-functional collaboration and are focused on delivering measurable business outcomes. The TDI DevProd Engineering team owns the foundational CI/CD platforms that power Okta’s business, spanning cloud infrastructure, delivery pipelines, and AI platform integration. We are a team of builders who design and operate at scale. Currently, we are in the middle of a strategic transformation: evolving our cloud practice from a self-service model into a managed, opinionated platform that the entire business can rely on for rapid, secure, and reliable software delivery The Opportunity : As a Senior Software Engineer for TDI DevProd Engineering, you will serve as the technical authority for how we design, build, and evolve the cloud infrastructure underpinning our AI platform and the broader workloads running across Okta. You will define the CI/CD architectural standards, GitOps patterns, and automation strategies that the DevProd team builds toward. In this role, you will be a key partner to AI, security, and productivity architects as we scale Okta's cloud capabilities to meet increasing business demand. This is a hands-on, high-impact builder role. We are looking for someone who has successfully shipped and scaled cloud in

We're transforming the grocery industry At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible earnings opportunities to Instacart Personal Shoppers. Instacart has become a lifeline for millions of people, and we’re building the team to help push our shopping cart forward. If you’re ready to do the best work of your life, come join our table. Instacart is a Flex First team There’s no one-size fits all approach to how we do our best work. Our employees have the flexibility to choose where they do their best work—whether it’s from home, an office, or your favorite coffee shop—while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work. Overview: We are looking for a Senior Machine Learning Engineer with a strong Operations Research background to join the Service Availability & Routing team within Instacart's Logistics organization. In this role, you will work at the intersection of combinatorial optimization, mathematical programming, and AI to solve high-impact problems in the fulfillment space — including order batching, shopper routing, service availability prediction, and real-time assignment. You'll partner closely with engineering, product, and data science to ship models and algorithms that directly influence Instacart's profitability and shopper experience at scale. The Logistics & ML group is responsible for the intelligence and execution behind Instacart’s fulfillment system. The team optimizes a multi-sided marketplace to ensure customers get their orders on-time and in high qu

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Lyft is looking for software engineers from a scope of disciplines. We are growing our team with people who want to build, improve and incorporate technologies that make the lives of our community more enriched. As an engineer at Lyft, you'll collaborate with teams like product, data science, analytics, and operations on code that empower us to iterate quickly, while focusing on delighting our passengers and drivers. The Applied AI team is looking for a Backend Engineer to join the AI Entries team. You will build the foundational infrastructure that connects Lyft to emerging AI ecosystems and devices and architect the APIs and orchestration layers that allow third-party agents and multimodal interfaces to interact with Lyft. By building these robust integration, you will help make Lyft available where our riders are. Responsibilities: Establish engineering best practices and patterns; help uplift the team's craft and drive a culture of engineering excellence Drive high-impact projects and innovate new solutions to deliver the best user experience Produce and drive scalable system design for large, complex features — from idea through execution and launch Mentor engineers on the team, providing technical guidance and supporting their growth Write well-crafted, well-tested, readable, maintainable code Participate in code reviews to ensure code quality and share knowledge across the team Participate in the team's on-call rotation; identify, triage, debug, and resolve issues across our applications and platforms Have the ability to explain the various trade offs made in decisions Manage project priorities, deadlines, and deliverables. Experience: BS/MS or equivalent in Computer Engineering, Computer Science, or related field or equivalent practical experience. 5+ years of software engineering/production

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Lyft connects people to transportation to change the way we live and get around our communities. Lyft’s engineering team is growing rapidly, and we are looking for Technical Program Managers to help us scale. Come be part of a new team at Lyft focused on enabling and empowering engineering teams to deliver at scale. Our drivers and passengers entrust Lyft with their personal information and travel details to get where they're going and expect us to keep that data safe. Lyft's security team leads efforts across the company to ensure our systems are secure and worthy of our users' trust. The security team designs and builds Lyft's security architecture, consult with other teams as they build and launch new products and features, proactively plans for the unexpected, and responds to incidents that occur. Our work affects the entire company and takes place at all levels of the stack, from infrastructure to web application security, as well as mobile apps, IT, and autonomous vehicles. We try to approach security from a software engineering standpoint. We believe in scaling security through automation and tooling and we ship frequently. Check out our blog posts at https://eng.lyft.com/tagged/security to learn more about some of the things we’ve built. We’re looking for the right person to join our team to perform service and application security review, and move us along our maturity journey. In order to be scalable, each secure product quality gate must be automated and integrated into our software release pipeline. Our grand vision is a fully automated series of quality controls that constantly validate that our

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Lyft is looking for experienced software engineers from a variety of disciplines. We are growing our team with people who want to build, improve and incorporate technologies that make the lives of our community more enriched. As an engineer at Lyft, you'll collaborate with teams like product, data science, analytics, and operations on code that empower us to iterate quickly, while focusing on delighting our passengers and drivers. As a Senior Software Engineer on the Marketplace team, you will lead work streams to improve business operations in Lyft’s Marketplace. You'll design AI driven data analytics platforms, data pipelines and metric governance systems that our business leaders use on a daily basis to make key strategic decisions. You will partner with business leaders and data scientists across our organizations to enable running the business more efficiently. Responsibilities: Help define the roadmap and architecture based on technology and business needs Drive AI innovation for business analytics and operations Write well-crafted, well-tested, readable, maintainable code Have a good grasp and ability to explain the various tradeoffs made in decisions Participate in code reviews to ensure code quality and distribute knowledge Lead projects from idea to positive execution Incorporate considerations for business context and failure modes in your work Proactively participate in resolving ongoing incidents Unblock, support, effectively communicate, and obtain buy-in across teams to achieve results Share your knowledge by giving brown bags, tech talks, and evangelizing appropriate tech and engineering best practices Experience: 5+ years of software engineering industry experience with a high level programming language (bonus points for experience with Python or Go) AI Experience in Agen

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Marketplace teams are at the heart of our products and decision-making, owning everything from rider pricing to driver earnings, incentives, and efficient matching. We’re looking for passionate, driven engineers to build systems that empower our riders and drivers to have the best transportation experience possible through prediction, adaptivity, and personalization. We’re looking for someone who is excited about working in a fast-paced, innovative, and impactful environment to create reliable solutions to distributed computing, ML, and data problems. The Pricing team is a centerpiece of Lyft’s Marketplace org, determining prices for all rideshare products and supporting new initiatives. We work with Product & Science to solve and implement complex pricing requirements, balancing the needs of riders, drivers, and the business goals. As an owner of one of the most critical flows in the company, you will work on a wide array of challenges such as latency-sensitive concurrency problems, large scale distributed systems, and experimentation. If you’re interested in playing a large part in demand / supply management and improving the Lyft customer experience, this could be a great fit for you. Responsibilities: Help define the roadmap and architecture based on technology and business needs Unblock, support, effectively communicate, and obtain buy-in across teams to achieve results Lead projects of multiple people from idea to positive execution Write clear, scalable and clear design documentation Write well-crafted, well-tested, readable, maintainable code Utilize your expertise in Python, Golang, AWS to deliver robust and scalable solutions Participate in code reviews to ensure code quality and distribute knowledge Proactively participate in resolving ongoing incidents Share your kno

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Lyft is a global company that connects people to transportation to change the way we live and get around our communities. Our drivers and passengers entrust Lyft with their personal information and travel details to get where they are going and expect us to keep that data safe. Lyft's Privacy team is composed of engineers and analysts dedicated to ensuring appropriate data protections are applied to our drivers' and passengers' data. Our goal is to make privacy the default setting for our internal engineers and our customers. We help design architectures, build a scalable data platform, and define policies to reduce the exposure of user data and ensure appropriate privacy and security protections are applied across the company. We are looking for a highly motivated, collaborative, team-focused and technically strong Senior Software Engineer to join our Privacy team. As a member of this team, you will design and build systems that make privacy the default at Lyft. Every day, you'll partner with engineering, product, legal, and compliance stakeholders on high-impact projects — from building data redaction pipelines to enabling users to exercise their privacy rights to deploying data management systems across a diverse set of Lyft services. You'll bring strong engineering instincts, a passion for privacy, and the ability to lead large projects from idea to execution. Responsibilities: Design, build, and maintain systems that enhance privacy across the organization Independently lead large projects from idea to execution Advocate for user privacy throughout the organization, consulting engineering teams throughout the software development lifecycle and escalating potential privacy concerns Write well-crafted, well-tested, readable, and maintainable code Participate in code reviews to ensure code quality

Role Description As an Infrastructure Engineer, your role will be crucial in shaping and constructing the robust systems that not only support our current flagship products but also lay the groundwork for the next wave of engineering innovations. From optimizing user experiences across various projects to ensuring seamless scalability and data integrity, you'll be at the forefront of shaping the technological backbone of our platform. Collaborating closely with cross-functional teams, you'll leverage your expertise to tackle audacious challenges and push the boundaries of what's possible. Your contributions will directly impact millions of users, as every line of code you write furthers our mission to revolutionize the way people work and collaborate. Join us in redefining the future, where your passion for building scalable, reliable systems will drive meaningful change on a global scale. Our Engineering Career Framework is viewable by anyone outside the company and describes what’s expected for our engineers at each of our career levels. Check out our blog post on this topic and more here . Responsibilities Build infrastructure capable of managing metadata for hundreds of billions of files, handling hundreds of petabytes of user data, and facilitating millions of concurrent connections. Lead the expansion of Dropbox's function as the data-fabric, connecting hundreds of millions of applications, devices, and services globally, while also driving initiatives to enhance interoperability and adaptability across diverse ecosystems. M easur e and optimiz e Dropbox's analytics platform to maintain its status as one of the most advanced in the industry for extracting meaningful insights from vast data volumes. Collaborat e with cross-functional teams to innovate and implement solutions that enhance the performance, reliability, and security of Dropbox's infrastructure, ensuring a seamless experience for users worldwide. Proactively identify new opportunities and drive imp

About Taskrabbit: Taskrabbit is a marketplace platform that conveniently connects people with Taskers to handle everyday home to-do’s, such as furniture assembly, handyman work, moving help, and much more. At Taskrabbit, we want to transform lives one task at a time. As a company we celebrate innovation, inclusion and hard work. Our culture is collaborative, pragmatic, and fast-paced. We’re looking for talented, entrepreneurially minded and data-driven people who also have a passion for helping people do what they love. Together with IKEA, we’re creating more opportunities for people to earn a consistent, meaningful income on their own terms by building lasting relationships with clients in communities around the world. Taskrabbit is a hybrid company with employees distributed across the US and EU and a Built In — Best Places to Work (2022, 2023, 2024, 2025) continually ranked across multiple national and regional categories. Join us at Taskrabbit, where your work will be meaningful, your ideas valued, and your potential unleashed! Prior to applying please note: W e are currently unable to provide visa sponsorship for this position (including H-1B, OPT, or other employment-based visas). Candidates must be legally authorized to work in the United States without employer sponsorship now or in the future. This role is hybrid requiring 2 days in office at our San Francisco hub every Tuesday & Wednesday (located at 130 Sutter St). About the Role: We're seeking a Senior Software Engineer to join our Post-Booking team, someone who doesn't just build, but raises the quality bar across our entire ecosystem. You'll be instrumental in shaping the consumer experience following the initial booking process. Your work will focus on building new features to improve the customer experience through high-performance Node.js services and AI-driven enhancements, as well as critical replatforming work to modernize our microservice infrastructure. Key Responsibil

MDM TechnologyMDM Technology, a company affiliated with Dun & Bradstreet, provides enterprise-grade master data management (MDM) solutions that help organizations create a single, trusted view of business entities. By cleansing, matching, linking, and enriching data, anchored by the global standard D‑U‑N‑S® Number business identifier, MDM Technology enables accurate identity resolution across systems to support analytics, compliance, and AI workflows across industries. The Senior Quality Assurance Engineer ensures our software meets user and product needs. The role creates and maintains project test plans, defines and tracks quality assurance metrics, collects and analyzes data for software process evaluation and improvements, and integrates them into business processes combining deep technical expertise in API and Integrations testing and Automation. This role must show a passion for AI enabled Software Quality practices Leveraging modern AI tools to improve testing efficiency, accelerate release cycles, and enhance software reliability across complex enterprise integration.

About the Team The Future of Computing Research team is an Applied Research team within the Consumer Devices group focused on developing new methods and models as we advance forward in our mission of building AGI that benefits all of humanity. As a Software Engineer on the Future of Computing Research team, you will work together with both the best ML researchers in the world and the greatest design talent of our generation to push the frontier of model capabilities. About the Role We are looking for a Software Engineer to join our team to build tools and services that enable AI research, evaluation, and data generation workflows. The best work in this role will start with an ambiguous design question and turn it into working research systems. You will work closely with researchers, designers, and engineers to build the evaluation systems, synthetic data generation pipelines, review tools, and supporting platform services. The goal is to make these workflows easier to create, run, and trust without requiring bespoke engineering support for each new design concept. You will help ensure that research artifacts have a clear lifecycle, runs are reproducible and observable, and results provide useful evidence for product and model-training decisions while the underlying systems remain reliable and reusable. This role is based in San Francisco, CA. We use a hybrid work model of three days in the office per week and offer relocation assistance to new employees. In this role, you will: Build web applications, APIs, data models, and backend services for AI research workflows. Build tools to author and manage evaluation tasks, rubrics, graders, suites, and rollout configurations, including workflows for publishing, versioning, auditing, and sharing research artifacts. Automate evaluation runs and generate useful reports for design, research, and engineering teams. Support synthetic data generation workflows for multimodal and conversational research, including tools that comb

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. The Cortex Apps team is building the future of AI for enterprise data. This role focuses on the backend infrastructure that powers our flagship products like Snowflake Intelligence , Cortex Agents and Search making agentic AI fast, reliable, scalable and secure at the enterprise level. You won’t just be using AI tools; you will be building the high-performance systems that orchestrate them. You’ll own and influence the architecture for agent execution environments, high-throughput context retrieval, or the ecosystem that allows our customers to iterate and launch agents in production. What you will do in this role: Architect Agentic Runtimes: Build and scale the orchestration engines that execute complex agentic workflows, ensuring low-latency tool execution and robust state management. Scale Context Engineering Infra: Design high-performance systems for RAG (Retrieval-Augmented Generation), including vector database integration, scalable and efficient search indexing, query processing, and result ranking, semantic caching, and automated metadata extraction. Build the "Evals Engine": Develop the automated infrastructure required to run massive-scale golden set simulations, error analysis pipelines, and "hillclimbing" experiments. Productionize AI Workflows: Collaborate with