Distributed Systems Engineer Data Platform Delivery Database Retrieval Jobs

At ClickUp, we're building the future of work: the first truly converged AI workspace unifying tasks, docs, chat, calendar, and enterprise search, all supercharged by context-driven AI. We are an AI-native company. Every team member is expected to leverage AI daily, and we evaluate AI fluency as part of our hiring process. Join us and help redefine what's possible. 🚀 ClickUp is on the lookout for talented backend engineers to join the Fields squad at ClickUp! Fields is the heart and soul behind our custom task data - think dynamic schemas, high-volume updates, and the flexibility that lets users tailor ClickUp to their individual workflows. We’re building scalable, high-throughput, low-latency services that handle millions of requests daily. If wrangling distributed systems, fine-tuning performance, and designing robust APIs sounds like your idea of fun, let’s chat. Role: Build features and systems with attention to detail and performance. Own end-to-end development, from conception to production. Work closely with cross-functional stakeholders to deliver a world-class product. Identify and implement improvements to our existing systems. Help establish a fun, fulfilling, world-class engineering culture. Qualifications: Bachelor’s degree in Computer Science or equivalent major. 5+ years of experience engineering performant and high-throughput systems (ideally on Node.js). You write high quality code (ideally in TypeScript) and are uniquely productive. You have a track record of building performant, high-throughput systems. You have experience writing and debugging sql queries at scale. You have experience developing event based systems. You have experience with major cloud services (ideally AWS). You are an empathetic communicator. You are comfortable with ambiguity and have consistently delivered projects with little direction. You are product-minded and have a good intuition on what a great user experience looks like. #LI-REMOTE #LI-MAV Equal Opportunity Employer

We're looking for a Staff Engineer to join the Logs organization at Datadog and help redefine how our customers ingest, query, and derive insights from logs data. In this role, you’ll work closely with Product Managers and customers to drive complex initiatives across ingestion pipelines, search infrastructure, and intelligent log management capabilities - all while pushing the boundaries of what’s possible with AI and distributed systems. You’ll have the opportunity to lead efforts that shape the future of log management. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Partner with Product Managers to define ambiguous product requirements and determine the most impactful solutions for customers Lead technical strategy and execution and design systems surrounding log query performance and ingestion at scale. Explore and prototype new capabilities and collaborate with peers on initiatives spanning AI-powered log management, security and business operations, advanced query capabilities, and external data sources query capabilities. Mentor engineers across levels and contribute to growing a high-performing, collaborative team culture Who You Are: You have deep experience architecting and scaling backend systems, with a strong focus on data-intensive or distributed infrastructure You excel in ambiguous environments, demonstrating a mix of drive, curiosity and pragmatic decision-making You’ve partnered effectively with Product Managers and customers to define product direction and ship impactful features You have expertise in debugging complex systems and optimizing performance across real-time data pipelines You have experience in using AI agents tools in your day-to-day engineering practices You lead by example and enjoy helping others grow through m

Roles and Responsibilities Write maintainable/scalable/e?cient code. Work in a cross-functional team, collaborating with peers during the entire SDLC. Follow coding standards, unit-testing, code reviews etc. Follow release cycles and commitment to deadlines. Qualifications & Experience Experience level of 3 to 5 years of experience in very large scale applications. Fair understanding in problem solving skills, data structures and algorithms. Experience with distributed systems handling large amounts of data. Fair understanding in coding skills in Java/J2EE, Web technologies, RDBMS/messaging.

Roles and Responsibilities Write maintainable/scalable/code Work in a cross-functional team, collaborating with peers during the entire SDLC. Follow coding standards, unit-testing, code reviews etc. Follow release cycles and commitment to deadlines. Qualifications & Experience Experience level of 3 to 6 years of experience in very large scale applications. Fair understanding in problem solving skills, data structures and algorithms. Experience with distributed systems handling large amounts of data. Fair understanding in coding skills in Java/J2EE, Web technologies, RDBMS/messaging.

Roles and Responsibilities Write maintainable/scalable/e?cient code. Work in a cross-functional team, collaborating with peers during the entire SDLC. Follow coding standards, unit-testing, code reviews etc. Follow release cycles and commitment to deadlines. Qualifications & Experience Experience level of 3 to 5 years of experience in very large scale applications. Fair understanding in problem solving skills, data structures and algorithms. Experience with distributed systems handling large amounts of data. Fair understanding in coding skills in Java/J2EE, Web technologies, RDBMS/messaging.

At Anyscale , we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray , a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI , Uber , Spotify , Instacart , Cruise , and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. About the Role Anyscale's need to detect and respond to security events across its production and corporate environments is growing as the company scales. We're looking for a Senior Detection and Response Engineer to own detection engineering and to lead incident response when it counts, coordinating the response and driving it to resolution. This is a high-ownership role with real room to shape how detection and response works at Anyscale. You will own the detection pipeline, the response runbooks, and incident response, reporting to the Head of Security and partnering with engineering. This role is based in India. In your first year, success looks like strong detection coverage across our cloud, endpoint, and runtime telemetry, a working correlation and alerting pipeline, and incident response runbooks that have been exercised in practice. What You'll Do Own and build detection coverage across cloud, endpoint, and runtime telemetry. Own a centralized correlation and alerting capability that turns telemetry into actionable detections. Own incident response: runbooks, escalation paths, and coordination during an incident, across corporate and production environments. Drive detection of anomalous activity across the environments

Role Summary: Datadog is seeking a Staff Software Engineer to help shape the future of our Bring Your Own Cloud (BYOC) Logs offering by unifying observability pipelines with log management software that customers deploy and manage in their own infrastructure. This role will focus on building and scaling systems that process, route, and store high-volume observability data within customer-managed infrastructure. You will operate as a hands-on technical leader, driving architecture, cross-team delivery, and product direction across a complex and evolving space. This is a high-impact opportunity to influence product strategy, mentor engineers, and solve deeply technical challenges at scale. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Make customer-controlled deployments feel like a managed Datadog product: deployment, upgrades, configuration, observability, diagnostics, reliability, and secure operation across diverse customer cloud environments Build and scale high-throughput systems for log processing, routing, and transformation across distributed environments Lead cross-team initiatives, aligning engineers, product managers, and stakeholders to deliver complex, multi-team projects Design and implement software that runs reliably that customers deploy and operate within their own cloud infrastructure. Improve system performance, scalability, and cost efficiency through thoughtful trade-off analysis and capacity planning Contribute hands-on to critical code paths, debugging, and deployment challenges in customer environments Who You Are: You have significant experience building software that is installed, deployed, and operated in customer environments rather than only as a fully managed SaaS service. You have strong expertise in distributed systems,

Join the Atlas Search team to design and develop the next generation of Semantic and Vector Search infrastructure. Atlas Search is a growing cloud service that allows users to execute complex search and vector search queries using the MongoDB Query Language. Our users can focus on relevance and data retrieval instead of the machinery needed to search data at scale. Our team is building a cloud-based distributed system responsible for the core components of search including data ingestion, performance, query language, query execution, for both relevance-based search and vector search. Our product is being adopted quickly and there are many interesting projects. This is a technical role where you will be responsible for the infrastructure and features enabling our at-scale cloud service powering vector and semantic search. We are looking to speak to candidates who are based in the San Francisco Bay Area for our hybrid working model. What You’ll Do Lead complex projects across the MongoDB ecosystem, for instance, development of a new Search deployment framework within the MongoDB managed cloud Set project level strategy, architect features, and lead projects to successful execution Identify, design, and implement features enhancing our reliability, performance, security and efficiency Perform code reviews with peers and make recommendations on how to improve our software development processes Influence and grow team members through active mentoring and leading by example What We Look For 5+ years experience in data management/search systems, ideally with a strong distributed systems and infrastructure background Experienced in the development and maintenance of concurrent, stateful services Eager to shape the technological direction of a complex system and have the ability to lead initiatives through collaboration with others Experienced in writing features, debugging and optimizing multithreaded applications written in Java Familiarity with LLM

MongoDB’s Replication Team builds the infrastructure that enables high availability, fault tolerance, automatic failover, and tunable consistency. As an engineer on the team, you will design and implement distributed-systems features that protect data and keep applications available under demanding operating conditions. You will work primarily in C++ on core database code, partner with engineers across MongoDB, and help shape features that are central to major MongoDB releases. This is an opportunity to apply distributed-systems fundamentals to a widely used database while solving challenging problems in correctness, performance, and operability. We're looking to speak with candidates based in New York City for our in-office working model. What you will do Design and implement replication features based on the Raft consensus protocol Improve failover behavior, availability, correctness, and performance across the replication system Write production-quality C++ and the unit, integration, and system tests needed to demonstrate correctness Use JavaScript and Python where appropriate to extend test coverage and validate end-to-end behavior Diagnose test failures, investigate bugs, and drive issues through root-cause analysis and resolution Measure the performance impact of code changes and prevent or resolve regressions Collaborate with partner engineering teams and stakeholders on large, cross-functional initiatives Investigate distributed-systems issues raised by customers and Technical Support, communicate findings clearly, and help deliver durable fixes Participate in code reviews, design reviews, and technical discussions that improve the quality of the team’s work Interview candidates and mentor junior engineers and interns What you bring Required At least five years of experience programming, debugging, and performance-tuning distributed or highly concurrent software systems Strong systems fundamentals, including multithreaded programming, concurrency, debugging,

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Marketplace teams are at the heart of our products and decision-making, owning everything from rider pricing to driver earnings, incentives, and efficient matching. We’re looking for passionate, driven engineers to build systems that empower our riders and drivers to have the best transportation experience possible through prediction, adaptivity, and personalization. We’re looking for someone who is excited about working in a fast-paced, innovative, and impactful environment to create reliable solutions to distributed computing, ML, and data problems. The Pricing team is a centerpiece of Lyft’s Marketplace org, determining prices for all rideshare products and supporting new initiatives. We work with Product & Science to solve and implement complex pricing requirements, balancing the needs of riders, drivers, and the business goals. As an owner of one of the most critical flows in the company, you will work on a wide array of challenges such as latency-sensitive concurrency problems, large scale distributed systems, and experimentation. If you’re interested in playing a large part in demand / supply management and improving the Lyft customer experience, this could be a great fit for you. Responsibilities: Help define the roadmap and architecture based on technology and business needs Unblock, support, effectively communicate, and obtain buy-in across teams to achieve results Lead projects of multiple people from idea to positive execution Write clear, scalable and clear design documentation Write well-crafted, well-tested, readable, maintainable code Utilize your expertise in Python, Golang, AWS to deliver robust and scalable solutions Participate in code reviews to ensure code quality and distribute knowledge Proactively participate in resolving ongoing incidents Share your kno

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. We are the Snowflake Metadata team. We own Snowflake’s metadata systems that make it easy for customers to query, modify and manage their petabyte-scale data. We develop distributed systems that store and maintain metadata, transaction frameworks that power Snowflake’s query and DML capabilities, asynchronous systems that provide time travel and lifecycle management capabilities and entity metadata supporting DDL capabilities. We also build foundational capabilities that deliver global features like cross-region replication (Snowgrid), data sharing, and data marketplace. AS A PRINCIPAL SOFTWARE ENGINEER AT SNOWFLAKE YOU WILL: Solve real business needs at large scale by applying your software engineering and analytical problem solving skills. Design, develop and support fault-tolerant scalable distributed systems for our Snowgrid and Data Sharing teams. Create architecture and design, influence our product roadmap, and take ownership and responsibility over new projects. Analyze fault-tolerance and high availability issues, performance and scale challenges, and solve them. Mentor and grow junior engineers. Understand trade-offs between consistency, performance and costs to build solutions which can meet the demands of rapidly growing services. Ensure operational readiness of

Senior Product Engineer Engineering Prolific Prolific is not just another player in the AI space – we are the architects of the human data infrastructure that's reshaping the landscape of AI development. In a world where foundational AI technologies are increasingly commoditized, it's the quality and diversity of human-generated data that truly differentiates products and models. The role We’re looking for impact-focused Software Generalists to join our specialized team focused on serving frontier model creators and enterprise AI application developers. As a full-stack engineer, you will work across Prolific’s domains to solve customer and product problems. This is an exciting opportunity to work directly with frontier AI companies, making critical technical decisions that balance scrappy startup execution with scalable, reliable engineering, as Prolific revolutionizes research for the AI community. You'll will have regular in person collaboration with customers and our US team, as well as collaborate closely with our UK-based tech teams. This role is hybrid based out of our New York office, approx 1-2 days a week. What you’ll bring to the role Over 4 years of experience in a product engineering role Can translate business concepts into software models Ability to quickly learn and adapt across the breadth of Prolific’s domains Familiar working in both monoliths and distributed systems Strong communication and collaboration skills for direct customer interaction Good understanding of modern web applications and architecture design patterns Experience supporting applications in production environments Judgment to balance scrappy startup execution with scalable, reliable engineering Comfort with rapid iteration and responding to customer queries with urgency Experience with some of our technology stack: Python (we use Django & Fast API) TypeScript and JavaScript (we use Vue.js) SQL and NoSQL databases (we use MongoDB and PostgresSQL) Building an

The Opportunity This is a critical and exciting time at Enigma. Our customers consistently tell us that our data products create tremendous value and are deeply aligned with their most important workflows. As demand grows, we have an urgent opportunity to improve both the intelligence of our data and the systems through which customers access it. We are looking for an experienced Senior/Staff Machine Learning Engineer to join our Match Team and help shape the next generation of Enigma’s customer-facing data products. In this role, you will combine advanced statistical and machine learning research with the engineering systems required to power fast, relevant, and reliable search experiences at scale. This is a uniquely high-impact role sitting at the intersection of information retrieval, ranking systems, semantic search, distributed systems, and customer data delivery. The Role At the core of Enigma’s product is our data, which makes both data science and delivery systems central to what we build. As a Senior/Staff ML Engineer on the Match Team, you will lead efforts that improve the relevance, latency, and scalability of our customer-facing data products. You’ll work across the full lifecycle: framing retrieval and ranking problems, developing models and experimentation strategies, evaluating results using real-world signals, and implementing high-throughput search and retrieval systems. This role is ideal for someone who is excited by both hard ranking/search problems and the systems challenges of turning those solutions into low-latency, production-grade retrieval systems. What You'll Do Develop innovative solutions to complex problems in information retrieval, ranking, semantic search, query understanding, and recommendation systems Build and optimize low-latency, high-throughput search APIs, indexing pipelines, and retrieval systems using Python, Typesense, and AWS Evaluate and evolve our search technology stack, driving technical design decisions across index

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Marketplace teams are at the heart of our products and decision-making, owning everything from rider pricing to driver earnings, incentives, and efficient matching. We’re looking for passionate, driven engineers to build systems that empower our riders and drivers to have the best transportation experience possible through prediction, adaptivity, and personalization. We’re looking for someone who is excited about working in a fast-paced, innovative, and impactful environment to create reliable solutions to distributed computing, ML, and data problems. The Pricing team is a centerpiece of Lyft’s Marketplace org, determining prices for all rideshare products and supporting new initiatives. Rider Engagement develops rider-facing engagement levers and optimizes user pricing experience to drive both short term and long term business outcomes. We work with Product & Science to solve and implement complex pricing requirements, balancing the needs of riders, drivers, and the business goals. As an owner of one of the most critical flows in the company, you will work on a wide array of challenges such as latency-sensitive concurrency problems, large scale distributed systems, and experimentation. If you’re interested in playing a large part in demand / supply management and improving the Lyft customer experience, this could be a great fit for you. Responsibilities: Drive high-impact projects and innovate new solutions to provide the best user experience. Work closely with cross-functional teams and partner teams to develop solutions based on technology and business needs, and advance team’s goals and priorities Independently lead features from idea to positive execution and launch Unblock, support and communicate with internal partners to achieve results Write well-crafted, well-tested, readable, maintaina

Join the Atlas Search Query team to design and develop the next generation of Search query architecture, optimization, and execution. Atlas Search is a growing cloud service that allows users to execute complex search and vector search queries using the MongoDB Query Language. Our users can focus on relevance and data retrieval instead of the machinery needed to search data at scale. Our team is building a cloud-based distributed system responsible for the core components of search including data ingestion, performance, query language, query execution, for both relevance-based search and vector search. Our product is being adopted quickly and there are many interesting projects. This is a technical role where you will be responsible for the success of complex Search Query feature development. We are looking to speak to candidates who are based in San Francisco, CA for our hybrid working model. What You’ll Do Lead complex projects across the MongoDB ecosystem, for instance, development of a new Search aggregation framework within the MongoDB aggregation framework. Set project level strategy, architect features, and lead projects to successful execution Identify, design, and implement features enhancing our query language, performance, and operability Perform code reviews with peers and make recommendations on how to improve our software development processes Influence and grow team members through active mentoring and leading by example What We Look For 5+ years experience in data management/search systems, ideally with a strong query processing and optimization background Experienced in the development and maintenance of stateful distributed systems Eager to shape the technological direction of a complex system and have the ability to lead initiatives through collaboration with others Experienced in debugging and profiling multithreaded applications written in Java and Rust Bonus: experience with designing high-volume query engines, such as a datab