Lead Software Development Engineer Jobs

The Public Sector software engineers (SWEs) create the core product building blocks forward-deployed teams use to develop agentic capabilities that function across multiple domains. SWEs responsibilities include building the systems required to ingest and process federal datasets to support real-time decision-making in contested environments. We develop novel agentic enabling capabilities that includes: Create multi-layered guardrails around agents Optimize data retrieval for agents Orchestrate fleets of asynchronous agents Automatically alerts users to deviations in data Illustrating how an agent reached a decision As a Senior Software Engineer, you will lead the development of a vertical feature or a horizontal capability to include defining requirements with stakeholders and implementation until it is accepted by the stakeholders. You will: Lead the design and implementation of scalable backend systems and distributed architectures for Federal customers. Manage the full lifecycle of feature development from requirement definition to deployment on classified networks. Direct the orchestration of asynchronous agent fleets to meet mission requirements. Lead customer engagements to translate mission needs into technical requirements. Own the communication with stakeholders to ensure implementation meets defined acceptance criteria. Conduct technical reviews and identify risks within machine learning infrastructure and model serving. Drive the platform roadmap by providing technical specifications for Federal product offerings. Ideally you will have: Full Stack Development: Proficiency in front-end, back-end development and infrastructure, including experience with modern web development frameworks, programming languages, and databases Cloud-Native Technologies: Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and experience in developing and deploying applications in a cloud-native environment. Understanding of containerization (e.g., Docker) and contai

P-1385 We are hiring a Senior Staff Software Engineer for Databricks' Engineering team reporting to an Engineering Leader. You will be part of the Databricks engineering organization, working with teams that develop Databricks products and features for thousands of enterprises worldwide. Key Characteristics As an executive engineering individual contributor at Databricks, you will have full ownership of the product or infrastructure direction in a major area, driving it from initial development to scalable solutions with clear business impact. You will serve as a force multiplier by elevating stability, reliability, and organizational processes, while bringing deep expertise in large-scale distributed systems. You will mentor senior engineers, contribute to recruiting, and lead high-impact company projects, often tackling complex problems beyond their comfort zone. Job Description At Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions. Our engineering teams build highly technical products that fulfill real, important needs in the world. We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we regularly observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above. The Impact You Will Have Solve real business needs at large scale by applying your software engineering. Deliver a highly scalable, available, and fault-tolerant engine processing hundreds of TB of data daily across thousands of customers Low level systems debugging, performance measurement & optimizat

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role Forward Deployed Software Engineers (FDSEs) understand our customers’ greatest pain points and design end-to-end solutions to address them. FDSEs solicit constant feedback on their work from both customers and colleagues, improving our products over time with rapid iteration cycles. FDSEs deploy ground breaking technical solutions to solve our customers’ hardest problems. Projects often start with a nebulous question like “Why are we losing customers?” or “How can we more effectively identify instances of money laundering?” FDSEs lead the way in developing a solution, from high-level system design and prototyping to application development and data integration. As an FDSE, you leverage everything around you: Palantir products, open source technologies, and anything you and your team can build to drive real impact. You work with customers around the globe, where you gain rare insight into the world’s most important industries and institutions. We help our customers detect insider trading, improve disaster relief, fight healthcare fraud, and more. Each mission presents different challenges, from the regulatory environment to the nature of the data to the user population. You will work to accommodate all aspects of an environment to drive real technical outcomes for our customers. Whether you aspire to be an entrepreneur or an engineering leader, we believe Palantir is the best place — with the best colleagues — to learn how. You’ll learn how to unpack a problem and understand the costs and consequences of its solution. You’ll learn new technologies and languages, and even develop them yourself. You’ll work autonomously and make decisions independently,

P-150 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Search plays a foundational role in this mission. Whether through keyword-based retrieval, semantic similarity via vector embeddings, or hybrid approaches that combine both, our Search technologies help customers find, discover, and understand information across massive, complex datasets. These capabilities power everything from Retrieval Augmented Generation (RAG), AI assistants, and recommendation systems to enterprise knowledge management, in-product search, and data exploration. As a Staff Software Engineer for Search Quality, you will drive the technical direction of ranking, relevance, evaluation, and quality initiatives across Databricks’ next-generation Search product. You’ll design and build the systems, models, and evaluation frameworks that ensure our Search stack delivers accurate, high-quality results across diverse multimodal datasets and query patterns. You’ll work across research, product, and infra to push the frontier of retrieval quality for enterprise AI applications — blending traditional information retrieval techniques, representation learning, and neural ranking. Beyond hands-on contributions, you will help define our long-term vision for relevance and quality, mentor senior engineers, and lead strategic efforts that raise the accuracy, reliability, and product impact of Search across Databricks. Check out our recent blog post: Reranking in Databricks AI Search for Faster, Smarter Retrieval in RAG Agents The impact you will have: Lead the technical vision for Search Quality, shaping the ranking architecture, relevance modeling stack, and evaluation systems that power Datab

P-1403 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Ingesting data into the Lakehouse is a strategic area of investment for Databricks and a key enabler for Data and AI workflows. Lakeflow Connect is looking to solve this problem by providing ready-to-use, point-and-click connectors for a wide variety of sources, including enterprise applications (like Salesforce, Workday, ServiceNow, SharePoint), databases (e.g., SQL Server), cloud storage, message queues, and local files. In addition to being an important part of Lakeflow and Data Engineering, Connect is also a key platform capability. Every surface in Databricks (Dashboards, Notebooks, SQL, AI) requires ingestion capabilities and the lead for this role will need to work closely with other products to embed Connect into these surfaces. We are looking for engineers with experience in core Database internals to join our Lakeflow Connect team. A key part of Connect is to extract data from OLTP systems while imposing minimal load on production systems. To do this efficiently we are building systems that use techniques such as incremental data capture, log parsing, etc. We are looking for engineers who continue to be hands on and are looking to make a large impact on an important problem for the company. The Impact you will have: Solve real business needs at large scale by applying your software engineering. Deliver a highly scalable, available, and fault-tolerant engine processing hundreds of TB of data daily across thousands of customers Low level systems debugging, performance measurement & optimization on large production clusters. Build architecture design, influence product roadmap, and ta

P-375 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Ingesting data into the Lakehouse is a strategic area of investment for Databricks and a key enabler for Data and AI workflows. Lakeflow Connect is looking to solve this problem by providing ready-to-use, point-and-click connectors for a wide variety of sources, including enterprise applications (like Salesforce, Workday, ServiceNow, SharePoint), databases (e.g., SQL Server), cloud storage, message queues, and local files. In addition to being an important part of Lakeflow and Data Engineering, Connect is also a key platform capability. Every surface in Databricks (Dashboards, Notebooks, SQL, AI) requires ingestion capabilities and the lead for this role will need to work closely with other products to embed Connect into these surfaces. We are looking for engineers with experience in core Database internals to join our Lakeflow Connect team. A key part of Connect is to extract data from OLTP systems while imposing minimal load on production systems. To do this efficiently we are building systems that use techniques such as incremental data capture, log parsing, etc. We are looking for engineers who continue to be hands on and are looking to make a large impact on an important problem for the company. The Impact you will have: Solve real business needs at large scale by applying your software engineering. Deliver a highly scalable, available, and fault-tolerant engine processing hundreds of TB of data daily across thousands of customers Low level systems debugging, performance measurement & optimization on large production clusters. Build architecture design, influence product roadmap, and tak

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role Forward Deployed Software Engineers (FDSEs) understand our customers’ greatest pain points and design end-to-end solutions to address them. FDSEs solicit constant feedback on their work from both customers and colleagues, improving our products over time with rapid iteration cycles. FDSEs deploy ground breaking technical solutions to solve our customers’ hardest problems. Projects often start with a nebulous question like “Why are we losing customers?” or “How can we more effectively identify instances of money laundering?” FDSEs lead the way in developing a solution, from high-level system design and prototyping to application development and data integration. As an FDSE, you leverage everything around you: Palantir products, open source technologies, and anything you and your team can build to drive real impact. You work with customers around the globe, where you gain rare insight into the world’s most important industries and institutions. We help our customers detect insider trading, improve disaster relief, fight healthcare fraud, and more. Each mission presents different challenges, from the regulatory environment to the nature of the data to the user population. You will work to accommodate all aspects of an environment to drive real technical outcomes for our customers. Whether you aspire to be an entrepreneur or an engineering leader, we believe Palantir is the best place — with the best colleagues — to learn how. You’ll learn how to unpack a problem and understand the costs and consequences of its solution. You’ll learn new technologies and languages, and even develop them yourself. You’ll work autonomously and make decisions independently,

Who we are At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers — and customer obsessed — we leap at every opportunity to tackle technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started. Our AI-powered Assistant serves as the initial point of contact for customers seeking assistance on how to use our platform effectively. The Customer Engagement and Docs platform team's objective is to help customers resolve their problems faster using AI / LLMs. We provide customers with precise and comprehensive solutions to their problems or build experiences to facilitate a seamless escalation to a support agent when necessary. As a Staff Engineer, you will operate at the intersection of Product development and Machine Learning. Responsibilities include gaining a deep understanding of user behavior; identifying factors contributing to problems; leveraging Product, Machine Learning (ML) and Large Language Models (LLMs) to analyze intricate technical use cases within a secure enterprise environment and eventually providing a path to resolving them. The impact you will have: Lead design, development, and deployment of systems for Evaluation, Answer retrieval and Quality improvement for helping customers. Lead architectural decisions to ensure performance, reliability, and accuracy of the knowledge systems. Drive best practices for engineering excellence, including design reviews, code quality, testing strategies, and performance optimizations. Deliver high-quality, production-ready code and serv

P-1408 The Applied AI team at Databricks sits at the forefront of advancing AI/ML-powered products . Databricks’ customers are continuously creating new assets (tables, notebooks, dashboards, datarooms, pipelines, sql queries, ml models etc.) on the platform. Some of them can have hundreds of millions of assets. Finding an asset is a critical user journey for Databricks’ customers which helps them accomplish their tasks. As our Search product continues to evolve, we are seeking a Staff Engineer to lead enhancements to our Search Quality. In 2025, we will focus on enhancing search ranking, improving query understanding, building robust evals and growing the coverage of assets to enable seamless search at scale. Key Responsibilities Drive the development and deployment of ML based search and discovery relevance models and systems integrated with Databricks' products and services. Design and implement automated ML and NLP pipelines for data preprocessing, query understanding and rewrite, ranking and retrieval, and model evaluation, enabling rapid experimentation and iteration. Collaborate with product managers and cross-functional teams to drive technology-first initiatives that enable novel business strategies and product roadmaps for the search and discovery experience. Contribute to building a robust framework for evaluating search ranking improvements - both offline and online. What We’re Looking For BS+ (M.S. or PhD preferred) in Computer Science, or a related field. 10+ years experience developing search relevance systems at scale in production or in high-impact research environments. Experience applying LLM to search relevance Experience in one or more of the following: Query understanding NLP Text mining Recommendations Personalization Discovery Conversational AI Strong understanding of computer science fundamentals. Contributions to well-used open-source projects. Why Join Us? At Databricks,

P-1408 The Applied AI team at Databricks sits at the forefront of advancing AI/ML-powered products. Databricks’ customers are continuously creating new assets (tables, notebooks, dashboards, datarooms, pipelines, sql queries, ml models etc.) on the platform. Some of them can have hundreds of millions of assets. Finding an asset is a critical user journey for Databricks’ customers which helps them accomplish their tasks. As our Search product continues to evolve, we are seeking a Staff Engineer to lead enhancements to our Search Quality. In 2026, we will focus on enhancing search ranking, improving query understanding, building robust evals and growing the coverage of assets to enable seamless search at scale. Key Responsibilities Drive the development and deployment of ML based search and discovery relevance models and systems integrated with Databricks' products and services. Design and implement automated ML and NLP pipelines for data preprocessing, query understanding and rewrite, ranking and retrieval, and model evaluation, enabling rapid experimentation and iteration. Collaborate with product managers and cross-functional teams to drive technology-first initiatives that enable novel business strategies and product roadmaps for the search and discovery experience. Contribute to building a robust framework for evaluating search ranking improvements - both offline and online. What We’re Looking For BS+ (M.S. or PhD preferred) in Computer Science, or a related field. 10+ years experience developing search relevance systems at scale in production or in high-impact research environments. Experience applying LLM to search relevance Experience in one or more of the following: Query understanding NLP Text mining Recommendations Personalization Discovery Conversational AI Strong understanding of computer science fundamentals. Contributions to well-used open-source projects. Why Join Us? At Databricks, w

P-1403 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems - from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Ingesting data into the Lakehouse is a strategic area of investment for Databricks and a key enabler for Data and AI workflows. Lakeflow Connect is looking to solve this problem by providing ready-to-use, point-and-click connectors for a wide variety of sources, including enterprise applications (like Salesforce, Workday, ServiceNow, SharePoint), databases (e.g., SQL Server), cloud storage, message queues, and local files. In addition to being an important part of Lakeflow and Data Engineering, Connect is also a key platform capability. Every surface in Databricks (Dashboards, Notebooks, SQL, AI) requires ingestion capabilities and the lead for this role will need to work closely with other products to embed Connect into these surfaces. We are looking for engineers with experience in core Database internals to join our Lakeflow Connect team. A key part of Connect is to extract data from OLTP systems while imposing minimal load on production systems. To do this efficiently we are building systems that use techniques such as incremental data capture, log parsing, etc. We are looking for engineers who continue to be hands on and are looking to make a large impact on an important problem for the company. The Impact you will have: Solve real business needs at large scale by applying your software engineering. Deliver a highly scalable, available, and fault-tolerant engine processing hundreds of TB of data daily across thousands of customers Low level systems debugging, performance measurement & optimization on large production clusters. Build architecture design, influence product roadmap, and ta

RDQ126R35 About Databricks At Databricks, we empower data teams to solve the world’s toughest challenges—from security threat detection to cancer drug development. Our mission is to build the best data and AI infrastructure platform, enabling our customers to focus on innovation. Our engineering teams push the boundaries of data and AI technology while ensuring our platform operates with the resilience, security, and scale that businesses need to succeed. About the Role We are developing a growing ecosystem of applications and partners on the Databricks Data Intelligence Platform. Our team creates frameworks, tools, and best practices to enable seamless integrations, helping developers and partners build impactful solutions. As a Senior Staff Software Engineer, you will define the vision, architecture, and strategy for this ecosystem. You will play a key role in enabling customers to integrate cutting-edge applications, helping developers thrive on Databricks, and shaping the future of data and AI platforms. Your Impact Define and drive the ecosystem strategy for Databricks, a crucial pillar of our platform growth. Shape how applications and integrations enhance the Databricks experience for developers, partners, and customers. Develop frameworks, APIs, and tools that make it seamless for partners and developers to build, integrate, and scale applications within the Databricks ecosystem. Enable customers to integrate cutting-edge applications and specialized functionalities, helping them drive competitive differentiation and expand their AI and data capabilities. Lead and mentor engineers across teams, providing technical guidance, architectural direction, and career development support. Foster a culture of innovation, best practices, and knowledge sharing. Collaborate cross-functionally with product, engineering, and business development teams to align technical roadmaps with strategic business goals. Engage with open-source communities and advocate for best practi

P-1385 Companies are investing billions of dollars into developing and deploying AI and the data platforms that enable it. But do they know what is happening? At Databricks, we are passionate about enabling data teams to solve the world’s toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world’s best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers — and customer obsessed — we leap at every opportunity to tackle technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started. As a Senior Software Engineer on the Customer Foresight Team , you'll lead the development of products that customers use to get insights on their AI and data workloads, optimize their performance, and lower costs. You will build data infrastructure that processes billions of entries daily, deploy to over 65 cloud regions worldwide, and enable some of the world's biggest companies to conduct their DevOps, FinOps, SecOps and AIOps jobs. This role requires leading the technical development of product milestones from refinement of requirements, through execution, operation, and iterating with the broader product development team and partner teams to ensure product success. The impact you will have : Develop systems that make it simple for customers to answer questions about their Databricks environment by providing a reliable and timely interface for observability Make it easy for frameworks teams across Databricks to publish their data to customers Effectively lead large milestones from the observability roadmap, contribute to the long-term vision and requirements development for Databricks products Mentor other engineers towards contributing to the product and the

P-375 The Search team at Databricks sits at the forefront of advancing AI/ML-powered products. Databricks’ customers are continuously creating new assets (tables, notebooks, dashboards, datarooms, pipelines, sql queries, ml models etc.) on the platform. Finding an asset is a critical user journey for Databricks’ customers which helps them accomplish their tasks. As our Search product continues to evolve, we are seeking a Staff Engineer to lead enhancements to our Search Quality. We are focusing on enhancing search ranking, improving query understanding, building robust evals and growing the coverage of assets to enable seamless search at scale. Key Responsibilities Drive the development and deployment of ML based search and discovery relevance models and systems integrated with Databricks' products and services. Design and implement automated ML and NLP pipelines for data preprocessing, query understanding and rewrite, ranking and retrieval, and model evaluation, enabling rapid experimentation and iteration. Collaborate with product managers and cross-functional teams to drive technology-first initiatives that enable novel business strategies and product roadmaps for the search and discovery experience. Contribute to building a robust framework for evaluating search ranking improvements - both offline and online. What We’re Looking For BS+ (M.S. or PhD preferred) in Computer Science, or a related field. 10+ years experience developing search relevance systems at scale in production or in high-impact research environments. Experience applying LLM to search relevance Experience in one or more of the following: Query understanding NLP Text mining Recommendations Personalization Discovery Conversational AI Strong understanding of computer science fundamentals. Contributions to well-used open-source projects. Why Join Us? At Databricks, we are building state-of-the-art AI solutions that redefine how users inte

NOTE: Although this position is in support of our US Government work, this role is located in Tokyo, Japan. A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role Forward Deployed Software Engineers (FDSEs) understand our customers’ greatest pain points and design end-to-end solutions to address them. FDSEs solicit constant feedback on their work from both customers and colleagues, improving our products over time with rapid iteration cycles. FDSEs deploy ground breaking technical solutions to solve our customers’ hardest problems. Projects often start with a nebulous question like “Why are we losing customers?” or “How can we more effectively identify instances of money laundering?” FDSEs lead the way in developing a solution, from high-level system design and prototyping to application development and data integration. As an FDSE, you leverage everything around you: Palantir products, open source technologies, and anything you and your team can build to drive real impact. You work with customers around the globe, where you gain rare insight into the world’s most important industries and institutions. We help our customers detect insider trading, improve disaster relief, fight healthcare fraud, and more. Each mission presents different challenges, from the regulatory environment to the nature of the data to the user population. You will work to accommodate all aspects of an environment to drive real technical outcomes for our customers. Whether you aspire to be an entrepreneur or an engineering leader, we believe Palantir is the best place — with the best colleagues — to learn how. You’ll learn how to unpack a problem and understand the costs and consequences of its solution. You’ll learn new technolog