Staff Software Engineer - Data Platform

P-1348 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high value challenges that are central to their own missions. Our engineering teams build technical products that fulfill real, important needs in the world. We always push the boundaries of data and AI technology, while simultaneously operating with the resilience, security and scale that is important to making customers successful on our platform. We develop and operate one of the largest scale software platforms. The fleet consists of millions of virtual machines, generating terabytes of logs and processing exabytes of data per day. At our scale, we observe cloud hardware, network, and operating system faults, and our software must gracefully shield our customers from any of the above. As a Staff Software Engineer working on the Data Platform team you will help build the Data Intelligence Platform for Databricks that will allow us to automate decision-making across the entire company. You will achieve this in collaboration with Databricks Product Teams, Data Science, Applied AI and many more. You will develop a variety of tools spanning logging, orchestration, data transformation, metric store, governance platforms, data consumption layers etc. You will do this using the latest, bleeding-edge Databricks product and other tools in the data ecosystem - the team also functions as a large, production, in-house customer that dog foods Databricks and guides the future direction of the product. The impact you will have: Design and run the Databricks metrics store that enables all business units and engineering teams to bring their detailed metrics into a common platform for sharing and aggregation, with high quality, introspection ability and query performance. Design and run the cross-c

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. About Okta Okta is an enterprise grade identity management service, built from the ground up in the cloud and delivered with an unwavering focus on customer success. With Okta you can manage access across any application, person, or device. Whether the people are employees, partners, or customers, or the applications are in the cloud, on premises, or on a mobile device, Okta helps you become more secure, make people more productive, and maintain compliance. The Okta service provides directory services, single sign-on, strong authentication, provisioning, workflow, and built in reporting. It runs in the cloud on a secure, reliable, extensively audited platform and integrates deeply with on premises applications, directories, and identity management systems. About the Team The Data Platform team is responsible for the foundational data services, systems, and data products for Okta that benefit our users. Today, the Data Platform team solves challenges and enables: Streaming analytics Interactive end-user reporting Data and ML platform for Okta to scale Telemetry of our products and data Our elite team is fast, creative and flexible. We encourage ownership. We expect great things from our engineers and reward them with stimulating new projects, new technologies and the chance to have significant equity in a company. Okta is about to change the cloud computing landscape forever. About the Position This is an opportunity for experienced Softwa

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. About Okta Okta is an enterprise grade identity management service, built from the ground up in the cloud and delivered with an unwavering focus on customer success. With Okta you can manage access across any application, person, or device. Whether the people are employees, partners, or customers, or the applications are in the cloud, on premises, or on a mobile device, Okta helps you become more secure, make people more productive, and maintain compliance. The Okta service provides directory services, single sign-on, strong authentication, provisioning, workflow, and built in reporting. It runs in the cloud on a secure, reliable, extensively audited platform and integrates deeply with on premises applications, directories, and identity management systems. About the Team The Data Platform team is responsible for the foundational data services, systems, and data products for Okta that benefit our users. Today, the Data Platform team solves challenges and enables: Streaming analytics Interactive end-user reporting Data and ML platform for Okta to scale Telemetry of our products and data Our elite team is fast, creative and flexible. We encourage ownership. We expect great things from our engineers and reward them with stimulating new projects, new technologies and the chance to have significant equity in a company. Okta is about to change the cloud computing landscape forever. About the Position This is an opportunity for experienced Softwa

P-1563 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers — and customer obsessed — we leap at every opportunity to solve technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started in Bengaluru , India ! As a software engineer with a backend focus, you will work with your team to build infrastructure for the Databricks platform at scale. About the Team We manage the infrastructure efficiency for one of the world's largest data and AI platforms. Operating at massive scale across AWS, Azure, and GCP, our mission is to ensure that every dollar spent on cloud infrastructure is optimized. The MCE team builds the critical tools, frameworks, and automated systems that provide deep cost visibility and ensure maximum resource utilization. We aren't just cutting costs; we are engineering systems to scale efficiently as our cloud footprint expands into the hundreds of millions of dollars. The Role As a Staff Software Engineer, you will serve as the technical lead for the Bengaluru MCE chapter. You will be responsible for defining the technical strategy for efficiency projects where the solutions are not yet known. You will lead cross-functional efforts, working with finance and cost team, to tackle massive-scale engineering challenges, ensuring our systems can automatically drive cost efficiency and handle the complexity of global, multi-cloud data processing without compromising on performance or stability. As one of the founding senior engineers of the Bengaluru MCE chapter — a team that has already deliver

P-375 The Search team at Databricks sits at the forefront of advancing AI/ML-powered products. Databricks’ customers are continuously creating new assets (tables, notebooks, dashboards, datarooms, pipelines, sql queries, ml models etc.) on the platform. Finding an asset is a critical user journey for Databricks’ customers which helps them accomplish their tasks. As our Search product continues to evolve, we are seeking a Staff Engineer to lead enhancements to our Search Quality. We are focusing on enhancing search ranking, improving query understanding, building robust evals and growing the coverage of assets to enable seamless search at scale. Key Responsibilities Drive the development and deployment of ML based search and discovery relevance models and systems integrated with Databricks' products and services. Design and implement automated ML and NLP pipelines for data preprocessing, query understanding and rewrite, ranking and retrieval, and model evaluation, enabling rapid experimentation and iteration. Collaborate with product managers and cross-functional teams to drive technology-first initiatives that enable novel business strategies and product roadmaps for the search and discovery experience. Contribute to building a robust framework for evaluating search ranking improvements - both offline and online. What We’re Looking For BS+ (M.S. or PhD preferred) in Computer Science, or a related field. 10+ years experience developing search relevance systems at scale in production or in high-impact research environments. Experience applying LLM to search relevance Experience in one or more of the following: Query understanding NLP Text mining Recommendations Personalization Discovery Conversational AI Strong understanding of computer science fundamentals. Contributions to well-used open-source projects. Why Join Us? At Databricks, we are building state-of-the-art AI solutions that redefine how users inte

P-1533 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Networking Infrastructure is a core part of the platform that powers all our data and AI products. The platform also powers key enterprise security features used by customers across all our products to build connectivity solutions to cloud resources and prevent data exfiltration. We are seeking an experienced Sr. Staff Software Engineer with deep networking expertise to help shape the future of Databricks’ Networking Infrastructure . As one of the early members of the rapidly growing Bangalore site, you will play a critical role in defining the technical vision and architecture for next-generation network connectivity & observability services that will power & manage millions of VMs across multiple clouds . In this role, you will own and drive the design of large-scale connectivity platforms that form the backbone between Databricks’ control plane and compute plane . These platforms are foundational to improving the scalability, reliability, and efficiency of our compute infrastructure, while enabling more intelligent and cost-effective use of cloud resources. You will operate at an org-wide level , setting technical direction, leading complex cross-team initiatives, and mentoring senior engineers. You’ll work closely with product management, operations, and partner engineering teams to translate long-term business goals into durable, extensible networking systems . This role requires both hands-on technical leadership and the ability to influence architecture and execution across teams. This is a unique opportunity for a senior technical leader who enjoys working in ambiguou