Staff Software Engineer (Search Ranking)

P-375 The Search team at Databricks sits at the forefront of advancing AI/ML-powered products. Databricks’ customers are continuously creating new assets (tables, notebooks, dashboards, datarooms, pipelines, sql queries, ml models etc.) on the platform. Finding an asset is a critical user journey for Databricks’ customers which helps them accomplish their tasks. As our Search product continues to evolve, we are seeking a Staff Engineer to lead enhancements to our Search Quality. We are focusing on enhancing search ranking, improving query understanding, building robust evals and growing the coverage of assets to enable seamless search at scale. Key Responsibilities Drive the development and deployment of ML based search and discovery relevance models and systems integrated with Databricks' products and services. Design and implement automated ML and NLP pipelines for data preprocessing, query understanding and rewrite, ranking and retrieval, and model evaluation, enabling rapid experimentation and iteration. Collaborate with product managers and cross-functional teams to drive technology-first initiatives that enable novel business strategies and product roadmaps for the search and discovery experience. Contribute to building a robust framework for evaluating search ranking improvements - both offline and online. What We’re Looking For BS+ (M.S. or PhD preferred) in Computer Science, or a related field. 10+ years experience developing search relevance systems at scale in production or in high-impact research environments. Experience applying LLM to search relevance Experience in one or more of the following: Query understanding NLP Text mining Recommendations Personalization Discovery Conversational AI Strong understanding of computer science fundamentals. Contributions to well-used open-source projects. Why Join Us? At Databricks, we are building state-of-the-art AI solutions that redefine how users inte

P-1408 The Applied AI team at Databricks sits at the forefront of advancing AI/ML-powered products . Databricks’ customers are continuously creating new assets (tables, notebooks, dashboards, datarooms, pipelines, sql queries, ml models etc.) on the platform. Some of them can have hundreds of millions of assets. Finding an asset is a critical user journey for Databricks’ customers which helps them accomplish their tasks. As our Search product continues to evolve, we are seeking a Staff Engineer to lead enhancements to our Search Quality. In 2025, we will focus on enhancing search ranking, improving query understanding, building robust evals and growing the coverage of assets to enable seamless search at scale. Key Responsibilities Drive the development and deployment of ML based search and discovery relevance models and systems integrated with Databricks' products and services. Design and implement automated ML and NLP pipelines for data preprocessing, query understanding and rewrite, ranking and retrieval, and model evaluation, enabling rapid experimentation and iteration. Collaborate with product managers and cross-functional teams to drive technology-first initiatives that enable novel business strategies and product roadmaps for the search and discovery experience. Contribute to building a robust framework for evaluating search ranking improvements - both offline and online. What We’re Looking For BS+ (M.S. or PhD preferred) in Computer Science, or a related field. 10+ years experience developing search relevance systems at scale in production or in high-impact research environments. Experience applying LLM to search relevance Experience in one or more of the following: Query understanding NLP Text mining Recommendations Personalization Discovery Conversational AI Strong understanding of computer science fundamentals. Contributions to well-used open-source projects. Why Join Us? At Databricks,

P-1408 The Mission We are democratizing Data and AI for every enterprise user. Our vision is a world where anyone can master their organization’s data through Apps and AI Agents. We are building the retrieval backbone for two worlds: the high-precision context layer for AI agents and the intuitive search experience for people goal is the same: instant, accurate, and actionable insight. The Role : As a Search Quality Engineer, you sit at the heart of this transformation. You aren't just building a search engine; you are building the contextual backbone of the entire company. You will own the quality of results for two distinct but deeply connected "users": The AI Agent: Optimizing the retrieval layer that allows LLMs to reason over data they weren’t trained on, ensuring they have the "ground truth" needed to synthesize accurate, high-stakes business actions. The Human User: Improving the traditional search experience so employees can find assets and answers through intuitive, high-recall interfaces. The Technical Challenge This isn't a solved problem. You will be tackling "Search" in its most evolved form: Hybrid Retrieval: Balancing traditional keyword-based search (for exactness) with semantic vector search (for intent). Dual-Optimization: Fine-tuning ranking models that satisfy both human readability and LLM-ready context. High-Stakes Accuracy: In a world of Agents, poor search quality leads to hallucinations. You will build the guardrails and relevance scoring that ensure our AI stays grounded in reality. Data Heterogeneity: Connecting the dots across structured SQL tables, unstructured docs, and real-time business metrics. Why This is the Place to Be You will have a front-row seat to the Agentic revolution. If you want to solve the hardest problems in data discovery and see your work power the decision-making of thousands of people, let’s talk. What We’re Looking For The IR Specialist: You know your way around Lucene/Elasticsearch, embe

P-1408 The Mission We are democratizing Data and AI for every enterprise user. Our vision is a world where anyone can master their organization’s data through Apps and AI Agents. We are building the retrieval backbone for two worlds: the high-precision context layer for AI agents and the intuitive search experience for people goal is the same: instant, accurate, and actionable insight. The Role : As a Search Quality Engineer, you sit at the heart of this transformation. You aren't just building a search engine; you are building the contextual backbone of the entire company. You will own the quality of results for two distinct but deeply connected "users": The AI Agent: Optimizing the retrieval layer that allows LLMs to reason over data they weren’t trained on, ensuring they have the "ground truth" needed to synthesize accurate, high-stakes business actions. The Human User: Improving the traditional search experience so employees can find assets and answers through intuitive, high-recall interfaces. The Technical Challenge This isn't a solved problem. You will be tackling "Search" in its most evolved form: Hybrid Retrieval: Balancing traditional keyword-based search (for exactness) with semantic vector search (for intent). Dual-Optimization: Fine-tuning ranking models that satisfy both human readability and LLM-ready context. High-Stakes Accuracy: In a world of Agents, poor search quality leads to hallucinations. You will build the guardrails and relevance scoring that ensure our AI stays grounded in reality. Data Heterogeneity: Connecting the dots across structured SQL tables, unstructured docs, and real-time business metrics. Why This is the Place to Be You will have a front-row seat to the Agentic revolution. If you want to solve the hardest problems in data discovery and see your work power the decision-making of thousands of people, let’s talk. What We’re Looking For The IR Specialist: You know your way around Lucene/Elasticsearch, embe

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Staff Software Engineer, Core Infrastructure Okta is the identity standard. The Okta Identity Cloud is an independent and neutral platform that securely connects the right people to the right technologies at the right time. We help organizations do two things - secure and manage their extended enterprise, and transform their customers’ experiences. With over 15,800 customers globally, 7000+ app integrations, and well over 200 million registered users, we are only getting started. Okta's Core Engineering team is responsible for building and evolving shared infrastructure and services that lay the foundation for what other engineering teams build on. We're in charge of common shared services like search, cache, configuration management, frameworks for async job management, and email pipeline, to name a few. We're cloud native, where redundancy, multi-tenancy, scale, resource optimization and resiliency are first class citizens. With Okta's mantra of 'Always On!' there's never a dull moment. Our biggest asset is our team of passionate engineers and technically minded managers. You'll be joining a team of highly skilled and talented team players who're proud of what they own and deliver. Our elite team is fast, creative and flexible; with a weekly release cycle and individual ownership we expect great things from our engineers and reward them with stimulating new projects, new technologies and the chance to have significant equity in a

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. About Okta Okta is an enterprise grade identity management service, built from the ground up in the cloud and delivered with an unwavering focus on customer success. With Okta you can manage access across any application, person, or device. Whether the people are employees, partners, or customers, or the applications are in the cloud, on premises, or on a mobile device, Okta helps you become more secure, make people more productive, and maintain compliance. The Okta service provides directory services, single sign-on, strong authentication, provisioning, workflow, and built in reporting. It runs in the cloud on a secure, reliable, extensively audited platform and integrates deeply with on premises applications, directories, and identity management systems. About the Team The Data Platform team is responsible for the foundational data services, systems, and data products for Okta that benefit our users. Today, the Data Platform team solves challenges and enables: Streaming analytics Interactive end-user reporting Data and ML platform for Okta to scale Telemetry of our products and data Our elite team is fast, creative and flexible. We encourage ownership. We expect great things from our engineers and reward them with stimulating new projects, new technologies and the chance to have significant equity in a company. Okta is about to change the cloud computing landscape forever. About the Position This is an opportunity for experienced Softwa