Staff Software Engineer, Data Catalog

Strength in Trust OneTrust’s mission is to enable innovation through the responsible use of data and AI. We believe that ensuring data is trusted shouldn’t slow teams down—it should accelerate what’s possible. This led us to develop the first technology platform for responsible data use in 2016. Today, with AI representing the latest and most impactful expansion of data yet, OneTrust is once again redefining what responsible innovation looks like. OneTrust, the AI‑Ready Governance Platform™, unifies regulatory intelligence, automation, and connected governance workflows so businesses can continue to move at the speed of AI while ensuring good governance to prevent data misuse at scale. Trusted by thousands of organizations worldwide, OneTrust is shaping the future where trusted data becomes a transformative force for business and society. The Challenge Enterprises need dependable visibility into both the data they hold and the AI they use. OneTrust’s Detection & Discovery team owns and actively maintains Data Discovery and Data Catalog capabilities while expanding discovery of AI models, agents, and related cloud resources. Customers rely on these systems to find, understand, and govern assets across complex environments. This role is intentionally balanced between strengthening the Data Discovery and Data Catalog pipeline and advancing AI Detection & Discovery. You will provide hands-on technical leadership across both: sustaining and improving mature production capabilities while building the next generation of AI discovery. Your Mission Data Discovery & Data Catalog Own the technical evolution and ongoing maintenance of Data Discovery and Data Catalog services and modules, including production support for capabilities customers depend on. Lead a major engineering-quality initiative to reduce technical debt, address critical issues, and modernize the code and architecture without compromising customer stability. Improve the stability, reli

P-1093 At Databricks, we are passionate about enabling data teams to solve the world’s toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world’s best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers — and customer obsessed — we leap at every opportunity to tackle technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started. The ManagedTables team at Databricks is responsible for the DataIntelligence initiatives that underpin the Unity Catalog ManagedTables offering. This encompasses products such as Predictive Optimization, Liquid Clustering, and control plane services facilitating Unity Catalog and Iceberg Rest Catalog API-based access to ManagedTables. The team is accountable for optimizing exabytes of data and saving millions of dollars annually for our customers through the Data Intelligence offerings. As part of this team, you will be working on realizing enterprise grade autonomous analytical datasystems - that ensure the best performance out-of-the-box. You will design and implement these next gen systems that leapfrog state-of-the-art: Storage lifecycle and additional background optimizations for a knob-free experience via Predictive Optimization Efficient storage structures and innovations to power storage layout solutions for the ML world Influence the Data format and Catalog interface unification efforts and enable strong ecosystem interoperability for ManagedTables The Impact you will have: Solve real business needs at large scale by applying your software engineering experience and by driving strong collaboration with Product partners Deliver a highly scalable, available, and inter-operable architecture for Managed Tables. Lo

We believe that the way people interact with their finances will drastically improve in the next few years. We’re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with thousands of companies like Venmo, SoFi, several of the Fortune 500, and many of the largest banks to make it easy for people to connect their financial accounts to the apps and services they want to use. Plaid’s network covers 12,000 financial institutions across the US, Canada, UK and Europe. Founded in 2013, the company is headquartered in San Francisco with offices in New York, Seattle, Washington D.C., Raleigh, London, and Amsterdam. The Data Governance team makes sure Plaid handles consumer and customer data responsibly — and can prove it. Our mission is to enforce Plaid's privacy commitments and regulatory obligations in the systems themselves rather than in policy documents: we build the platform and controls that govern how data flows through Plaid — where it lives, who can use it, for what purpose, and for how long. That includes verifiable deletion of consumer data on request, enforcement of data-use restrictions so downstream systems can only use data in permitted ways, and the cataloging and classification that let Plaid know what data it holds and how sensitive it is. We operate at the scale of Plaid's entire data footprint, and correctness and auditability matter to us as much as throughput. As a Staff Software Engineer on Data Governance, you will set the technical direction for how Plaid enforces data governance at scale. You'll lead the design of distributed backend systems that reliably delete, restrict, and track data across dozens of services, making architectural decisions whose blast radius spans the whole company. You'll drive multi-quarter initiatives from ambiguous privacy and regulatory r

At Vanta, our mission is to help businesses earn and prove trust. We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. As a Staff Software Engineer on the Automation - Foundations team, you will lead the re-platforming of the data layer underneath Vanta’s entire compliance product. This is a migration that spans multiple teams, has to preserve every public API contract along the way, and cannot lose a single customer’s evidence while it happens. Foundations is Vanta’s data platform team. We ingest security and compliance data from across our customer’s environments, currently tens of thousands of resources per second, with single-customer bursts running into the millions. We store the data, catalog it, make it queryable, and turn it into evidence that has to survive a real SOC 2 or FedRAMP audit. We are in the middle of moving our platform from a Mongo-centric architecture to a schema-aware, Postgres-backed architecture, on a Kafka and S3 pipeline that decouples data fetching from processing. Both pipelines run in parallel today, the hard problems here are correctness under migration, eventual consistency, and multi-tenancy, in a domain where “mostly right” is not an acceptable failure mode. Visit our Vanta Engineering Blog to learn more about what our team is working on. What you'll do as a Staff Software Engineer at Vanta: Lead the migration of Vanta’s resource data model from a Mongo-centric solution to a schema-aware Postgres-backed solution and running both generations in parallel without breaking a customer integration. Drive solutions across teams that you do not own but are dependent on the platform built by your team. Design for correctness under eventual consistency with idempotent session handling, conditional writes that survive out

RDQ126R35 At Databricks, observability and governance are what turn a massive, multi-tenant data and AI platform into one customers can trust at scale. We are looking for a senior technical leader to drive strategy and execution across three closely related teams at the heart of that mission: Query Observability, SQL Warehouse Management, and Account-Level Observability and Governance. Query Observability builds the performance and observability tooling, ingesting very large volumes of query telemetry and turning it into history views, execution plans, performance insights, and recommendations that help customers run workloads reliably at scale. Beyond query observability, you will be responsible for building observability and actionable insights at compute level, workspace level, and account level so that admins can confidently manage large accounts. This is a new technical leadership role responsible for setting the durable architecture across all these surfaces, raising the engineering bar of the combined team, and shaping the next generation of agentic experiences that let users — and the systems they run on — investigate, diagnose, and act on insights across query, warehouse, workspace, and account levels. The Impact You Will Have Establish the long-term technical direction across query observability, warehouse management, and account-level governance, and own the multi-year architecture all three surfaces are built on. Design and lead high-impact projects that move the needle on performance, reliability, and cost transparency for customers. Build the next generation of agentic observability and governance — extensible experiences that let users and automated agents investigate, diagnose, and act on telemetry across query, warehouse, and account. Partner deeply with Databricks SQL, Unity Catalog, AI, security, and platform teams to integrate end-to-end visibility and governance across the data plane and control plane. Mentor senior engineers, set the technical

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community you will join Airbnb's Data Authoring Platform exists to turn raw data into decision-grade insight, fast, reliable, and at scale. We provide a single, paved path for 4,000+ internal data producers and consumers to model, transform, and serve trustworthy data and metrics that power everything from A/B experimentation to executive dashboards. What we own: Minerva, Airbnb's semantic layer & metrics platform , ensuring one definition of truth across the company. The end-to-end data-authoring framework that cuts through pipeline boilerplate and accelerates iteration, pipeline testing, and validation. Tooling for reliability, governance, and cost-efficiency, including automated testing, anomaly detection, and right-sized materialization. The difference you will make As a Staff Software Engineer focused on Minerva, you will own and drive high-impact workstreams end to end. You'll take ambiguous problem spaces, such as making experimentation faster and easier, talk to users, define the work, and deliver it. Your work will help thousands of internal users define, understand, and consume trustworthy business metrics across product, finance, BI, and experimentation. Engineers, designers, and product leaders rely on these tools to explore and develop new product experiences and to run experiments that tell them what is right for our customers. Depending on your background, you may partner closely with the experimentation team to find gaps and shape how Minerva serves them. We believe data is the voice of our customers at scale. The tools you build will help improve the Airbnb product for every guest and h