Staff+ Software Engineer, Memory & Search

P-1285 About This Role As a staff software engineer for GenAI inference, you will lead the architecture, development, and optimization of the inference engine that powers Databricks Foundation Model API.. You’ll bridge research advances and production demands, ensuring high throughput, low latency, and robust scaling. Your work will encompass the full GenAI inference stack: kernels, runtimes, orchestration, memory, and integration with frameworks and orchestration systems. What You Will Do Own and drive the architecture, design, and implementation of the inference engine, and collaborate on model-serving stack optimized for large-scale LLMs inference Partner closely with researchers to bring new model architectures or features (sparsity, activation compression, mixture-of-experts) into the engine Lead the end-to-end optimization for latency, throughput, memory efficiency, and hardware utilization across GPUs, and accelerators Define and guide standards to build and maintain instrumentation, profiling, and tracing tooling to uncover bottlenecks and guide optimizations Architect scalable routing, batching, scheduling, memory management, and dynamic loading mechanisms for inference workloads Ensure reliability, reproducibility, and fault tolerance in the inference pipelines, including A/B launches, rollback, and model versioning Collaborate cross-functionally on Integrating with federated, distributed inference infrastructure – orchestrate across nodes, balance load, handle communication overhead Drive cross-team collaboration: with platform engineers, cloud infrastructure, and security/compliance teams Represent the team externally through benchmarks, whitepapers, and open-source contributions What We Look For BS/MS/PhD in Computer Science, or a related field Strong software engineering background (6+ years or equivalent) in performance-critical systems Proven track record of owning complex system components and driving architectural decisions end-to-end Deep understa

At Affirm, we exist for the moments that matter—giving people a clear, predictable way to pay over time, with no hidden fees, no surprises, and no tradeoffs on what matters most. The Capacity Modeling team ensures Affirm can safely handle forecasted traffic—especially during peak sales events—by translating demand forecasts into concrete, testable capacity plans. They build and maintain statistical capacity models that map traffic inputs (e.g., checkout volume, app opens, batch/job activity) to resource outputs (CPU, memory, connections) and then convert those forecasts into recommended capacity settings such as pod counts, HPA ranges, and/or infrastructure sizing changes across regions and environments. The coverage of infrastructure resources includes not only Compute but also infrastructure such as ElasticCache, DynamoDB, AuroraDB, and more. What You'll Do You will be responsible for setting technical strategy for your team on a year-long time scale, and help your team tie it together with critical, business-impacting projects. You will collaborate across teams in the product development lifecycle by collaborating with product management, design & analytics to ensure technical sustainability, risks and trade-offs are well understood and managed. You will act as a force-multiplier for your team through your definition and advocacy of technical solutions and operational processes. You take ownership of your team’s operations and availability by ensuring you have the right monitoring, triage rotations, playbooks, policies, testing and alerting in place to support “keep the lights on” & on-call efforts. You will foster a culture of quality and ownership on your team by setting code review and design standards for your team, and advocating for them beyond your team through your writing and tech talks. You will help develop talent on your team by providing feedback and guidance, and leading by example. What We Look For You have 8+ years of experience des

Why Harvey At Harvey, we’re transforming how legal and professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come. This is a rare chance to help build a generational company at a true inflection point. We have strong product-market fit and world-class investor support. We’re scaling fast and defining a new category in real time. The work is ambitious, the bar is high, and the opportunity for growth — personal, professional, and financial — is unmatched. Our team moves fast, takes ownership, and is deeply committed to the mission — operating with intensity, staying close to our customers, and pushing each other for excellence. We live by three values: Decisiveness, Simplicity, and Job's Not Finished. We act quickly on clear judgment over perfect information, we believe simplicity is what scales, and we're never satisfied with where we are. If you want to do the best work of your career alongside people who share that drive, we'd love to build with you. At Harvey, the future of professional services is being written today — and we’re just getting started. Role Overview Harvey’s products all depend on a shared AI foundation: the model layer and agent infrastructure that determine the quality of work our agents deliver. Legal is one of the hardest domains for AI: documents run to hundreds of pages, matters can span millions of files, and there is zero margin for error on accuracy. The AI Platform team builds the foundation that every product and agent team at Harvey builds upon. This team is early and there’s a lot to build: model routing, agent architecture, context management, evals. Your work here sets the ceiling for what Harvey’s AI can do. Representative Projects Context Engineering & Agent Infrastructure. Build the platform-level systems for context management, session state, and memory that all of Harvey’s agents and produc

Why Harvey At Harvey, we’re transforming how legal and professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come. This is a rare chance to help build a generational company at a true inflection point. We have strong product-market fit and world-class investor support. We’re scaling fast and defining a new category in real time. The work is ambitious, the bar is high, and the opportunity for growth — personal, professional, and financial — is unmatched. Our team moves fast, takes ownership, and is deeply committed to the mission — operating with intensity, staying close to our customers, and pushing each other for excellence. We live by three values: Decisiveness, Simplicity, and Job's Not Finished. We act quickly on clear judgment over perfect information, we believe simplicity is what scales, and we're never satisfied with where we are. If you want to do the best work of your career alongside people who share that drive, we'd love to build with you. At Harvey, the future of professional services is being written today — and we’re just getting started. Role Overview Harvey’s products all depend on a shared AI foundation: the model layer and agent infrastructure that determine the quality of work our agents deliver. Legal is one of the hardest domains for AI: documents run to hundreds of pages, matters can span millions of files, and there is zero margin for error on accuracy. The AI Platform team builds the foundation that every product and agent team at Harvey builds upon. This team is early and there’s a lot to build: model routing, agent architecture, context management, evals. Your work here sets the ceiling for what Harvey’s AI can do. Representative Projects Context Engineering & Agent Infrastructure. Build the platform-level systems for context management, session state, and memory that all of Harvey’s agents and produc

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. The Staff Software Engineer Opportunity The team that built Jeeva AI is building Digital Workers, a new suite of autonomous agents for identity operations and security inside Okta. The team works directly with Todd McKinnon, Okta's co-founder and CEO, with the opportunity to bring this product to Okta's 20,000+ customers. You will help shape the product with the ownership and pace of a startup and the resources of a public company. You will build the harnesses and evaluations that make these workers reliable. They investigate risk, use tools, wait for approvals and complete tasks across enterprise systems. Bring depth in agent execution or model quality and help turn it into working software customers can trust. About You Production builder : You have shipped AI software and know what changes when real users depend on it. Careful evaluator : You investigate failures and use evidence to judge quality. Strong owner: You follow an improvement through code, evaluation, release and customer use. What you will be doing Build the agent harness for planning, tool use, memory, context compaction, interruption and recovery during long-running work. Integrate OpenAI and Anthropic model APIs. Select models using measured quality, latency and cost, with clear failure handling. Evaluate existing harnesses and build only the missing pieces. Keep the harness connected to AWS workflow execution and approval state. Keep authorization and sensitive writes behind application p

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. Snowflake is now building a world class OLTP service on Postgres. We’re hiring Senior Postgres Engineers to help build the new Snowflake Postgres service. This is an exciting opportunity to help build a large scale, multi-cloud Postgres offering with access to an existing customer base. AS A SENIOR POSTGRES ENGINEER YOU WILL: Develop orchestration layer/ control-plane of large scale databases Work with AWS, Azure, and GCP APIs Build High Availability and Disaster Recovery solutions Tune Postgres to operate at scale for some of the largest datasets in the world Secure and ensure customer data is protected Work alongside some of the brightest minds in the industry and help redefine the space by inventing at various layers of the software stack — from broad distributed systems to low-level optimizations that fundamentally change the performance characteristics of the system to cater to our customer needs. OUR IDEAL SENIOR POSTGRES ENGINEER WILL HAVE: 7+ years industry experience designing, building and developing large scale systems in production Experience building and maintaining distributed, highly available, fault tolerant services Excellent understanding of low level operating systems concepts including multi-threading, memory management, networking, storage, performance,