Software Engineer 2c Inference Performance Optimization Jobs

Truveta is the world’s first health provider led data platform with a vision of Saving Lives with Data. Our mission is to enable researchers to find cures faster, empower every clinician to be an expert, and help families make the most informed decisions about their care. Achieving Truveta’ s ambitious vision requires an incredible team of talented and inspired people with a special combination of health, software and big data experience who share our company values . This position is based out of India (Hyderabad). Who We Need Truveta is rapidly building a talented and diverse engineering team to solve complex healthcare and technology challenges. We are seeking a Senior Software Engineer with deep backend services engineering experience and a proven track record of building reliable, scalable, cloud-native systems. This role is ideal for an experienced engineer who can design and deliver backend APIs, distributed services, data-driven applications, and platform capabilities using Microsoft Azure and .NET technologies. You will work closely with product managers, architects, security teams, and other engineers to build services that power Truveta’s healthcare data platform. As a senior engineer, you will also help shape technical direction, drive engineering best practices, mentor other engineers, and contribute to the long-term reliability, scalability, and maintainability of Truveta’s services. This Opportunity Join the founding team of the Truveta India Development Center (IDC) and play a pivotal role in shaping its future. As one of the initial members, you'll help build and scale a high-impact organization while contributing to products and platforms that advance healthcare through data and AI. This is a unique opportunity to influence both the technical direction and the culture of a growing global engineering hub. Patients, doctors, and medical researchers deserve the same cutting-edge technological inn

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. Snowflake is a high-growth, cloud-native data platform company committed to empowering enterprises to achieve their full potential. With a culture built on impact, innovation, and collaboration, we offer an environment where you can build large-scale systems, move fast, and take your technology career to the next level. We are seeking an outstanding Staff Software Engineer with a passion for large scale databases and distributed systems to help us take the FDB platform to the next level. A massive new market opportunity is being created at the intersection of Cloud and Data, and the Snowflake Data Cloud is leading the way, all powered by the database engine we are building from the ground up. Key to Snowflake’s Database Engine is our large scale distributed transactional Key-Value store - called FDB - which powers all of Snowflake’s products and services and is rapidly evolving to meet Snowflake’s future needs. FDB runs on multiple cloud providers including Amazon Web Services, Microsoft Azure and Google Cloud. The elastic infrastructure FDB runs on is being built from the ground up and is envisioned to be a cloud agnostic, fully automated manageability platform that provides: Autoscaling and auto-balancing of clusters based on utilization, traffic and workloads Auto-provis

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join: The Host Pricing & Settings team builds the platform and tools that help hosts run their business — with pricing strategies informed by market intelligence, comparable listings, and demand signals. We partner with Search, Listings, Tax, and Payments to ensure our guidance is accurate, timely, and trusted. Behind every pricing recommendation is a sophisticated ML system undergoing a fundamental rearchitecture. Our north star: a serving infrastructure where training, inference, and evaluation are consistent by design — features from a centralized store, model composition in one place, and backfills available on demand so data scientists and MLEs can evaluate candidates in days, not weeks. The Difference You Will Make: As a senior technical individual contributor, you will own the technical strategy for the full Modeling → ML Serving → API interface across the Host Pricing org. Although you will be at one of our highest levels of seniority, all individual contributors at Airbnb are Software Engineers — you are expected to be hands-on and contribute code. Define the architecture and contracts governing how models move from development to production — feature store design, model schema management, online/offline inference consistency, and multi-version support. Lead the buildout of a unified serving stack that eliminates per-model one-off implementations and gives data scientists a turnkey path from training to production. Architect backfill and evaluation infrastructure so the modeling team can simulate production inference over historical data in days, not weeks. Establish do

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible. At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI. Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here . Job Title: Staff Software Engineer, Edge Team. Intro : The Edge team owns the systems (including CDN, TLS, DNS, ingress/egress proxy fleet, and rate limiting) that connect 600M+ users to Pinterest. We're looking for a Staff Software Engineer to lead our efforts to manage automation traffic (such as bots and crawlers) at the Edge, while shaping the future of our rate limiting platform.. What you’ll do: Build Edge systems that combine in-house implementation, open-source software like Envoy proxy, and multiple CDN & DNS providers. Balance what to build, what to leverage from the community, and what to orchestrate across vendors. Drive automation traffic management efforts in the Edge space, designing solutions to manage bots and crawlers at scale. Design and implement request processing logic in Envoy to support Edge capabi

What you’ll do Act as the technical lead for large parts of the scanner platform: system architecture, codebase structure, and long-term maintainability. Own core runtime foundations: distributed control, state management, fault handling, and reliability. Drive engineering rigor: testability, code quality, review standards, performance regression prevention, and release processes. Build robust observability: logs, metrics, traces, and replayable diagnostics (with privacy constraints). Collaborate with hardware and recon/ML teams to define interfaces, data contracts, timing/synchronization, and failure modes. Lead complex refactors (e.g., message passing / RPC boundaries, modularization, concurrency model) without halting forward progress. What we’re looking for Deep software architecture experience for real-world systems: robotics, instrumentation, medical devices, or other complex distributed products. Strong Python and concurrency background (asyncio, multiprocessing, profiling, performance engineering). Track record of shipping systems that are observable, debuggable, and resilient. Strong technical leadership: clarity, pragmatic trade-offs, and mentoring. Useful experience Building but rock-solid systems: clear interfaces (gRPC/protobuf or equivalent), strong state modeling, and failure handling. High-leverage engineering habits on a lean team: good tests, CI, reproducible dev environments, and fast code review. Practical performance + concurrency work in Python (asyncio, profiling, multiprocessing) and comfort debugging distributed behavior. Security-minded device software: safe defaults, encrypted data paths, and disciplined handling of PII/PHI. Operational thinking: remote updates/management, excellent logging, and diagnostics that make real hardware debuggable.

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Role Overview We are seeking a Senior Software Engineer to build and evolve Okta’s web platform using React and Next.js. In this role, you will bring deep frontend expertise to solve complex engineering problems autonomously from designing scalable page systems and optimizing performance to integrating CMS APIs and refining developer workflows. You work independently on ambiguous problems but thrive in collaboration with designers, content architects, and fellow engineers. AI-assisted development tools are part of how this team works, and you leverage them fluently to move faster while maintaining high standards. This is a hands-on IC role with significant autonomy and real ownership, ideal for an engineer who combines deep technical understanding with strong collaborative instincts. Key Responsibilities Frontend Development & Architecture: Build and maintain reusable page templates, features, and component systems in Next.js using TypeScript and React. Design scalable data-fetching patterns from headless CMS APIs (GraphQL and REST), transforming structured content into polished frontend experiences. Collaborate on content model design with content architects, ensuring CMS data maps cleanly to frontend templates. Implement responsive, accessible, high-performance UI following established design system patterns and propose improvements when existing patterns fall short. Design System Collaboration: Work closely with the design system team to assemble pag

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. Our team builds and operates Snowflake's Streaming Platform — the core infrastructure responsible for bringing data into Snowflake continuously and at scale. This includes Snowpipe Streaming and Datastream, services used by large set of enterprise customers to move mission-critical data in real time. Data is the fuel powering the new enterprise AI world, and we are the team responsible for getting it there reliably, continuously, and fast. Responsibilities Design, build, and maintain core components of Snowflake's streaming ingestion platform Improve service reliability, scalability, and latency under high-throughput production workloads Debug and resolve incidents in a distributed, multi-tenant cloud service Contribute to the design and evolution of streaming APIs, SDKs, and server-side protocols Write comprehensive tests including unit, integration, and chaos/fault-injection scenarios Collaborate with partner teams (storage, query, compute) on cross-cutting platform concerns Participate in code reviews, on-call rotations, and architecture discussions Required Qualifications 3–5 years of software engineering experience on large-scale distributed systems or cloud services Strong proficiency in Java or C++ Deep understanding of distributed systems concepts: consistency, faul

The eBPF APM team is building a zero-instrumentation observability solution that automatically discovers services on every host, supports both plaintext and TLS-encrypted traffic, classifies Layer 7 protocols, decodes service-level traffic, and reports RED (requests, errors, duration) metrics. Leveraging deep expertise in eBPF, the team operates across a wide range of Linux kernel versions, distributions, and complex customer environments. In addition to low-level networking, the team solves challenges related to protocol versioning, TLS detection across diverse languages and runtimes, and resilient performance in production systems We’re looking for a senior engineer with strong systems-level thinking and a good understanding of Linux. You should be comfortable working close to the kernel, ideally with experience in eBPF, or with a strong desire to dive into it. Proficiency in C/C++/ Go is essential, and familiarity with networking protocols, TLS internals, or distributed tracing is a strong advantage. You’ll join a high-impact team tackling ambitious technical challenges—like decoding traffic across multiple protocols, and ensuring high-fidelity metrics in complex, real-world environments. You’ll be expected to lead design and implementation efforts, contribute to roadmap planning, and collaborate across teams to ensure our solution remains robust, scalable, and frictionless for our users. This role is a great fit for engineers who thrive on low-level, performance-sensitive problems, and want to shape the future of observability through cutting-edge kernel technology. At Datadog, we place value in our office culture - the relationships that it builds, the creativity it brings to the table, and the collaboration of being together. We operate as a hybrid workplace to ensure our employees can create a work-life harmony that best fits them. What You’ll Do: Design and build core components of our zero-instrumentation APM product using eBPF and Go Develop systems to aut

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Okta is The World’s Identity Company. We free everyone to safely use any technology - anywhere, on any device or app. Our Identity as a Service solution enables secure yet flexible access, authentication, and automation that transforms how people move through the digital world, putting Identity at the heart of business security and growth. At Okta, we celebrate a variety of perspectives and experiences. We are not looking for someone who checks every single box - we’re looking for lifelong learners and people who can make us better with their unique experiences. The Engineering Opportunity Okta's Workforce Identity Cloud (WIC) secures billions of global logins every day. The Resilience Team within WIC maximizes service availability by building foundational, high-scale systems. Our engineers solve complex distributed-systems challenges - from database proxies to traffic shaping - to ensure the platform remains trustworthy and reliable for every customer. We are seeking a Staff Back-End Software Engineer to lead technical initiatives and own the reliability of our expanding Identity as a Service platform. In this role, you will develop microservices, build innovative frameworks, and optimize our cloud-native environment. You will champion reliability during design phases and collaborate across teams to address technical gaps. We value iterative development, automated testing, and individual ownership. Join our creative, fast-paced team to work on impac

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Staff Software Engineer (Full Stack - Backend) Staff Software Engineer The Product Auth0 is a developer-friendly identity platform designed by developers, for developers, simplifying authentication and authorization for more than 100 million daily logins worldwide. Within this global platform, our team drives two of Auth0’s most critical, high-impact surfaces: The Manage Dashboard: The definitive front door for developers and enterprise administrators worldwide. It is the control center where our customers configure critical identity policies, manage complex organizations, and monitor active threat intelligence. The Auth0 Marketplace: Our rapidly expanding extensibility ecosystem. The Marketplace allows customers to seamlessly discover and install third-party integrations - such as security monitoring, consent management, and database connectors - to dynamically customize their identity pipeline. The Role As a Staff Engineer on this team, you will not just write code; you will own the technical strategy, architect highly resilient frameworks, design developer-friendly APIs, and mentor a high-performing team of engineers. Your architectural ownership will span the entire stack - from the React-based frontend down through our Node.js/Go services, robust operational pipelines, and PostgreSQL databases. What You Will Do: Product Ownership: Lead the technical lifecycle of your team’s products, ensuring they are robust, secure, and performant from the frontend to

SmartBear delivers application integrity for modern tech stacks, ensuring continuous, measurable assurance that software just works as intended with governance to operate at AI speed and scale. SmartBear offers deep test automation, API lifecycle management, and observability capabilities. With integrations across the SDLC, it sets a new quality standard for application delivery teams. SmartBear is trusted by developers, testers, and software engineers across 32,000 organizations, including 75% of the largest financial institutions and industry leaders such as Adobe, JetBlue, and Microsoft. SmartBear’s open source tools are downloaded more than 100 million times a month and have earned over 30,000 GitHub stars from the developer community. With its best-loved brands, including Swagger, TestComplete, Reflect, QMetry, Zephyr, and more, SmartBear meets customers where they are to make our technology-driven world a better place. Learn more at www.smartbear.com , or follow us on LinkedIn , X , and Reddit . At SmartBear, you will be part of a dynamic team solving one of the most critical challenges facing modern businesses: ensuring the integrity of software in an AI-driven world. Whether you are working directly with customers, driving go to market strategies, supporting operations, building products, or enabling teams, your contributions help shape the future of software quality for organizations worldwide. Join us in our mission. Senior Software Engineer - C++ TestComplete Developing and maintaining the testing tool using C++. Collaborating with the team to implement and enhance backend functionalities. Tech stack: C++, C#, Delphi, Avalonia, Windows programming (COM, WinApi), GUI (DevExpress) Product intro All businesses today interact with their customers via an app, and the wide range of use cases and configurations available in the market today makes it extremely hard to deliver high-quality apps at speed. And end-users today do not have the time

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. The AI-Core Team The team is building a scalable Agentic AI platform for agents that run real engineering work, agents that write code, triage incidents, investigate alerts, remediate vulnerabilities, upgrade libraries, patch flaky tests, automate runbooks, and other workloads across Okta's infra. Owning this platform means owning the hard cross cutting problems: agent identity, delegated access, secure isolated execution, orchestration, and governance, at the scale and reliability bar that Infra demands. The work is novel and high ownership, and the candidate should be drawn to problems the industry hasn't solved yet. What You'll Work On Design and implement backend APIs and services that make up the agentic platform Build the agent identity and machine-to-machine authentication system, including credential management and delegated access flows Build the agent knowledge base and memory layer so agents retain context within and across sessions Buil

About Pinterest: Millions of people around the world come to our platform to find creative ideas, dream about new possibilities and plan for memories that will last a lifetime. At Pinterest, we’re on a mission to bring everyone the inspiration to create a life they love, and that starts with the people behind the product. Discover a career where you ignite innovation for millions, transform passion into growth opportunities, celebrate each other’s unique experiences and embrace the flexibility to do your best work. Creating a career you love? It’s Possible. At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. To get a complete picture of your experience and abilities, we’ll explore your foundational skills and how you collaborate with AI. Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think. You can read more about our AI interview philosophy and how we use AI in our recruiting process here . Intro : The Service Communications team manages the foundational high-layer networking systems ensuring reliable, secure, and performant service-to-service interactions at Pinterest. Our Envoy-based mesh and multi-language frameworks provide critical primitives for hundreds of internal services, and we are looking for a Staff Engineer to lead technical strategy across identity, traffic optimization, and platform scaling. What you’ll do: Architect and deploy advanced service mesh features, focusing on service discovery, traffic shaping, and deep observability using Envoy proxy. Lead the organization-wide adoption of service identity and mTLS to satisfy critical AAA security requirements for service-to-service paths. Design traffic optimization primitives like locality-aware routing to materially reduce data transfer costs for high-vo

At ClickUp, we're building the future of work: the first truly converged AI workspace unifying tasks, docs, chat, calendar, and enterprise search, all supercharged by context-driven AI. We are an AI-native company. Every team member is expected to leverage AI daily, and we evaluate AI fluency as part of our hiring process. Join us and help redefine what's possible. 🚀 The Mission The Foundry is ClickUp's internal AI innovation lab — embedded inside GTM Systems and accountable for turning AI capabilities into production-grade, internally deployed products that make every GTM function faster and smarter. We build the infrastructure that powers AI-first work across Sales, Marketing, Post-Sales, and Revenue Operations. As the Senior Software Engineer on this team you will own the technical delivery of our MCP server platform, agent orchestration layer, and internal tooling — shipping production systems used daily by hundreds of ClickUp employees, and scaling your own throughput by treating AI tools as first-class engineering collaborators. What You'll Own MCP Server Platform Design, build, and operate Model Context Protocol servers that expose CRM, ticketing, analytics, and communication data to AI agents across the GTM stack Implement Okta PKCE authentication flows and RBAC policy enforcement so agents access only the data they're authorized to touch Maintain deployment infrastructure on AWS (Bedrock, Lambda, ECS, API Gateway) and contribute to GCP workloads where applicable Own observability: structured logging, distributed tracing, latency SLOs, and on-call runbooks for every production server Agent Orchestration & AI-Native Products Build and maintain multi-step autonomous agents that execute end-to-end GTM workflows — lead qualification, deal room assembly, onboarding automation, support triage, and more Architect prompt engineering frameworks, tool-call schemas, and agent evaluation harnesses that make AI behavior predictable and auditable Integrate with LLM p

About Us At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world’s largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of code. Internet properties powered by Cloudflare all have web traffic routed through its intelligent global network, which gets smarter with every request. As a result, they see significant improvement in performance and a decrease in spam and other attacks. Cloudflare was named to Entrepreneur Magazine’s Top Company Cultures list and ranked among the World’s Most Innovative Companies by Fast Company. At Cloudflare, we’re not looking for people who wait for a polished roadmap; we’re looking for the builders who see the cracks in the Internet that everyone else has simply learned to live with. We value candidates who have the instinct to spot a "normalized" problem and the AI-native curiosity to create a solution using the latest tools. Our culture is built on iteration, leveraging AI to ship faster today to make it better tomorrow, while ensuring that every improvement, no matter how small, is shared across the team to lift everyone up. If you’re the type of person who values curiosity over bureaucracy, and that AI is a partner in solving tough problems to keep the Internet moving forward, you’ll fit right in. Available Locations Austin, US About the Role Cloudflare's People team supports 5,000+ employees globally. To scale, we are building an AI-driven operating layer on the Cloudflare Developer Platform to automate workflows, ensure data integrity, and streamline employee support. You will ship production systems for hiring, onboarding, and self-service, using AI to create leverage while designing rigorous guardrails for sensitive employee data. Lever