Software Engineer Distributed Systems Jobs

Scale GP (Scale Generative AI Platform) is an enterprise-grade Generative AI platform that provides APIs for knowledge retrieval, inference, evaluation, and more. We are looking for a strong engineer to join our team and help us build and scale our product in a fast-paced environment. The ideal candidate will have a strong understanding of software engineering principles and practices, as well as experience with large-scale distributed systems. You will be responsible for owning large new areas within our product, working across backend, frontend, and interacting with LLMs and ML models. You will solve hard engineering problems in scalability and reliability. You will: Own large new areas within our product Work across backend, frontend, and interacting with LLMs and ML models Deliver experiments at a high velocity and level of quality to engage our customers Work across the entire product lifecycle from conceptualization through production Be able, and willing, to multi-task and learn new technologies quickly Ideally you'd have: 7+ years of full-time engineering experience, post-graduation Experience scaling products at hyper growth startups Experience tinkering with or productizing LLMs, vector databases, and the other latest AI technologies Proficient in Python or Javascript/Typescript, and SQL Experience with Kubernetes Experience with major cloud providers (AWS, Azure, GCP) Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position and may be inclusive of several career levels at Scale; it will be determined during the interview process based on work location and additional factors, including job-related skills, experience, qualifications, interview performance, and relevant education or training. Scale employees in eligible roles are also granted equity based compensation, subject to Board of Director approval

About the Team Our Inference team brings OpenAI’s most capable research and technology to the world through our products. We empower consumers, enterprise and developers alike to use and access our start-of-the-art AI models, allowing them to do things that they’ve never been able to before. We focus on performant and efficient model inference, as well as accelerating research progression via model inference. About the Role We are looking for an engineer who wants to take the world's largest and most capable AI models and optimize them for use in a high-volume, low-latency, and high-availability production and research environment. In this role, you will: Work alongside machine learning researchers, engineers, and product managers to bring our latest technologies into production. Work alongside researchers to enable advanced research through awesome engineering. Introduce new techniques, tools, and architecture that improve the performance, latency, throughput, and efficiency of our model inference stack. Build tools to give us visibility into our bottlenecks and sources of instability and then design and implement solutions to address the highest priority issues. Optimize our code and fleet of Azure VMs to utilize every FLOP and every GB of GPU RAM of our hardware. You might thrive in this role if you: Have an understanding of modern ML architectures and an intuition for how to optimize their performance, particularly for inference. Own problems end-to-end, and are willing to pick up whatever knowledge you're missing to get the job done. Have at least 5 years of professional software engineering experience. Have or can quickly gain familiarity with PyTorch, NVidia GPUs and the software stacks that optimize them (e.g. NCCL, CUDA), as well as HPC technologies such as InfiniBand, MPI, NVLink, etc. Have experience architecting, building, observing, and debugging production distributed systems. Bonus point if worked on performance-critical distributed systems. Have need

About Vercel: Vercel is the agentic infrastructure company, freeing people and agents to ship what's next. For more than a decade we've helped builders move from idea to production with speed, security, and exceptional developer experience. Now we're scaling our products for both agents and people to ship and run software, built in the open and trusted by OpenAI, PayPal, Ramp, Supreme, and millions of developers worldwide. About the Role: We are looking for a Software Engineer to join our Observability team. Vercel users rely on Observability to monitor and understand their applications’ health and behavior. In this role, you will design, implement, and maintain Observability products that meet high-quality standards and integrate seamlessly with the Vercel Platform. This role is based in NYC. If you’re based within a pre-determined commuting distance of one of our offices (SF, NY, London, or Berlin), the role includes in-office anchor days on Monday, Tuesday, and Friday. If you're located beyond that distance, the role is fully remote. For location-specific details, please connect with our recruiting team. What You Will Do: Handle large-scale data ingestion, storage, and processing from distributed systems. Develop cutting-edge visualization tools to provide insights into application behavior and performance. Integrate observability features with popular frontend tools, frameworks, and build systems to enhance developer experience. Write clean, efficient, and well-documented code, ensuring platform reliability through thorough testing. Collaborate with product managers, designers, and infrastructure teams to solve challenges and deliver top-tier solutions. Engage with the open-source community by contributing to projects and participating in discussions, supporting Vercel’s developer-focused mission. Collect feedback from developers and users to drive continuous innovation and improvement in the observability product area. About You: You have at least 5+ year

Reddit is a community of communities. It’s built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 130 million daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit www.redditinc.com . Reddit has a flexible workforce! If you happen to live close to one of our physical office locations our doors are open for you to come into the office as often as you'd like. Don't live near one of our offices? No worries: You can apply to work remotely in any country in which we have a physical presence. Role Description: This is a generalist mid-level backend position within the Ads Organization. Ads is the fuel that powers Reddit’s mission. As a backend engineer on the team, candidates might work on: Microservices and APIs that power our advertiser-facing product, ads.reddit.com Distributed systems that ensure the right ad gets shown to the right user at the right time Backends that power interactive user experiences on our ads like Polls and Games Real time, data intensive systems that measure the performance of our ad campaigns Infrastructure that supports all of the above Technologies used on the team include: Languages: Go, Python, Scala Frameworks: Spark, Thrift, Baseplate, Kafka Datastores: Postgres, BigQuery, Redis, Druid Tools: Kubernetes, Argo, Docker Mid-level engineers are expected to absorb best practices and learn exceptionally quickly while being effective core contributors. Engineers at this level must be able to code independently, but may work with senior engineers on the design of complex solutions. The most important skills an engineer at this level must possess are 1) coachability and an eagerness to grow, 2) deep passion for coding, and 3) excellent independent learning skills, all while o

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role If you joined us today, you get to author the strategy by which each of Palantir’s software platforms - Foundry, Gotham, Apollo - achieves full containerization across an intimidating diversity of infrastructure types. Tomorrow, you get to do the same for Palantir’s ever expanding customer community. You will drive those goals by building elegant, robust APIs powered by K8s controllers which bridge the gap between a raw Kubernetes cluster and a fully-featured, infrastructure agnostic runtime that can scale to the operational needs of 100s of specialized microservices. Joining you on that journey is a highly motivated team with a diverse group of backgrounds and skillsets, brimming with ambition. Core Responsibilities Engage with and internalize Palantir’s infrastructure strategy and the needs of your team’s customer base Deeply understand and leverage K8s primitives, the broader OSS ecosystem around K8s, and highly technical service lifecycle semantics to solve business critical problems at scale Build and evolve the APIs through which in-house as well as third-party software developers interact with K8s to satisfy their runtime needs, cleanly abstracting away the complex distributed systems powering them Work closely with your team and stakeholders to enable sustainable and timely delivery of technical solutions to address business needs Champion a long-term tech roadmap to reduce operational burden, ensure scalability, reduce risk, and strive for step-changes whenever possible What We Value Clear and concise verbal and written communications A focus on impact and an ability to articulate the valu

Roles and Responsibilities Write maintainable/scalable/code Work in a cross-functional team, collaborating with peers during the entire SDLC. Follow coding standards, unit-testing, code reviews etc. Follow release cycles and commitment to deadlines. Qualifications & Experience Experience level of 3 to 6 years of experience in very large scale applications. Fair understanding in problem solving skills, data structures and algorithms. Experience with distributed systems handling large amounts of data. Fair understanding in coding skills in Java/J2EE, Web technologies, RDBMS/messaging.

Roles and Responsibilities Write maintainable/scalable/e?cient code. Work in a cross-functional team, collaborating with peers during the entire SDLC. Follow coding standards, unit-testing, code reviews etc. Follow release cycles and commitment to deadlines. Qualifications & Experience Experience level of 3 to 5 years of experience in very large scale applications. Fair understanding in problem solving skills, data structures and algorithms. Experience with distributed systems handling large amounts of data. Fair understanding in coding skills in Java/J2EE, Web technologies, RDBMS/messaging.

Roles and Responsibilities Write maintainable/scalable/e?cient code. Work in a cross-functional team, collaborating with peers during the entire SDLC. Follow coding standards, unit-testing, code reviews etc. Follow release cycles and commitment to deadlines. Qualifications & Experience Experience level of 3 to 5 years of experience in very large scale applications. Fair understanding in problem solving skills, data structures and algorithms. Experience with distributed systems handling large amounts of data. Fair understanding in coding skills in Java/J2EE, Web technologies, RDBMS/messaging.

About eClinical Solutions eClinical Solutions is transforming clinical development with elluminate®, our Clinical Data Cloud , helping life sciences organizations unify, analyze, and unlock the value of their data faster than ever before. By combining a modern cloud platform with expert data services, we empower smarter decisions across the clinical trial lifecycle—accelerating innovation that ultimately improves patient outcomes. Our engineering teams build enterprise-grade, revenue-generating products at the intersection of cloud, data, analytics, and emerging AI technologies . If you’re excited about building sophisticated software that makes a real-world impact on healthcare, this is the place to do it. You will make an impact: As a Principal Full Stack Software Engineer , you will be a technical leader within the elluminate Product Development team. You’ll help design and build the core services and user experiences of a next-generation clinical data and analytics platform—while influencing architecture, engineering standards, and technical direction. This role is ideal for an experienced engineer who enjoys hands-on development , mentoring others, and bringing modern capabilities—including AI-assisted and agentic workflows—into production-grade systems . Your day to day: Design, develop, test, and deploy scalable, secure, and highly interactive web applications Own and evolve core platform modules , from concept through release and support Influence application and system architecture with a focus on performance, reliability, security, and maintainability Lead by example through clean, well-tested code , thoughtful design reviews, and pragmatic technical decisions Collaborate closely with Product Management, QA, and other engineers throughout the SDLC Provide technical mentorship and guidance to other engineers on the team Diagnoses and resolves complex production issues across distributed systems Ensure solutions meet eClinica

SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today, SpaceX is actively developing the technologies to make this possible, with the ultimate goal of making life multiplanetary and expanding consciousness to the stars. SpaceXSI is building Super Intelligence to help humanity understand the universe. Our teams are building the full Super Intelligence stack: from our Colossus supercomputers, to Grok models, to our suite of applications, including Grok Bot, Grok Build, Grok Imagine, Grok Voice, and X. We're creating a powerful flywheel where more compute trains better models, better models power more useful products, and what we learn from people using those products shapes what we build next. ABOUT THE ROLE: At SpaceXSI, we design, build, and operate Colossus from the ground up. This includes the massive GPU clusters, high-speed interconnect fabric, and the software that makes it all work at unprecedented scale. Colossus powers Grok and our frontier AI models with a custom, high-performance datacenter network that delivers ultra-low latency and massive bandwidth across hundreds of thousands of GPUs. As a Software Engineer on the Colossus Networking team, you will develop the core networking software that maximizes the performance and reliability of our datacenter fabric. Your work will directly impact training efficiency, model convergence, and the speed at which we can push the frontier of AI. Our engineers own the full lifecycle of their software — from design and implementation to deployment, monitoring, and iteration based on real-world performance at scale. You will solve hard problems in distributed systems, high-performance networking, and real-time control of one of the largest AI supercomputers on Earth. RESPONSIBILITIES: Develop routing and traffic-engineering algorithms for the Colossus high-performance datacenter network. Develop highly reliable, real-tim

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career. About the team In this role, you'd be joining the Alloy Integrations team. We own how Metronome's customers collect payments and recognize revenue. We build and run the integrations that connect Metronome's usage-based billing platform to the systems businesses depend on to get paid: Stripe invoicing and payments, cloud marketplaces (AWS, Azure, and Google Cloud), ERP systems like NetSuite and QuickBooks, and CRM systems like Salesforce. We also bring Stripe products such as Checkout into Metronome, so customers can move from contract to cash in one place. Our team helps Stripe increase the GDP of the internet by making sure every invoice reaches the right system and every payment is collected and accounted for correctly, at scale. We focus on two areas: Invoicing: collection, dunning, and invoice delivery Quote-to-cash automation: connecting the full journey from a signed deal to recognized revenue What you'll do You'll build and operate distributed systems that move billing data between Metronome and the platforms our customers use to run their finances. The work combines product engineering and reliability. You'll ship features that customers ask for directly, and you'll strengthen the event-driven pipelines that handle large invoicing spikes every month-end. You'll work closely with our product manager, with partner engineering teams that own contracts, usage rating, and invoice finalization, with solutions architects who build ERP integrations with cu

Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Software Engineer Overview Mastercard is seeking a highly skilled and passionate Tech Lead to drive the next generation of platform modernization, API transformation, cloud-native engineering, agentic workflow solutions, and AI-enabled product capabilities. The ideal candidate is a hands-on technical leader who can architect and deliver scalable enterprise systems while mentoring engineering teams, influencing technical strategy, and driving innovation across multiple initiatives. This role requires deep expertise in distributed systems, APIs, cloud technologies, AI-powered engineering, data platforms, and software delivery at scale. The successful candidate will play a critical role in shaping the future of Mastercard's intelligent platforms by combining strong technical leadership with exceptional execution capabilities. Role & Responsibilities Technical Leadership • Lead end-to-end delivery of complex engineering initiatives. • Define technical architecture, engineering patterns, solution roadmaps, and development standards. • Drive technical design reviews, architecture discussions, and engineering best practices. • Guide teams in building scalable, secure, resilient, and maintainable platforms. • Evaluate emerging technologies and recommend strategic adoption opportuni

Job Requisition ID # 26WD101603 Position Overview We are seeking an experienced Senior Software Engineer to design, build, and operate resilient, scalable, high-performing services for the Product Access platform, which supports the access experience for millions of Autodesk users worldwide. You will own end-to-end solution design and delivery across the full engineering lifecycle and use spec-driven development and agentic systems to build, operate, and support Product Access in production, including agent-based automation for engineering and operational workflows. This role includes shared production on-call responsibilities as part of end-to-end service ownership. You will report to the Senior Engineering Manager and collaborate closely with Product Managers, Architects, Domain Leads, and cross-functional stakeholders across Product Access and beyond. Responsibilities Design, develop, and operate resilient, scalable, high-performing cloud-native Java microservices and distributed systems on AWS for the Product Access platform Own business features and platform initiatives end to end, from requirement analysis through production support, working with product and engineering partners on design, testing, and operational readiness Enhance system resiliency, reliability, scalability, and security; optimize performance, troubleshoot production issues, and implement engineering best practices across development and delivery pipelines Lead project delivery by organizing scope, estimating effort, establishing timelines, and driving medium-to-large initiatives independently Apply spec-

This is Adyen Adyen provides payments, data, and financial products in a single solution for customers like Meta, Uber, H&M, and Microsoft - making us the financial technology platform of choice. At Adyen, everything we do is engineered for ambition. For our teams, we create an environment with opportunities for our people to succeed, backed by the culture and support to ensure they are enabled to truly own their careers. We are motivated individuals who tackle unique technical challenges at scale and solve them as a team. Together, we deliver innovative and ethical solutions that help businesses achieve their ambitions faster. Authentication & Tokenization Team Operating at the intersection of high-grade security and conversion optimization, our Authentication and Tokenization systems deliver robust solutions for global commerce. The Adyen Tokenization solution securely vaults payment credentials to enable seamless, friction-free checkout experiences worldwide while ensuring adherence to localized market regulations. Our Authentication engine dynamically optimizes transaction flows to eliminate checkout friction while maintaining strict compliance. Both products are core pillars of Adyen Uplift , an advanced, AI-powered payment optimization suite designed to drive peak performance for global enterprise merchants. By capitalizing on Adyen's vast, unparalleled global payments data, Adyen Uplift offers intelligent, AI-powered solutions that help businesses maximize payment conversions, streamline fraud management, and reduce the overall cost of transactions. Based in one of the world's most dynamic fintech hubs, our engineering team navigates intricate compliance frameworks, including the RBI's Card-on-File Tokenization (CoFT) and multi-factor authentication mandates. We design and scale low-latency, highly resilient distributed systems that process millions of daily transactions. Joining this team means taking complete, end-to-end ownership of mission-c

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. Core Services builds the foundational services and software infrastructure behind Roblox’s global platform. Our work includes the C#/.NET and Rust frameworks, shared libraries, and runtime integrations that engineers use to build and operate production services. As a Principal Software Engineer on the Core Services team you will solve problems spanning distributed systems, concurrency, memory management, API design, and developer experience. You will improve the performance and reliability of our C# ecosystem, expand our Rust infrastructure, and develop shared components and interoperability patterns across both languages. Your work will help teams adopt better foundations safely, with improvements that compound across Roblox’s service fleet. This role combines hands-on systems engineering with technical leadership. You will work with service owners and infrastructure partners to turn complex platform capabilities into reliable, usable building blocks, and own their evolution from design through production adoption. You Will Build and evolve shared C#/.NET and Rust frameworks, libraries, and SDKs, including HTTP/gRPC infrastructure, caching, configuration, and observability. Investig