Software Engineer Distributed Systems Jobs

We are a global team of innovators and pioneers dedicated to shaping the future of observability. At New Relic, we build an intelligent platform that empowers companies to thrive in an AI-first world by giving them unparalleled insight into their complex systems. As we continue to expand our global footprint, we're looking for passionate people to join our mission. If you're ready to help the world's best companies optimize their digital applications, we invite you to explore a career with us! Your opportunity We are a global team of innovators shaping the future of observability. Our intelligent platform gives customers real-time insight into complex systems so they can innovate faster and operate reliably in an AI-first world. If you’re excited by high-throughput distributed systems and want to contribute to one of the largest and fastest-growing observability platforms, we’d love to hear from you. Join a backend engineering team focused on building and operating JVM-based services that ingest, process, and serve massive volumes of telemetry data. You’ll work on high-scale, low-latency systems that power mission-critical observability features used by engineers worldwide. What you'll do Design, build, and operate JVM-based microservices (primarily Java and Kotlin) with a focus on performance, scalability, and reliability. Own services end-to-end: architecture, implementation, deployment, monitoring, on-call participation, and continuous improvement. Apply strong concurrency and performance practices: asynchronous programming, backpressure, efficient I/O, memory management, and GC tuning. Build and evolve event-driven systems; work with Kafka for streaming, partitioning, consumer groups, and schema evolution.Instrument services for deep observability (metrics, logs, traces), define SLIs/SLOs, and use e Experience with Kafka or similar streaming technologies (topic/partition strategy, consumer lag, idempotency, schema compatibility) strongly preferred. Proficiency w

Position Overview: We are looking for a Senior Software Engineer to drive technical excellence, architect complex systems, and elevate our engineering team. You will own critical technical decisions, lead major initiatives from conception to delivery, and set the standard for engineering quality across our products. As a senior engineer, you will architect and lead the development of sophisticated AI-enabled features and infrastructure. This includes designing MCP server architectures, building advanced RAG systems, implementing agentic AI workflows, and establishing patterns that scale across our product portfolio. You will combine deep technical expertise in both traditional software engineering and AI/ML to deliver production-grade solutions. What You'll Do Lead the design and implementation of AI integration infrastructure (MCP servers, orchestration layers, API gateways) Build sophisticated AI features including advanced RAG systems, agentic workflows, and multi-step reasoning Establish AI engineering best practices, security patterns, and quality standards Lead technical initiatives from requirements through production deployment Make critical architectural decisions balancing performance, scalability, cost, and maintainability Design AI evaluation frameworks and implement quality benchmarks Debug and resolve complex production issues across traditional and AI systems Required Qualifications Tech Stack Core: Node.js, React, TypeScript, AWS, PostgreSQL, MSSQL, Docker AI & Integration: Python, MCP, AWS Bedrock, LangGraph/Semantic Kernel, Vector Databases, RAG Core Technical Skills 5+ years professional development with proven track record of delivering complex systems Strong Node.js and JavaScript/TypeScript expertise Advanced React and frontend architecture skills Extensive AWS architecture experience Expert PostgreSQL database design, optimization, and performance tuning Deep understanding of microservices, distributed systems, and

DeepIntent is the leading healthcare marketing platform, purpose-built to help marketers plan, activate, and optimize data-driven campaigns with speed and precision. Trusted by the world’s top healthcare brands and their agencies, DeepIntent uniquely unites media, identity, and real-world clinical data to power privacy-safe, omnichannel marketing across every screen. Backed by patented technology and proven outcomes, DeepIntent’s platform delivers measurable audience quality and script lift at scale. Learn more at www.deepintent.com . What You’ll Do: We are looking for a Software Engineer to help build and scale our core backend systems and data infrastructure. In this role, you will work hands-on to develop the foundational data pipelines, storage solutions, and robust architectures that drive our healthcare advertising solutions and support our core products, reporting APIs, and analytics initiatives. This is an excellent opportunity for a growth-oriented engineer to work with massive datasets, modern cloud technologies, and cross-functional teams to deliver high-performance, fault-tolerant solutions. Build & Operate: Develop, test, and maintain highly reliable, scalable, and cost-optimized distributed systems and data architectures. Enable Self-Service Data: Create automated ingestion, storage, and transformation pipelines that make it simple for downstream users to access and utilize new datasets. Empower Machine Learning: Design and operate data pipelines specifically tailored to support the complex workflows of our Data Scientists and Machine Learning Engineers. Drive Operational Excellence: Help implement and champion DataOps and DevOps practices across the team to ensure system reliability and smooth deployments. Contribute to Best Practices: Play an active role in establishing and refining formal data practices, architectures, and engineering standards for the organization. Cross-Functional Collaboration: Partner effectively with business stakeholders,

A CAREER WITH POINT72’S TECHNOLOGY TEAM As Point72 reimagines the future of investing, our Technology group is constantly improving our company’s IT infrastructure, positioning us at the forefront of a rapidly evolving technology landscape. We’re a team of experts experimenting, discovering new ways to harness the power of open source solutions, and embracing enterprise agile methodology. We encourage professional development to ensure you bring innovative ideas to our products while satisfying your own intellectual curiosity. WHAT YOU’LL DO • Build software used to support global trading across time zones • Work closely with business users to establish and refine requirements • Participate in identifying new technologies to continuously improve software systems • Implement DevOps practices within the team (GitHub/GitLab, Jenkins) • Provide production support to diagnose and resolve elevated application software production incidents and implement proactive remediation measures WHAT’S REQUIRED • Bachelor’s degree in computer science or another technical/scientific field • Minimum 8 years object-oriented programming experience with C#/.NET • Significant experience working with / understanding databases - primarily MS SQL Server • Must have experience in writing automated tests, unit tests, Test-Driven Development • Knowledge of design/architecture patterns, distributed systems, microservices, observability and monitoring, and containerization (Docker) • Willingness to work as part of a distributed Dev Team - 3 time zones (USA, Poland, India) • Strong problem solving and analytical skills • Exceptional verbal and written communication skills • Commitment to the highest ethical standards WE TAKE CARE OF OUR PEOPLE We invest in our people, their careers, their health, and their well-being. When you work here, we provide: • Health care benefits • Maternity, Adoption & related leave policies • Generous paternity and family care leave policies • Employee Assistance Prog

Here's a summary of the role: Do you love building scalable cloud platforms and solving complex engineering problems with modern technologies? As a Senior Software Engineer at Diligent, you'll design and deliver high-performing , serverless applications that power our global SaaS platform. You'll work extensively with TypeScript, Node.js, AWS, and event-driven microservices, owning services from design to deployment and production monitoring. This is an opportunity to influence technical decisions, mentor engineers, and explore how AI can transform software development and engineering productivity. If you're passionate about cloud-native architectures, distributed systems, and building software that scales to millions of users, we'd love to meet you. Here's a breakdown of what you'll do (not all of it, just the important stuff): Design and build scalable backend services and event-driven microservices using TypeScript and AWS. Develop secure APIs and integrations that power reporting, analytics, and dashboard experiences. Build and maintain serverless solutions using AWS services such as Lambda, EventBridge , SQS, and DynamoDB. Drive engineering excellence through testing, observability, automation, and production readiness practices. Contribute to infrastructure-as-code and CI/CD pipelines using AWS CDK and modern DevOps practices. Mentor engineers, participate in architecture discussions, and champion the use of AI tools to improve development efficiency. These are the essentials you'll need to get an interview: 6-8 years of professional software engineering experience. Strong experience with TypeScript, Node.js, and modern backend development patterns. Hands-on experience building cloud-native applications on AWS. Strong understanding of serverless architectures and event-driven microserv

About Graphcore Graphcore is one of the world’s leading innovators in Artificial Intelligence compute. It is developing hardware, software and systems infrastructure that will unlock the next generation of AI breakthroughs and power the widespread adoption of AI solutions across every industry. As part of the SoftBank Group, Graphcore is a member of an elite family of companies responsible for some of the world’s most transformative technologies. Together, they share a bold vision: to enable Artificial Super Intelligence and ensure its benefits are accessible to everyone. Graphcore’s teams are drawn from diverse backgrounds and bring a broad range of skills and perspectives. A melting pot of AI research specialists, silicon designers, software engineers and systems architects, Graphcore enjoys a culture of continuous learning and constant innovation. Job Summary Join our dynamic Software Infrastructure team and take a pivotal role in scaling and managing our infrastructure. You will develop essential tools and services that empower our broader software team. Your contributions will enhance the build, test, deployment, and productisation processes of our Machine Learning Software components. Work with our High-Performance Computing (HPC) AI platforms and gain invaluable experience in distributed systems. The Team An exciting opportunity to join a new team within the Software Operations group. The Build Engineering team is a new function within Software Infrastructure, which focuses on the overall process of building and integration of the Machine Learn ing S oftware S tack. You will work closely with the QA and development teams to get an understanding of how our ML SW stack is built, helping to ensure good build practices, and proving that the stack works together and is reproducible in secure, sandboxed environments. Responsibilities and Duties Developing our internal t

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. The Trust & Safety function at Lyft is dedicated to keeping every Lyft ride safe for both riders and drivers. We build and maintain the tools, features, and systems that deter bad actors, protect vulnerable populations, and reinforce trust across the platform. As an Backend Engineer working on Trust & Safety, you'll work at the intersection of product, design, engineering, and policy to ship high-impact safety features to millions of users. Responsibilities: Drive high-impact projects and innovate new solutions to provide the best user experience. Work closely with cross-functional teams and partner teams to develop solutions based on technology and business needs, and advance team’s goals and priorities Independently lead features from idea to positive execution and launch Unblock, support and communicate with internal partners to achieve results Write well-crafted, well-tested, readable, maintainable code Utilize your expertise in Python, Golang, AWS to deliver robust and scalable solutions Participate in code reviews to ensure code quality and distribute knowledge, as well as on call rotations Share your knowledge by giving brown bags, tech talks, and promoting appropriate tech and engineering best practices Experience: BS/MS or equivalent in Computer Engineering, Computer Science, or related field or relevant work experience 3+ years of software engineering industry experience Extensive experience in object oriented programming, ideally in GoLang or Python Experience in backend software development of distributed systems and concurrency Strong oral and written communication skills, and ability to collaborate with and influence cross-functional partners Benefits: Extended health and dental coverage options, along with life insurance and disability benefits Mental health benefits Family bui

About the Team OpenAI's mission is to ensure that artificial general intelligence (AGI) benefits all of humanity. The API Platform turns frontier research into reliable capabilities that developers use to build transformative products and services for people around the world. API Safety's goal is to ensure safe deployment of frontier models in the API. We design APIs and systems that help developers share usage context, understand safety events, and apply safeguards tailored to the risk profile of the applications they are building. This work is critical to our frontier model launches and partners closely with teams across API, Integrity, and Safety Research. About the Role We're looking for product-minded software engineers to join a team that is addressing emerging risks at the frontier of model development while building novel solutions for real-world AI deployment. The day-to-day work ranges from solving production challenges to designing new product experiences and safeguards. The right candidate is comfortable balancing tradeoffs across developer experience, latency, reliability, and risk. In this role, you will: Design and build dashboards and APIs for safety controls and customer-facing observability. Develop scalable systems that extend trusted safety capabilities to new use cases, customers, and deployment environments. Partner with Safety Research and Integrity to build safeguards that mitigate emerging risks. Be responsible for the availability, latency, and scalability of safeguards across high-volume API traffic. Own projects from technical design and implementation through launch and ongoing iteration, while raising the team’s engineering standards Your background might look something like: 7+ years of professional experience, excluding internships, in backend, infrastructure, platform, or product engineering roles. A track record of designing, building, and operating production backend services, developer-facing APIs, or distributed systems. Strong s

As a Staff Software Engineer on Coder’s Agentic Engineering team, you’ll shape the systems behind our agentic development experience. You’ll work across the agent harness, integrations, and workflows that connect agents with real development environments. You’ll stay hands-on while setting the team's technical direction. You’ll lead complex work, make sound architectural decisions, and help other engineers do their best work. What you’ll do here Set technical direction across Coder’s agent harness, integrations, and workflows. Design and build production systems in Go, with work across React and TypeScript where needed. Evolve agent execution, tool use, context management, streaming, and long-running workflows. Extend our provider-agnostic architecture as models and capabilities change. Lead complex projects from early ambiguity through production. Raise the engineering bar through design reviews, code reviews, and technical mentorship. Partner with Product and Design on clear, useful agent experiences. Improve the reliability, performance, and operability of agentic systems. What we’re looking for Deep experience building and operating production software systems. Strong hands-on experience with Go. Experience with React and TypeScript. Hands-on experience building systems around LLMs and agentic workflows. Experience with model APIs, tool calling, context management, or agent loops. Strong distributed systems knowledge. Working knowledge of AWS. A track record of setting technical direction without formal authority. Strong architectural judgment and comfort working through ambiguity. Someone who makes the engineers around them better. Our tech stack Backend: Go, Postgres Frontend: TypeScript, React Infrastructure: AWS, Kubernetes Observability: Prometheus, Grafana CI/CD: GitHub Actions Bonus tacos if you have (Tacos? If you need an ice-breaker, ask how we say thanks by giving tacos!) Experience building coding agents, developer tools, or cloud development environm

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE Baseten is building its own GPU infrastructure for large-scale inference. As we move into large scale, high-density NVIDIA systems, the hardest failures are intermittent, cross-layer, and difficult to prove: RoCE congestion, InfiniBand stalls, ECN/DCQCN mis-tuning, bad optics, RNIC issues, host kernel stalls, GPU driver problems, and workload symptoms that look like network problems, but are not. We are hiring a Lead Software Engineer to build a first-class observability and root-cause analysis system for GPU fabrics. This is a hard distributed systems problem, not a dashboarding problem. The system will collect high-volume signals from switches, hosts, active probes, and inference services; reduce and correlate them in real time; understand topology and service ownership; and produce actionable diagnosis while an incident is still unfolding. This role sits at the boundary between networking and inference software. RDMA data paths, GPUDirect transfers, prefill/decode disaggregation, KV cache movement, request routing, and workload backpressure can all create fabric symptoms or hide real fabric failures. The goal is to tell an operator, quickly and with evidence, whether an incident is caused by the fabric, host, NIC, GPU, RDMA path, scheduler, or serving layer — and what to do next. EXAMPLE INITIATIVES Real-time telemetry engine — Build the ingestion, reduction, storage, and query path for high-cardinality fab

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE: Baseten’s Model Performance (MP) team is responsible for ensuring the models running on our platform are fast, reliable, and cost‑efficient. As part of this team, you’ll focus on Model APIs — the infrastructure powering our hosted API endpoints for the latest open‑source models. This work spans distributed systems, model serving, and developer experience. You’ll join a small, high‑impact team operating at the intersection of product, model performance, and infra, helping to define how developers interact with AI models at scale. RESPONSIBILITIES: Design, build, and operate the Model APIs surface with focus on advanced inference capabilities: structured outputs (JSON mode, grammar-constrained generation), tool/function calling and multi-modal serving Profile and optimize TensorRT-LLM kernels, analyze CUDA kernel performance, implement custom CUDA operators, tune memory allocation patterns for maximum throughput and optimize communication patterns across multi-GPU setups Productionize performance improvements across runtimes with deep understanding of their internals: speculative decoding implementations, guided generation for structured outputs, custom scheduling and routing algorithms for high-performance serving Build comprehensive benchmarking frameworks that measure real-world performance across different model architectures, batch sizes, sequence lengths, and hardware configurations Productionize performa

At Vanta, our mission is to help businesses earn and prove trust. We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. Vanta’s new Enterprise Resilience team is being formed to support the next era of growth by powering services that are reliable, scalable, and resilient by design. As our customer base expands and our systems scale, we need a dedicated group focused on partnering closely with product engineering teams to build and operate robust distributed systems across all of Vanta’s environments, including our new FedRAMP deployment. In this role, you’ll help define the foundations of reliability at Vanta including shaping best practices, building core infrastructure, and guiding teams as they design services that perform consistently for customers. This team will have a broad and deep impact across product engineering. Your work will influence how every Vanta engineer builds, deploys, monitors, and maintains their services, whether for our commercial environment or regulated customers with more stringent requirements. You’ll develop tools and frameworks that make it easier to detect and remediate issues, improve operational readiness, and support feature development that meets the needs of increasingly large and complex enterprise customers. Vanta engineers design and develop new product functionality and infrastructure using modern frameworks and tooling, including TypeScript, React, Node.js, MongoDB, GitHub Actions, and AWS services such as Fargate and ECS. If you're excited to help define a new function, raise the reliability bar across an entire engineering organization, and build systems that scale with Vanta’s growth, we’d love to meet you. Visit our Vanta Engineering Blog to learn more about what our team is working on! What you’ll

About Ramp Ramp is building the smart infrastructure for finance teams, embedded in the transaction flow of every dollar a business spends. We automate how over $200B in annualized spend flows in and out of 70,000+ companies: authorizing payments, flagging risk, categorizing spend, and closing books. The problems are high-stakes, data-dense, and unforgiving. We hire people with high agency and high urgency. We look for slope over intercept. We care less about where you trained and more about what you’ve built. At Ramp, everyone is a builder who owns problems end to end and makes consequential decisions that shape the outcome. The median Ramp customer saves 5% and grows revenue 16% in their first year – far in excess of businesses operating without Ramp. We believe every ambitious company deserves the same. If you want to build systems that directly shape how companies move and manage billions, Ramp is the place to do it. About the Role The Credit Engineering team builds the systems that enable Ramp to manage credit lifecycles for businesses end-to-end, from initial underwriting through ongoing portfolio strategy optimization. As an engineer on Credit, you’ll own systems that influence $100+ billion in annual payment volume through millions of decisions across our product stack in support of the most ambitious FinTech portfolio in the United States. We are looking for a backend engineer to own the technical roadmap for underwriting, limit management, portfolio optimization, and agentic workflows. You will build robust systems, automate complex operational tasks, and maintain the high-frequency controls that power all of Ramp’s products. If you are obsessed with correctness, excited by ambiguity, and passionate about problems at the intersection of distributed systems and financial strategy, this role is for you. What You'll Do Architect scalable, stateful systems for automated limit management to optimize Ramp’s charge card portfolio. Envision and build the next gene

About Ramp Ramp is building the smart infrastructure for finance teams, embedded in the transaction flow of every dollar a business spends. We automate how over $200B in annualized spend flows in and out of 70,000+ companies: authorizing payments, flagging risk, categorizing spend, and closing books. The problems are high-stakes, data-dense, and unforgiving. We hire people with high agency and high urgency. We look for slope over intercept. We care less about where you trained and more about what you’ve built. At Ramp, everyone is a builder who owns problems end to end and makes consequential decisions that shape the outcome. The median Ramp customer saves 5% and grows revenue 16% in their first year – far in excess of businesses operating without Ramp. We believe every ambitious company deserves the same. If you want to build systems that directly shape how companies move and manage billions, Ramp is the place to do it. About the Role Ramp is, at its core, a fintech company. Our financial infrastructure enables us to issue cards, move money globally, and manage treasury flows for our customers. Stablecoins are emerging as a critical lever to make these flows faster, cheaper, and more accessible. We are looking for a Software Engineer to join our engineering team with a dedicated focus on stablecoin-based payment and treasury systems. In this role, you will act as both a technical owner and multiplier: working on core stablecoin services, ensuring secure and reliable integrations with external partners, and guiding Ramp’s evolution toward next-generation fintech solutions. Our ideal candidate combines deep curiosity about eventually consistent distributed systems with strong financial infrastructure experience, thrives in highly regulated and mission-critical environments, and has a passion for diving into new problem spaces. What You'll Do Help build & scale Ramp’s stablecoin-based payment and treasury infrastructure Partner with external providers and internal

For over 20 years, Smartsheet has empowered teams to manage work seamlessly and scale solutions smarter. Now, in our most ambitious chapter yet, we are uniting human teams with AI agents. By orchestrating the work agents do best, automating manual tasks and uncovering insights at scale, we create the space for people to focus on what truly matters: judgment, creativity, and big thinking. That is magic at work, and it’s what we show up for every day. About the Role The AI Platform Engineering team is looking for a highly motivated and talented engineer who are passionate about continuous learning and excited to grow in a fast-paced, innovative environment. We are an agile team that operates iteratively, focused on building high-quality software and adhering to rigorous operational best practices across complex, cross-functional distributed systems. This full-time position reports to a Software Engineering Manager and can be located in our Bellevue, WA office, or you may work remotely from anywhere in the US where Smartsheet is a registered employer. What You'll Do Build the AI Platform Foundation : Lead the design and ownership of the core infrastructure that serves as the backbone for all Smartsheet AI experiences. Focus on building a robust, multi-tenant environment that reduces friction for internal teams, allowing them to deploy reliable and scalable AI features with ease. Standardize the AI Developer Path : Architect high-level abstractions and "Golden Path" APIs that democratize AI development across Smartsheet. By insulating product teams from infrastructure complexity, you will enable them to ship intelligent features with high velocity while guaranteeing safety and consistency at scale. Engineer AI Trust & Safety Systems : Establish the mission-critical monitoring and quality assurance layers that protect Smartsheet customers. By creating rigorous evaluation pipelines, you will ensure every AI-driven feature meets the high bar for safety, data privacy, a