Jobiba hiring network

Ai Infrastructure Systems Engineer Jobs

10,000 active opportunities · Updated for October 2026

Fresh results

15 shown

Explore current ai infrastructure systems engineer jobs. Use filters to narrow by work mode, employment type, experience and date posted.

H
Harvey
📍 San Francisco• Full-time• Remote• $231K – $340K/yr
1mo ago

Why Harvey At Harvey, we’re transforming how legal and professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come. This is a rare chance to help build a generational company at a true inflection point. We have strong product-market fit and world-class investor support. We’re scaling fast and defining a new category in real time. The work is ambitious, the bar is high, and the opportunity for growth — personal, professional, and financial — is unmatched. Our team moves fast, takes ownership, and is deeply committed to the mission — operating with intensity, staying close to our customers, and pushing each other for excellence. We live by three values: Decisiveness, Simplicity, and Job's Not Finished. We act quickly on clear judgment over perfect information, we believe simplicity is what scales, and we're never satisfied with where we are. If you want to do the best work of your career alongside people who share that drive, we'd love to build with you. At Harvey, the future of professional services is being written today — and we’re just getting started. Role Overview As a Staff Software Engineer on the Model Infrastructure team, you'll lead the design and development of the systems that power every AI request at Harvey. You'll partner closely with AI Research, Product Engineering, Infrastructure, and external model providers to build a platform that is highly reliable, scalable, observable, and efficient. What You’ll Do Lead the design and implementation of Harvey's Model Infrastructure platform. Build systems to ensure high availability, low latency, and operational excellence for AI inference. Design and improve Harvey's Unified Model Controller (UMC) and Model Selector platform to automatically detect model degradations and intelligently route traffic based on reliability, latency, quality, compliance, and cost. Develop systems

REMOTEpythonjavaazure
View job →
A
Anthropic
📍 Ca New York City• $405K – $625K/yr
1mo ago

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role Every request that hits Claude — from claude.ai , the API, our cloud partners, or internal research — depends on a set of decisions made before it ever reaches a model: where each request should be served and how much capacity each model needs right now. Getting those decisions right is crucial to satisfying throughput, reliability, and latency constraints. This group builds the control plane that makes those decisions for Anthropic's inference fleet and own the inference request path. This is a deeply technical group. The engineers here design placement and load-balancing algorithms, build quantitative models of demand, capacity, and system performance, improve latency across kernel, network, and framework boundaries, and reason carefully about how a change to the fleet ripples through everything that depends on it. You'll lead a strong group of ML platform, infrastructure, and distributed-systems engineers working alongside the teams that build our ML internals and cloud infrastructure. You need enough systems depth to make architectural calls, hire people who go deep, and see when a proposed change will ripple across the fleet. You're accountable for the health of the whole path from request to model: its efficiency, its reliability, and how well it evolves as models, hardware, and clouds change underneath it. Key responsibilities Own the technical roadmap for how the inference fleet is coordinated — where traffic goes, where capacity lives, how caches are placed, how fast the system reacts to demand, and the protocols that keep the control plane and the inference engines in sync Partner with the product, inference e

kubernetesmachine learningai
View job →
R
Roblox
📍 San Mateo• Full-time• $196.8K – $243.3K/yr
2mo ago

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone. As a Sr. Studio Software Engineer for Roblox Studio Platform, you will be a key contributor to the evolution of Roblox Studio, the primary IDE for making massive multiplayer online games on the Roblox platform. Studio provides the mission-critical tools for 3D modeling, animation, and the complete SDLC for millions of developers. We are looking for engineers who thrive on an adventure into the unknown and have experience across various systems, Operating Systems, Game Engines, and Application Frameworks. You’ll tackle projects involving: Core User Features: Architecting application frameworks, windowing systems, and code generation. “AI Native” Features: Pioneering scalable systems that extend to complex, agentic use cases. Foundational Architecture: Driving OS integration, extensibility, and customizability at the deepest levels. Central Backend Systems: Engineering the infrastructure to power a consistent, high-performance UX. Design Evolution: Collaborating with UX designers to translate Studio into a modern, consistent design language. You Will: Design and execute the technical direction to drive the future extensibility and adaptability of the application. Own and deliver complex techn

reactaic++
View job →
P
Pinecone
📍 New York• Full-time• Remote• $190K – $270K/yr
2mo ago

About Pinecone Pinecone is the trusted AI knowledge company. Its trusted AI knowledge platform—including its Database, Nexus, and Marketplace products—power accurate, fast, and cost-effective AI applications for more than 10,000 customers and 1M developers worldwide. Pinecone's mission is to make AI knowledgeable. For more information, visit pinecone.io . About the Team and Role: We are hiring a senior/staff software engineer to help design and build core components of our next-generation knowledge retrieval system built for the AI era – search and retrieval infrastructure that powers high-quality, scalable, and enterprise-grade agentic systems. You’ll build the framework that allows our customers to connect knowledge–synthesized from structured and unstructured data–to modern LLM-powered applications, leveraging the world’s best-in-class vector DB supporting semantic search and hybrid retrieval. This role is ideal for someone who loves backend system architecture, distributed systems, and applied AI infrastructure. It is a high impact role with significant ownership across architecture, performance, and system reliability. Responsibilities: Design and build scalable platform components leveraging advanced retrieval via query planning, semantic and hybrid search, metadata-aware search, and LLM generation Design and build optimized indexing pipelines for structured and unstructured data Build backend services for semantic and hybrid retrieval, knowledge graph construction, and retrieval orchestration Improve retrieval quality through evaluation and observability frameworks Design APIs for internal and external user and agentic consumers Optimize latency, throughput and cost across large-scale inference and retrieval workloads Drive technical direction for reliability and security What You’ll Bring to the Table: To thrive in this role, you don't need to check every single box, but you should be deeply passionate about how to turn data into knowledge. Systems Expertise

REMOTEpythonjavakubernetes
View job →
P
Pinecone
📍 United States• Full-time• Remote• $190K – $270K/yr
2mo ago

About Pinecone Pinecone is the trusted AI knowledge company. Its trusted AI knowledge platform—including its Database, Nexus, and Marketplace products—power accurate, fast, and cost-effective AI applications for more than 10,000 customers and 1M developers worldwide. Pinecone's mission is to make AI knowledgeable. For more information, visit pinecone.io . About the Team and Role: We are hiring a senior/staff software engineer to help design and build core components of our next-generation knowledge retrieval system built for the AI era – search and retrieval infrastructure that powers high-quality, scalable, and enterprise-grade agentic systems. You’ll build the framework that allows our customers to connect knowledge–synthesized from structured and unstructured data–to modern LLM-powered applications, leveraging the world’s best-in-class vector DB supporting semantic search and hybrid retrieval. This role is ideal for someone who loves backend system architecture, distributed systems, and applied AI infrastructure. It is a high impact role with significant ownership across architecture, performance, and system reliability. Responsibilities: Design and build scalable platform components leveraging advanced retrieval via query planning, semantic and hybrid search, metadata-aware search, and LLM generation Design and build optimized indexing pipelines for structured and unstructured data Build backend services for semantic and hybrid retrieval, knowledge graph construction, and retrieval orchestration Improve retrieval quality through evaluation and observability frameworks Design APIs for internal and external user and agentic consumers Optimize latency, throughput and cost across large-scale inference and retrieval workloads Drive technical direction for reliability and security What You’ll Bring to the Table: To thrive in this role, you don't need to check every single box, but you should be deeply passionate about how to turn data into knowledge. Systems Expertise

REMOTEpythonjavakubernetes
View job →
H
Harvey
📍 San Francisco• Full-time• $236K – $290K/yr
3mo ago

Why Harvey At Harvey, we’re transforming how legal and professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come. This is a rare chance to help build a generational company at a true inflection point. We have strong product-market fit and world-class investor support. We’re scaling fast and defining a new category in real time. The work is ambitious, the bar is high, and the opportunity for growth — personal, professional, and financial — is unmatched. Our team moves fast, takes ownership, and is deeply committed to the mission — operating with intensity, staying close to our customers, and pushing each other for excellence. We live by three values: Decisiveness, Simplicity, and Job's Not Finished. We act quickly on clear judgment over perfect information, we believe simplicity is what scales, and we're never satisfied with where we are. If you want to do the best work of your career alongside people who share that drive, we'd love to build with you. At Harvey, the future of professional services is being written today — and we’re just getting started. Role Overview As a Staff Software Engineer on the Model Infrastructure team, you'll lead the design and development of the systems that power every AI request at Harvey. You'll partner closely with AI Research, Product Engineering, Infrastructure, and external model providers to build a platform that is highly reliable, scalable, observable, and efficient. What You’ll Do Lead the design and implementation of Harvey's Model Infrastructure platform. Build systems to ensure high availability, low latency, and operational excellence for AI inference. Design and improve Harvey's Unified Model Controller (UMC) and Model Selector platform to automatically detect model degradations and intelligently route traffic based on reliability, latency, quality, compliance, and cost. Develop systems

pythonjavaazure
View job →

Salary Range: (Determined during interview process, based on technical fit for each level of role) Staff Engineer - PLN 350,700 - 474,400 + Benefits + Equity Senior Engineer - PLN 260,400 - 352,200 + Benefits + Equity Subject to alignment to the responsibilities and duties of the role. Location: Gdańsk - Hybrid Working Policy - 3 Days per week in office About the job Explore how a next-generation AI architecture behaves from rack scale to data centre scale. As a Senior Systems Engineer, you will investigate a novel AI computing architecture under demanding real-world workloads. You will turn complex system behaviour into measurable evidence. You will design experiments, benchmark representative AI workloads and explore how hardware components and software interact at scale. When behaviour is unexpected, you will turn uncertainty into new measurements. Your work will help infrastructure engineers, architects and application specialists understand performance, scalability and reliability across the stack. You will also help develop tooling and automation to collect, analyse and visualise system metrics. You do not need to be an AI expert. You will need strong judgement, a clear preference for evidence over opinion and a desire to explore complex systems beyond the obvious. The team and culture The System QA team is distributed across multiple locations so we work deliberately to stay connected. Daily team meetings create space to share ideas, ask questions, discuss findings and solve problems together. You will have regular 1:1s with your people manager where you will have the opportunity to discuss things that matter to you. You will have dedicated time each week to focus on your CPD. The technical lead will provide direction and help set priorities, but everyone in the team is there to support each other. Decisions are guided by evidence, clear communication and a willingness to challenge assumptions. Your manager will trust you to follow the evidence w

pythonartificial intelligenceai
View job →

Gong harnesses the power of AI to transform how revenue teams win. The Gong Revenue AI Operating System unifies data, insights, and workflows into a single, trusted system that observes, guides, and acts alongside the world’s most successful revenue teams. Powered by the Gong Revenue Graph, AI-powered intelligence, specialized agents, and trusted applications, Gong helps more than 5,000 companies around the world deeply understand their teams and customers, automate critical sales workflows, and close more deals with less effort. For more information, visit www.gong.io. At Gong, you will join a company built on innovative products, ambitious goals, and passionate people. We are shaping the future of revenue intelligence and we want people who are excited to build what comes next. You will work with a team that dreams big, moves fast, and cares deeply about the craft and about each other. Here, transparency and trust are core to how we operate, and every person has the opportunity to make a visible impact. If you want to grow, stretch, and do work that truly matters, Gong is the place to do the best work of your career. As an Application Infrastructure Team Lead , you’ll spearhead the development of the core frameworks and services that power our entire ecosystem. In this role, you’ll sit at the vital intersection of application development and systems engineering, ensuring our platform remains resilient, high-performing, and developer-friendly as we scale. If you are a technical heavyweight who loves Java but thrives on leading teams through complex data and infrastructure puzzles, this is your opportunity to build the foundation for our next phase of growth. You’ll Own: Team leadership & mentorship : Guiding a high-performing engineering team and fostering a culture of ownership and excellence. Core application infrastructure : Designing and maintaining mission-critical frameworks using Java and Spring Boot. Technical standards : Defining and enforcing the benc

javapostgresqlmongodb
View job →
C
9 days ago

We’re building a world of health around every individual — shaping a more connected, convenient and compassionate health experience. At CVS Health®, you’ll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves accountable and prioritize safety and quality in everything we do. Join us and be part of something bigger – helping to simplify health care one person, one family and one community at a time. Position Summary: We are looking for a Staff Systems Engineer - Digital to join our team, the foundational layer that powers access, governance, and intelligence across our digital products. You will work horizontally across engineering, product, and AI teams, leading, owning, and evolving the shared infrastructure that every team at the company depends on. You will be the primary authority on how information is modeled, governed, and served across operational, analytical, and AI workloads - driving quality, compliance, and reliability at scale. If you thrive in a role where your architecture decisions multiply the productivity and capability of entire teams, this is the opportunity for you. Key Responsibilities: Data Architecture & Platform Ownership: Define and own the enterprise data architecture strategy across operational, analytical, and AI/ML workloads Design and govern data models, data contracts, and canonical schemas used across product and platform teams Evaluate and standardize data platform tooling — data lakes, warehouses, streaming, and serving layers (GCP BigQuery, Pub/Sub, Dataflow, or equivalent) Serve as the primary point of contact and SME for shared data platform concerns acro

pythonsqlazure
View job →
A
Anthropic
📍 Boston• Remote• $285K – $325K/yr
13 days ago

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role The Endpoint team (Client Platform Engineering) treats Anthropic's device fleet as a platform we build and run. We run our own MDM as a production service and manage every piece of device configuration as code. Policies, configuration profiles, queries, remediation scripts, and software all ship through pull requests, CI, a staging environment, and a canary group before they reach the fleet. The fleet is mostly macOS, plus a small number of Linux machines and a growing mobile footprint. You'll own that platform end to end: the infrastructure underneath the MDM, the configuration on top of it, the patching and software pipelines that keep thousands of devices patched and secure, and the telemetry that tells us what is actually true on every device. You'll also build automation that cuts down on manual operational work. You'll work with Security teams on hardening, compliance controls, and detection and response, and with developer and infrastructure teams to make sure those controls don't get in the way of their work. Your work will let us base access decisions on whether a device can be trusted. We value people who double check a compliance report before they believe it. The team is deliberately lean and runs with high autonomy. You'll help define the endpoint roadmap, make architecture decisions, and own the platform every Anthropic employee's work runs on. You'll also help us meet the security standards our Responsible Scaling Policy requires as models advance. Responsibilities Own endpoint configuration as code: author, review, test, and progressively roll out MDM policies, configuration profiles, and remediation scr

REMOTEpythonlinuxai
View job →
RJ
29 days ago

About the Team & Role: We're building Rubrik Agent Cloud, the enterprise platform to monitor, govern, and remediate AI agents. Our team operates at the intersection of AI, distributed systems, and enterprise security, creating solutions that make it possible for organizations to operate production-grade AI agents at scale. As a member of the Rubrik Agent Cloud team, you'll work with cutting-edge AI technologies while solving complex challenges in scaling, security, and performance. We're a collaborative team passionate about pushing the boundaries of what's possible with enterprise AI infrastructure. Nature of the Specialized Duties ➢ Architecting and Governing Secure Multi-Cloud Foundations (30% of time) Leading the end-to-end architectural design and onboarding of complex business units into a multi-cloud ecosystem (AWS, Azure, GCP, OCI), ensuring structural parity across disparate environments. Engineering secure "Landing Zones" and multi-tenant structures using advanced Identity and Access Management (IAM) hierarchies and automated policy enforcement. Developing and implementing global Role-Based Access Control (RBAC) models and Attribute-Based Access Control (ABAC) frameworks to manage granular permissions for AI agent workloads. Designing and governing resource hierarchy models and tagging standards that utilize metadata for automated lifecycle management and complex cost-attribution algorithms. ➢ Engineering Security and Compliance at Scale for AI Workloads (25% of time) Designing and implementing cryptographic controls, including Key Management Service (KMS) integration, encryption-at-rest/transit protocols, and hardware security module (HSM) configurations. Architecting network security perimeters using VPC Service Controls , Privileged Identity Management (PIM), and deep packet inspection logging. Conducting technical root-cause analysis of security vulnerabilities and engineering automated remediation scripts to close compliance gaps (SOC 2, ISO

pythonawsazure
View job →
M
Mixpanel
📍 New York• Full-time• Hybrid• $130K – $176K/yr
1mo ago

About Mixpanel Mixpanel is the leading product intelligence and analytics platform, trusted by more than 29,000 companies to help understand how people use the products they build. By combining powerful analytics with AI that knows your business, Mixpanel helps teams see what’s working, diagnose what’s not, and decide what to build next. Learn more at mixpanel.com . About the Team The Revenue Marketing team at Mixpanel is responsible for pipeline generation across paid, website, and product-led channels. This role sits within that team as its dedicated engineering owner — accountable for the technical systems that power how people discover, evaluate, and request Mixpanel. You are the only engineer dedicated to this surface, which means you set its technical direction rather than execute against someone else's. You work directly with our marketing teams and partner with Growth Engineering on shared systems. Website design and content are handled by our web design team; your focus is the technical infrastructure, integrations, and systems that sit underneath. About the Role As our Marketing Systems Engineer, you own the technical layer of our marketing engine: the integrations and infrastructure that power our marketing website. The website is our primary lead capture system that turns traffic into pipeline. You own the systems that connect our marketing surface to Salesforce, Customer.io/Hubspot, and our broader GTM stack. You set the technical roadmap for this surface, move fast, measure impact, and treat reliability as a first-class concern rather than a cleanup task.You will also collaborate with Growth Engineering on shared infrastructure including handraiser routing and tracking. Responsibilities Own the technical health of the Mixpanel marketing website: page speed, WCAG compliance, Google Tag Manager, technical SEO, and third-party integrations including Qualified, Optimizely, and TrustArc. Own the integrations between the marketing website and our GTM stack t

javascriptpythonai
View job →
M
Mixpanel
📍 San Francisco• Full-time• Hybrid• $130K – $176K/yr
1mo ago

About Mixpanel Mixpanel is the leading product intelligence and analytics platform, trusted by more than 29,000 companies to help understand how people use the products they build. By combining powerful analytics with AI that knows your business, Mixpanel helps teams see what’s working, diagnose what’s not, and decide what to build next. Learn more at mixpanel.com . About the Team The Revenue Marketing team at Mixpanel is responsible for pipeline generation across paid, website, and product-led channels. This role sits within that team as its dedicated engineering owner — accountable for the technical systems that power how people discover, evaluate, and request Mixpanel. You are the only engineer dedicated to this surface, which means you set its technical direction rather than execute against someone else's. You work directly with our marketing teams and partner with Growth Engineering on shared systems. Website design and content are handled by our web design team; your focus is the technical infrastructure, integrations, and systems that sit underneath. About the Role As our Marketing Systems Engineer, you own the technical layer of our marketing engine: the integrations and infrastructure that power our marketing website. The website is our primary lead capture system that turns traffic into pipeline. You own the systems that connect our marketing surface to Salesforce, Customer.io/Hubspot, and our broader GTM stack. You set the technical roadmap for this surface, move fast, measure impact, and treat reliability as a first-class concern rather than a cleanup task.You will also collaborate with Growth Engineering on shared infrastructure including handraiser routing and tracking. Responsibilities Own the technical health of the Mixpanel marketing website: page speed, WCAG compliance, Google Tag Manager, technical SEO, and third-party integrations including Qualified, Optimizely, and TrustArc. Own the integrations between the marketing website and our GTM stack t

javascriptpythonai
View job →
E
Everpure
📍 Malaysia• Full-time• Remote
1mo ago

Everpure (NYSE: P) has evolved from storage pioneer to data platform, closing fiscal 2026 with $3.7 billion in revenue, its first billion-dollar quarter, and accelerating growth into FY27. Our strategic agenda spans the companies defining the next era of technology - hyperscalers, AI labs, the AI hardware supply chain, data platform providers, and the broader AI ecosystem. This type of work—work that changes the world—is what the tech industry was founded on. So, if you're ready to seize the endless opportunities and leave your mark, come join us. THE ROLE Drive the technical strategy and customer adoption of Pure Storage's enterprise portfolio across high-value accounts in Malaysia. In this high-impact pre-sales role, you will partner directly with Enterprise Account Managers, Alliance Partners, and Customer Leadership to translate complex IT challenges into high-performance data solutions. By demonstrating technical leadership and guiding architectural evaluations, you will accelerate revenue growth, secure key technical wins, and redefine how leading regional organizations modernize their storage infrastructure. WHAT YOU'LL DO Drive Technical Architecture & Revenue Growth: Lead end-to-end technical evaluations, custom proof-of-concepts, and system configurations alongside Account Managers to secure technical wins and expand market share across Enterprise accounts in Malaysia. Architect Tailored Business Solutions: Translate complex customer business goals and infrastructure pain points into high-value, differentiated Pure Storage solution designs in collaboration with key alliance and channel partners. Lead RFIs, RFPs, & Technical Validations: Author comprehensive RFP/RFI responses and execute technical benchmark testing, ensuring prospective clients clearly understand the performance, scalability, and TCO advantages of Pure’s portfolio. Deliver Strategic Thought Leadership: Serve as a trusted technical advisor by delivering compelling architectural prese

REMOTElinuxaisupply chain
View job →
A
Anthropic
📍 Boston• Remote• $285K – $325K/yr
1mo ago

About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the role The Endpoint team (Client Platform Engineering) manages the laptops and handsets every Anthropic employee works on, plus the infrastructure underneath them. We treat the fleet as a distributed platform, not a collection of devices, and every piece of configuration ships as code through pull requests, CI, staging, and a canary group. Today the mobile side of the fleet is BYOD. This role exists to change that. You will design and implement a corporate-issued mobile device program (managed company phones and managed Apple accounts) in every region Anthropic operates in, and take it from early design to production. The team is deliberately lean and runs with high autonomy. You’ll define what a corporate mobile program looks like at Anthropic and own the platform decisions that get it there. Responsibilities Design the corporate-issued mobile device program: device standards, what we issue to whom, and how the program grows from a first region to everywhere Anthropic operates Own the global logistics of issuing hardware: procurement partners, regional coverage, spares, and refresh cycles Bring mobile configuration into the team’s config-as-code pipeline so mobile policies are reviewed, tested, and progressively rolled out like the rest of the fleet Build zero-touch enrollment: Apple Business Manager and ADE with managed Apple accounts on iOS, the zero-touch equivalent on Android, so a new phone works the first time without hands-on setup Own policy, compliance, and device lifecycle for the corporate fleet, from issue to wipe Build telemetry on the corporate fleet: which devices are checking in, OS and patch state, drift betw

REMOTEpythonawsgcp
View job →
🔔

Get new ai infrastructure systems engineer jobs by email

Daily job updates · Unsubscribe anytime