Software Engineer Ml Infrastructure Jobs

About the Role At Together AI, you’ll build and operate one of the world’s largest GPU fleets used for frontier model training and inference. This isn’t a traditional infrastructure role—we’re looking for engineers who love building systems, automating everything, and solving problems at massive scale. If you enjoy writing software more than clicking dashboards, obsess over eliminating manual work, and want to build infrastructure that manages tens of thousands of GPUs autonomously, we’d love to talk. Responsibilities Design and build fleet automation systems that provision, validate, deploy, upgrade, repair, and retire GPU clusters with minimal human intervention. Build AI Infrastructure Agents that automate deployment, root-cause failures, incident triage, and autonomous remediation. Develop Fleet Intelligence platforms that continuously monitor hardware health, firmware, networking, storage, thermals, and workload performance to predict failures before they impact customers. Build software that maximizes GPU availability, utilization, performance, and reliability across thousands of accelerators. Create automated validation systems for GPUs, InfiniBand/RoCE fabrics, NVLink/NVSwitch, storage, and distributed AI workloads. Build internal platforms and developer tools that allow infrastructure to be managed through software—not manual operations. Continuously improve deployment velocity, reliability, and operational efficiency through automation. Partner closely with hardware, networking, platform, and AI teams to push the limits of AI infrastructure. Requirements 3+ years building distributed systems, infrastructure platforms, or large-scale backend software. Strong software engineering skills in Python, Go, or Rust . Experience building platforms, automation systems, or developer infrastructure. Experience with Linux, Kubernetes, Terraform, Ansible, or similar infrastructure technologies. Strong systems thinking with the ability to understand problems across hardw

About Decagon Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences. Our technology enables industry-defining enterprises like Avis Budget Group, Block’s Cash App and Square, Chime, Oura Health, and Hunter Douglas to deploy AI agents that power personalized, deeply satisfying interactions across voice, chat, email, SMS, and every other channel. We’re building a future where customer experiences are being redefined from support tickets and hold music to faster resolutions, richer conversations, and deeper relationships. We’re proud to be backed by world-class investors who share that vision, including a16z, Accel, Bain Capital Ventures, Coatue, and Index Ventures, along with many others. We’re an in-office company, driven by a shared commitment to excellence and velocity. Our values — Just Get It Done, Invent What Customers Want, Winner’s Mindset, and The Polymath Principle — shape how we work and grow as a team. About the Team Over the past few years, development of LLMs has evolved at a rapid pace. It’s not enough for our customers to just “set it and forget it” when it comes to AI software. Truly successful AI Agents require hands-on execution, rigorous iteration, and deep technical delivery to reach enterprise-grade performance. We’re creating an Agent Deployment Engineering Org : a specialized technical delivery team responsible for end-to-end execution of AI agent builds. Agent Deployment Engineers own the hands-on work required to deliver best-in-class agents—writing and configuring key components, validating integrations, and ensuring agents perform reliably at scale. This team brings greater specialization and focus to build quality. Agent Deployment Engineers are technical and customer-facing: you’ll interface with senior technical stakeholders on the customer side while also going deep on agent configuration and build execution. About the Role As an Agent Deployment Engineer, you will be responsi

About Decagon Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences. Our technology enables industry-defining enterprises like Avis Budget Group, Block’s Cash App and Square, Chime, Oura Health, and Hunter Douglas to deploy AI agents that power personalized, deeply satisfying interactions across voice, chat, email, SMS, and every other channel. We’re building a future where customer experiences are being redefined from support tickets and hold music to faster resolutions, richer conversations, and deeper relationships. We’re proud to be backed by world-class investors who share that vision, including a16z, Accel, Bain Capital Ventures, Coatue, and Index Ventures, along with many others. We’re an in-office company, driven by a shared commitment to excellence and velocity. Our values — Just Get It Done, Invent What Customers Want, Winner’s Mindset, and The Polymath Principle — shape how we work and grow as a team. About the Team Over the past few years, development of LLMs has evolved at a rapid pace. It’s not enough for our customers to just “set it and forget it” when it comes to AI software. Truly successful AI Agents require hands-on execution, rigorous iteration, and deep technical delivery to reach enterprise-grade performance. We’re creating an Agent Deployment Engineering Org : a specialized technical delivery team responsible for end-to-end execution of AI agent builds. Agent Deployment Engineers own the hands-on work required to deliver best-in-class agents—writing and configuring key components, validating integrations, and ensuring agents perform reliably at scale. This team brings greater specialization and focus to build quality. Agent Deployment Engineers are technical and customer-facing: you’ll interface with senior technical stakeholders on the customer side while also going deep on agent configuration and build execution. About the Role As an Agent Deployment Engineer, you will be responsi

Who are we? Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems. We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that. We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft. We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us! About North: North is Cohere's cutting-edge AI workspace platform, designed to revolutionize the way enterprises utilize AI. It offers a secure and customizable environment, allowing companies to deploy AI while maintaining control over sensitive data. North integrates seamlessly with existing workflows, providing a trusted platform that connects AI agents with workplace tools and applications. Why This Role? This role offers a unique opportunity to shape how enterprises harness the power of AI in real-world applications. As a bridge between our core North product and our clients’ engineering teams, you’ll be at the forefront of solving complex problems and securely integrating AI into critical sectors such as finance, healthcare, and telecommunications. We’re looking for Software Engineers with Applied AI experience who can own the design, build, and deployment of agentic workflows powered by Large Language Models (LLMs), from early prototypes to production-grade AI agents, to deliver concrete business value in enterprise workflows. You’ll work closely with customers on real-world business problems, often building first-of-thei

We are seeking a highly versatile Sensor & Hardware Safety Engineer to bridge the gap between rigorous hardware reliability and real-world system behavior. In this hybrid role, you will be responsible for 50% hardware-level Functional Safety (ISO 26262) and 50% system-level sensor safety (SOTIF / ISO 21448). You will ensure that our custom hardware meets strict ASIL compliance while guaranteeing our advanced sensor suites (Cameras, LiDAR, Radar) operate safely through perception edge-cases and environmental challenges. In This Role, You Will: Evaluate supplier technical documentation for advanced imagers, microprocessors, and SoCs to verify SEooC and AoU alignment. Assess vendor deliverables to guarantee ASIL standards are met for firmware/software maturity and diagnostic systems. Execute board-level FMEDA for sophisticated integrated circuits, including FPGAs and microcontrollers. Partner with Software, FW, and EE departments to define architectural requirements that enhance diagnostic monitoring. Support the V&V team in developing SOTIF-compliant simulation and physical test protocols for edge-case scenarios. Qualifications Minimum of a B.S. in Automotive, Robotics, Aerospace, or Electrical Engineering. At least 3 years of professional experience involving board bring-up, silicon validation, or hardware design. Understanding of SOTIF and ISO 26262 safety protocols. Strong interpersonal and professional communication capabilities within a collaborative environment Bonus Qualifications ISO 26262 professional certification (CFSP or CFSE). Background in automotive-grade hardware validation and design. Experience utilizing traceability platforms like JAMA or Polarion. Familiarity with industry standards including IEC 61508, DO-254, and DO-178C during board bring-up.

About Zinnov Zinnov is a global management consulting firm that helps organizations make decisions that actually get used — and deliver results that matter. For over two decades, we’ve partnered with leading enterprises, high-growth technology companies, and investors to answer some of the toughest questions they face: Where should we invest? How do we scale globally? What capabilities will win in the next decade? Our work shapes market entry strategies, global operating models, M&A decisions, and long-term growth bets. We’re known for being data-led, execution-focused, and outcome-driven — not opinion-heavy slideware. At Zinnov, how you work matters as much as what you deliver. We value independent thinking, crisp communication, and early ownership. With 450+ professionals across 10 global offices, we work across industries including Digital Services, ER&D, Enterprise Software, Semiconductors, Healthcare, BFSI, Automotive, Media & Telecom, and Private Equity. Zinnov isn’t for everyone. It’s for people who want steep learning curves, honest feedback, and the chance to see their work influence real business decisions — not just presentations. About the Role As a Senior Data Engineer , you will own the data foundation of Zinnov’s GCC Intelligence Platform—building reliable multi-tenant pipelines and KPI-ready datasets across Finance and Hiring domains. Your work enables downstream dashboards and AI agents to operate on clean, reconciled, governed data. What You’ll Do Data Pipelines & Medallion Architecture Build andmaintainingestion pipelines from source systems (e.g., Dynamics, Workday, Airtable, SFTP feeds). Design and implement Medallion pipelines (Bronze → Silver → Gold) across Finance and Hiring data. Build reconciliation and gating logic to ensure only validated data reaches Gold. Multi-tenant Data Modeling Design multi-tenant PostgreSQL schemas with row-level s

About Zinnov Zinnov is a global management consulting firm that helps organizations make decisions that actually get used — and deliver results that matter. For over two decades, we’ve partnered with leading enterprises, high-growth technology companies, and investors to answer some of the toughest questions they face: Where should we invest? How do we scale globally? What capabilities will win in the next decade? Our work shapes market entry strategies, global operating models, M&A decisions, and long-term growth bets. We’re known for being data-led, execution-focused, and outcome-driven — not opinion-heavy slideware. At Zinnov, how you work matters as much as what you deliver. We value independent thinking, crisp communication, and early ownership. With 450+ professionals across 10 global offices, we work across industries including Digital Services, ER&D, Enterprise Software, Semiconductors, Healthcare, BFSI, Automotive, Media & Telecom, and Private Equity. Zinnov isn’t for everyone. It’s for people who want steep learning curves, honest feedback, and the chance to see their work influence real business decisions — not just presentations. About the Role As an Agent / AI Engineer , you will build the AI layer of the GCC Intelligence Platform—the conversational agent users interact with. You will own grounding, retrieval, persona routing, session state, and permission-aware querying so the agent stays accurate, secure, and tenant-safe. What You’ll Do LLM & Agent Integration Integrate LLM APIs (e.g., AzureOpenAIor equivalent) for conversational workflows. • Build a grounding layer that anchors responses to real platform data (not model guesses). • Maintain prompt templates across multiple personas and use-cases. Retrieval, Permissions & Security Boundaries Implement intent classification and persona routing to the right KPI views. • Build the API

About Decagon Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences. Our technology enables industry-defining enterprises like Avis Budget Group, Block’s Cash App and Square, Chime, Oura Health, and Hunter Douglas to deploy AI agents that power personalized, deeply satisfying interactions across voice, chat, email, SMS, and every other channel. We’re building a future where customer experiences are being redefined from support tickets and hold music to faster resolutions, richer conversations, and deeper relationships. We’re proud to be backed by world-class investors who share that vision, including a16z, Accel, Bain Capital Ventures, Coatue, and Index Ventures, along with many others. We’re an in-office company, driven by a shared commitment to excellence and velocity. Our values — Just Get It Done, Invent What Customers Want, Winner’s Mindset, and The Polymath Principle — shape how we work and grow as a team. About the Team Over the past few years, development of LLMs has evolved at a rapid pace. It’s not enough for our customers to just “set it and forget it” when it comes to AI software. Truly successful AI Agents require hands-on execution, rigorous iteration, and deep technical delivery to reach enterprise-grade performance. We’re creating an Agent Deployment Engineering Org : a specialized technical delivery team responsible for end-to-end execution of AI agent builds. Agent Deployment Engineers own the hands-on work required to deliver best-in-class agents—writing and configuring key components, validating integrations, and ensuring agents perform reliably at scale. This team brings greater specialization and focus to build quality. Agent Deployment Engineers are technical and customer-facing: you’ll interface with senior technical stakeholders on the customer side while also going deep on agent configuration and build execution. About the Role As an Agent Deployment Engineer, you will be responsi

Celonis is the trusted platform to industrialize Enterprise AI. At our core is the Celonis Context Model — which combines process data, business knowledge, and intelligence into a living digital twin of the enterprise that AI can actually understand, turning AI's operational blind spots into operational clarity. World's leading companies trust Celonis and its global ecosystem of partners to make their AI agents, people, systems, and processes work together, achieving transformational outcomes. We believe there's a massive opportunity to unlock global productivity and sustainability by giving AI the context to understand how every business process really works. Join our mission to make processes work for people, companies, and the planet. Are you a digital transformation leader ready to architect the AI-driven future of the Energy sector? This is not a standard process optimization role. We are looking for a Lead Value Partner to own customer success and drive high-stakes SaaS and AI adoption across top-tier O&G enterprise accounts. You will serve as the strategic bridge—translating complex business needs into technical strategy. As a trusted advisor to C-suite executives (COO, CFO, CTO), you will blend deep operational Oil & Gas DNA with elite management consulting and an AI-first mindset to realize maximum customer value. The Impact You Will Drive Value Architecture: Translate executive priorities into AI use cases (optimization, maintenance, decarbonization) and Value Realization Frameworks. Solution Blueprints: Architect scalable, end-to-end data flows to resolve complex operational bottlenecks (refinery, pipeline, reservoir). Financial Quantification: Build data-backed business cases driving $10M+ in CAPEX/OPEX savings. Executive Advisory: Deliver high-stakes value narratives to C-suite stakeholders and supermajor leadership to accelerate software pipelines. Process Transformation: Automate field-to-back-office workflows using Master Black Belt methodolo

About the role As a Forward Deployed Engineer (FDE) focused on Inference & Post-Training, you will be a hands-on technical partner to our most strategic customers — production AI teams looking to leverage high quality models and do inference at scale. For us, FDE is not a replacement for a Solutions Architect; you will partner with our SAs as a deep-domain specialist in inference optimization, fine-tuning pipelines, and production deployment. As key contributors to both the CX, Engineering, and Sales organizations, FDEs add tremendous value by ensuring we can meet the requirements of our most complex POCs, facilitate successful platform adoption, and guide tailored optimization efforts — directly impacting customer success, company growth, and the hardening of our core platform. Responsibilities Inference Engine Optimization: Select, configure, and optimize inference engine based on hardware, model architecture, and workload profile Configuration & Performance Tuning: Develop configuration updates to win critical POCs, benchmarks, and optimize customer deployments; tune KV cache, apply speculative decoding, determine optimal tensor parallelism, and determine quantization strategy to hit throughput and latency targets. Post-Training & Fine-Tuning: Drive hands-on RL training runs and optimize system design; guide customers through LoRA, SFT, DPO, RLHF, and GRPO pipelines from experimentation through production. Strategic Customer Alignment: Act as the primary technical point of contact for aligned strategic accounts — monitoring and optimizing endpoint configurations, helping customers get the most out of the platform, and collaborating to ensure we hit critical milestones. Opinionated Onboarding: Establish direct alignment with strategic customers at onboarding; ensure the right inference and post-training configurations are in place from day one to improve time-to-value. Product Feedback Loop: Directly influence our software and model roadmap by surfacin

About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career. About the team We are a brand new team, working quickly to accelerate Stripes engineering productivity by effectively deploying LLM agents and tools to automate large swaths of the engineering workflow. We’re a cross-continent team, spanning North America and Europe - filled with high agency engineers with strong product perspectives. Some examples of what we work on: here and here . What you’ll do You will build the next generation of internal AI coding tools and platforms, to massively accelerate Stripe’s engineering productivity safely and with a clear focus on our users’ needs. Who you are We’re looking for someone who meets the minimum requirements to be considered for the role. If you meet these requirements, you are encouraged to apply. The preferred qualifications are a bonus, not a requirement. Minimum requirements We’re looking for someone who has: Strong software engineering skills and ability to write high quality code at high velocity 2-5 years of professional hands-on software development experience, able to write well-factored algorithms and have experience with commonly used data structure and algorithms Hands on experience building tools or platforms used by other engineers or internal users Strong collaboration skills, can work across workstreams within your team and contribute to your peers’ success Customer obsession, ability to articulate and represent customer experience in various forums to drive the right outcome Have t

Everpure (NYSE: P) has evolved from storage pioneer to data platform, closing fiscal 2026 with $3.7 billion in revenue, its first billion-dollar quarter, and accelerating growth into FY27. Our strategic agenda spans the companies defining the next era of technology - hyperscalers, AI labs, the AI hardware supply chain, data platform providers, and the broader AI ecosystem. This type of work—work that changes the world—is what the tech industry was founded on. So, if you're ready to seize the endless opportunities and leave your mark, come join us. THE ROLE Pure Storage is seeking a full-time Principal Hardware Engineer working as part of our Hardware Development Team. In this position, you'll be working to define the technical direction of our next-generation hardware platforms. You’ll work closely with Architects, Engineering, Operations, OEM/JDM Partners and Support & Escalation Teams. You'll be responsible for the future of Pure’s high performance storage systems, acting as the primary subject matter expert for system hardware across executive, product, and client interactions.. WHAT YOU'LL DO Define system-level hardware architecture for FlashBlade, including compute, memory, interconnect, storage, power, and thermal design. Translate product requirements and customer needs into clear technical specifications and design trade-offs. Evaluate and select key components, technologies, and vendors, and lead make-vs-buy decisions. Drive architecture reviews and design reviews, and ensure designs meet performance, reliability, and compliance targets. Partner with firmware and software teams to define hardware/software interfaces and optimize the full stack Track emerging technologies and industry standards, and shape the long-term hardware roadmap. Work with manufacturing and supply chain on DFM/DFT, yield, cost reduction, and component risk. Strong understanding of X86 architecture and proven design track record Solid understanding of Major Bus

Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify innovations in software models, compilers, platforms, networking, and semiconductors. Our diverse team of technologists have developed a high performance RISC-V CPU from scratch, and share a passion for AI and a deep desire to build the best AI platform possible. We value collaboration, curiosity, and a commitment to solving hard problems. We are growing our team and looking for contributors of all seniorities. Tenstorrent is seeking a SoC Physical Design Verification Engineer to drive full-chip signoff and ensure manufacturable, high-quality silicon across advanced technology nodes. You’ll lead physical verification closure (DRC, LVS, ERC, etc.), debug issues using standard industry PV tools, and collaborate across RTL, PD, CAD, and packaging teams to achieve successful tapeouts. If you thrive in a fast-paced environment and enjoy solving complex challenges in cutting-edge silicon, we’d love to hear from you. This role is hybrid , based out of Santa Clara, CA or Austin, TX or Fort Collins, CO. We welcome candidates at various experience levels for this role. During the interview process, candidates will be assessed for the appropriate level, and offers will align with that level, which may differ from the one in this posting. Who You Are A seasoned engineer with a strong background in CPU/IP/SoC physical verification and tapeout closure. A hands-on problem solver who excels at debugging and driving signoff through complex verification flows. A collaborative team player who works effectively across RTL, PD, CAD, and foundry interfaces. A mentor and technical leader passionate about building efficient, manufacturable silicon. What We Need BS/MS in Electrical/Electronics Engineering (or related) with 7–14 years of hands-on CPU/IP/SoC physical verif

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products. THE ROLE As an OS / K8s Systems Engineer at Baseten, you’ll build the automation and systems that turn raw GPU hardware into production-ready compute. From provisioning to orchestration, you’ll own the software layer that makes our infrastructure reproducible, scalable, and reliable across data centers. This is a senior, hands-on role focused on building systems not operating them. You’ll work close to the metal designing OS images, building provisioning pipelines, and automating cluster bring-up from scratch. Your work will define how quickly we can turn new capacity into usable compute. EXAMPLE INITIATIVES Zero-to-cluster automation Build workflows that take new hardware from unprovisioned to fully operational cluster. Provisioning systems Design PXE-based or equivalent systems for imaging and lifecycle management. Reproducible infrastructure — Ensure clusters deploy consistently across data centers. RESPONSIBILITIES Own the end-to-end automation of cluster bring-up and lifecycle management. Build and maintain OS images, provisioning systems, and configuration pipelines. Deploy and operate cluster orchestration platforms (Kubernetes, Slurm, or similar). Design systems for reproducibility across sites and hardware generations. Automate upgrades, rollouts, and failure recovery. Optimize system performance, including GPU utilization and networking. Partner with hardware and network teams to validate and improve system b

Here at Datadog, we think about offensive security a little bit differently. We embrace automation and AI to run adversary simulations continuously across a massive cloud-native environment, and we expect our offensive engineers to build the tooling that makes that possible. We're looking for a Senior Security Engineer who can execute sophisticated red team operations, write the code that scales them, and take an AI-first approach to offensive security engineering. At Datadog, we place value in our office culture - the relationships and collaboration it builds, and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You'll Do: Plan and execute red team engagements end-to-end, simulating real-world threat actors across cloud infrastructure (AWS, GCP), Kubernetes, CI/CD pipelines, and corporate environments Build and maintain custom offensive tooling, automation frameworks, and engagement infrastructure, treating offensive operations as a software engineering problem Develop custom payloads and evasion capabilities tailored to Datadog's environment and modern defensive controls (EDR, SIEM, network monitoring) Improve the efficiency of offensive operations through thoughtful use of automation and AI, accelerating reconnaissance, vulnerability analysis, and reporting workflows Partner with the Detection & Response team on purple team exercises to validate detection logic, improve alert fidelity, and influence threat models Translate offensive findings into concrete improvements by working directly with defensive security and engineering teams to close gaps Who You Are: You have 5+ years of hands-on experience in offensive security (red teaming, penetration testing, or adversary simulation) with a track record of operating against mature, well-defended environments You write production-quality code (Python, Go, or similar), can build your own tools, and automate your w