NVIDIA is seeking a Senior Technical Program Manager to join the CSP Engagements team, focused on deep technical engagement with hyperscale cloud service providers for NVIDIA’s next‑generation datacenter systems such as Vera Rubin NVL72. This role is intended for experienced systems and embedded software leaders—including software engineering managers, technical leads, or senior architects—who have led datacenter server and platform software programs and can operate as a trusted technical partner to hyperscale CSP engineering teams. As a member of the CSP Engagements team, you will act as the primary technical engagement leader between NVIDIA’s system software organizations and CSP platform, system software, and AI teams, ensuring alignment, readiness, and successful large‑scale deployment of NVIDIA‑based datacenter solutions. What you will be doing: Lead deep technical engagements with hyperscale CSPs as the primary NVIDIA point of contact for system software, firmware, and platform readiness for NVIDIA datacenter products. Partner directly with CSP system software, firmware, and infrastructure engineering leaders to align on software architecture, bring‑up plans, deployment readiness, and production requirements for NVIDIA‑based server and rack‑scale platforms. Represent CSP technical priorities internally, advocating for customer requirements and tradeoffs across NVIDIA’s system software, firmware, hardware, silicon, and product teams are aligned to customer needs, timelines, and constraints. Own the end‑to‑end CSP engagement lifecycle, from early technical alignment and pre‑production readiness through large‑scale deployment, escalation management, and sustained production support. Drive bi‑directional technical communication: translating CSP system‑level requirements into actionable focus areas for NVIDIA engineering teams, while clearly communicating N
Senior Manager, Software Engineering - Rack Scale Systems Infrastructure
Market pay estimate
$200,000–$228,000 / year for comparable Senior Manager roles in United States. Not employer-provided.
Role overview
Job description
NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.
Join our team in Santa Clara to lead engineers building rack-scale infrastructure software that makes complex hardware manageable and programmable. You will own delivery of control planes, lifecycle orchestration, system health, and recovery capabilities, working across hardware, firmware, networking, and operations teams to support customer deployments at rack and fleet scale.
What you'll be doing:
- Take ownership for the delivery of rack-scale infrastructure software within a cross-functional organizational structure. Coordinate commitments, address ownership gaps, and stay accountable for results from requirements to production adoption and support.
- Translate business needs and evolving hardware roadmaps into release priorities and achievable plans. Balance staffing, dependencies, and technical risk across projects as priorities change.
- Partner with architects and technical leads on control planes, lifecycle orchestration, health analysis, and recovery. Guide engineering tradeoffs and ensure a consistently high standard for reliability, security, and maintainability.
- Build and develop the team through hiring, mentoring, and clear performance expectations. Grow technical leads and future managers, delegate important ownership, and balance work across the team.
- Establish effective planning, validation, release, and issue triage practices. Use delivery and quality evidence to identify risks early, drive root-cause resolution of production issues, and improve how the team works.
- Coordinate with firmware, platform, networking, quality assurance, security, and operations teams to deliver coordinated capabilities. Work directly with customers and partners to turn deployment feedback into product improvements.
- Be responsible for the team's open-source delivery and support practices, including contribution review, issue triage, documentation, and release maintenance.
- Communicate priorities, progress, and tradeoffs clearly to engineers, collaborators, and leadership. Make sound decisions in ambiguous situations and carry cross-team commitments through to completion.
What we need to see:
- Bachelor's, master's, or doctoral degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field, or equivalent experience.
- 12 or more overall years of engineering experience in systems software, platform software, server firmware, or data center infrastructure, including a minimum of 6 years managing software or firmware engineering teams.
- Proven track record delivering production software across multiple programs in a matrix organization, aligning shared resources and dependencies while maintaining quality, release rigor, and effective production support.
- Solid technical background in Linux, distributed systems, application programming interfaces, state machines, and failure handling. Familiarity with data center architecture, hardware-conscious orchestration, server manageability, firmware or operating system lifecycle, telemetry, and large-scale reliability.
- Software development experience in Go, C++, or Rust, with the depth to review designs and code, guide debugging, and assess engineering quality.
- Proven capability to guide distributed engineering groups, recruit and nurture engineers, cultivate technical leaders, assign significant responsibilities, and maintain a steady standard of performance.
- Clear written and verbal communication, good judgment under ambiguity, and experience aligning engineering teams, customers, and partners on practical solutions.
Ways to stand out from the crowd:
- Experience across the rack-scale systems lifecycle, from hardware bring-up and validation through provisioning, firmware and operating system updates, production operations, and recovery. Familiarity with NVIDIA GB200 or GB300 systems is a plus.
- Experience with Kubernetes controllers or operators, declarative control planes, and simulation or fault injection to validate software before hardware is available.
- Hands-on experience with baseboard management controller software, OpenBMC, embedded Linux, Python, and server debugging. Familiarity with Redfish or related standards for out-of-band management and device security, and with accelerated computing platforms using NVLink, Ethernet, or InfiniBand.
- Built open-source infrastructure software used by external teams. Strong Rust experience and thoughtful use of artificial intelligence tools for development, testing, and debugging.
NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you!
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 248,000 USD - 391,000 USD.You will also be eligible for equity and benefits.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.Role market pulse
How Senior Manager demand looks in United States
Live jobs
270
Posted 30d
180
30d movement
+291.3%
Remote share
25.2%
Salary listed
60.4%
Salary trend 1Y
Not enough history
What they are looking for
Skills & requirements
Qualification
What we need to see: Bachelor's, master's, or doctoral degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field, or equivalent experience
Hiring company
NVIDIA
We create the world’s fastest supercomputer and largest gaming platform.
Related opportunities
Similar active roles
Relevant, currently active roles for this market.
● Strong current hiring demand for this role
● Strong current hiring demand for this role
$250K – $300K/yr
● Strong current hiring demand for this role
● Strong current hiring demand for this role
🔔 Get job alerts
New Senior Manager, Software Engineering - Rack Scale Systems Infrastructure jobs in Ca, Santa Clara, United States, straight to your inbox.
No spam · Unsubscribe anytime