About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now. Our customers include category-defining companies like Lovable , Ramp , Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. We recently raised a $355M Series C at a $4.65B valuation, led by General Catalyst and Redpoint Ventures. We've crossed $300M+ ARR and grown fivefold since September. Our team includes creators of popular open-source projects (e.g., Seaborn , Luig i ), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience. The Role: We're looking for strong backend engineers who love building a developer tools used by the largest AI companies in the world. You’ll be building for things at scale, but also for new AI workflows that change every day. Requirements: Experience building and shipping modern web applications end-to-end. We care more about what you’ve built than how many years you’ve been building. Comfort working across the stack: TypeScript on the frontend, Python services on the backend, and ClickHouse for data and analytics. Deep knowledge of observability tools and patterns used for large-scale workloads such as custom sandboxes, training and inference for large language (LLM) and diffusion models. Experience with at least one of: billing/payments systems, B2B SaaS tooling, or enterprise software, or LLM / diffusion models inference and training loads. Strong product instincts; yo
Jobs in United States
Infrastructure Engineer in New York
153 active opportunities · Updated October 2026
Showing
15 jobs
Explore current infrastructure engineer jobs in New York. Filter by work mode, employment type, experience, department, date posted and distance.
About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now. Our customers include category-defining companies like Lovable , Ramp , Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. We recently raised a $355M Series C at a $4.65B valuation, led by General Catalyst and Redpoint Ventures. We've crossed $300M+ ARR and grown fivefold since September. Our team includes creators of popular open-source projects (e.g., Seaborn , Luig i ), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience. The Role: We’re looking for strong engineers with experience building developer tools that users love to work with. Our ideal candidate is someone with a demonstrated drive to build beautiful interfaces that enhance developer productivity. Requirements: 5+ years of experience developing high-quality Python libraries with broad user-bases, ideally including some experience maintaining open-source software. Knowledge of advanced Python features, especially async programming. A strong product sense that manifests as a focus on developer ergonomics and productivity. A high level of customer empathy, good communication skills, and an openness to working directly with our users to help solve their problems. Ability to participate in on-call rotation and respond to production incidents. Ability to work in-person in our NYC or Stockholm office. Any of the following would be a plus:
About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now. Our customers include category-defining companies like Lovable , Ramp , Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. We recently raised a $355M Series C at a $4.65B valuation, led by General Catalyst and Redpoint Ventures. We've crossed $300M+ ARR and grown fivefold since September. Our team includes creators of popular open-source projects (e.g., Seaborn , Luig i ), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience. The Role: We're looking for a Growth Engineer to own the technical foundation of Modal's marketing and developer-facing web surfaces: the marketing site, docs site, growth landing pages, high-profile microsites, forms, analytics instrumentation, and the integrations that help users discover, understand, and get started with Modal. This is a frontend-heavy role for someone with strong product taste, web engineering craft, and a business-owner mindset. You'll partner with Product Engineering, Design, Data, and Growth to ship polished, measurable web experiences from high-profile projects like the GPU Glossary and LLM Engine Advisor to internal tooling that helps teams publish content faster. When this role is going well, Modal launches new pages, docs experiences, campaigns, and experiments quickly without sacrificing performance, craft, or measurement. In this role you will:
About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now. Our customers include category-defining companies like Lovable , Ramp , Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. We recently raised a $355M Series C at a $4.65B valuation, led by General Catalyst and Redpoint Ventures. We've crossed $300M+ ARR and grown fivefold since September. Our team includes creators of popular open-source projects (e.g., Seaborn , Luig i ), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience. The Role: We are looking for PhD research interns with strong research experience in reinforcement learning, machine learning, and foundation models, including large language and multimodal models, to join our research team. This internship is well suited to candidates interested in improving existing methods and developing new techniques for large-scale model training, optimization, and inference, extending models to long-context and long-horizon tasks, and improving inference-time efficiency, reliability, and robustness in high-stakes real-world deployments. Preferred Qualifications: Currently pursuing a PhD in computer science, machine learning, or a related field. A demonstrated record of research in reinforcement learning, machine learning, foundation models, or related areas. Experience developing and evaluating large-scale models or machine learning systems. Familiari
About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now. Our customers include category-defining companies like Lovable , Ramp , Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. We recently raised a $355M Series C at a $4.65B valuation, led by General Catalyst and Redpoint Ventures. We've crossed $300M+ ARR and grown fivefold since September. Our team includes creators of popular open-source projects (e.g., Seaborn , Luig i ), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience. The Role: Most of the value of owning a model shows up at serving time. We're building a platform that covers the whole life of an LLM -- train it, deploy it, observe it -- and inference is where teams feel the difference every day. We already run elastic inference, sandboxes, distributed volumes, and multi-node training, and we control the infrastructure underneath, so the serving stack is ours to shape rather than something we resell. You will do hands-on inference research at Modal, working with the research lead to pick high-impact bets and owning them end to end. The bets that matter most are the ones that move cost per token and tail latency on the workloads our customers actually run. What you'll do: Own end-to-end inference research bets: speculative decoding, disaggregated prefill/decode, quantization (FP8, INT4), KV-cache and memory management, autoscaling for spik
About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now. Our customers include category-defining companies like Lovable , Ramp , Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. We recently raised a $355M Series C at a $4.65B valuation, led by General Catalyst and Redpoint Ventures. We've crossed $300M+ ARR and grown fivefold since September. Our team includes creators of popular open-source projects (e.g., Seaborn , Luig i ), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience. The Role: We're building a platform that covers the whole life of an LLM: training it, deploying it, and observing it in production. We already run multi-node training, elastic inference, sandboxes, and distributed volumes, and we control the infrastructure underneath. We’re looking for research depth in post-training to sit alongside our systems and product work. What you'll do: We are looking for research scientists with a strong track record in reinforcement learning, machine learning, and foundation models, including large language and multimodal models, to join our research team. This role is well suited to candidates interested in improving existing methods and developing new techniques for large-scale model training, optimization, and inference, extending models to long-context and long-horizon tasks, and improving inference-time efficiency, reliability, and robustnes
From $110K/yr
Datadog AI Research — Scholars Program with Carnegie Mellon University Datadog AI Research (DAIR) is partnering with Carnegie Mellon University to support a small number of PhD students working on open research problems grounded by ongoing efforts at Datadog/DAIR. You will frame a problem, run your own experiments, and write up what you find, with compute and data at a scale most academic labs cannot provide. You will collaborate with colleagues working on the same questions. The Lab And The Research: DAIR is an industrial research lab motivated by practical challenges in observability and software operation: detecting and diagnosing failures, understanding complex production environments, and helping engineers operate software more effectively. The lab focuses on creating specialized foundation models, post-training and evaluating AI agents, and building frontier-scale machine learning systems. By combining fundamental research with Datadog's large-scale, real-world data and infrastructure, the lab develops new AI capabilities and translates them into practical systems with meaningful impact. Internship projects are shaped with your DAIR mentor and your CMU faculty advisor. You do not need prior experience with observability, monitoring, or infrastructure. What You'll Do: Own a research project end to end: framing the question, running the experiments, writing it up Work directly with a DAIR mentor engaged in the same problem, and stay connected to your advisor and lab Publish, and use the work toward your dissertation See research reach production, when it works Who You Are: Currently enrolled in a PhD program at Carnegie Mellon in machine learning, computer science, statistics, or a related field Depth in at least one area relevant to the research above Comfort running real experiments — training models, working with GPUs, reading and reimplementing recent papers Evidence you can do research: conference or workshop papers, preprin
From $100K/yr
Datadog is seeking curious, driven interns to join our Product Management team and help build products that improve how engineers monitor and understand their systems. As a Product Management Intern, you'll support the product development lifecycle by partnering closely with Engineering, Design, and Product Marketing to bring new ideas and features to life. You'll gain hands-on experience working on products that serve highly technical customers while contributing to meaningful business and user outcomes. Interns are embedded directly within product teams, working on meaningful initiatives alongside full-time Product Managers and contributing to actual product decisions. Our platform processes over 100 trillion events per day across 30,000+ customers in a multi-cloud environment -- giving you direct exposure to large-scale, real-time systems built by engineers, for engineers. It's an environment where you'll develop product thinking, technical communication, and cross-functional collaboration skills by doing the work, not just observing it. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Conduct customer discovery conversations and gather feedback to better understand user needs Drive product initiatives from concept through launch alongside Engineering, Design, and Product Marketing teams Translate customer and business needs into clear product requirements and engineering priorities Analyze customer feedback, product data, and market insights to help inform product decisions Prepare and deliver technical product demonstrations and communication materials Develop technical understanding of Datadog’s observability platform and cloud infrastructure products Who You Are: Targeting a 2028 full-time graduation or start date Pursuing a degree in
We believe that the way people interact with their finances will drastically improve in the next few years. We’re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with thousands of companies like Venmo, SoFi, several of the Fortune 500, and many of the largest banks to make it easy for people to connect their financial accounts to the apps and services they want to use. Plaid’s network covers 12,000 financial institutions across the US, Canada, UK and Europe. Founded in 2013, the company is headquartered in San Francisco with offices in New York, Washington D.C., London and Amsterdam. The FinOps function is responsible for financial accountability, visibility, and optimization across all engineering-related spend at Plaid. This includes cloud infrastructure, AI/ML and data workloads, third-party SaaS tools, and other technical investments that support Plaid’s products and internal platforms. The team operates at the intersection of Engineering, Product, and Finance, ensuring that spending decisions are transparent, intentional, and aligned with product strategy and business priorities. Rather than functioning as a cost-control or approval layer, FinOps enables teams to understand, own, and optimize their spend while maintaining engineering velocity. Responsibilities Monitors and analyzes engineering spend across cloud, AI/ML, data platforms, and SaaS, identifying trends, anomalies, and optimization opportunities. Builds and maintains forecasts for engineering spend, partnering with Finance and engineering leaders to understand drivers, assumptions, and risks. Partners with engineering, product, and TPMs to incorporate cost considerations into roadmaps, architectural decisions, and execution plans. Leads cost optimization initiatives, such as rightsizing, commitment strategies, an
From $330K/yr
Datadog is expanding the Technical Solutions (TS) organization by seeking a customer-focused, deeply technical Distinguished Architect to join our Product Solutions Architecture (PSA) team. In this role, you will act as a technical multiplier for the world's leading AI labs and AI-native companies. You will bridge the gap between their bleeding-edge infrastructure aspirations and Datadog’s technology roadmap, ensuring our platform natively solves the unique observability challenges of training and deploying foundational models at scale. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Leadership : Demonstrate thought leadership in the AI/LLM space. Influence key decision makers and stakeholders by connecting technical capabilities to organizational and business impact. Advisory : Strategically partner with highly technical Founders, Heads of Infrastructure, and Research Lead peers. Guide them on best practices and emerging industry trends in the AI/LLM space. Lead high-level technical and architectural conversations around AI adoption. Presentations : Lead deep-dive architecture reviews and design engagements with customer teams and their leaders to share industry trends, best practices, and demonstrate how Datadog can support high-throughput hyper scale AI workloads. GTM : Identify emerging AI-native technology shifts and feed them directly back to Datadog Product Management. Co-create custom observability integrations and solutions alongside Product SAs to keep Datadog at the absolute forefront of the AI stack. Collaboration : Collaborate with Product Solutions Architecture (PSA), Sales, Sales Engineering and Marketing in providing high-quality technical resources to a broad audience of practitioners and economic buyers. Hiring : Assis
AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now. Our customers include category-defining companies like Lovable , Ramp , Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. We recently raised a $355M Series C at a $4.65B valuation, led by General Catalyst and Redpoint Ventures. We've crossed $300M+ ARR and grown fivefold since September. Our team includes creators of popular open-source projects (e.g., Seaborn , Luig i ), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience. About the Role: As a Manager, Enterprise Sales, you will lead and scale our enterprise sales team, driving strategic revenue growth with a consultative, customer-first approach. You will oversee complex deal cycles, coach Enterprise Account Executives, and build the motion that wins high-impact, multi-stakeholder deals in a rapidly evolving AI landscape. What You’ll Do Lead, mentor, and develop a team of Enterprise Account Executives, fostering a culture of performance, strategic thinking, and collaboration Own and guide the full enterprise sales cycle, from targeted outbound and discovery to multi-threaded navigation, negotiation, and close Build and refine enterprise sales playbooks, qualification frameworks, and forecasting models that increase accuracy and velocity Collaborate cross-functionally with Product, Marketing, and Engineering to align on go-to-market strategy, unblock en
About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now. Our customers include category-defining companies like Lovable , Ramp , Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. We recently raised a $355M Series C at a $4.65B valuation, led by General Catalyst and Redpoint Ventures. We've crossed $300M+ ARR and grown fivefold since September. Our team includes creators of popular open-source projects (e.g., Seaborn , Luig i ), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience. About Talent at Modal Modal is growing fast, and the programs that bring people in and set them up to succeed are still being built. You'll join the Talent team as one of its first hires focused purely on programs; working closely with recruiting and leadership to build the events, internship, and campus presence that shape how the best people discover and experience Modal for the first time. The Role As Talent Programs Manager, you will own Modal's talent events, our intern program, and our presence at career fairs, end-to-end. This is a build-from-the-ground-up role for someone who wants full ownership rather than an existing playbook to execute. You'll work directly with recruiters, hiring managers, and marketing to make sure every program ladders up to real hiring outcomes, and you'll be the person who makes candidates' and interns' first experience of Modal a great one.
About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now. Our customers include category-defining companies like Lovable , Ramp , Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. We recently raised a $355M Series C at a $4.65B valuation, led by General Catalyst and Redpoint Ventures. We've crossed $300M+ ARR and grown fivefold since September. Our team includes creators of popular open-source projects (e.g., Seaborn , Luig i ), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience. About Modal Design Modal is building the future of serverless computing, and the brand that carries that story is still taking shape — You'll join Modal's newly formed Brand team inside our design org as one of its first senior hires, working directly with the Director of Brand Design and Head of Design to build a brand developers recognize instantly and remember. The Role As a staff-level Brand Designer, you will have major influence over every brand surface: the marketing website, campaigns, events, editorial projects like the GPU Glossary and forthcoming publications, and out-of-home work as we scale into larger formats. You'll also be a beacon to external agencies, representing Modal's internal creative voice and making sure the work translates into a system we can actually build on. And as the studio grows, you'll help set its craft standard — guiding and mentoring earl
Who We Are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world’s largest enterprises to the most ambitious startups—use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone’s reach while doing the most important work of your career. About The Team The Enterprise Hunter Solutions Architecture Team aims to land new users adopt prescriptive solutions that drive their growth and success. We work with C-level executives, finance leaders, product design and engineering teams at global brands who are building financial services solutions with Stripe. Our SA team works closely with Account Executives, Professional Services, Partners, and Product Teams to develop our strategy for winning new users. At Stripe, managers grow people and inspire them to do outstanding work. This leader must be a driver who loves building teams through its people and can deliver outstanding results. This role requires great interpersonal skills to work cross functionally as a trusted advisor to both our sales, partner and professional services teams. This role will also play an important role in helping shape our product and messaging with our product development and marketing teams. As a manager/leader of Solution Architecture for our new business, you will recruit, lead, and mentor a world class pre-sales engineering team to grow our user base through new deals. You will drive collaboration from cross-functional teams to influence and unify stakeholders at all levels of the organization to drive business results. You will lead from the front and drive outcomes for our users. What You’ll Do Responsibilities Recruit, hire, lead, and retain a world class pre sales team. Be an advocate for the
About Us: AI needs a new infrastructure layer. We're building it at Modal. Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now. Our customers include category-defining companies like Lovable , Ramp , Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale. We recently raised a $355M Series C at a $4.65B valuation, led by General Catalyst and Redpoint Ventures. We've crossed $300M+ ARR and grown fivefold since September. Our team includes creators of popular open-source projects (e.g., Seaborn , Luig i ), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience. The Role: We’re looking for business operations managers to join the team. This person will work closely with folks across marketing, sales, operations, and finance across a variety of initiatives to help scale the business in our next phase of growth. You'll be a generalist who gets in the weeds on all the business and operational aspects of a high-growth startup. In this role, you will: Drive in-depth quantitative analyses to inform our pricing and packaging strategy. Help spin up our deal desk and streamline enterprise deals. Support the exec team on various finance functions, from investor relations to large cloud vendor negotiations to identifying cost optimization opportunities. Implement new tools and processes to enable the GTM org to grow rapidly. Get creative on a spectrum of ad-hoc projects like securing new office space in Manhattan. Requirements: We are looking
Other cities to consider
More places hiring for this role
Get new infrastructure engineer jobs in New York, United States by email
Daily job updates · Unsubscribe anytime