Business Systems drives efficiency across Datadog through business process analysis, systems automation and integrations, AI agent and MCP development, and vendor/software review. The team is increasingly embedded in cross-functional initiatives across People, Finance, GTM , Legal, Recruiting, and Technical Solutions — translating ambiguous business problems into scoped, buildable solutions and owning delivery end-to-end. This is not a generalist BSA role. Each Senior BSA will own a cluster of business functions end-to-end, acting as an internal product manager for their domain rather than processing inbound requests reactively. There are two openings, each covering a different domain: People, Recruiting, Legal or Finance, GTM, Procurement As the role evolves alongside AI, Senior BSAs leverage agentic tools for data aggregation and context gathering while remaining the critical human-in-the-loop layer — owning business context and product outlook, validating use cases, managing stakeholder relationships, and making the judgment calls agents can't. At Datadog, we place value in our office culture - the relationships that it builds, the creativity it brings to the table, and the collaboration of being together. We operate as a hybrid workplace to ensure our employees can create a work-life harmony that best fits them. What You’ll Do: Discovery and scoping: Translate ambiguous asks from business stakeholders into well-defined requirements that Business Systems Engineers can build against. Many stakeholders don't know what they want or the cross-functional impact of what they're asking for — you surface both before engineering begins. Cross-functional visibility: Identify dependencies, downstream impacts, and integration considerations that requesting teams miss. Proactive opportunity identification: Develop deep domain knowledge to identify automation and AI opportunities before they become inbound requests, shifting the team from reactive in
Jobs in United States
Senior Ai Agent Test Development Engineer in New York
211 active opportunities · Updated October 2026
Showing
15 jobs
Explore current senior ai agent test development engineer jobs in New York. Filter by work mode, employment type, experience, department, date posted and distance.
We are investing in agentic AI and need a Senior AI Engineer to lead the design and delivery of these systems. This is a foundational hire: you will own both the agent-facing workstreams — pipelines, orchestration, conversational interfaces — and the underlying context layer that makes them reliable, including memory management, knowledge graph integration, and retrieval infrastructure. You will work closely with data engineers, project leads, and client stakeholders, and play a key role in shaping how Lynx builds and ships AI solutions at scale. What This Involves: Lead the architecture and delivery of agentic AI systems end-to-end: agents, orchestration, tool use, and multi-step reasoning workflows. Own the context layer: design and implement memory architectures (episodic, semantic, working memory) and integrate GraphRAG and knowledge graph retrieval into agentic pipelines. Build robust RAG systems — including vector retrieval, graph traversal, and hybrid search — and ensure retrieval quality through evaluation frameworks. Translate client requirements into technical designs, presenting approaches and trade-offs to both technical and non-technical stakeholders. Define standards and reusable patterns for agentic AI development that other engineers at Lynx can build on. Set up observability, evaluation, and monitoring pipelines to ensure AI systems perform correctly in production. Requirements: 5–8 years of software or ML engineering experience, with at least 2–3 years building LLM-based or agentic AI systems in production. Deep hands-on experience with agentic frameworks (LangChain, LlamaIndex, AutoGen, CrewAI, or similar) and LLM APIs (OpenAI, Anthropic, etc.). Strong understanding of agent design patterns: ReAct, planning loops, tool use, multi-agent coordination, and memory architectures. Practical experience with GraphRAG or knowledge graph-based retrieval (e.g., Neo4j, Microsoft GraphRAG) and vector databases (Pinecone, Weaviate, Qdrant, etc.). Proficiency in
From $192K/yr
As the Senior Product Manager for the Actions & Automations team, you will own the ecosystem that enables customers, partners, and Datadog teams to build, deploy, and operate AI agents on Datadog. You will drive the strategy and execution for the platform capabilities, developer experience, integrations, and extensibility model that make Datadog the best place to build agents that understand and act on production systems. Modern engineering organizations are entering a new era where software is not only monitored and operated by humans, but increasingly by AI-powered agents. As agentic workflows reshape how teams build, operate, secure, and troubleshoot systems, customers need a platform for creating specialized agents, connecting them to business and engineering systems, governing their behavior, and extending them to solve unique organizational problems. You will define and build the ecosystem that makes this possible. Agent Builder sits at the intersection of Datadog's products, AI capabilities, and ecosystem strategy. You will have the opportunity to work across the breadth of the Datadog platform, partner with teams throughout the company, and help establish Datadog as the foundation for operational AI. At Datadog, we place value in our office culture, the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Define the vision, strategy, and roadmap for Datadog's Agent Builder platform and ecosystem. Own the core platform capabilities that enable customers and partners to create, customize, deploy, and manage AI agents. Drive the extensibility model for agents, including integrations, tools, actions, context sources, APIs, SDKs, and developer workflows. Shape how agents perform actions across Datadog products and third-party systems. Partner closely with AI, platform, infrastructure, and product tea
Datadog's integrations are the connective tissue between our platform and the technologies our customers run in the real world. As a Sr. PM on the Agent Integrations team, you will own the vision, prioritization, and execution for 100+ integrations that run directly inside the Datadog Agent from foundational infrastructure (MySQL, Kafka, Kubernetes) to the rapidly growing landscape of self-hosted AI and on-premise enterprise technologies. This is a high-impact, breadth-first role at the intersection of infrastructure observability and the frontier of AI-native workloads. At Datadog, we place value in our office culture; the relationships it builds, the creativity it brings, and the collaboration of being together. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You'll Do: Own the Agent Integrations roadmap. Determine which new integrations to build and which existing ones to improve, balancing customer demand, business impact, and engineering capacity across a catalog of 100+ technologies. Drive the expanding AI integration surface. Lead product strategy for self-hosted AI workloads, including LLM inference frameworks (e.g., Hugging Face TGI, BentoML), AI agents, MCP servers, and model orchestration tools, so Datadog customers can monitor every layer of their AI stack. Expand on-prem and hybrid coverage. Prioritize and execute new integrations for on-prem technologies including storage systems, HPC schedulers, network devices, and legacy enterprise platforms where customers run critical workloads. Build observability for ERP systems. Define and drive Datadog's strategy for monitoring enterprise ERP platforms (SAP, Oracle EBS/Fusion, Microsoft Dynamics) covering performance, job execution health, and integration layer telemetry so enterprise customers can observe their ERP stack alongside the rest of their infrastructure. Analyze adoption and customer feedback at scale. Use data from multiple sources to
From $192K/yr
Today, everyone from PMs to Sales to SREs uses AI to query their business data - but every answer is a one-off with no governance, no consistency, and no visibility for data teams. We're building the system that fixes this: a context layer that learns from existing data tools driving high quality and consistent answers, an AI-powered query experience, full governance for data teams, and rich analysis surfaces to present and share the results. You'd be building a zero to one product of what we believe will become a major new product line for Datadog. At Datadog, we place value in our office culture - the relationships and collaboration it builds, and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What you'll do Drive the product vision and roadmap spanning the Data agent experience, the semantic/context layer, governance console, chat experience and analysis surfaces (dashboards, notebooks, sheets) Own the end-to-end product lifecycle from discovery to launch, working with a cross-functional team of engineers, designers and other PMs Deeply understand the needs of two key personas: data teams (who govern and curate) and data consumers (PMs, engineers, SREs, executives who ask questions) Design the context and governance layer that makes AI-powered analytics trustworthy - including auto-generation from existing BI tools, eval frameworks, confidence scoring, and self-improvement loops Define how observability data and business data come together to serve unique use cases Engage directly with early customers and internal dogfooding users to iterate on accuracy, usability, and trust Independently research the competitive landscape across legacy BI vendors, warehouse-native analytics, AI-first startups, and AI labs Work on the product pricing Work with GTM teams to define positioning, packaging, and the path to displacing entrenched tools Who you are 5+ years of experience
From $192K/yr
As a Senior Platform Product Manager focused on AI SDLC Trusted Throughput, you will define and drive the product strategy for enabling safe, reliable software delivery at AI-native scale across Datadog’s Internal Developer Platform. As AI accelerates development velocity and system complexity, you will help evolve SDLC systems from human-supervised workflows to platforms with built-in safety, observability, and correctness guarantees. You will partner closely with engineering, security, and developer platform teams to improve deployment reliability, operational visibility, and governance while enabling both engineers and AI agents to move quickly with confidence. This role offers the opportunity to shape foundational developer infrastructure and influence how AI-powered software delivery operates across Datadog. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Own the product strategy, roadmap, and execution for AI-native SDLC throughput and reliability initiatives across Datadog’s Internal Developer Platform Define and drive platform outcomes aligned to DORA metrics, balancing deployment velocity with reliability, change failure reduction, and operational safety Partner with engineering, infrastructure, security, and developer experience teams to build automated validation, auditability, and risk-scoring capabilities into deployment workflows Deliver actionable SDLC observability and diagnostic capabilities that connect executive-level metrics to operational signals across the software delivery lifecycle Drive systems that monitor and validate AI-generated or AI-attributed changes to ensure correctness, compliance, and trustworthy automation Serve as a cross-functional product leader across SDLC Foundations, Security Engineering, and compl
At Datadog, we're on a mission to build the best platform in the world for engineers to understand and scale their systems, applications, and teams. We operate at high scale, enabling seamless collaboration and problem-solving among Dev, Ops, and Security teams globally for tens of thousands of companies. Our engineering culture values pragmatism, honesty, and simplicity to solve hard problems the right way. Feature flags used to be simple on/off switches. That's changing fast. Flags are becoming a control plane: they're tied to observability, they drive rollout decisions, and AI agents build and run more of this work every day. Datadog is building the platform for that future, and we are now expanding our Feature Flagging & Experimentation product to pair flag decisions directly with observability signals and to modernize the flagging workflow for an SDLC increasingly run by agents. As a Senior Product Manager for Feature Flagging, you will own product strategy and drive execution across flags-plus-observability integration and agentic-era flagging workflows. You will set direction for a critical area of the roadmap, work closely with the observability, RUM, and APM teams, and report directly to the Director of Product leading this team. You'll be relied on to make sound, independent product judgment calls with limited oversight, bring engineering credibility to every decision, and drive B2B go-to-market strategy alongside sales. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. This role is based in New York City and works from our office 3 days a week to support that collaboration. What you will Do: Find every place where a flag decision and an observability signal should talk to each other - rollout gating, anomaly-triggered rollback, experiment diagnostics - and ship a roadmap that unlocks observability and experimentation differentiators in Datadog Feature Flags
The mission of The New York Times is to seek the truth and help people understand the world. That means independent journalism is at the heart of all we do as a company. It’s why we have a world-renowned newsroom that sends journalists to report on the ground from nearly 160 countries. It’s why we focus deeply on how our readers will experience our journalism, from print to audio to a world-class digital and app destination. And it’s why our business strategy centers on making journalism so good that it’s worth paying for. About the Role, Mission or Department Overview As a Senior Engineer, Marketing, you'll be embedded with the Marketing team, providing us with technical leadership, consulting, and systems thinking. You'll assemble the orchestration systems, integrations, and AI capabilities that help teams work faster, and in more data‑driven ways. You will lead end‑to‑end design, implementation, and management of the marketing campaign lifecycle system, integrations, internal tools, and learning/experimentation infrastructure. You will report to our Director, Advertising Systems. Responsibilities: You will write high-quality, secure, and well-tested code, contributing to standards and documentation for Marketing infrastructure, data models, and tools You will build the campaign lifecycle orchestration backbone You will build integrations and internal tools that connect project management, collaboration, creative, media, and email/lifecycle platforms You will work with Marketing partners as a technical advisor, translating needs into designs You will integrate AI agents and automations (including LLM-powered flows) into Marketing workflows according to company GenAI guidance You will design and operate data pipelines and models that ingest marketing and performance data into a data layer, supporting experimentation and analytics workflows You will deliver abstractions and APIs that ensure AI systems and our users to create campaign wrap-ups, insights, next-t
Who Are We? Postman is the world’s leading API platform, used by more than 45 million+ developers and 500,000 organizations, including 98% of the Fortune 500. Postman is helping developers and professionals across the globe build the API-first world by simplifying each step of the API lifecycle and streamlining collaboration—enabling users to create better APIs, faster. The company is headquartered in San Francisco and has offices in Boston, New York, Austin, Tokyo, London, and Bangalore - where Postman was founded. Postman is privately held, with funding from Battery Ventures, BOND, Coatue, CRV, Insight Partners, and Nexus Venture Partners. Learn more at postman.com or connect with Postman on X via @getpostman. P.S: We highly recommend reading The "API-First World" graphic novel to understand the bigger picture and our vision at Postman. About Fern, a Postman Company Fern helps software companies build a world-class API experience. Our customers include industry leaders like Nvidia, Square, and Twilio, as well as fast-growing AI companies like ElevenLabs and OpenRouter. In the next year, the majority of API integrations will be implemented by AI agents. Agents don’t read marketing pages. They need strongly typed schemas, structured endpoints, deterministic contracts, and documentation that can be fed into a context window. Our team is small and talent-dense. We’re a team of builders from Google, Palantir, Amazon, and Uber, working together in New York City. About the Role As a Senior Software Engineer at Fern, you’ll build APIs, scale AI infrastructure, and design developer experiences that reach millions of people. Scale infrastructure to keep up with growth: Work on AI systems deployed on Vercel, AWS, and Turbopuffer that must be performant, reliable, and secure under real-world load. Stay close to customers: We work directly with API teams at companies like Nvidia, Twilio, and Square. You’ll debug real production edge cases, shape APIs ba
The way products get built is changing. Agents write a growing share of shipped interfaces, designers work in code, and a design system's output is bigger than a component library. At Datadog we're redefining ours for that world, and evolving how the product looks and feels at the same time. DRUIDS is the design system behind every Datadog surface, used daily by more than a hundred designers and thousands of engineers across thirty-plus products. You'll lead the team that owns it: designers and design engineers who set the system's direction, hold the quality bar for what ships, and build the tools that make designing in code the default way to work. The team partners closely with product designers, frontend engineers and PMs across the company. This is a hands-on leadership role in a technical, engineering-forward company. You'll be expected to have a point of view and defend it, to be the person the design org asks about quality, and to make the call when work isn't good enough yet. Much of what a design system should be right now hasn't been settled — here or anywhere else. If you're a designer who never stopped making things, and you'd rather decide what a system should be than maintain one that already exists, this is the role. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You'll Do Lead the team and set its direction Decide what DRUIDS owns, what it ships, and what stays with product teams. Own where the system goes next. Have a view on what a design system should be, and argue for it. Turn direction into a roadmap, and work with partners on what gets built and when. Coach the designers and design engineers on your team, be clear about what each person owns, and hire as the team grows. Own craft and quality Own the craft and quality of components, patterns,
Become a part of our caring community Most AI engineering jobs are a thin wrapper around a model API. This role is different. We build the platform that transforms millions of clinical documents into trusted, actionable data. Our systems use large language models (LLMs) to read medical records, extract structured facts, answer complex questions with citations back to the source document, and route ambiguous cases to human experts for review. Our users make decisions that impact real healthcare outcomes, so “good enough” is not good enough. Building AI systems that are accurate, reliable, auditable, and scalable is at the core of this role. As a Senior AI Applied Engineer, you will design, build, deploy, and operate production AI systems used at scale within one of the largest health insurers in the United States. You will own solutions end-to-end, from user experience and APIs to model orchestration, evaluation frameworks, infrastructure, and production operations. Why Join Us Build production AI systems where LLMs are in the critical path, not just demos or proofs of concept. Work on extraction, retrieval, agentic workflows, and human-review systems that process real healthcare data at scale. Own projects end-to-end across frontend, backend, AI orchestration, infrastructure, deployment, and operations. Solve challenging problems around accuracy, explainability, traceability, and reliability in regulated environments. Ship quickly in a small, high-impact team that embraces AI-assisted development and rigorous quality standards. Build systems that continuously improve through expert feedback, evaluations, and human-in-the-loop workflows. Key Responsibilities Design, develop, and deploy full-stack AI-powered application
At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. Our Solution Engineering organization is seeking an AI Specialist who can provide hands-on expertise and support while working with technical decision makers and data scientists to design and architect AI solutions built on the Snowflake AI Data Cloud. This is a strategic role that works closely with cross-functional teams, including product, engineering, and the broader field organization to ensure successful execution and customer adoption of Snowflake’s AI & ML solutions. IN THIS ROLE YOU WILL GET TO: Be the technical expert in the room that positions Snowflake’s AI and ML features and value to technical stakeholders at Snowflake’s customers across the Americas. Partner with Snowflake account team teams and customer champions to scope and drive POCs to success and technical wins that prove the value of Snowflake’s capabilities, including executive readouts and business value cases. Collaborate with Snowflake’s product and engineering teams to influence Snowflake’s AI and ML roadmaps based on customer feedback. Publish content that helps the team and company scale beyond your individual efforts, like blog posts, presentations at conferences, or technical collateral like notebooks and demos. Influence, tailor and maintain Sales Engineering AI and ML selling assets, inc
Who We Are Addepar is a global data and AI platform empowering investment professionals to turn complex financial information into actionable intelligence. Addepar unifies portfolio, market and client data in a total portfolio view and delivers AI-powered insights within investment and client workflows. More than 1,400 firms in nearly 60 countries use Addepar to manage and advise on nearly $9 trillion in assets. Its open platform integrates with nearly 650 software, data and consulting partners to power end-to-end investment operations across firms of all sizes and complexity. Addepar supports clients worldwide with offices in New York City, Salt Lake City, London, Edinburgh, Pune, Dubai, Geneva, Singapore and São Paulo. The Role We are seeking a Staff Full Stack Software Engineer to join the Advisor Experience team as our Technical Lead. Our team is focused on building tools for financial advisors to grow and sustain their business. We oversee bespoke products for advisors and develop advisor-focused capabilities throughout the Addepar platform. In this role, you will be the primary technical anchor for new capabilities including Secure Message Center — a compliant messaging experience built into Addepar's client portal that allows advisors and their clients to communicate directly within the platform. You will partner directly with Engineering Leadership and Product Management to build a modern, scalable architecture from the ground up. Beyond system design, you will act as a true engineering multiplier: setting technical standards, mentoring junior and mid-level engineers, and working alongside other senior engineers and AI specialists to deliver high-impact advisor tools. Applicants must be legally authorized to work in the United States for any employer without requiring current or future visa sponsorship (for example, employment-based visas such as H-1B, F-1/OPT, or similar), and must be authorized to begin work in the U.S. on their first day of employme
From $192K/yr
Databases and data stores are at the center of our applications, for legacy applications and modern AI applications alike. Yet most observability and optimization approaches lack a holistic approach or application context. Datadog has been on a mission to revolutionize how databases are operated, flipping what is often seen as a black box of complexity prone to security and performance risks, into a well oiled machine enabling our builders and businesses to move faster and smarter. We’re looking for an experienced product manager passionate about joining this mission to lead this product opportunity. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Lead ambitious investments that rethink how customers operate and get value from their databases, diving into ambiguity, working with our customers on new models, and shipping new products and changes to existing products. Develop a deep understanding of our customers and their issues, what problems are really behind those issues, and how we can improve how databases are operationalized across SRE teams, DBAs and application developers. Continuously refine your understanding of database management systems and datastores from SQL and OLTP based to NoSQL e.g. AWS RDS, PostgreSQL, SQL Server, MongoDB, MySQL, etc Define, build and launch the next generation of database monitoring and optimization capabilities for our customers Join a talented engineering team with a record of disrupting observability approaches to further the mission of demystifying and optimizing databases using your team’s creativity, alongside your customers’ problems, as a key resource. Collaborate with other Product teams in Datadog to maintain and improve all Datadog products, improve the seamless integration across th
About the Team DoorDash’s mission is to grow and empower local economies. By building intelligent, last-mile delivery technology for local cities, DoorDash connects people with the local businesses they care about — helping grow businesses and the communities that support those businesses. The Marketing Technology team is responsible for delivering best-in-class tools, data, and processes so teams at DoorDash can effectively acquire new customers, drive retention, and grow new business lines across all our audiences. Our mission is to enable teams to deliver personalized, engaging, and relevant content across all our owned and paid channels. We partner closely with Product, Engineering, Data Science, and Analytics teams to translate Marketing’s technology needs into measurable business outcomes for our Growth and Performance Marketing teams. About the Role We're looking for a Senior Associate, AI Solutions Architect to help build and scale AI-powered tools across DoorDash's Marketing teams. You'll work alongside our existing Marketing Technology AI Solutions Architects to identify opportunities where AI can solve real marketing problems, then build, test, and iterate on the solutions that make it happen. This role is grounded in hands-on building: you'll spend your time prototyping, coding, and shipping tools rather than pitching strategy from the sidelines. This is a great opportunity to grow your technical and strategic skills at the intersection of marketing and AI. You'll get mentorship from a team of builders and exposure to the full lifecycle of AI development from prototype to deployment. This role will report to the Senior Manager, Marketing Technology within the Growth Marketing organization. You're excited about this opportunity because you will… Build and deploy AI-powered tools and automations, such as automated reporting, QA frameworks, and workflow optimizations. Develop MVPs and proof-of-concepts, then iterate based on user feedback within a defined w
Other cities to consider
More places hiring for this role
Get new senior ai agent test development engineer jobs in New York, United States by email
Daily job updates · Unsubscribe anytime