Who are we? Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems. We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that. We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft. We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us! Why this role? Our team is a fast-growing group of researchers and engineers focused on building reliable ML systems and pushing the boundaries of LLM inference efficiency. We develop techniques that improve how models execute in production, driving lower latency, higher throughput, and consistent quality across diverse workloads. As an engineer on this team, you’ll work across the inference stack to improve core performance metrics by diving deep into model execution, identifying bottlenecks, and developing innovative optimizations. You’ll collaborate closely with modeling and systems teams to experiment, measure, and ship improvements that meaningfully accelerate inference. As the team evolves, you’ll have opportunities to build expertise in advanced performance techniques, including GPU/CUDA optimizations, kernel-level improvements, and model execution strategies for MoE and large-scale architectures. Please Note: We have offices in Toronto, Montreal, San Francisco, New York, Paris, Seoul and London. We embrace a remote-friendly environment, and as part of this approach, we strategically distribute teams based on interests, e
Jobs in United States
Ml Platform Engineer in New York
24 active opportunities · Updated October 2026
Showing
9 jobs
Explore current ml platform engineer jobs in New York. Filter by work mode, employment type, experience, department, date posted and distance.
From $272K/yr
We’re looking for a Senior Staff Software Engineer with deep experience in GenAI/ML to join Datadog’s Application Performance Monitoring (APM) team. APM is a product which provides deep visibility into applications, enabling users to identify performance bottlenecks, troubleshoot issues, and optimize services. With distributed tracing, profiling, out-of-the-box dashboards, and seamless correlation with other telemetry data, Datadog APM provides some of the deepest and most structured visibility into the health and performance of applications. This context sets us up for an opportunity to be the world leaders in agentic investigations and incident troubleshooting. You’ll act as a technical leader within the APM group, focused on agentic workflows. You’ll lead efforts to design, train, evaluate, and deploy GenAI/ML models at scale. We’re looking for a product-minded ML engineer with strong technical expertise, excellent communication skills, and a track record of driving impactful initiatives end to end. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Serve as the technical owner for GenAI initiatives within APM, leading design, development, and deployment of ML/AI-powered features across multiple teams. Guide long-term strategy and technical direction for GenAI workflows across APM and related products. Build and benchmark GenAI/ML models using state-of-the-art techniques. Contribute to Datadog’s broader senior engineering community through thought leadership and collaboration on company-wide initiatives. Collaborate with cross-functional teams to build automated investigation and triaging tools. Influence product direction by bringing a strong product mindset to your work, always advocating for the end user. Guide teams through ambiguity, sc
From $234K/yr
We’re looking for a Staff Software Engineer with deep experience in GenAI/ML to join Datadog’s Application Performance Monitoring (APM) team. APM is a product which provides deep visibility into applications, enabling users to identify performance bottlenecks, troubleshoot issues, and optimize services. With distributed tracing, profiling, out-of-the-box dashboards, and seamless correlation with other telemetry data, Datadog APM provides some of the deepest and most structured visibility into the health and performance of applications. This context sets us up for an opportunity to be the world leaders in agentic investigations and incident troubleshooting. You’ll act as a technical leader within the APM group, focused on agentic workflows. You’ll lead efforts to design, train, evaluate, and deploy GenAI/ML models at scale. We’re looking for a product-minded ML engineer with strong technical expertise, excellent communication skills, and a track record of driving impactful initiatives end to end. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You’ll Do: Act as a technical leader within the APM organization, driving GenAI/machine learning projects from concept to production. Build and benchmark GenAI/ML models using state-of-the-art techniques. Collaborate with cross-functional teams to build automated investigation and triaging tools. Influence product direction by bringing a strong product mindset to your work, always advocating for the end user. Guide teams through ambiguity, scaling challenges, and evolving requirements with clear technical direction. Actively mentor engineers and influence engineering culture through leadership in design reviews, technical talks, and working groups. Who You Are: You have a BS/MS/PhD in a scientific field or equiva
We believe that the way people interact with their finances will drastically improve in the next few years. We’re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with thousands of companies like Venmo, SoFi, several of the Fortune 500, and many of the largest banks to make it easy for people to connect their financial accounts to the apps and services they want to use. Plaid’s network covers 12,000 financial institutions across the US, Canada, UK and Europe. Founded in 2013, the company is headquartered in San Francisco with offices in New York, Seattle, Washington D.C., Raleigh, London, and Amsterdam. The Data team within Plaid’s Fraud organization builds the machine learning systems that power Plaid’s fraud detection products, leveraging Plaid’s unique network data to identify and stop fraud before it happens. The team owns the full ML lifecycle—from feature pipelines and model training to production serving and monitoring—building reliable, scalable systems that deliver high-quality fraud detection as we grow to support hundreds of customers. As a Senior Machine Learning Engineer, you will own the development of high-performance feature computation and online inference pipelines that power production machine learning systems at scale. You’ll build robust observability, monitoring, and automated debugging capabilities, while leveraging AI-assisted tools to investigate complex system behavior and maintain high reliability. You’ll partner closely with ML Infrastructure, Data Science, and Product teams to execute critical technical initiatives and deliver scalable, high-impact ML solutions. Responsibilities: Build and scale machine learning systems that power a rapidly growing fraud detection product in a fast-paced environment. Solve complex technical challenges at the intersect
We believe that the way people interact with their finances will drastically improve in the next few years. We’re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with thousands of companies like Venmo, SoFi, several of the Fortune 500, and many of the largest banks to make it easy for people to connect their financial accounts to the apps and services they want to use. Plaid’s network covers 12,000 financial institutions across the US, Canada, UK and Europe. Founded in 2013, the company is headquartered in San Francisco with offices in New York, Seattle, Washington D.C., Raleigh, London, and Amsterdam. We are the Data team within Plaid’s Fraud organization. We build the machine learning systems that power Plaid’s fraud detection products, leveraging Plaid’s network data to help identify and prevent fraud before it happens. Our team owns the end-to-end ML lifecycle, from feature pipelines and model training to production serving and monitoring, ensuring our systems are reliable, scalable, and built to support hundreds of customers and data partners. As a Data Scientist on the Fraud Data team, you will analyze customer and network traffic to understand how Plaid Protect performs across a range of use cases and customer segments. You’ll build dashboards and metrics that provide a clear, shared view of product performance, run backtests to evaluate performance and identify high-impact rules and model strategies, and generate insights that support customer growth and expansion. You’ll also design scalable data models and schemas to enable reliable analysis and reporting, while partnering closely with Product and Engineering to design and analyze experiments for new customer-facing features. Responsibilities: Work at the intersection of product analytics, machine learning, and fraud a
$99.2K – $165.4K/yr
Use Your Power for Purpose Global Commercial Analytics (GCA) harnesses the power of data to drive robust analytical insights that inform some of Pfizer's most critical business questions. With colleagues across the globe, GCA's rigorous analytical expertise is depended on as the compass and decision support for the enterprise. Our dynamic, exciting team of subject-matter experts comes from diverse backgrounds and experiences, including data science, market research, digital analytics, finance, and consulting. As a team, we partner to turn data into meaningful insights that will have a direct impact on patients' lives and the future of Pfizer as a data-driven organization. The Data Science Manager is accountable for delivering data science support across the commercial business. As a strategic partner to US Commercial teams, this person will develop and implement models and data science-derived insights that influence brands’ strategic priorities. These responsibilities will include driving the execution and interpretation AI/ML models, framing problems, and shaping solutions. This role is dynamic, fast-paced, highly collaborative, and covers a broad range of strategic topics that are critical to our business. The successful candidate will join GCA colleagues worldwide that are constantly supporting business transformation through their proactive thought leadership, innovative analytical capabilities, and their ability to communicate highly complex and dynamic information in new and creative ways. What You Will Achieve Commercial Data Science and Insights Provide data science and insights to US Commercial teams to drive brand tactic decisions Assist to frame, investigate, and translate complex data-informed models, and answer key business questions related to the identification and evaluation of brand strategies a
We believe that the way people interact with their finances will drastically improve in the next few years. We’re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with thousands of companies like Venmo, SoFi, several of the Fortune 500, and many of the largest banks to make it easy for people to connect their financial accounts to the apps and services they want to use. Plaid’s network covers 12,000 financial institutions across the US, Canada, UK and Europe. Founded in 2013, the company is headquartered in San Francisco with offices in New York, Seattle, Washington D.C., Raleigh, London, and Amsterdam. Fraud Data is the data science and machine learning team within Plaid’s Fraud organization, responsible for using data and ML to improve and scale Plaid’s fraud products. Within Fraud Data, the Customer & Product Intelligence team focuses on understanding product performance, uncovering customer insights, and enabling go-to-market teams with data-driven solutions. The team partners closely with customers and GTM teams on fraud analyses and proofs of concept, turning customer learnings into scalable, reusable product capabilities. We also build the metrics, analytics, and data foundations that measure product health, identify opportunities for improvement, and guide product decisions across Plaid’s Fraud portfolio. As a Data Science Manager, you will lead a team responsible for customer-facing data science and Fraud product analytics. You will set the team's roadmap, develop its data scientists, and remain involved in analytical methods, technical reviews, and customer investigations. You will: Set a 6–12-month roadmap with Product, Engineering, and GTM, and assign priorities and responsibilities across the team. Define product metrics, their underlying data, and reporting and
We believe that the way people interact with their finances will drastically improve in the next few years. We’re dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to create their own products. Plaid powers the tools millions of people rely on to live a healthier financial life. We work with thousands of companies like Venmo, SoFi, several of the Fortune 500, and many of the largest banks to make it easy for people to connect their financial accounts to the apps and services they want to use. Plaid’s network covers 12,000 financial institutions across the US, Canada, UK and Europe. Founded in 2013, the company is headquartered in San Francisco with offices in New York, Seattle, Washington D.C., Raleigh, London, and Amsterdam. About the Team The Embedded Insights team supports Plaid’s mission to build a world-class suite of intelligence products. We identify the best opportunities to use machine learning in Plaid products, prove out those opportunities, and collaborate with cross-functional partners to turn them into real-world production systems. About the Role As a Senior Machine Learning Engineer on Embedded Insights, you will help shape Plaid’s future by building machine learning-powered products and features. You will initially support the Plaid App, working on a 0-to-1 consumer-facing product and helping establish product-market fit for a new business line. You will work closely with product managers, data scientists, engineers, customers, and other machine learning engineers to translate ambiguous opportunities into effective ML systems that create measurable customer value. In supporting the Plaid App, you will: Build machine learning-based features for a 0-to-1 consumer-facing product. Partner with product managers to translate ambiguous business requirements into machine learning problems and influence product strategy and roadmap decisions. Rapidly iterate and experiment to help drive product
From $71K/yr
Datadog is looking for a resourceful and creative Associate Field Marketing Manager to lead event strategy and execution for Datadog's AI product line across the East and Canada region. This role is ideal for someone who is passionate about AI and developer communities, enjoys getting hands-on with technical audiences, and wants to build a market-leading brand presence for Datadog's AI offerings. As part of the NAMER Field Marketing team, you will own the strategy, planning, and execution of a mix of practitioner-focused events, hands-on workshops, and surround activations at major AI conferences. This role is critical to scaling awareness and adoption of Datadog's AI products, and to building durable relationships with AI customers, prospects, and the broader developer community. At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them. What You'll Do Own the strategy, planning, and end-to-end execution of AI practitioner events, hands-on workshops, and meetups across the East and Canada Lead surround and off-site activations at major AI conferences (e.g., NVIDIA GTC, Ray Summit, AI Engineer Summit, and similar industry events) to build brand visibility and drive engagement with target audiences Partner with Product Marketing and AI/ML product teams to translate Datadog's AI observability and LLM monitoring capabilities into compelling, technically credible event content Design and continuously improve hands-on workshop curriculum and live demos that showcase Datadog's AI products to practitioners and technical decision-makers Build scalable, repeatable event playbooks and toolkits so programs can be run consistently across multiple markets Manage vendors, venues, budgets, staffing, and on-site logistics, ensuring every event reflects Datadog's brand and delivers a seamles
Other cities to consider
More places hiring for this role
Get new ml platform engineer jobs in New York, United States by email
Daily job updates · Unsubscribe anytime