Location: United States – Remote Clearance: Ability to obtain and maintain a Public Trust LTS is seeking a Senior AI Platform and Harness Engineer to develop and maintain the infrastructure, tooling, and evaluation frameworks that power enterprise AI solutions. This role is responsible for building the AI platform and reusable "AI harnesses" that enable Large Language Models (LLMs), AI agents, Retrieval-Augmented Generation (RAG), and Generative AI applications to be securely developed, tested, evaluated, monitored, and deployed at scale. The ideal candidate has experience with AI platforms, LLMOps, software engineering, cloud-native technologies, and backend systems, along with a passion for building reliable, observable, and production-ready AI solutions. You will work closely with AI architects, software engineers, data scientists, and product teams to ensure AI solutions are scalable, secure, cost-effective, and continuously improving. What You'll Do: Design, build, and maintain enterprise AI platform capabilities supporting Large Language Models (LLMs), AI agents, RAG, and Generative AI applications. Lead data preparation, training and fine-tuning of LLMs Develop reusable AI harnesses to automate testing, prompt evaluation, model benchmarking, regression testing, and quality assurance. Build AI evaluation frameworks to measure model accuracy, retrieval quality, hallucination detection, latency, throughput, cost, and overall application performance. Implement observability and monitoring solutions for AI applications, including telemetry, tracing, logging, dashboards, and operational metrics. Build and maintain LLMOps pipelines supporting model deployment, versioning, evaluation, experimentation, rollback, and continuous improvement. Design automated workflows for prompt testing, retrieval evaluation, AI system validation, and performance benchmarking. Develop internal tools for prompt management, model experimentation, AI performance optimization, and developer
Role overview
Job description
Who are we? FalconX is a pioneering team of operators, investors, and builders committed to revolutionizing institutional access to the crypto markets. Operating at the intersection of traditional finance and cutting-edge technology, FalconX addresses the industry's foremost challenges: Navigating the digital asset market can be complex and fragmented, with limited products and services that support trading strategies, structures, and liquidity found in conventional financial markets. As a comprehensive solution for all digital asset strategies from start to scale, FalconX operates as the connective tissue empowering clients with seamless navigation through the ever- evolving cryptocurrency landscape. Responsibilities Build, scale, and optimize core low-latency trading platforms. Architect AWS and hybrid cloud infrastructure for microsecond execution using kernel tuning (isolcpus), AWS P
…Role market pulse
How DevOps Engineer demand looks in United States
Live jobs
38
Posted 30d
16
30d movement
-27.3%
Remote share
21.1%
Salary listed
68.4%
Salary trend 1Y
Not enough history
What they are looking for
Skills & requirements
Qualification
Minimum Qualifications Bachelor’s degree with 5+ years of experience as an Infrastructure or Systems Engineer in low-latency electronic trading environments
Department · Engineering - Quant & Trading Systems

Hiring company
FalconX
FalconX is the leading digital asset prime broker providing deep liquidity, financing, and advanced technology solutions to the world’s top institutions
Related opportunities
Similar active roles
Relevant, currently active roles for this market.
$186.1K – $218.9K/yr
From $130K/yr
🔔 Get job alerts
New Senior Trading Systems DevOps Engineer jobs in New York City, New York, United States, straight to your inbox.
No spam · Unsubscribe anytime