
Open for applications
TechOps-CloudOps-AI-ML Platform Operations Senior Engineer
- Pay
- Not stated in the adSee TechOps-CloudOps-AI-ML Platform Operations Senior Engineer pay
- Job type
- Not stated
- Work mode
- Not stated
- Experience
- 5–8 years
About the job
At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all.
TechOps - CloudOps – AI/ML Platform Operations Engineer: Senior
At EY, we’re all in to shape your future with confidence.
We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.
Join EY and help to build a better working world.
About Global Delivery Services
Global Delivery Services refers to EY's worldwide network of service delivery centers. The GDS team plays an important role in EY’s strategy by ensuring effective support to EY’s growth agenda.
Our journey started in 2002 with approximately 200 people. Today we stand at 80,000+ professionals in ten locations around the world. We operate in Argentina, China, Hungary, India, Philippines, Poland, Sri Lanka, Mexico, Spain and the United Kingdom.
Client service is focused on providing Consulting, Assurance, Tax, Strategy & Transactions, and Knowledge support to our clients around the world. The teams enable account teams worldwide to provide seamless, high-quality, value-added support, helping deliver exceptional client service.
Enablement Services provides cost-effective, high-skilled, and innovative services to support EY’s global and local enablement teams. Markets, BMC, AWS, Finance and Accounting, Risk Management, Procurement, People Shared Services, IT Service Delivery and IT Global Infrastructure services, are among the services offered by Enablement Services.
Our innovation specialists serve the GDS Client Service and Enablement Services teams, along with Service Lines, Core Business Services and Sectors. The team brings the desired environment, technologies and skilled teams together for facilitation, rapid prototyping and innovative thinking. The competencies offered include analytics, digital, user experience, mobile technology, infrastructure, Microsoft technologies and open innovation.
The opportunity
We are looking for a seasoned and proactive Senior AI/ML Platform Operations Engineer to operate, support, and continuously improve enterprise machine learning and generative AI platforms. The role will focus on MLOps and LLMOps across model deployment, monitoring, API and endpoint operations, model pipelines, prompt and model configuration, observability, and incident resolution. The engineer will act as a technical escalation point for production AI services and work closely with data scientists, ML engineers, application teams, cloud platform teams, security, DevOps, and business stakeholders to deliver reliable, secure, scalable, and cost-effective AI capabilities.
Your key responsibilities
- Provide day-to-day production and operational support for machine learning, generative AI, and large language model platforms across development, test, staging, and production environments.
- Deploy, configure, validate, and support machine learning models, foundation models, embedding models, rerankers, and associated inference services using controlled MLOps and LLMOps practices.
- Monitor real-time and batch inference workloads, APIs, endpoints, model pipelines, queues, scheduled jobs, and dependent services, and restore failed or degraded services within agreed SLAs.
- Troubleshoot endpoint errors, latency, throttling, token limits, authentication failures, networking issues, dependency conflicts, model-loading errors, memory constraints, and scaling problems.
- Operate model training, evaluation, registration, approval, deployment, rollback, and retirement pipelines with traceability across model and environment versions.
- Support prompt templates, system instructions, model parameters, routing rules, guardrails, content filters, retrieval configuration, tool connections, and environment-specific configuration.
- Implement and maintain observability for model quality, response latency, throughput, error rate, availability, token consumption, cost, drift, data quality, hallucination risk, safety events, and user feedback.
- Investigate production incidents using application, model, prompt, API gateway, orchestration, cloud service, infrastructure, and security logs, and coordinate service recovery.
- Perform root cause analysis for recurring incidents and implement corrective actions, preventive alerts, automated recovery, runbook improvements, and platform engineering enhancements.
- Develop and maintain Python utilities, automation scripts, health checks, deployment tooling, test harnesses, evaluation workflows, and operational dashboards.
- Support enterprise integrations with OpenAI services, Azure OpenAI where applicable, AWS Bedrock, model gateways, vector stores, API gateways, identity providers, secrets management, and monitoring platforms.
- Ensure secure handling of model endpoints, API keys, service identities, secrets, private networking, customer data, prompts, responses, and model artifacts.
- Support capacity planning, autoscaling, quota management, rate-limit management, GPU or accelerator utilization, token forecasting, and cost optimization for AI workloads.
- Coordinate controlled releases using Git and CI/CD, including testing evidence, model and prompt versioning, approvals, deployment validation, rollback planning, and post-release monitoring.
- Manage complex incidents, service requests, problems, and changes, and mentor junior engineers in troubleshooting, platform operations, and operational best practices.
- Create and maintain runbooks, SOPs, architecture and dependency records, known-error articles, monitoring standards, escalation paths, and support knowledge bases.
- Responsible for decision-making, optimizing processes, resource management, and overseeing team management as needed for task execution.
- Accountable for allocating personnel, supervising team members, assigning tasks, ensuring that the team has the necessary tools and support to succeed in their roles and optimizing and evaluating their performance to meet organizational goals.
Skills and attributes for success
- Strong hands-on knowledge of MLOps practices covering experiment tracking, model packaging, model registry, validation, promotion, deployment, monitoring, rollback, and lifecycle governance.
- Strong understanding of LLMOps, including foundation model access, prompt and configuration management, evaluation, observability, retrieval-augmented generation, guardrails, endpoint operations, and cost controls.
- Experience operating model APIs and endpoints, including authentication, authorization, throttling, load management, autoscaling, latency troubleshooting, retries, timeouts, and high availability.
- Strong Python skills for platform automation, API integration, log analysis, operational tooling, testing, and incident diagnosis.
- Working knowledge of OpenAI APIs and AWS Bedrock services, including model invocation, embeddings, streaming responses, configuration, quotas, monitoring, and security.
- Understanding of machine learning and generative AI evaluation methods, including accuracy and task metrics, groundedness, relevance, toxicity and safety checks, drift, regression testing, and human evaluation.
- Ability to interpret distributed application, model, API, cloud, container, orchestration, network, and security telemetry to isolate failures across multiple technology layers.
- Strong incident management, root cause analysis, problem-solving, and production change-management skills.
- Clear communication and stakeholder-management skills, including the ability to explain operational risk, business impact, recovery status, and remediation plans.
- Ability to mentor engineers, coordinate technical recovery, review operational designs, and promote reliability and engineering standards.
To qualify for the role, you must have
- Bachelor’s degree in computer science, artificial intelligence, machine learning, data science, engineering, or a related discipline, or equivalent professional experience.
- 5–8 years of experience in platform engineering, DevOps, data engineering, machine learning engineering, cloud operations, or production support, including at least 2 years supporting ML or generative AI workloads.
- Hands-on experience implementing or operating MLOps pipelines and production model deployments.
- Practical experience with LLMOps, including model endpoints, prompt or model configuration, evaluation, monitoring, observability, and incident troubleshooting.
- Experience supporting OpenAI-based services, AWS Bedrock, or comparable enterprise foundation-model platforms.
- Strong Python experience for automation, API consumption, operational tooling, testing, and troubleshooting.
- Experience with CI/CD, infrastructure automation, containerized workloads, cloud monitoring, secrets management, and identity and access controls.
- Experience managing complex production incidents, root cause analysis, problem records, changes, releases, and operational documentation.
- Experience working with distributed teams and supporting business-critical services under agreed SLAs.
- Willingness to participate in 24/7 support rotations or cover critical business hours when required.
Technologies and Tools
Must have
- MLOps: experiment tracking, model packaging, model registry, evaluation gates, approval workflows, deployment strategies, feature and data dependencies, monitoring, rollback
Skills in this ad
Qualification · To qualify for the role, you must have Bachelor’s degree in computer science, artificial intelligence, machine learning, data science, engineering, or a related discipline, or equivalent professional experience; 5–8 years of experience in platform engineering, DevOps, data engineering, machine learning engineering, cloud operations, or production support, including at least 2 years supporting ML or generative AI workloads
More like this
EY
Technology
EY provides consulting, assurance, tax and transaction services that help solve our client’s toughest challenges and build a better working world for all.
Similar jobs
All jobsTechOps-CloudOps-AI-ML Platform Operations Senior Engineer payCareer pathCheck my market payJobs that ask for a bachelor's degreeRoles in demandTailor your CV for this job
About this listing
- First seen by Jobiba 21 Nov 2026
Jobiba never charges you to apply. Never pay to apply or share OTPs, card or bank details.