Backend Engineer (Senior Level) - SDE IV We're looking for a Senior Backend Engineer to lead the architecture and evolution of backend services that deploy and serve machine learning models in production. You'll work closely with ML Engineers, Platform, and Product teams to build scalable, reliable systems and drive technical direction across multiple teams. What You’ll Do Design and drive the long-term architecture of backend services for biometrics and ML model serving. Collaborate with core platform and backend teams on organization-wide architectural initiatives. Partner with business and engineering teams to design and deliver cross-cutting platform capabilities. Lead architectural reviews, mentor engineers, and promote engineering best practices. Build and maintain backend services for deploying and serving ML models Monitor service reliability, performance, and scalability in production Deploy and operate services on AWS using ECS + Fargate, SageMaker, or EC2 + Kubernetes Support real-time and batch inference workflows Contribute to CI/CD pipelines and deployment automation What We’re Looking For Strong expertise in backend development using Java and working knowledge of Python. Experience mentoring engineers and driving architectural decisions. Working knowledge of Python, especially for ML-related workflows Hands-on experience with AWS (e.g., DynamoDB, ECS, EC2, Redis, S3, SageMaker) Familiarity with Terraform or other infrastructure-as-code tools, and experience with CI/CD and production monitoring Experience with observability tools (Datadog, New Relic, etc.) Experience with containers and orchestration (Docker, ECS, etc.) Understanding of how ML models are deployed and served in production Experience with Kubernetes Nice to Have Experience with MLOps or ML platform engineering. Experience with asynchronous programming and event-driven systems. Jumio Values: IDEAL: Integrity, Diversity, Empowerment, Accountability, Leading Innovation Equal Opportunities :
Jobs in India
Software Engineer Ml Inference Platform in India
15 active opportunities · Updated September 2026
Showing
15 jobs
Explore current software engineer ml inference platform jobs across India. Filter by work mode, employment type, experience, department, date posted and distance.
Hiring demand
66/100
rising · 163 related jobs
Hiring trend
+96.4%
Job postings compared with the previous 30 days
Remote options
6.1%
Share of matching jobs listed as remote
Typical salary
₹52L – ₹52L/yr
Based on 8 salary observations
A Career with Point72's Technology Team As Point72 reimagines the future of investing, our Technology group is constantly improving our company’s IT infrastructure, positioning us at the forefront of a rapidly evolving technology landscape. We’re a team of experts experimenting, discovering new ways to harness the power of open source solutions, and embracing enterprise agile methodology. We encourage professional development to ensure you bring innovative ideas to our products while satisfying your own intellectual curiosity. What you'll do Lead the design, development, and operation of scalable, enterprise-grade AI/ML architectures and systems with a strong emphasis on reliability, availability, and performance. Lead and mentor a team of engineers, driving technical direction, code quality, and iterative delivery of large-scale solutions. Partner closely with data scientists, engineers, product teams, and compliance to integrate AI/ML solutions into existing and new products. Own the end-to-end lifecycle of GenAI services, including LLM inference, model serving, and proxy/gateway layers that support multiple downstream applications. Define and uphold engineering best practices around observability, scalability, security, and cost efficiency for AI/ML platforms. Evaluate tools, technologies, and processes to ensure the highest quality and performance of AI/ML systems. Stay abreast of the latest advancements in AI/ML technologies and methodologies, and translate them into pragmatic solutions for the business. Ensure compliance with industry standards and best practices in AI/ML. What's required Bachelor's or Master's degree in Computer Science, Engineering, or a related field. 10+ years of experience in software/AI/ML engineering, with a proven track record of successful delivery of complex, production-grade systems. Demonstrated experience building large-scale enterprise-grade services with high reliability, availability, and observability (SLO/SLA-driven en
AI/ML – Investment Services A Career with Point72's AI/ML – Investment Services Team The AI/ML – Investment Services team at Point72 spearheads the development of cutting-edge AI solutions that seek to transform our business processes and enhance enterprise intelligence. The team aims to bridge the gap between business challenges and technological innovation, collaborating with stakeholders across the firm and leveraging expertise in generative AI, data engineering, and machine learning. WHAT YOU'LL DO Build and scale core backend services and platforms that power generative AI applications and data infrastructure used across the firm’s investment workflows Design and implement high-throughput, low-latency data pipelines to ingest, normalize, and serve both structured and unstructured data Develop robust APIs and microservices to support model inference, feature serving, and downstream applications Integrate generative AI tools and model-serving workflows into production, including embedding stores, retrieval components, and fine-tuning pipelines Optimize system performance, cost, and reliability through profiling, capacity planning, and architectural improvements Implement automated testing, continuous delivery pipelines, monitoring, and incident response practices to maintain production health Partner with data scientists, AI engineers, product owners, and operations to translate models and prototypes into scalable, production-grade solutions Mentor engineers, lead code reviews, and establish engineering best practices for maintainability, security, and observability Own end-to-end delivery, operational runbooks, and metrics-driven measurement of feature impact and system reliability WHAT'S REQUIRED Bachelor’s degree in computer science, software engineering, or a related technical field Minimum 5+ years of professional experience building backend systems and production services Demonstrated experience designing and operating large-scale data engineering pipelines
Role Purpose: As a Principal iOS Engineer, you will make sure that our SDK stays cutting edge and therefore elegantly converts strangers into trusted users. You take pride in combining mobile native technologies with ML and CV. You feel comfortable switching hats between software development, software architecture, business requirements gathering, and working with our machine learning experts. You enjoy learning new technologies and sharing your code with others. Our team has already proven that our mobile SDK solution was perfect for far more than 100 Million users, join our team to make it even better. Example Responsibilities You’ll be responsible for the further development and architecture of our core products (mainly our native iOS SDK and sometimes on our end user-facing customer applications, cross-platform deliveries, …) Take ownership in delivering new functionality and fixes from idea creation, through the design phase until the public release. You write clean, readable and well documented code and you understand that your changes impact hundreds of well known applications in the app store and influence the experience of an impressive number of daily unique end-users using our SDK. Participate in resolving issues together with our customers. Collaborate with the whole R&D team / entire company to build features that matter Manage your own work by organizing your time, prioritizing tasks and taking ownership of topics. Experience and Qualifications 8+ years of experience in developing iOS applications in Swift Strong understanding of software design patterns as well as iOS specifics Capable of working on large scale projects Obsessive in delivering quality software Business driven and result-oriented individual Effective communication & collaboration skills as you will be working a high performing team who currently works in a distributed setup Experience with CI/CD Test Automation - writing Unit and Integration tests Android bas
Role Purpose: At Jumio, you will work for one of the market leaders in the global identity verification space that is helping to make the digital world a safer place for everyone. As a Software Development Engineer in the MLOpsTeam, you will develop the blueprint for highly scalable and performant ML model serving. Role Value: As a Software Engineer (SDE III), you will drive the continuous improvement of the infrastructure and applications to manage the lifecycle of ML assets (data, models) to better developer experience and strengthen governance capabilities. Secondly, you will design and implement robust ML infrastructure for model deployment, serving, and optimization. You will work on efficient CI/CD pipelines for ML models and leverage advanced compilers or hardware optimization to maximize inference performance while optimizing costs. We welcome you to challenge us to impact our software development processes and tools. Example Responsibilities: Upgrade ML assets (models, data) management systems for better developer experience and robust governance capabilities Build and optimize model serving infrastructure with a focus on inference latency and cost optimization Architect efficient inference pipelines that balance latency, throughput, and cost across various acceleration options Implement cost-efficient, enterprise-scale solutions Collaborate in a cross-functional, distributed team for continuous system improvement Work with MLEs, QA Engineers, and DevOps Engineers Evaluate and implement new technologies and tools Contribute to architectural decisions for distributed ML systems Experience and Qualifications : 5+ years of experience in software engineering with Python Experience with model lifecycle management (MLFlow, Weights & Biases or equivalent) Experience with data management ecosystem (quality, transformation, catalog) Experience with ML frameworks, particularly PyTorch Experience optimizing ML models with hardwar
EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute efficiency and density compared to today’s best-in-class solutions. The high-performance architecture is coupled with seamless software integration and will enable the immense potential of AI to be accessible in power, energy, and space constrained applications. EnCharge AI launched in 2022 and is led by veteran technologists with backgrounds in semiconductor design and AI systems. About the Role EnCharge AI is seeking a highly skilled and experienced AI Compiler Engineer to spearhead the efforts in developing and optimizing graph compilers tailored to cutting-edge AI and ML workloads. You will collaborate with hardware architects, and AI researchers to enhance performance, optimize computation graphs, and enable efficient model deployment on EnCharge’s Inference Accelerators. Responsibilities Architect, design, and implement optimizations for AI model execution on graph compilers to improve performance, reduce latency, and maximize hardware utilization. Work closely with ML researchers, hardware engineers, and software developers to design and deploy AI models, understanding and addressing hardware-specific challenges. Work on performance optimizations for neural network models, such as layer fusion, operator fusion, and graph-level transformations. Develop compiler optimizations and passes that convert high-level AI models (e.g., from TensorFlow, PyTorch) into intermediate representations (IR). Implement parsing, semantic analysis, and IR generation for deep learning frameworks. Research and integrate the latest advancements in compiler design, ML model optimizations, and hardware acceleration into graph compilers. Provide leadership, mentorship, and technical guidance to a team of engineers focused on graph compiler optimizations. Qual
₹2K – ₹68.6L/yr · Jobiba est.
Want to be a bswifter? At bswift we’ve been transforming benefits administration since 1996, making it simpler, smarter, and more human. Our state-of-the-art, cloud-based technology and services empower employees to understand, manage, and love their benefits. From downtown Chicago, and remotely across the country, we serve thousands of companies and millions of people nationwide, reducing administrative burdens and freeing HR teams to focus on creating thriving, people-first workplaces. We’re looking for motivated and goal-driven individuals who share our passion for delivering excellence and creating solutions that make a difference. The reward is a fun, flexible and creative environment with ample opportunity for professional and personal growth. If you love the bswift values of pursue excellence, embrace accountability, deliver superior service, and be a great place to work, we want to hear from you! About the Role We are looking for an AI Engineer II to design, build, and deploy cutting-edge generative AI applications , including agentic workflows and intelligent chat experiences , that transform how employees interact with their benefits. This role goes beyond individual contribution—you will own complex AI features end-to-end , influence architecture decisions around LLMs and agent systems , and mentor junior engineers . You will play a key role in bringing secure, scalable, and high-performance AI solutions to production using AWS cloud technologies. You will collaborate closely with software engineers, architects, product managers, and cross-functional teams to deliver seamless and impactful user experiences Key Responsibilities 1. Solution Design & Development Lead the design and development of scalable, secure, and high-performance applications . Architect robust backend systems and integrate them with frontend applications and third-party services. Drive technical decisions and participate in design reviews alongside senio
From ₹45L/yr
Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. Senior Software Engineer(AI/ML),Trust - India The Community You Will Join: Everyone at Airbnb thinks about trust, but our team obsesses over it daily. At the core of trust is safety, and thus we spend a significant amount of our time and energy keeping the community safe. The Trust team is responsible for protecting our community and platform from fraud while also ensuring our hosts, guests, homes, and experiences meet our high standards. We constantly work to fight against online fraud (such as monetary loss, compromised accounts, spam and scam in messages, fake inventory, etc.) as well as offline fraud (theft, property damage, personal safety, etc.). We also work on onboarding and screening of users, and think about complex topics like identity and reputation to ensure that every interaction with Airbnb helps build trust in us and our community. Trust Engineering is responsible for the technology vision and development of a complex stack that runs on every key interaction on the platform. The Difference You Will Make: As part of the Trust Engineering team, you will work in a team of talented software engineers to help us build intuitive & delightful experiences, strengthen our current offerings, and deliver new products to strengthen our Trust defenses. You will play a significant role in shaping the technical vision and delivering flexible, efficient and scalable solutions to stay on top of the ever evolving attack vectors and make Airbnb the most safe and trusted community. There are still many unsolved problems to tackle in both online and offline risk, and we're looking for talented engineers to solve
₹2K – ₹68.6L/yr · Jobiba est.
We are looking for a highly motivated AI/ML Software Engineer to join the Enterprise Agentic AI Platform team within IT. You will work closely with Business Analysts, and Engineering teams to design, develop, and deploy enterprise AI solutions that improve productivity and automate business workflows across Engineering, Operations, and Manufacturing. What you'll be doing: Design, develop, and deploy Agentic AI applications using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and AI orchestration frameworks. Build scalable AI services and reusable components integrated with enterprise applications such as PLM, SAP, and other business systems. Collaborate with business and IT teams to translate business requirements into AI-driven solutions. Develop secure, scalable APIs and enterprise integrations to enable intelligent workflows and automation. Improve AI solution quality, performance, and reliability through prompt engineering, evaluation, and continuous optimization. Partner with cross-functional teams throughout the Software Development Lifecycle (SDLC), from solution design through deployment and production support. What we need to see: Bachelor's or Master's degree in Computer Science, Information Technology, AI/ML, or a related field. 6+ years of software engineering experience with strong proficiency in Python and backend application development. Hands-on experience with Generative AI, LLMs, RAG, AI agents, REST APIs, and cloud-native application development. Experience integrating enterprise applications and building scalable, production-ready software solutions. Strong analytical, problem-solving, communicatio
₹2K – ₹68.6L/yr · Jobiba est.
Opportunity Overview: Cohere Health is at the forefront of leveraging artificial intelligence (AI) to transform prior authorization, shifting from transaction-based processes to creating elevated care journeys. By integrating AI into healthcare decisioning, we aim to improve efficiency, reduce costs, and ultimately enhance patient care. This is a unique opportunity to join our rapidly growing Clinical Intelligence team, where you’ll work on building impactful healthcare technologies that streamline and optimize the prior authorization process using AI/ML and Advanced Rules Engines. What you’ll do: Contribute to the functional & technical roadmap for the team, working alongside cross-functional teams to deliver high-impact deterministic rules-based and AI-driven healthcare automation solutions. Actively support the technical design process, bringing your expertise and analysis to help make data-driven decisions Continuously discover, understand, and implement new technologies & services to maximize development efficiency Contribute heavily to feature design, development, testing, and delivery of our cloud platform and web applications Support all parts of our platform from the database to the frontend Drive daily engineering release once 2-4 times a month Perform production support duties 1-2 times a year. ISMS roles and responsibilities: Good knowledge of Information practices. Assist the manager in all the information security activities implementation and maintenance process. Ensuring the team and imparted with Competence related to Information security Responsible for implementation of security policies and procedures and report any issues to the Information Security Manager. What we looking for: You have experience working on software development teams, building and deploying full stack web applications You are passionate about building quality products and want to own product development end-to-end, with excellent design and development stan
Position Overview: We are looking for a Senior Software Engineer to drive technical excellence, architect complex systems, and elevate our engineering team. You will own critical technical decisions, lead major initiatives from conception to delivery, and set the standard for engineering quality across our products. As a senior engineer, you will architect and lead the development of sophisticated AI-enabled features and infrastructure. This includes designing MCP server architectures, building advanced RAG systems, implementing agentic AI workflows, and establishing patterns that scale across our product portfolio. You will combine deep technical expertise in both traditional software engineering and AI/ML to deliver production-grade solutions. What You'll Do Lead the design and implementation of AI integration infrastructure (MCP servers, orchestration layers, API gateways) Build sophisticated AI features including advanced RAG systems, agentic workflows, and multi-step reasoning Establish AI engineering best practices, security patterns, and quality standards Lead technical initiatives from requirements through production deployment Make critical architectural decisions balancing performance, scalability, cost, and maintainability Design AI evaluation frameworks and implement quality benchmarks Debug and resolve complex production issues across traditional and AI systems Required Qualifications Tech Stack Core: Node.js, React, TypeScript, AWS, PostgreSQL, MSSQL, Docker AI & Integration: Python, MCP, AWS Bedrock, LangGraph/Semantic Kernel, Vector Databases, RAG Core Technical Skills 5+ years professional development with proven track record of delivering complex systems Strong Node.js and JavaScript/TypeScript expertise Advanced React and frontend architecture skills Extensive AWS architecture experience Expert PostgreSQL database design, optimization, and performance tuning Deep understanding of microservices, distributed systems, and
₹2K – ₹68.6L/yr · Jobiba est.
Staff Software Engineer - Testing & Automation Exceptional software engineering is challenging. Amplifying it to ensure that multiple teams can concurrently create and manage a vast, intricate product escalates the complexity. As a Staff Engineer within the Verification Platform team at Sumo Logic, you will drive the implementation and optimization for our verification platform as well as the modernization of our CI/CD pipelines. Your mission is to develop and sustain automated tooling for all testing, verification, and functional requirements, leveraging AI reasoning and machine learning models to predict and prevent delivery issues, while integrating advanced security validation and non-functional requirements into our delivery lifecycle. You will contribute significantly to establishing automated delivery pipelines, empowering autonomous teams to create independently deployable services, and progressing Sumo Logic’s internal Platform-as-a-Service. This role sits at the intersection of Platform Engineering, Quality Engineering, DevSecOps, and Developer Productivity, helping teams deliver secure, reliable, and independently deployable services at scale. Responsibilities Strategy & Leadership: Drive technical direction and design for a modern Quality Engineering platform, driving the adoption of AI reasoning for enhanced automation of all testing, verification, and functional requirements. Pipeline Modernization: Lead the modernization of CI/CD pipelines to include automated security validation, compliance checks, and other critical non-functional requirements, with a focus on integrating AI/ML for intelligent pipeline optimization and risk prediction. Framework Ownership: Own the delivery pipeline and release automation framework for all Sumo services, ensuring improvements in developer productivity, deployment frequency, and release reliability. Cross-Team Collaboration: Educate and collaborate with teams during design and development phases to ensur
₹2K – ₹68.6L/yr · Jobiba est.
Who We Are Addepar is a global data and AI platform empowering investment professionals to turn complex financial information into actionable intelligence. Addepar unifies portfolio, market and client data in a total portfolio view and delivers AI-powered insights within investment and client workflows. More than 1,400 firms in nearly 60 countries use Addepar to manage and advise on nearly $9 trillion in assets. Its open platform integrates with nearly 650 software, data and consulting partners to power end-to-end investment operations across firms of all sizes and complexity. Addepar supports clients worldwide with offices in New York City, Salt Lake City, London, Edinburgh, Pune, Dubai, Geneva, Singapore and São Paulo. The Role Did you know? Alternative investing has the potential to generate higher returns compared to traditional investments over the long term. AI and Machine Learning are revolutionizing the way alternative investments are managed and analyzed. Investors are using these technologies to gain insights, see opportunities, and optimize their investment strategies. Addepar is building solutions to support our clients' alternatives investment strategies. The alternatives data management product is a serverless, modular and terraformed stack. We're hiring a Senior Software Engineer to design, implement and deliver modern software solutions that ingest and process ML-extracted data. You will collaborate closely with cross-functional teams including data scientists and product managers to build intuitive solutions that revolutionize how clients experience alternatives operations. You will work closely with operations engineering on document-based workflow automation and peer engineering teams to define the tech stack. You will iterate quickly through cycles of testing a new product offering on Addepar. If you've crafted scalable systems, or worked with phenomenal teams on hard problems in financial data, or are just interested in solving reall
₹2K – ₹68.6L/yr · Jobiba est.
Who We Are Addepar is a global data and AI platform empowering investment professionals to turn complex financial information into actionable intelligence. Addepar unifies portfolio, market and client data in a total portfolio view and delivers AI-powered insights within investment and client workflows. More than 1,400 firms in nearly 60 countries use Addepar to manage and advise on nearly $9 trillion in assets. Its open platform integrates with nearly 650 software, data and consulting partners to power end-to-end investment operations across firms of all sizes and complexity. Addepar supports clients worldwide with offices in New York City, Salt Lake City, London, Edinburgh, Pune, Dubai, Geneva, Singapore and São Paulo. The Role We are currently seeking a Staff Software Engineer, Infrastructure to join the AI Platform team that powers seamless insights and interaction through natural language and data intelligence across our AI products. As a Staff Software Engineer, you’ll architect, build, and operate the backend and platform systems that power AI Platform. You’ll work across service design, distributed systems, cloud infrastructure, event-driven processing, observability, CI/CD, and production reliability, helping shape the technical direction of a platform that supports scalable, client-facing AI experiences. This role requires a strong software engineering foundation combined with deep infrastructure and systems thinking. We are looking for an engineer who can write high-quality production code, make sound architectural tradeoffs, and own platform capabilities end-to-end — not someone focused only on scripting, cloud configuration, or infrastructure tooling in isolation. You will collaborate closely with frontend, product, and AI/ML engineers to deliver reliable, secure, and scalable systems that align with Addepar’s standards of performance, resilience, and trust. Applicants must have legal authorization to work in the country where this role is based o
₹2K – ₹68.6L/yr · Jobiba est.
Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. About Okta Okta is an enterprise grade identity management service, built from the ground up in the cloud and delivered with an unwavering focus on customer success. With Okta you can manage access across any application, person, or device. Whether the people are employees, partners, or customers, or the applications are in the cloud, on premises, or on a mobile device, Okta helps you become more secure, make people more productive, and maintain compliance. The Okta service provides directory services, single sign-on, strong authentication, provisioning, workflow, and built in reporting. It runs in the cloud on a secure, reliable, extensively audited platform and integrates deeply with on premises applications, directories, and identity management systems. About the Team The Data Platform team is responsible for the foundational data services, systems, and data products for Okta that benefit our users. Today, the Data Platform team solves challenges and enables: Streaming analytics Interactive end-user reporting Data and ML platform for Okta to scale Telemetry of our products and data Our elite team is fast, creative and flexible. We encourage ownership. We expect great things from our engineers and reward them with stimulating new projects, new technologies and the chance to have significant equity in a company. Okta is about to change the cloud computing landscape forever. About the Position This is an opportunity for experienced Softwa
Higher-paying openings
Jobs with higher listed pay
Other cities to consider
More places hiring for this role
Get new software engineer ml inference platform jobs in India by email
Daily job updates · Unsubscribe anytime