Lead Software Engineer Inference Performance Optimization Salary India in Canada

About the Role: The Growth team is responsible for building and optimizing the UI/UX across all Web and OTT applications at Tubi. The team primarily focuses on implementing features related to full funnel user acquisition and growth, including SEO user registration, onboarding, and account management. As a Staff Engineer (L5) on this team, you act as the technical leader for one or more Growth areas. You own the technical architecture and direction, solve ambiguous problems that few others can, and influence cross-functional teams across multiple pods. You will work closely with Product and Design to develop cutting-edge, experiment-driven features, while driving the front-end architecture that ensures performance and scalability for millions of users. You will be working with React, Node.js, GitHub Actions, Terraform, and CDN infrastructure to build and deploy high-performance applications that reach millions of users. This is a hybrid role based out of our Toronto office. You must be willing to travel to our Toronto office two days/week. What You'll Do: Own the technical roadmap and architecture for a Growth area with large amounts of ambiguity: driving direction across web, mobile web, and smart TV platforms, and influencing the team to invest in new projects. Solve challenging, ambiguous problems with a focus on scalability and performance; proactively identify systemic issues and propose innovative solutions. Lead and drive innovation in building experiment-driven features; independently design, implement, and interpret a series of A/B experiments that move growth metrics. Lead and coordinate major rollouts and releases: including cross-team coordination, migrations, and phased releases of major initiatives across Web and OTT apps. Establish team-wide quality and engineering standards; set the bar for code quality and front-end best practices. Identify and implement improvements in shared UI components, platform-specific optimizations, and overall fr

Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates. We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused on creating an intelligent ecosystem across HP’s portfolio. Together, we’re developing intuitive, adaptive solutions that spark creativity, boost productivity, and make collaboration seamless. We create breakthrough solutions that make complex tasks feel effortless, teamwork more natural, and ideas more impactful—always with a human-centric mindset. By embedding AI advancements into every HP product and service, we’re expanding what’s possible for individuals, organisations, and the future of work. Join us as we reinvent work, so people everywhere can do their best work. About The Role The AI team is building cutting-edge solutions that bring the power of AI directly to edge devices while seamlessly integrating with cloud infrastructure. We are looking for a Lead Software Engineer to design and develop high-performance, scalable services to support AI workloads across edge and cloud environments. What You Might Do Design, build, and maintain services that power AI-driven applications, ensuring scalability and performance. Develop APIs and microservices that facilitate seamless integration between cloud-based AI models and edge devices. Optimize data pipelines and storage solutions for real-time AI inference and processing. Implement security and privacy best practices for distributed AI systems. Work closely with AI researchers, infrastructure engineers, and frontend developers to deliver end-to-end AI-driven solutions. Build and optimize an agent orchestration runtime that enables tool use, memory management, and multi-step reasoning across LLMs, APIs, and edge-connected systems. Develop robust logging, monitoring, and alerting systems to ensure system reliability.

About the Team DoorDash’s GenAI Platform team sits within Machine Learning Platform and builds the shared infrastructure that helps DoorDash, Wolt, and Deliveroo teams safely bring GenAI-powered products, agents, automation, and personalization to production. Our mission is to increase the velocity of business impact from GenAI. A central pillar of that work is running frontier open-weight LLMs and VLMs (such as GLM, Qwen, Kimi, and DeepSeek) ourselves — real-time GPU serving, high-throughput batch inference, and fine-tuning on autoscaling GPUs — delivering large cost and latency wins (for example, a billion embeddings produced roughly 20× cheaper and visual models served roughly 72% cheaper). We also own core platform surfaces including the LLM Gateway, Agent Gateway, evals infrastructure, guardrails, and cost attribution. About the Role You will join a small, high-leverage team building production infrastructure for Generative AI at DoorDash, leading the design and architecture of our open-weights model platform spanning inference and fine-tuning: real-time GPU serving, high-throughput batch inference, and model fine-tuning. You’ll set technical direction across model serving and inference engines, fine-tuning and training pipelines, GPU autoscaling and utilization, batch pipelines, backend services, and observability, and mentor engineers as you go. This role is ideal for a senior engineer who enjoys owning ambiguous, high-impact systems and pushing the cost/performance frontier of GPU inference and fine-tuning in a fast-moving technical area where product needs, model capabilities, vendor ecosystems, and cost/performance tradeoffs are evolving quickly. You’re excited about this opportunity because you will… Lead the design of infrastructure that helps DoorDash teams move GenAI ideas from prototype to production, increasing the velocity of business impact from AI across the company. Own and evolve our open-weights serving stack — real-time GPU endpoints, high-thr

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. The Lyft Business organization builds the platform that lets organizations move the people they depend on employees, clients, and customers. From the foundational mechanics of a company funding and provisioning a ride to the tailored workflows that get an employee to a client meeting or home after a late shift, we sweat the small stuff to make Lyft the transportation solution businesses build their programs on. As a Staff Software Engineer on the Lyft Business Team, you will act as a critical technical leader, taking holistic ownership of complex systems that span the rider experience, the administrator experience, and the enterprise integrations behind them — defining strategic roadmaps, driving cross-functional alignment, and driving engineering excellence to improve how organizations move their people. Responsibilities: Shape the long-term architecture for systems, taking accountability for both short-term functionality and long-term health Translate high-level business goals into actionable engineering projects. Own the technical roadmap from conception to delivery, managing cross-team dependencies and mitigating risks Champion improvements in system, observability, performance, and tech debt reduction, extending your influence beyond your immediate team Establish best practices for deployment, alerting, and on-call health. Take holistic ownership of the platform's stability, tracking down issues root causes and building preventive safeguards for your immediate scope and beyond. Drive alignment across product, design, and operations. Proactively resolve bottlenecks and make decisive trade-offs to protect system architecture from competing organizational priorities Mentor and level up the engineers around you. Delegate stretch opportunities, lead cross-team reviews, and foster a culture of s

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. About the role The App Runtime team is building a platform that lets every Snowflake user go from an idea to a live, deployed web application (Node.js first) in minutes. We own the end-to-end experience of building and running apps, from Cortex AI-assisted development to deployment in a secure, scalable infrastructure. Apps built on the platform inherit Snowflake's security, governance, lineage, and access controls by default. See Deploy Faster with Snowflake Apps . As a Staff/Principal Engineer, you will shape the product and its architecture. It’s a high leverage role - you will lead a team to scale and harden an early-stage, public-preview product. Your decisions will have a long-lasting impact on the future of Snowflake as an app platform. This role requires a unique combination of deep hands-on expertise in scalability, performance and security, great product instincts, customer obsession and the organizational influence to drive cross-team programs. Responsibilities Own the roadmap and technical decisions to evolve the public-preview platform into a production-grade one, adding features like horizontal scaling, cost efficiency via suspend/resume, support for stacks beyond Node.js, and stronger access and data-governance controls Stay deeply hands-on by authoring specs

Overview We are seeking a hands-on Director of AI Software Engineering to lead and scale AI engineering efforts supporting multiple business units across Governance, Risk, and Compliance (GRC). This role sits at the intersection of product delivery, platform evolution, and applied AI—driving real-world impact across core workflows. This is not a pure management role. We are looking for a builder who leads from the front, someone who has recently written production code, shipped systems end-to-end, and can operate comfortably in ambiguity while aligning teams and stakeholders. What You’ll Do Lead AI Engineering Across GRC Own delivery of AI-powered capabilities embedded directly into business unit workflows (e.g., risk analysis, compliance automation, reporting, due diligence) Partner with product, data, and platform teams to translate business problems into scalable AI systems Stay Hands-On Contribute to architecture, code reviews, and critical path implementation Prototype and validate new approaches (LLMs, agents, retrieval systems, classification pipelines, etc.) Set engineering standards for performance, reliability, and cost efficiency Build and Scale Teams Lead and mentor a high-performing team of AI/ML and software engineers Drive hiring, coaching, and career development Establish a culture of ownership, speed, and technical excellence Drive Execution Deliver production-grade systems—not experiments Balance speed with rigor (security, privacy, compliance) Operate across multiple concurrent initiatives with clear prioritization Communicate and Influence Act as a bridge between engineering and business stakeholders Clearly articulate trade-offs, risks, and outcomes to senior leadership Align cross-functional teams around shared goals and timelines What We’re Looking For Proven Builder 10+ years in software engineering, with recent hands-on coding experience Demonstrated track record of shipping production systems at scale Experience with modern

About the Role: As a Staff Software Engineer on the ML Infrastructure team, you will collaborate closely with the Machine Learning and Product teams to build world-class machine learning inference platforms. These platforms power essential services like personalized recommendations, search, and content understanding across Tubi. A core responsibility of this team is developing and maintaining low-latency ML model serving systems that support Deep Learning, LLM, and Search models. This involves building self-service infrastructure and critical components such as the inference engine, feature store, vector store, and experimentation engine. You will improve the way we deploy and operate our services and even contribute to open-source projects. This role grants the architectural freedom to explore new frameworks, lead critical cross-functional projects, and transform the capabilities of our ML and Product teams. Responsibilities: Design and build scalable, high throughput, and low latency distributed systems using Scala Build reusable components and services that serve various ML applications like Personalization, Search, Ads and Exploration Partner closely with ML engineers to understand their challenges and limitations and develop scalable solutions to address them. Proactively recommend solutions to keep our ML Inference stack state of the art. Take a data driven approach to identifying & optimizing latency, cost, and efficiency of our infra. Lead large scale cross functional refactorings if necessary Mentor other engineers on the team on system design, effective incident management, interviewing, leveraging LLMs for work, etc. Collaborate with ML, Product, and cross functional engineering teams to define the long term vision and architecture for ML Infrastructure at Tubi. Your Background: Experience designing and building scalable, distributed systems in any modern backend language (e.g., Scala, Java, Python, Go, C++); experience with Scala or JVM b

Scale AI is seeking a highly skilled and motivated Software Engineer, Frontier AI Infrastructure to join our dynamic Public Sector Engineering team. As a part of this team, you will own the model inference layer - enabling state of the art models, debugging the latest AI tools, managing networking, debugging latency, and tracking pricing/usage metrics for AI models. You will lead technical discussions on the frontlines with cloud vendors and customers to deliver on critical contracts and to debug platform issues. You will also work upstream with Product to understand features before they break, moving us from "infra-only debugging" to proactive integration testing. You will: Design and implement secure scalable backend systems for Public Sector customers, leveraging Scale's modern and cloud-native AI infrastructure. Own services or systems and define their long-term health goals, while also improving the health of surrounding components Re-architect the stack to run in compliant or restrictive environments. This requires designing swappable components (auth, storage, logging) to meet government/security mandates without breaking the product. You will work with Product to build integration tests that catch issues early, shifting the focus from "infra-only debugging" to preventing failures upstream. Participate actively in customer engagements, working closely with stakeholders to understand requirements and deliver innovative solutions. Contribute to the platform roadmap and product strategy for Scale AI's Public Sector business, playing a key role in shaping the future direction of our offerings. Must have: At least an active secret clearance and the ability & willingness to up level to TS/SCI with CI Poly. This is a requirement and candidates will not be considered who do not hold at least a secret clearance Ideally you'd have: Full Stack Development: Proficiency in both front-end and back-end development, including experience with modern web develo

Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates. We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused on creating an intelligent ecosystem across HP’s portfolio. Together, we’re developing intuitive, adaptive solutions that spark creativity, boost productivity, and make collaboration seamless. We create breakthrough solutions that make complex tasks feel effortless, teamwork more natural, and ideas more impactful—always with a human-centric mindset. By embedding AI advancements into every HP product and service, we’re expanding what’s possible for individuals, organisations, and the future of work. Join us as we reinvent work, so people everywhere can do their best work. About The Role HP IQ's Connectivity team is seeking an Embedded Firmware Engineer with strong hands-on experience across RTOS and embedded Linux platforms. You'll bring up new hardware, develop and support firmware across core device subsystems, and help scale products from prototype to fleet deployment. A key part of this role is enabling on-device intelligence — bringing AI models, sensing algorithms, and local processing to lightweight, power-constrained devices at the edge. What You Might Do Design, develop, and debug firmware across RTOS and embedded Linux platforms. Lead hardware bring-up — board bring-up, driver integration, and firmware support through to production. Develop and maintain firmware for subsystems such as connectivity, power and other sensors. Integrate lightweight model inference and sensing/proximity algorithms within tight compute, memory, and power budgets. Support fleet-scale deployment: OTA updates, field diagnostics, and post-launch sustainment. Collaborate with hardware, systems, and QA teams to troubleshoot system-level issues and drive root-cause fixes to closure. Ess

We're transforming the grocery industry At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible earnings opportunities to Instacart Personal Shoppers. Instacart has become a lifeline for millions of people, and we’re building the team to help push our shopping cart forward. If you’re ready to do the best work of your life, come join our table. Instacart is a Flex First team There’s no one-size fits all approach to how we do our best work. Our employees have the flexibility to choose where they do their best work—whether it’s from home, an office, or your favorite coffee shop—while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work. Overview Instacart is the North American leader in online grocery, and we’re building the operating system for the grocery industry so people can access the food they love and more time to enjoy it together. We’re looking for an Engineering Manager to lead our Catalog Enrichment team. This team builds the AI-native platform and pipelines that create, enrich, and maintain product attributes across a catalog of tens of millions of products from more than 100,000 retailer locations. Catalog data is the foundation of our marketplace: when attributes are complete and accurate, search returns the right results, recommendations feel personal, and advertisers can target with confidence. In this role, you’ll lead a team of engineers building systems that blend large language models, classical inference, workflow orchestration, and human review into configurable pipeli

Who We Are HP IQ is HP’s new AI innovation lab. Combining startup agility with HP’s global scale, we’re building intelligent technologies that redefine how the world works, creates, and collaborates. We’re assembling a diverse, world-class team—engineers, designers, researchers, and product minds—focused on creating an intelligent ecosystem across HP’s portfolio. Together, we’re developing intuitive, adaptive solutions that spark creativity, boost productivity, and make collaboration seamless. We create breakthrough solutions that make complex tasks feel effortless, teamwork more natural, and ideas more impactful—always with a human-centric mindset. By embedding AI advancements into every HP product and service, we’re expanding what’s possible for individuals, organisations, and the future of work. Join us as we reinvent work, so people everywhere can do their best work. About The Role As the Senior Software Engineer, Tooling and Development Infrastructure, you will play a critical role in shaping the developer productivity tools and automated testing strategy. You’ll collaborate closely with design, development, and quality teams to plan, design, and implement robust automated tools and services that ensure the quality and reliability of our AI software stack. You will be highly hands-on in your work and collaborate closely with stakeholders. This position offers a unique opportunity to influence the development of cutting-edge automation frameworks, foster a culture of quality, and contribute to the long-term success of the organization. What You Might Do Develop and implement automation frameworks and testing strategies that cover the entire software stack, from backend systems to user-facing features. Identify, evaluate, and integrate new tools that streamline development. This includes everything from code quality tools and to Infrastructure-as-Code (IaC) solutions. Lead continuous improvement efforts for our build, release, and test systems, ensuring a robust

Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. The Streaming Foundations team builds services and operates data pipeline infrastructure to support event streaming, messaging, and analytics use cases. We are looking for a Software Engineer who is passionate about distributed systems, platform engineering, and solving data-intensive problems at scale. In this high-impact role, you will get to work with engineers throughout the organization to build foundational infrastructure that allows Auth0 to scale for years to come. What you’ll be doing Help set the technical direction for the team and influence the engineering roadmap for the Platform’s streaming capabilities Design and lead the implementation of our most complex and critical systems for data-intensive use cases. Research and champion new technologies and architectural patterns to solve strategic challenges and scale the platform. Lead and influence cross-functional initiatives, ensuring technical alignment and successful execution across multiple teams. Improve the operational posture of our systems by designing for observability, reliability, and scalability, and by mentoring others in operational best practices. Coach and mentor senior engineers and act as a technical leader across the engineering organization. Collaborate with different stakeholders like product teams whenever needed. What you’ll bring to our teams 7+ years of software development experience in a fast-paced, agile environment Experience working with Golang or Java is preferred H

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Our mission depends on having a digital representation of the physical world - a map with all routing related (real-time) information. This is what makes Lyft different from many products: our products don’t just facilitate online interactions, they facilitate dynamic, real-world ones. Without mapping services, none of these real world interactions between people and transport can happen. We are hiring a Senior Software Engineer to join our Pickup, Places and Search team within the Mapping organization that is responsible for building, enhancing and maintaining the Rider and Driver product for the Pickup/Drop off Experience. This team supports the backbone of Lyft’s search system, supporting millions of rides by helping our riders and drivers connect and reach their destination. Our focus is to ensure the pickup/dropoff experience is seamless by enhancing guidance and routing as well as the rider experience. Additionally the team uses map data and other signals to create new product experiences in collaboration with teams across Lyft. This team has a history of enabling rich and creative features that directly influence the product for all of our users. We constantly innovate and incorporate cutting-edge technologies to make the lives of our community more enriched. In this role, you'll collaborate with other engineering teams, product, data science, analytics, and operations on programs that empower us to iterate quickly, delighting our passengers and drivers with rideshare focused mapping experiences. Responsibilities: Drive high-impact projects and innovate new solutions to provide the best customer experiences Lead backend and cross functional projects to achieve long term goals as well as deliver short term roadmaps Lead large features from idea to successful execution and launch Own systems and

Location Details: At GoDaddy the future of work looks different for each team. Some teams work in the office full-time; others have a hybrid arrangement (they work remotely some days and in the office some days) and some work entirely remotely.​ This is a remote position, so you’ll be working remotely from your home. You may occasionally visit a GoDaddy office to meet with your team for events or meetings. Join our team When GoDaddy's customers are considering a new venture, it often starts with a name. The Search Results team (SERP) plays a key role in that mission by building the discovery experience that helps customers find the right domain name and products for their idea. We're a small team that moves quickly, holds a high bar for craft, and ships work that impacts millions of customers. We’re looking for a Senior Software Engineer to help shape our search and discovery experiences. This is a hands-on individual contributor role. You’ll lead by example through the quality of your code, the decisions you make, and the way you help others succeed. You’ll have opportunities to lead projects, influence technical direction, mentor peers, and speak up when you see a better path. What you'll get to do... Build and ship frontend experiences that help customers find the right domain, including match quality, smart alternatives, favorites, and AI-enabled experiences Lead projects from problem definition through technical design, implementation, launch, measurement, and production ownership Improve how the team ships by building internal tools, automation, and reusable engineering patterns Your experience should include... 7+ years of professional software development experience Strong proficiency building modern web applications with React, JavaScript, and Node.js Practical experience with deployment, CI/CD, observability, and production ownership Experience using AI-assisted development tools such as Claude Code, Cursor, Copilot, or similar tools wi

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. The Trust & Safety function at Lyft is dedicated to keeping every Lyft ride safe for both riders and drivers. We build and maintain the tools, features, and systems that deter bad actors, protect vulnerable populations, and reinforce trust across the platform. As an Backend Engineer working on Trust & Safety, you'll work at the intersection of product, design, engineering, and policy to ship high-impact safety features to millions of users. Responsibilities: Drive high-impact projects and innovate new solutions to provide the best user experience. Work closely with cross-functional teams and partner teams to develop solutions based on technology and business needs, and advance team’s goals and priorities Independently lead features from idea to positive execution and launch Unblock, support and communicate with internal partners to achieve results Write well-crafted, well-tested, readable, maintainable code Utilize your expertise in Python, Golang, AWS to deliver robust and scalable solutions Participate in code reviews to ensure code quality and distribute knowledge, as well as on call rotations Share your knowledge by giving brown bags, tech talks, and promoting appropriate tech and engineering best practices Experience: BS/MS or equivalent in Computer Engineering, Computer Science, or related field or relevant work experience 3+ years of software engineering industry experience Extensive experience in object oriented programming, ideally in GoLang or Python Experience in backend software development of distributed systems and concurrency Strong oral and written communication skills, and ability to collaborate with and influence cross-functional partners Benefits: Extended health and dental coverage options, along with life insurance and disability benefits Mental health benefits Family bui