About the Role: As a Staff Software Engineer on the ML Infrastructure team, you will collaborate closely with the Machine Learning and Product teams to build world-class machine learning inference platforms. These platforms power essential services like personalized recommendations, search, and content understanding across Tubi. A core responsibility of this team is developing and maintaining low-latency ML model serving systems that support Deep Learning, LLM, and Search models. This involves building self-service infrastructure and critical components such as the inference engine, feature store, vector store, and experimentation engine. You will improve the way we deploy and operate our services and even contribute to open-source projects. This role grants the architectural freedom to explore new frameworks, lead critical cross-functional projects, and transform the capabilities of our ML and Product teams. Responsibilities: Design and build scalable, high throughput, and low latency distributed systems using Scala Build reusable components and services that serve various ML applications like Personalization, Search, Ads and Exploration Partner closely with ML engineers to understand their challenges and limitations and develop scalable solutions to address them. Proactively recommend solutions to keep our ML Inference stack state of the art. Take a data driven approach to identifying & optimizing latency, cost, and efficiency of our infra. Lead large scale cross functional refactorings if necessary Mentor other engineers on the team on system design, effective incident management, interviewing, leveraging LLMs for work, etc. Collaborate with ML, Product, and cross functional engineering teams to define the long term vision and architecture for ML Infrastructure at Tubi. Your Background: Experience designing and building scalable, distributed systems in any modern backend language (e.g., Scala, Java, Python, Go, C++); experience with Scala or JVM b
Jobs in Canada
Low Latency Fpga Developer in Toronto
15 active opportunities · Updated September 2026
Showing
15 jobs
Explore current low latency fpga developer jobs in Toronto. Filter by work mode, employment type, experience, department, date posted and distance.
C$135K – C$210K/yr
Overview: Guidepoint seeks an experienced Data/AI Engineer as an integral member of the Toronto-based AI team. The Toronto Technology Hub serves as the base of our Data/AI/ML team, dedicated to building a modern data infrastructure for advanced analytics and the development of responsible AI. This strategic investment is integral to Guidepoint’s vision for the future, aiming to develop cutting-edge Generative AI and analytical capabilities that will underpin Guidepoint’s Next-Gen research enablement platform and data products. This role demands exceptional leadership and technical prowess to drive the development of next-generation research enablement platforms and AI-driven data products. You will develop and scale Generative AI-powered systems, including large language model (LLM) applications and research agents, while ensuring the integration of responsible AI and best-in-class MLOps. The Senior AI/ML Engineer will be a primary contributor to building scalable AI/ML capabilities using Databricks and other state-of-the-art tools across all of Guidepoint’s products. Guidepoint’s Technology team thrives on problem-solving and creating happier users. As Guidepoint works to achieve its mission of making individuals, businesses, and the world smarter through personalized knowledge-sharing solutions, the engineering team is taking on challenges to improve our internal application architecture and create new AI-enabled products to optimize the seamless delivery of our services. This is a hybrid position based in Toronto. What You'll Do: Architect and Build Production Systems: Design, build, and operate scalable, low-latency backend services and APIs that serve Generative AI features, from retrieval-augmented generation (RAG) pipelines to complex agentic systems. Own the AI Application Lifecycle: Own the end-to-end lifecycle of AI-powered applications, including system design, development, deployment (CI/CD), monitoring, and optimization
C$135K – C$210K/yr
Overview: Guidepoint seeks an experienced AI Engineer as an integral member of the Toronto-based AI team. The Toronto Technology Hub serves as the base of our Data/AI/ML team, dedicated to building a modern data infrastructure for advanced analytics and the development of responsible AI. This strategic investment is integral to Guidepoint’s vision for the future, aiming to develop cutting-edge Generative AI and analytical capabilities that will underpin Guidepoint’s Next-Gen research enablement platform and data products. This role demands exceptional leadership and technical prowess to drive the development of next-generation research enablement platforms and AI-driven data products. You will develop and scale Generative AI-powered systems, including large language model (LLM) applications and research agents, while ensuring the integration of responsible AI and best-in-class MLOps. The AI/ML Engineer will be a primary contributor to building scalable AI/ML capabilities using Databricks and other state-of-the-art tools across all of Guidepoint’s products. Guidepoint’s Technology team thrives on problem-solving and creating happier users. As Guidepoint works to achieve its mission of making individuals, businesses, and the world smarter through personalized knowledge-sharing solutions, the engineering team is taking on challenges to improve our internal application architecture and create new AI-enabled products to optimize the seamless delivery of our services. This is a hybrid position based in Toronto. What You'll Do: Architect and Build Production Systems: Design, build, and operate scalable, low-latency backend services and APIs that serve Generative AI features, from retrieval-augmented generation (RAG) pipelines to complex agentic systems. Own the AI Application Lifecycle: Own the end-to-end lifecycle of AI-powered applications, including system design, development, deployment (CI/CD), monitoring, and optimization in production
Who are we? Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems. We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that. We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft. We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us! Why this role? Are you energized by building high-performance, scalable and reliable machine learning systems? Do you want to help define and build the next generation of AI platforms powering advanced NLP applications? We are looking for a Site Reliability Engineer to join the Model Serving team at Cohere. The team is responsible for developing, deploying, and operating the AI platform delivering Cohere's large language models through easy to use API endpoints. In this role, you will work closely with many teams to deploy optimized NLP models to production in low latency, high throughput, and high availability environments. You will also get the opportunity to interface with customers and create customized deployments to meet their specific needs. As a Site Reliability Engineer you will: Build self-service systems that automate managing, deploying and operating services. This includes our custom Kubernetes operators that support language model deployments. Automate environment observability and resilience. Enable all developers to troubleshoot and resolve problems. Take steps required to ensure we hit defined SLOs, including pa
C$162K – C$420K/yr
About Sentry Software runs the world and the pace is faster than ever. Sentry helps developers fix errors and performance issues before users notice, so teams can spend less time firefighting and more time building. Trusted by 200,000+ organizations, Sentry is today’s application monitoring standard and our team is building its AI-native future. About the team The Billing team sits at the intersection of product, finance, and infrastructure. They're responsible for ensuring every observable event—errors, logs, traces, tokens—gets accurately measured, priced, and billed. Their work directly impacts company revenue and customer trust, requiring distributed systems expertise, attention to financial accuracy, and deep understanding of product usage patterns. The team works cross-functionally with product, engineering, BizOps, marketing, and sales to build systems that enable new products and pricing models. About the role As a Senior Software Engineer, you will architect and scale the core systems that power Sentry's billing infrastructure, ensuring accuracy and reliability at massive scale. You will collaborate on building the next generation of Sentry’s usage tracking pipeline, processing hundreds of billions of events daily with low latency and financial-grade accuracy. You will help design flexible pricing primitives that support everything from per-event usage billing to complex enterprise contracts, enabling product and sales teams to experiment rapidly while maintaining revenue accuracy and reduced time-to-market for new products. You will contribute to technical decisions on data consistency challenges unique to billing—like handling event delays, retroactive pricing changes, and distributed count reconciliation across our infrastructure. You'll love this job if you Want to solve the "easy to explain, hard to build" problems—like ensuring a customer's bill matches their usage perfectly, even when processing hundreds of billions of events daily across distributed
From C$160K/yr
Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted, neutral infrastructure that enables organizations to safely embrace this new era. This work requires a relentless drive to solve complex challenges with real-world stakes. We are looking for builders and owners who operate with speed and urgency and execute with excellence. This is an opportunity to do career-defining work. We're all in on this mission. If you are too, let's talk. Staff Software Reliability Engineer - Data Platform About the Team The Data Platform team is responsible for the foundational data services, systems, and data products for Okta that benefit our users. Today, the Data Platform team solves challenges and enables: Streaming analytics Interactive end-user reporting Data and ML platform for Okta to scale Telemetry of our products and data Our elite team is fast, creative and flexible. We encourage ownership. We expect great things from our engineers and reward them with stimulating new projects, new technologies and the chance to have significant equity in a company. Okta is about to change the cloud computing landscape forever. About the Position This is an opportunity for experienced Software Reliability Engineers to join our fast growing Data Platform organization that is passionate about scaling high volume, low-latency, distributed data-platform services & data products. In this role, you will get to work with engineers throughout the organization to build foundational infrastructure that allows Okta to scale for years to come. As a member of the Data Platform team, you will be responsible for designing, building, and deploying the systems that power our data analytics and ML. Our analytics infrastructure stack sits on top of many modern technologies, including Kinesis, Flink, ElasticSearch, and Snowflake. We are looking for experienced Software Engineers who can help desi
$100K – $500K/yr
Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify innovations in software models, compilers, platforms, networking, and semiconductors. Our diverse team of technologists have developed a high performance RISC-V CPU from scratch, and share a passion for AI and a deep desire to build the best AI platform possible. We value collaboration, curiosity, and a commitment to solving hard problems. We are growing our team and looking for contributors of all seniorities. As a Software Engineer on the Acceleration Kernel Development team at Tenstorrent, you’ll work at the intersection of software and hardware performance. You’ll be writing low-level code that directly powers high-efficiency machine learning workloads, optimizing every cycle, every memory move, every instruction. If you're motivated by performance, precision, and real impact, this is where your skills will shine. This role is hybrid, based out of Toronto, ON. We welcome candidates at various experience levels for this role. During the interview process, candidates will be assessed for the appropriate level, and offers will align with that level, which may differ from the one in this posting. Who You Are A developer who loves high performance code, parallel algorithms, wrangling bits, optimizing compute, and making hardware fly. Great in C/C++ and able to build fast, efficient code from the ground up. Obsessed with performance and precision, especially in ML workloads. Motivated by complex problems and thrives in collaborative, fast-moving environments. What We Need Expertise in building and optimizing compute kernels for parallel ML and high-performance workloads. Ability to analyze and tune instruction-level performance across latency, memory, and bandwidth. A collaborative mindset to work closely with ML engineers and integrate opti
At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. About the team The Apps & Experiences Platform team is powering systems and services for all our user facing apps including Snowsight , Snowflake Intelligence , and new mobile apps . Our mission is to craft innovative backend services, features, tools, infrastructure, and AI tooling that bring such products to life with delightful user experiences. As part of our team, you'll dive into a mix of building & managing platform infrastructure, and building AI self-serve tools to support the platform and its developer’s needs. We're passionate about building a platform that is highly reliable, available, maintainable, and scalable. We are a high growth AI data cloud company and we are looking for exceptional talent like you to help build and grow our infrastructure to scale us to the next level. AS TECHNICAL LEAD & MANAGER FOR APPS & EXPERIENCES STORAGE TEAM, YOU WILL: Own the storage team’s technical strategy and execution , driving projects from initial idea formulation and detailed system design to high-quality implementation and successful deployment. Provide deep technical oversight by actively participating in design reviews, architecture discussions, and drilling into complex system implementations to ensure reliability and scalability. Serve as a key techn
We’re looking for an Account Manager, Scale to maintain day-to-day contact with our existing customers at scale to help them realize the value of our products and services and establish long-term partnerships with Hootsuite by exploring and qualifying future growth opportunities. In this role, you will leverage your commercial skillset to successfully manage a high volume of customer renewals, while cultivating upsell, cross sell and expansion opportunities for both Hootsuite and Partner products in your book of business. As part of the Scaled Account Management team you will collaborate cross-functionally to provide customer value in all stages of the sales cycle. This is a hybrid role and is open to applicants located within commuting distance of our Toronto or Vancouver office. In this role, you will report to the Manager, Scaled Account Management. WHAT YOU’LL DO: Maintain low-touch day-to-day contact with customers for our pooled accounts at scale; providing timely answers to questions and focus on driving customer health and experience. Develop rapport with customers by proactively providing insightful market information and solutions that showcase maximum benefits from Hootsuite products. Drive renewals, upsells, and expansion in your low ARR accounts by focusing on customer engagements at scale and educating customers on Hootsuite’s value proposition in our pooled motion. Provide weekly forecasts and maintain rolling forecasts including monitoring and reporting account data health. Consistently contribute to generating team pipeline of upsell /product add-ons upon contract renewal or during service period to meet or exceed expansion targets. Successfully manage the end-to-end renewal process required to hit or exceed team renewal targets/quotas, leveraging your product knowledge to efficiently meet customers needs. Demonstrate understanding of contract terms and processes in order to maximize contract valu
At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collaborator that is core to how you solve problems and accelerate your impact. We look for low-ego individuals who thrive in dynamic and fast-moving environments and move with an experimental mindset — who rapidly test emerging capabilities to discover simpler, more powerful ways to deliver results. At Snowflake, your role isn't just to execute a function, but to help redefine the future of how work gets done. Account Executive, Commercial Acquisition Build the future of data. Join the Snowflake team. Snowflake’s Commercial sales organization continues to grow and we are actively seeking a Commercial Account Executive to join the team. Our Account Executives are customer-obsessed and we believe in the value we can add and stay honest about it. We love to learn, are open to giving and receiving feedback and are passionate about making our clients successful. Our team works to ensure data is accessible, usable and valuable to everyone. YOU MAY BE A GOOD FIT FOR THE TEAM IF YOU: Enthusiastic, self-motivated, and positive attitude with a passion for building customer relationships and closing new business opportunities. The Account Executive must have the confidence and ability to negotiate and close agreements with Clients and support new customers through our on-boarding process. You are driven to exceed performance objectives. You are excited about being positioned right in the middle of the exploding cloud based economy and to develop and maintain a highly desired knowledge of Snowflake’s solutions. You have an understanding of the Cloud application/computing space along with familiarity with data warehouse or analytic technologies. You are familiar with a solution-based approach
About Forma.ai: Forma.ai is a Series B startup that's revolutionizing how sales compensation is designed, managed and optimized. We handle billions in annual managed commissions for market leaders like Edmentum, Stryker, and Autodesk. Our growth has been fuelled by our passion for fundamentally changing and shaping how companies use sales intelligence to drive business strategy. We’re welcoming equally driven individuals who are excited about creating something big! About the Team Engineers on this team construct our rules-based calculating engine for processing sales commissions. This might sound simple if you have never been exposed to sales comp plans, it is not! We are low on meetings, high on accountability. Most of the team are in EST time zone but we have a few located in PST and Central as well. We are far from maintenance / progressive evolution in many areas, there is a lot of room to make a big impact in the overall design. What you’ll be doing Reporting to the Manager of Data Platform, you will play a critical role in the evolution of our Spark based data platform. You'll lead development efforts for our complex, data-rich platform features while being an example to the team of code quality and thoughtful software design. You will be working on the most challenging code at Forma. As a Staff Engineer, you are expected to operate with a high degree of ownership and trust. This includes proactively identifying architectural risks, surfacing edge cases or constraints others may not see, and advocating for improvements that strengthen the long-term integrity of the system. We value engineers who bring forward thoughtful perspectives - even when they challenge assumptions - and who help the team see around corners. You will: Design and evolve backend services that power product workflows. Architect data models representing hierarchical & graph structures, relationships, and large-scale enterprise datasets. Build
From C$190K/yr
About Forma.ai: Forma.ai is a Series B startup that's revolutionizing how sales compensation is designed, managed and optimized. We handle billions in annual managed commissions for market leaders like Edmentum, Stryker, and Autodesk. Our growth has been fuelled by our passion for fundamentally changing and shaping how companies use sales intelligence to drive business strategy. We’re welcoming equally driven individuals who are excited about creating something big! About the Team Engineers on this team build our rules-based calculation engine for processing sales commissions. This might sound simple if you have never been exposed to sales compensation plans, it is not. We are low on meetings and high on accountability. Most of the team is in the EST time zone, with a few located in PST and Central as well. We are still evolving many areas of the platform, which means there is meaningful room to improve the design, reliability, and scalability of the systems we build. What you’ll be doing Reporting to the Manager of Data Platform, you will play an important role in the evolution of our Spark-based data platform. You’ll design and build data-rich platform capabilities, contribute to system design discussions, and help ensure our data systems remain reliable, maintainable, and scalable as Forma grows. As a Senior Engineer, Data Platform, you are expected to operate with strong ownership and sound technical judgment. This includes identifying risks in the work you own, surfacing edge cases, asking thoughtful questions, and proposing improvements that strengthen the quality and reliability of the platform. You will: Design, build, and improve Spark-based data pipelines and platform services. Work with complex data models representing sales compensation plans, hierarchies, relationships, and enterprise datasets. Build reliable, deterministic data systems that customers and internal teams can trust. Improve testing, observability, data quality,
Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify innovations in software models, compilers, platforms, networking, and semiconductors. Our diverse team of technologists have developed a high performance RISC-V CPU from scratch, and share a passion for AI and a deep desire to build the best AI platform possible. We value collaboration, curiosity, and a commitment to solving hard problems. We are growing our team and looking for contributors of all seniorities. Tenstorrent is seeking a skilled Software Engineer with a passion for building high-performance, low-level systems software. In this role, you’ll contribute to the development and optimization of the infrastructure that powers our cutting-edge processors, with a primary focus on C/C++ development and low-level programming. You'll work closely with large inference and training model development to further drive Scale Out software and hardware performance. This role is hybrid, based out of Toronto, ON. Who You Are Strong C or C++ systems engineer with a deep understanding of memory, threading, I/O, and low-level execution models. Experienced building low-level software, drivers, embedded systems, or performance-critical infrastructure. Comfortable working close to hardware and curious about how systems behave under the hood. Proficient with Linux systems programming and debugging tools such as gdb, strace, and perf. Structured problem solver who thrives in fast-paced, highly technical environments. What We Need Design, develop, and maintain core infrastructure software that interfaces directly with Tenstorrent hardware. Build low-level libraries and APIs for communication and synchronization across compute nodes. Optimize system-level software for performance, scalability, and reliability in distributed environments. Support hardware
Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify innovations in software models, compilers, platforms, networking, and semiconductors. Our diverse team of technologists have developed a high performance RISC-V CPU from scratch, and share a passion for AI and a deep desire to build the best AI platform possible. We value collaboration, curiosity, and a commitment to solving hard problems. We are growing our team and looking for contributors of all seniorities. Tenstorrent is looking for a Firmware Engineer working on microcontrollers and SoCs, focused on low-level C/C++ development and board bring-up. You’ll implement and debug firmware, develop boot/power/reset sequences, and use lab tools to diagnose issues across the hardware–software boundary. You’ll collaborate closely with hardware, board, and system software teams while building strong skills in modern embedded platforms, RTOS/Embedded Linux, and automated testing. This role is hybrid, based out of Toronto, Canada. We welcome candidates at various experience levels for this role. During the interview process, candidates will be assessed for the appropriate level, and offers will align with that level, which may differ from the one in this posting. Who You Are An experienced embedded engineer with a strong foundation in computer engineering, electrical engineering, computer science, or a related field, and a track record of building reliable software for real-world systems. A strong problem solver who enjoys working where software meets hardware and can move comfortably between architecture, implementation, debugging, and system-level thinking. Curious by nature and energized by complex challenges, with a willingness to explore new technologies, development approaches, and AI-assisted tools to make engineering more effective. A thou
From C$46/hr
At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. With over half a billion rides and counting, Lyft is solving hard problems in a flourishing domain with a lot of data and creative solutions in Marketplace, Mapping, Fraud, Growth and beyond. We're actively building the next-generation Machine Learning (ML) platform for low-cost, ultra-immersive transportation to improve people’s lives using modern ML with peta-byte scale data. Our Machine Learning Engineers are excited to work on these challenging problems and redefine solutions to directly impact various aspects of Lyft's primary business. If you are a student with experience in machine learning workflows, passionate about solving challenging problems using data and working in a dynamic, creative, and collaborative environment, this opportunity is for you! Responsibilities: Contribute to the design, build, train and test of Machine Learning models Write production-level code to convert ML models into working pipelines Partner with Product Managers, Data Scientists, and fellow ML Engineers to frame Machine Learning problems within the business context Analyze experimental and observational data, communicate findings to support decisions Participate in code and spec reviews to ensure code quality and distribute knowledge Experience: Currently pursuing a Bachelor's, Master's, or PhD degree in Computer Science or a related technical field from a university in Canada (required) , with a graduation date between December 2027 and Summer 2028 (required). For any candidates who are master's students who worked between their bachelor's and master's programs: candidates should also have less than 2 years of relevant full-time work experience Available during Summer 2027 for the internship in Toronto Good understanding and knowledge of ML libraries like scikit-learn, Tensorflow, PyTorch, Keras, MXNet, et
Other cities to consider
More places hiring for this role
Get new low latency fpga developer jobs in Toronto, Canada by email
Daily job updates · Unsubscribe anytime