M
4 days ago
Toronto, Ontario, Canada· Full-time· Remote
C$88K – C$195K/yr
TypeScriptNode.js
BA
Role overview
Job description
About The Role
Boson AI builds production-grade AI systems that make communication with AI more natural, capable, and useful. We are looking for a Site Reliability Engineer to help build and operate the infrastructure behind that work.
Based in Toronto or remote, you will work across the systems that enable large-scale AI training and serving: high-performance networks, GPU clusters, storage, scheduling, and the operational tooling that keeps them reliable. This is a hands-on role for someone who enjoys taking complex infrastructure from “it works” to dependable, observable, and scalable.
You do not need to be an expert in every layer of the stack. We are looking for deep strength in at least one area—networking, cluster scheduling, storage, GPU systems, or AI infrastructure— and the curiosity and judgment to collaborate across the rest.
Responsibilities
Design, operate, and improve reliable infrastructure for AI training and inference workloads
Own and automate operational workflows across one or more core areas: networking, compute allocation, storage, GPU/server configuration, or AI platforms
Build monitoring, alerting, runbooks, and incident-response practices that make systems easier to operate
Diagnose performance, capacity, and reliability issues across hardware, operating systems, networks, schedulers, and distributed workloads
Partner closely with ML, research, and platform teams to translate workload needs into practical infrastructure improvements
Improve provisioning, configuration management, testing, and deployment automation
Help plan cluster growth, capacity allocation, upgrades, and lifecycle management
Contribute to a thoughtful reliability culture through documentation, post-incident learning, and pragmatic engineering standards
Minimum Qualifications
4+ years of experience in site reliability engineering, infrastructure engineering, systems engineering, or a related production-operations role
Strong hands-on expertise in at least one of the following:
Networking, including firewalls, switching, routing, ASN/BGP configuration, or InfiniBand
Cluster and systems allocation with Kubernetes, SLURM, MAAS, or similar platforms
Distributed storage, particularly Ceph
GPU and server administration, including CUDA drivers, firmware, BIOS, and hardware troubleshooting
AI training or model-serving infrastructure
Experience operating production systems with a focus on availability, performance, security, and automation
Strong Linux administration and scripting skills
A systematic approach to troubleshooting across multiple layers of a complex system
Clear written and verbal communication skills, including the ability to work effectively with a distributed team
Preferred Qualifications
Boson AI is building AI systems for real-world, business-critical use. If you enjoy solving difficult infrastructure problems and want your work to directly enable the next generation of AI products, we’d love to hear from you.
Boson AI uses artificial intelligence (AI) to help screen and assess applications for this position, and our team reviews the shortlisted candidates.
Experience supporting GPU-intensive AI or HPC environments
Experience with NVIDIA GPUs, CUDA, NCCL, and high-performance interconnects - Experience with InfiniBand, RDMA, RoCE, or 100Gb+ Ethernet
Familiarity with Kubernetes, SLURM, MAAS, Terraform, Ansible, or similar infrastructure tooling
Experience operating or tuning Ceph clusters
Familiarity with observability tooling such as Prometheus, Grafana, and centralized logging systems
Experience with hardware provisioning, firmware management, and bare-metal automation
Experience running large-scale distributed training or high-throughput inference workloads
Familiarity with cloud and hybrid infrastructure across AWS, GCP, or Azure
About this listing
- Source: Boson AI's official careers site (via Lever) · last confirmed on the source 2 Nov 2026
- Posted 14 Jul 2026
Jobiba does not charge job seekers. Never pay to apply or share OTPs, card or bank details.
Role market pulse
How DevOps Engineer demand looks in Canada
Live jobs
21
Posted 30d
12
30d movement
+100%
Remote share
42.9%
Salary listed
81%
Salary trend 1Y
Not enough history
What they are looking for
Skills & requirements
Department · Engineering
Hiring company
Boson AI
Education
Own bosonai.com today. Secure checkout and guided transfer support. No hidden fees.
Related opportunities
Similar active roles
Relevant, currently active roles for this market.
M
Toronto, ON, Canada· Full-time
C$144K – C$200K/yr
PythonMongoDBAWSAzure
C
Toronto, Ontario, Canada· Full-time· Remote
$160K – $260K/yr
AWSAzureGCPKubernetes
A
Toronto, Ontario, Canada· Full-time
C$130K – C$180K/yr
JavaScriptPythonAWSAzure
T-
Toronto, Ontario, Canada· Full-time· Hybrid
C$116K – C$235.1K/yr
TypeScriptPythonAWSKubernetes
M
PythonMongoDBAWSAzure
🔔 Get job alerts
New Site Reliability Engineer jobs in Toronto, ON, Canada, straight to your inbox.
No spam · Unsubscribe anytime