AI Infrastructure
New York, NY
On-site · Full-time
$225k – $320k
annual package
Montreal, QC, Canada · Full-time · Hybrid
AI Infrastructure
Hybrid
Montreal, QC, Canada
CA$165k – CA$230k
annual package
Our client is Canada's flagship enterprise foundation model laboratory, operating dual research and infrastructure hubs in Montreal and Toronto alongside offices in London and New York. They build frontier multilingual reasoning models, retrieval stacks, and sovereign AI deployments specifically engineered for regulated enterprises, financial institutions, defence organizations, and national governments that require full data custody inside private cloud VPCs or air-gapped on-premise data centers.
They are working with Talent247 to hire a Senior Sovereign LLM Inference Engineer (CUDA / ROCm) in Montreal. Joining their Inference & Deployment Engineering group, you will own the low-level runtime optimizations and reproducible container packaging that enable massive enterprise LLMs and rerankers to run at peak throughput across heterogeneous NVIDIA and AMD Instinct GPU fleets inside customer-controlled environments.
Their stack spans C++17/20, Python, PyTorch, CUDA, HIP/ROCm, Triton, vLLM, TensorRT-LLM, Docker, and Kubernetes. Offered on a hybrid basis from Montreal, compensation includes CA$165,000–CA$230,000 base salary, competitive equity options, comprehensive Quebec/Canadian benefits, and full visa/relocation support.