AI Infrastructure
New York, NY
On-site · Full-time
$225k – $320k
annual package
San Francisco, CA · Full-time · Hybrid
AI Infrastructure
Hybrid
San Francisco, CA
$225k – $315k
annual package
Our client is a multi-billion-dollar AI Acceleration Cloud headquartered in San Francisco operating massive bare-metal clusters of NVIDIA H100, H200, B200, and GB200 NVL72 superpods across North America and Europe. Delivering hyperscale-beating distributed training and disaggregated MoE inference performance depends on lossless, microsecond-tuned 400G/800G InfiniBand and RoCEv2 RDMA fabrics engineered down to the NIC register and NCCL transport layer.
They have engaged Talent247 to hire a Senior GPU Cluster & RDMA Networking Engineer in San Francisco, CA. Joining their Bare-Metal Supercomputing Infrastructure group, the successful candidate will architect rail-optimized AI fabrics, tune NCCL/NVSHMEM collective transports, and build real-time RDMA telemetry across tens of thousands of GPUs.
ib_write_bw, nccl-tests, bisectional all-reduce/all-to-all sweeps) and continuous link-flap/BER optical degradation detectors that quarantine degraded rails before training jobs stall.rdma-core / MLNX_OFED / DOCA) kernel stacks.Stack: 400G/800G InfiniBand (UFM) & RoCEv2 (SONiC / EOS / Cumulus), ConnectX-7/8 & BlueField-3 DPUs, GPUDirect RDMA, NCCL/NVSHMEM, Linux networking, Python/Go/Rust automation, Prometheus/eBPF. Workplace: Hybrid in San Francisco, CA. Compensation: $225,000 – $315,000 base salary plus substantial equity ownership and full US benefits.
rdma-core / DOCA / OFED drivers, and nccl-tests performance profiling.