AI Infrastructure
New York, NY
On-site · Full-time
$225k – $320k
annual package
San Francisco, CA · Full-time · Hybrid
AI Infrastructure
Hybrid
San Francisco, CA
$240k – $335k
annual package
Our client is a multi-billion-dollar AI inference infrastructure platform headquartered in San Francisco, powering mission-critical low-latency model serving for breakout AI-native applications and healthcare, voice, code, and creative-media enterprises. Rather than offering generic shared endpoints, their Model Performance Engineering group squeezes hardware-limit throughput and sub-50ms time-to-first-token out of custom multimodal, audio, diffusion, and 400B+ LLM architectures across dedicated Hopper and Blackwell clusters.
They have retained Talent247 to appoint a Staff Model Performance & TensorRT-LLM Engineer in San Francisco, CA. Operating at the intersection of GPU kernel optimization, compiler runtimes, and speculative decoding research, the successful candidate will own flagship model optimization benchmarks and core runtime primitives across their inference fleet.
Stack: C++20, CUDA, CUTLASS/CuTe, Triton, Python, TensorRT-LLM, SGLang, vLLM, FlashInfer, PyTorch, Nsight Compute/Systems, Hopper & Blackwell GPU pods. Workplace: Hybrid in San Francisco, CA. Compensation: $240,000 – $335,000 base salary plus high-upside Series-stage equity, comprehensive healthcare, and 401(k).