£105k – £145k
annual package
San Francisco, CA · Full-time · Hybrid
Applied AI
Hybrid
San Francisco, CA
$190k – $265k
annual package
Our client is a premier San Francisco AI inference platform trusted by category-defining voice AI, coding assistant, healthcare, and multimodal media companies to run custom models in production at massive scale. Their ML Solutions & Forward-Deployed Inference team acts as the tip of the spear—partnering directly with founders and Staff ML engineers at breakout AI companies to take custom PyTorch checkpoints from research notebooks to sub-100ms global production endpoints.
They have engaged Talent247 to recruit an ML Solutions & Forward-Deployed Inference Engineer in San Francisco, CA. Blending hands-on GPU model optimization with high-velocity customer architecture, the appointed engineer will solve gnarly real-world serving bottlenecks across LLMs, streaming audio, vision-language, and diffusion pipelines.
Stack: Python, PyTorch, TensorRT-LLM, vLLM, SGLang, Triton Inference Server, Docker/Kubernetes, FastAPI/gRPC/WebSockets, FP8/INT4 quantization toolkits, H100/H200/B200 GPUs. Workplace: Hybrid in San Francisco, CA. Compensation: $190,000 – $265,000 base salary plus meaningful equity grants, performance incentives, and full US benefits.