£105k – £145k
annual package
San Francisco, CA · Full-time · Hybrid
Applied AI
Hybrid
San Francisco, CA
$195k – $275k
annual package
Our client is a developer-beloved serverless GPU and AI infrastructure platform with engineering hubs in New York and San Francisco. Their core thesis is that AI engineers should define distributed GPU clusters, microVM code sandboxes, scheduled batch pipelines, and low-latency inference endpoints entirely in idiomatic Python—with zero YAML, zero Terraform, and sub-second feedback loops.
They have engaged Talent247 to recruit an Applied ML Infrastructure & Python SDK Engineer in San Francisco, CA. Sitting directly at the boundary between their Rust serverless compute engine and the global ML developer community, the successful candidate will shape the Python SDK primitives, distributed RL/training abstractions, and flagship reference architectures adopted by thousands of AI teams.
Stack: Python (deep internals: AST/bytecode, asyncio, typing, C/Rust PyO3 extensions), Rust, gRPC/Protobuf, PyTorch, vLLM/SGLang, TensorRT-LLM, CUDA, distributed sandboxes. Workplace: Hybrid in San Francisco, CA. Compensation: $195,000 – $275,000 base salary plus high-upside equity grants and comprehensive US benefits.
asyncio concurrency, import/serialization mechanics, type-system ergonomics, and CPython/Rust (PyO3) boundary performance.