Skip to main content
TALENT247 // SPECIALIST AI EXECUTIVE SEARCH & TECHNICAL RECRUITMENT
APP · Applied AI

Applied ML Infrastructure & Python SDK Engineer

San Francisco, CA · Full-time · Hybrid

AI Specialism

Applied AI

Workplace

Hybrid

Location

San Francisco, CA

Compensation

$195k – $275k

annual package

Role Dossier & Specification

REF: APPLIED-ML-INFRAST

THE CLIENT & MANDATE

Our client is a developer-beloved serverless GPU and AI infrastructure platform with engineering hubs in New York and San Francisco. Their core thesis is that AI engineers should define distributed GPU clusters, microVM code sandboxes, scheduled batch pipelines, and low-latency inference endpoints entirely in idiomatic Python—with zero YAML, zero Terraform, and sub-second feedback loops.

They have engaged Talent247 to recruit an Applied ML Infrastructure & Python SDK Engineer in San Francisco, CA. Sitting directly at the boundary between their Rust serverless compute engine and the global ML developer community, the successful candidate will shape the Python SDK primitives, distributed RL/training abstractions, and flagship reference architectures adopted by thousands of AI teams.

KEY RESPONSIBILITIES

  • Design and evolve ergonomic, rock-solid Python SDK primitives for declarative container environments, GPU memory snapshotting, distributed multi-node gang scheduling, Ephemeral Sandboxes, and high-concurrency async RPCs.
  • Architect production-grade reference implementations and reusable building blocks for frontier ML workloads—including disaggregated vLLM/SGLang serving, distributed RLVR rollout gyms, petabyte video/data curation, and biomolecular folding pipelines.
  • Partner directly with ML researchers and Staff engineers at flagship AI startups in San Francisco to debug gnarly distributed PyTorch, NCCL, CUDA Graph, and async concurrency edge cases.
  • Optimize Python client-runtime serialization, gRPC/HTTP2 streaming throughput, asyncio event-loop overhead, and introspectable local-to-cloud stack traces.
  • Build automated end-to-end performance benchmarks tracking cold-start, throughput, and multi-node scaling across every new open-weight model family and GPU generation (H100/H200/B200).
  • Author crystal-clear technical guides, architectural deep-dives, and open-source blueprints that set the standard for developer-centric AI infrastructure.

TECHNICAL ENVIRONMENT & OFFERING

Stack: Python (deep internals: AST/bytecode, asyncio, typing, C/Rust PyO3 extensions), Rust, gRPC/Protobuf, PyTorch, vLLM/SGLang, TensorRT-LLM, CUDA, distributed sandboxes. Workplace: Hybrid in San Francisco, CA. Compensation: $195,000 – $275,000 base salary plus high-upside equity grants and comprehensive US benefits.

Core Requirements

ESSENTIAL QUALIFICATIONS

  • 4+ years of ML infrastructure, developer SDK/framework, or applied distributed systems engineering experience.
  • Deep mastery of Python internals—including asyncio concurrency, import/serialization mechanics, type-system ergonomics, and CPython/Rust (PyO3) boundary performance.
  • Hands-on production experience running modern GPU workloads: LLM inference engines (vLLM/SGLang), distributed PyTorch training/fine-tuning, or containerized code-execution sandboxes.
  • Strong API design taste: ability to distill complex distributed systems semantics into intuitive, composable abstractions that developers love.
  • High autonomy and crisp written technical communication skills.

PREFERRED / BONUS EXPERIENCE

  • Core authorship or maintenance of widely used Python ML, async networking, workflow-orchestration, or developer-tooling libraries.
  • Working fluency in Rust or C++ to trace performance across the SDK-to-runtime boundary.
  • Experience building RL rollout infrastructure, multimodal video/audio pipelines, or AI coding-agent sandboxes.

Position Telemetry

Location San Francisco, CA (Hybrid)
Department Applied AI
Employment type Full-time
Workplace type Hybrid
Salary range
$195k – $275k annual package