---
title: "Applied ML Infrastructure & Python SDK Engineer"
slug: "applied-ml-infrastructure-python-sdk-engineer"
id: "80f268f8-f4ba-4179-bfd1-596b829f3d77"
department: "Applied AI"
department_code: "APP"
location: "San Francisco, CA"
workplace_type: "Hybrid"
employment_type: "Full-time"
compensation: "$195k – $275k (annual package)"
is_remote: false
is_featured: false
headcount: 1
canonical_url: "https://jobs.talent247.co/jobs/applied-ml-infrastructure-python-sdk-engineer"
markdown_url: "https://jobs.talent247.co/jobs/applied-ml-infrastructure-python-sdk-engineer.md"
apply_endpoint: "https://jobs.talent247.co/api/public/jobs/applied-ml-infrastructure-python-sdk-engineer/apply"
schema_endpoint: "https://jobs.talent247.co/api/public/jobs/applied-ml-infrastructure-python-sdk-engineer/form-schema"
webmcp_tool: "apply_for_role"
updated_at: "2026-11-15T17:41:58.812Z"
content_signal: "search=yes, ai-input=yes, ai-train=no"
---

# Applied ML Infrastructure & Python SDK Engineer

## Position Telemetry

- **Reference:** `APPLIED-ML-INFRAST`
- **Practice / Sector:** Applied AI (`APP`)
- **Location:** San Francisco, CA
- **Workplace Type:** Hybrid
- **Employment Type:** Full-time
- **Compensation:** $195k – $275k (annual package)
- **Canonical HTML URL:** https://jobs.talent247.co/jobs/applied-ml-infrastructure-python-sdk-engineer

## Role Dossier & Specification

THE CLIENT & MANDATE
Our client is a developer-beloved serverless GPU and AI infrastructure platform with engineering hubs in New York and San Francisco. Their core thesis is that AI engineers should define distributed GPU clusters, microVM code sandboxes, scheduled batch pipelines, and low-latency inference endpoints entirely in idiomatic Python—with zero YAML, zero Terraform, and sub-second feedback loops.

They have engaged Talent247 to recruit an Applied ML Infrastructure & Python SDK Engineer in San Francisco, CA. Sitting directly at the boundary between their Rust serverless compute engine and the global ML developer community, the successful candidate will shape the Python SDK primitives, distributed RL/training abstractions, and flagship reference architectures adopted by thousands of AI teams.

KEY RESPONSIBILITIES
• Design and evolve ergonomic, rock-solid Python SDK primitives for declarative container environments, GPU memory snapshotting, distributed multi-node gang scheduling, Ephemeral Sandboxes, and high-concurrency async RPCs.
• Architect production-grade reference implementations and reusable building blocks for frontier ML workloads—including disaggregated vLLM/SGLang serving, distributed RLVR rollout gyms, petabyte video/data curation, and biomolecular folding pipelines.
• Partner directly with ML researchers and Staff engineers at flagship AI startups in San Francisco to debug gnarly distributed PyTorch, NCCL, CUDA Graph, and async concurrency edge cases.
• Optimize Python client-runtime serialization, gRPC/HTTP2 streaming throughput, asyncio event-loop overhead, and introspectable local-to-cloud stack traces.
• Build automated end-to-end performance benchmarks tracking cold-start, throughput, and multi-node scaling across every new open-weight model family and GPU generation (H100/H200/B200).
• Author crystal-clear technical guides, architectural deep-dives, and open-source blueprints that set the standard for developer-centric AI infrastructure.

TECHNICAL ENVIRONMENT & OFFERING
Stack: Python (deep internals: AST/bytecode, `asyncio`, typing, C/Rust PyO3 extensions), Rust, gRPC/Protobuf, PyTorch, vLLM/SGLang, TensorRT-LLM, CUDA, distributed sandboxes. Workplace: Hybrid in San Francisco, CA. Compensation: $195,000 – $275,000 base salary plus high-upside equity grants and comprehensive US benefits.

## Core Requirements

ESSENTIAL QUALIFICATIONS
• 4+ years of ML infrastructure, developer SDK/framework, or applied distributed systems engineering experience.
• Deep mastery of Python internals—including `asyncio` concurrency, import/serialization mechanics, type-system ergonomics, and CPython/Rust (`PyO3`) boundary performance.
• Hands-on production experience running modern GPU workloads: LLM inference engines (vLLM/SGLang), distributed PyTorch training/fine-tuning, or containerized code-execution sandboxes.
• Strong API design taste: ability to distill complex distributed systems semantics into intuitive, composable abstractions that developers love.
• High autonomy and crisp written technical communication skills.

PREFERRED / BONUS EXPERIENCE
• Core authorship or maintenance of widely used Python ML, async networking, workflow-orchestration, or developer-tooling libraries.
• Working fluency in Rust or C++ to trace performance across the SDK-to-runtime boundary.
• Experience building RL rollout infrastructure, multimodal video/audio pipelines, or AI coding-agent sandboxes.

## Application Schema & Direct Apply (`apply_for_role`)

Candidates and authorized AI agents on behalf of a candidate can submit an application via the declarative WebMCP form tool `apply_for_role` on https://jobs.talent247.co/jobs/applied-ml-infrastructure-python-sdk-engineer or via HTTP `POST https://jobs.talent247.co/api/public/jobs/applied-ml-infrastructure-python-sdk-engineer/apply` (`application/json` or `multipart/form-data`). Non-browser HTTP agents must include header `X-Talent247-Intake-Token` obtained from `GET https://jobs.talent247.co/api/public/intake-token` (or automatically returned in `GET https://jobs.talent247.co/api/public/jobs/applied-ml-infrastructure-python-sdk-engineer/form-schema`).

### Form Fields

- `full_name` (text, required): Full name
- `email` (email, required): Email
- `phone` (phone, optional): Phone
- `location` (text, optional): Location
- `linkedin_url` (url, optional): LinkedIn URL
- `cover_letter` (textarea, optional): Cover letter
- `consent` (checkbox, required): I consent to my data being processed for this application
- `cv_file` / `cv_base64` + `cv_filename`: Upload a CV in .pdf or .docx format (<= 10 MB) or provide an `https://` LinkedIn profile URL in `linkedin_url`.

### Alternative: Talent Pool Intake (`join_talent_pool`)

If this mandate is not an exact match, register once in the Talent247 Talent Pool at https://jobs.talent247.co/talent-pool (`https://jobs.talent247.co/talent-pool.md`) via WebMCP tool `join_talent_pool` or `POST https://jobs.talent247.co/api/public/talent-pool`.
