---
title: "ML Solutions & Forward-Deployed Inference Engineer"
slug: "ml-solutions-forward-deployed-inference-engineer"
id: "8941465d-bd0c-492b-807d-63e25f451f1f"
department: "Applied AI"
department_code: "APP"
location: "San Francisco, CA"
workplace_type: "Hybrid"
employment_type: "Full-time"
compensation: "$190k – $265k (annual package)"
is_remote: false
is_featured: false
headcount: 1
canonical_url: "https://jobs.talent247.co/jobs/ml-solutions-forward-deployed-inference-engineer"
markdown_url: "https://jobs.talent247.co/jobs/ml-solutions-forward-deployed-inference-engineer.md"
apply_endpoint: "https://jobs.talent247.co/api/public/jobs/ml-solutions-forward-deployed-inference-engineer/apply"
schema_endpoint: "https://jobs.talent247.co/api/public/jobs/ml-solutions-forward-deployed-inference-engineer/form-schema"
webmcp_tool: "apply_for_role"
updated_at: "2026-11-15T17:41:25.574Z"
content_signal: "search=yes, ai-input=yes, ai-train=no"
---

# ML Solutions & Forward-Deployed Inference Engineer

## Position Telemetry

- **Reference:** `ML-SOLUTIONS-FORWA`
- **Practice / Sector:** Applied AI (`APP`)
- **Location:** San Francisco, CA
- **Workplace Type:** Hybrid
- **Employment Type:** Full-time
- **Compensation:** $190k – $265k (annual package)
- **Canonical HTML URL:** https://jobs.talent247.co/jobs/ml-solutions-forward-deployed-inference-engineer

## Role Dossier & Specification

THE CLIENT & MANDATE
Our client is a premier San Francisco AI inference platform trusted by category-defining voice AI, coding assistant, healthcare, and multimodal media companies to run custom models in production at massive scale. Their ML Solutions & Forward-Deployed Inference team acts as the tip of the spear—partnering directly with founders and Staff ML engineers at breakout AI companies to take custom PyTorch checkpoints from research notebooks to sub-100ms global production endpoints.

They have engaged Talent247 to recruit an ML Solutions & Forward-Deployed Inference Engineer in San Francisco, CA. Blending hands-on GPU model optimization with high-velocity customer architecture, the appointed engineer will solve gnarly real-world serving bottlenecks across LLMs, streaming audio, vision-language, and diffusion pipelines.

KEY RESPONSIBILITIES
• Partner directly with customer ML engineering teams during critical launches to package, benchmark, quantize, and deploy custom PyTorch, TensorRT-LLM, SGLang, and vLLM pipelines onto dedicated GPU clusters.
• Profile end-to-end request lifecycles—from tokenization, audio/image preprocessing, and dynamic batching through GPU kernel execution and WebSocket/gRPC streaming—cutting latency by 2x–5x and GPU cost by 40%+.
• Implement production-ready compound inference chains combining custom LoRA adapters, Whisper/streaming ASR, expressive TTS, embeddings/rerankers, and speculative decoding draft models.
• Design realistic load-testing suites matching customer burst concurrency, context-length distributions, and multi-turn prefix-cache patterns prior to production cutover.
• Build clean open-source reference templates, Python packaging SDK improvements, and automated quantization recipes benefiting thousands of platform developers.
• Serve as the voice of frontier ML builders internally, shaping product roadmaps across core model performance and multi-cloud infrastructure teams.

TECHNICAL ENVIRONMENT & OFFERING
Stack: Python, PyTorch, TensorRT-LLM, vLLM, SGLang, Triton Inference Server, Docker/Kubernetes, FastAPI/gRPC/WebSockets, FP8/INT4 quantization toolkits, H100/H200/B200 GPUs. Workplace: Hybrid in San Francisco, CA. Compensation: $190,000 – $265,000 base salary plus meaningful equity grants, performance incentives, and full US benefits.

## Core Requirements

ESSENTIAL QUALIFICATIONS
• 4+ years of ML engineering, inference optimization, or forward-deployed solutions engineering experience deploying deep learning models into latency-sensitive production environments.
• Strong hands-on proficiency in PyTorch alongside modern LLM/generative serving engines (vLLM, TensorRT-LLM, SGLang, or Diffusers/TorchCompile).
• Practical command of GPU memory sizing, KV-cache math, continuous batching, tensor parallelism, and quantization trade-offs across L40S, H100, H200, and B200 GPUs.
• Crisp Python systems engineering skills (asyncio, multiprocessing, shared memory, containerization, OpenTelemetry/Prometheus metrics).
• Articulate, low-ego collaborator energized by debugging live technical challenges alongside elite AI engineering teams.

PREFERRED / BONUS EXPERIENCE
• Experience optimizing real-time streaming audio/voice pipelines (TTS/ASR), video/image diffusion models, or custom C++/CUDA PyTorch extensions.
• Prior forward-deployed, applied AI, or developer-facing ML engineering experience at a high-growth AI infrastructure company.
• Published technical benchmarks, blog posts, or open-source inference recipes.

## Application Schema & Direct Apply (`apply_for_role`)

Candidates and authorized AI agents on behalf of a candidate can submit an application via the declarative WebMCP form tool `apply_for_role` on https://jobs.talent247.co/jobs/ml-solutions-forward-deployed-inference-engineer or via HTTP `POST https://jobs.talent247.co/api/public/jobs/ml-solutions-forward-deployed-inference-engineer/apply` (`application/json` or `multipart/form-data`). Non-browser HTTP agents must include header `X-Talent247-Intake-Token` obtained from `GET https://jobs.talent247.co/api/public/intake-token` (or automatically returned in `GET https://jobs.talent247.co/api/public/jobs/ml-solutions-forward-deployed-inference-engineer/form-schema`).

### Form Fields

- `full_name` (text, required): Full name
- `email` (email, required): Email
- `phone` (phone, optional): Phone
- `location` (text, optional): Location
- `linkedin_url` (url, optional): LinkedIn URL
- `cover_letter` (textarea, optional): Cover letter
- `consent` (checkbox, required): I consent to my data being processed for this application
- `cv_file` / `cv_base64` + `cv_filename`: Upload a CV in .pdf or .docx format (<= 10 MB) or provide an `https://` LinkedIn profile URL in `linkedin_url`.

### Alternative: Talent Pool Intake (`join_talent_pool`)

If this mandate is not an exact match, register once in the Talent247 Talent Pool at https://jobs.talent247.co/talent-pool (`https://jobs.talent247.co/talent-pool.md`) via WebMCP tool `join_talent_pool` or `POST https://jobs.talent247.co/api/public/talent-pool`.
