Skip to main content
TALENT247 // SPECIALIST AI EXECUTIVE SEARCH & TECHNICAL RECRUITMENT
ML · Machine Learning

Machine Learning Engineer, Model Routing & Post-Training

Redwood City, CA · Full-time · Hybrid

AI Specialism

Machine Learning

Workplace

Hybrid

Location

Redwood City, CA

Compensation

$200k – $285k

annual package

Role Dossier & Specification

REF: MACHINE-LEARNING-E

THE CLIENT & MANDATE

Our client is a premier Silicon Valley generative AI inference and model-customization platform in Redwood City, CA enabling developers and enterprises to move from monolithic, high-cost frontier API calls to compound systems of fast, specialized open-weight models. Their Model Post-Training & Adaptive Routing group builds self-serve reinforcement fine-tuning pipelines and sub-millisecond query routers that match or beat frontier quality at a fraction of the latency and cost.

They have partnered with Talent247 to hire a Machine Learning Engineer for Model Routing & Post-Training in Redwood City, CA. Combining applied RL research with production ML systems engineering, the appointed engineer will build automated distillation, RFT/GRPO post-training recipes, and learned difficulty routers deployed across thousands of production workloads.

KEY RESPONSIBILITIES

  • Design and train lightweight semantic and complexity-aware router models (<5ms overhead) that dynamically dispatch prompts, tool calls, and reasoning steps across specialized LoRA adapters, compact 8B–32B models, and 400B+ MoE backbones.
  • Build turnkey, automated post-training recipes—spanning teacher-to-student trajectory distillation, DPO, and reinforcement fine-tuning (GRPO/RLOO)—that adapt open-weight models from small customer evaluation sets.
  • Develop calibrated speculative-cascade and confidence-abstention mechanisms allowing fast draft/small models to escalate hard reasoning queries seamlessly without accuracy loss.
  • Train custom speculative draft heads (EAGLE / Medusa-style) co-adapted to customer traffic distributions to unlock 2x–3x lossless decoding speedups automatically.
  • Construct comprehensive benchmark suites across function calling, structured JSON extraction, coding, and multi-turn agentic reasoning to validate automated post-training recipes.
  • Partner with distributed training infrastructure teams to run serverless multi-node LoRA and full-weight RL jobs reliably on shared GPU pools.

TECHNICAL ENVIRONMENT & OFFERING

Stack: Python, PyTorch, FSDP/Megatron, Verl/TRL, custom high-speed inference engine, Ray, ClickHouse, Kubernetes, H100/B200 GPU clusters. Workplace: Hybrid in Redwood City, CA. Compensation: $200,000 – $285,000 base salary plus generous unicorn equity, comprehensive medical/dental/vision, and 401(k).

Core Requirements

ESSENTIAL QUALIFICATIONS

  • 3+ years of machine learning engineering or research engineering experience focused on LLM fine-tuning, post-training alignment, model distillation, or compound AI routing.
  • Strong hands-on proficiency in PyTorch for training and fine-tuning dense and MoE transformers (LoRA/QLoRA, full-parameter SFT, DPO, GRPO/PPO).
  • Practical experience building automated LLM evaluation pipelines, LLM-as-a-judge calibrators, and synthetic training-data generators.
  • Solid statistical and optimization intuition for cost-quality-latency Pareto frontiers, calibration/uncertainty estimation, and contextual bandits.
  • Clean software engineering habits capable of turning experimental recipes into reliable, self-serve customer APIs.

PREFERRED / BONUS EXPERIENCE

  • Published research or open-source work on LLM routing (RouteLLM/FrugalGPT-style cascades), speculative decoding draft-head training, or on-policy knowledge distillation.
  • Experience fine-tuning Vision-Language Models (VLMs) or multi-turn tool-calling agents.
  • Familiarity with serverless multi-tenant training job orchestration and memory-efficient optimizer states.

Position Telemetry

Location Redwood City, CA (Hybrid)
Department Machine Learning
Employment type Full-time
Workplace type Hybrid
Salary range
$200k – $285k annual package