Skip to main content
TALENT247 // SPECIALIST AI EXECUTIVE SEARCH & TECHNICAL RECRUITMENT
ROB · Robotics & Embodied AI

Research Engineer, Robot Reinforcement Learning & Sim-to-Real

San Francisco, CA · Full-time · On-site

AI Specialism

Robotics & Embodied AI

Workplace

On-site

Location

San Francisco, CA

Compensation

$235k – $330k

annual package

Role Dossier & Specification

REF: RESEARCH-ENGINEER-

THE CLIENT & MANDATE

Our client is a frontier physical-AI research laboratory in San Francisco developing generalist robot foundation models across diverse real-world manipulation and mobile tasks. While human teleoperation provides broad behavioral priors, achieving industrial-grade speed, contact-rich precision, and autonomous recovery from mistakes requires scalable reinforcement learning across GPU-accelerated simulation and autonomous real-world practice.

They have engaged Talent247 to recruit a Research Engineer specializing in Robot Reinforcement Learning & Sim-to-Real onsite in San Francisco. The successful candidate will build massively parallel GPU physics gyms and real-world offline-to-online RL pipelines that push pretrained VLA policies far beyond demonstration performance.

KEY RESPONSIBILITIES

  • Architect real-world and hybrid reinforcement learning algorithms (offline-to-online RL, Q-chunking, advantage-weighted flow matching, residual RL) fine-tuning large VLA policies directly on robot fleets.
  • Build high-throughput GPU-accelerated physics simulation environments in MuJoCo MJX and NVIDIA Isaac Lab featuring automated real-to-sim asset reconstruction and contact-parameter system identification.
  • Design autonomous reset mechanisms, VLM-based dense success/failure reward detectors, and safe exploration controllers enabling unattended multi-hour real-robot RL training runs.
  • Engineer distributed actor-learner infrastructure streaming real-time multimodal rollouts from dozens of physical robot cells directly into centralized GPU training clusters.
  • Investigate domain randomization, tactile/force-conditioned policies, and privileged-critic asymmetric architectures for contact-rich assembly and deformable-object manipulation.
  • Collaborate closely with foundation model scientists to fold RL-refined high-skill trajectories back into generalist pre-training mixtures.

TECHNICAL ENVIRONMENT & OFFERING

Stack: Python, JAX, PyTorch, MuJoCo / MJX, Isaac Lab / Warp, C++, distributed RL actor-learner frameworks, multi-arm physical robot fleet & H100 GPU clusters. Workplace: Onsite in San Francisco, CA. Compensation: $235,000 – $330,000 base salary plus high-upside equity and comprehensive benefits.

Core Requirements

ESSENTIAL QUALIFICATIONS

  • MS or PhD in Robotics, Machine Learning, or Computer Science (or 4+ years of research engineering experience) with a strong focus on robot RL and control.
  • Demonstrated success training RL policies that transfer to real physical robots (locomotion, dexterous manipulation, or contact-rich assembly) via sim-to-real or real-world RL.
  • Deep proficiency in JAX or PyTorch alongside GPU-parallel physics simulators such as MuJoCo MJX, Isaac Lab/Gym, or Brax.
  • Strong systems engineering ability to build low-overhead distributed rollout collection, replay buffers, and VLM reward-model pipelines.
  • Solid foundations in off-policy RL, actor-critic stability, value overestimation mitigation, and continuous action distributions.

PREFERRED / BONUS EXPERIENCE

  • Experience fine-tuning diffusion or flow-matching visuomotor policies with reinforcement learning (e.g., DPPO, IQL/Cal-QL, advantage-weighted regression, RLPD).
  • Track record of publications at CoRL, RSS, ICRA, IROS, NeurIPS, or ICML.
  • Hands-on familiarity with automated 3D scene/URDF reconstruction (3DGS/mesh-to-sim) for scalable task generation.

Position Telemetry

Location San Francisco, CA
Department Robotics & Embodied AI
Employment type Full-time
Workplace type On-site
Salary range
$235k – $330k annual package