Machine Learning
San Francisco, CA
On-site · Full-time
$240k – $340k
annual package
San Francisco, CA · Full-time · Hybrid
Machine Learning
Hybrid
San Francisco, CA
$235k – $330k
annual package
Our client is a globally scaled data and artificial intelligence platform leader headquartered in San Francisco, empowering thousands of enterprises to build, evaluate, govern, and serve custom agentic AI systems over their proprietary data estates. Their AI Research & Agent Evaluation organization builds the automated judge models, synthetic benchmark generators, and reinforcement-learning feedback loops that allow enterprise engineering teams to hill-climb compound agent quality systematically without manual labeling bottlenecks.
They have retained Talent247 to appoint a Staff Machine Learning Engineer for Agent Evaluation & Judges in San Francisco, CA. Combining post-training research depth with large-scale product impact, the successful candidate will architect custom generative judge models, automatic prompt/weight optimizers, and trajectory-diagnosis algorithms deployed across tens of thousands of enterprise AI pipelines.
Stack: Python, PyTorch, FSDP/Megatron, Verl/TRL, vLLM/SGLang, Ray, Spark, OpenTelemetry agent tracing, AWS/GCP/Azure GPU clusters. Workplace: Hybrid in San Francisco, CA. Compensation: $235,000 – $330,000 base salary plus substantial equity grants, annual refreshers/bonus, and comprehensive US benefits.