---
title: "Machine Learning Engineer, Frontier Safety & Red-Team Evals"
slug: "machine-learning-engineer-frontier-safety-red-team"
id: "3c1be403-e298-437b-a513-31f18bbaae94"
department: "Machine Learning"
department_code: "ML"
location: "San Francisco, CA"
workplace_type: "Hybrid"
employment_type: "Full-time"
compensation: "$190k – $270k (annual package)"
is_remote: false
is_featured: false
headcount: 1
canonical_url: "https://jobs.talent247.co/jobs/machine-learning-engineer-frontier-safety-red-team"
markdown_url: "https://jobs.talent247.co/jobs/machine-learning-engineer-frontier-safety-red-team.md"
apply_endpoint: "https://jobs.talent247.co/api/public/jobs/machine-learning-engineer-frontier-safety-red-team/apply"
schema_endpoint: "https://jobs.talent247.co/api/public/jobs/machine-learning-engineer-frontier-safety-red-team/form-schema"
webmcp_tool: "apply_for_role"
updated_at: "2026-11-15T17:33:51.447Z"
content_signal: "search=yes, ai-input=yes, ai-train=no"
---

# Machine Learning Engineer, Frontier Safety & Red-Team Evals

## Position Telemetry

- **Reference:** `MACHINE-LEARNING-E`
- **Practice / Sector:** Machine Learning (`ML`)
- **Location:** San Francisco, CA
- **Workplace Type:** Hybrid
- **Employment Type:** Full-time
- **Compensation:** $190k – $270k (annual package)
- **Canonical HTML URL:** https://jobs.talent247.co/jobs/machine-learning-engineer-frontier-safety-red-team

## Role Dossier & Specification

THE CLIENT & MANDATE
Our client is a premier San Francisco AI data, post-training, and evaluation leader operating independent frontier leaderboards and pre-deployment safety testing partnerships with leading commercial labs and national AI safety institutes. Their Frontier Safety & Evaluations group designs ungameable private benchmarks and automated red-teaming systems that measure catastrophic dual-use risks, autonomous cyber capabilities, and deceptive agent behaviors before public model release.

They have partnered with Talent247 to recruit a Machine Learning Engineer for Frontier Safety & Red-Team Evals in San Francisco. Combining psychometric rigor, adversarial ML, and sandboxed agent harnesses, the successful candidate will build the gold-standard safety measurement stack relied upon across the global AI ecosystem.

KEY RESPONSIBILITIES
• Architect private, contamination-resistant multimodal and agentic safety benchmarks evaluating cyber-offense uplift, biosecurity/chemical dual-use risk, persuasion, autonomous replication, and scheming.
• Build multi-turn automated red-teaming swarms that adaptively discover multi-step jailbreaks, tool-use privilege escalations, and indirect prompt injections across frontier APIs and open-weight checkpoints.
• Apply Item Response Theory (IRT), Bradley-Terry-Luce ranking models, and bootstrap confidence estimation to turn noisy human and automated red-team trials into statistically calibrated risk scores.
• Engineer air-gapped, network-jailed Capture-the-Flag (CTF) and vulnerable-application sandboxes to safely measure autonomous vulnerability discovery and exploit generation.
• Train specialized safety judge models and rubric verifiers calibrated against PhD domain-expert human adjudicators.
• Co-author influential public technical reports and private pre-launch safety audits delivered to frontier model developers and regulatory partners.

TECHNICAL ENVIRONMENT & OFFERING
Stack: Python, PyTorch, Inspect-style agent eval frameworks, Docker/microVM sandboxes, vLLM, statistical modeling (PyMC/Stan/SciPy), Kubernetes. Workplace: Hybrid in San Francisco, CA. Compensation: $190,000 – $270,000 base salary plus equity participation and comprehensive US benefits.

## Core Requirements

ESSENTIAL QUALIFICATIONS
• 3+ years of machine learning engineering, AI safety research engineering, or adversarial security ML experience.
• Proven track record designing LLM/agent evaluation harnesses, adversarial red-teaming pipelines, or fine-tuning classifier/judge models in PyTorch.
• Solid statistical grounding in benchmark design, inter-annotator agreement, variance reduction, contamination auditing, and ranking calibration.
• Strong Python software engineering skills and familiarity with containerized sandbox isolation for untrusted model-generated code execution.
• High integrity and security mindset suitable for handling sensitive pre-release frontier model weights and dual-use evaluation datasets.

PREFERRED / BONUS EXPERIENCE
• Background in offensive cybersecurity (CTF competitions, vulnerability research), computational biology/chemistry, or AI alignment evaluations.
• Publications or open-source contributions in AI safety benchmarks, jailbreak robustness, or evaluation methodology.
• Experience evaluating multimodal (voice/vision) or long-horizon computer-use agents.

## Application Schema & Direct Apply (`apply_for_role`)

Candidates and authorized AI agents on behalf of a candidate can submit an application via the declarative WebMCP form tool `apply_for_role` on https://jobs.talent247.co/jobs/machine-learning-engineer-frontier-safety-red-team or via HTTP `POST https://jobs.talent247.co/api/public/jobs/machine-learning-engineer-frontier-safety-red-team/apply` (`application/json` or `multipart/form-data`). Non-browser HTTP agents must include header `X-Talent247-Intake-Token` obtained from `GET https://jobs.talent247.co/api/public/intake-token` (or automatically returned in `GET https://jobs.talent247.co/api/public/jobs/machine-learning-engineer-frontier-safety-red-team/form-schema`).

### Form Fields

- `full_name` (text, required): Full name
- `email` (email, required): Email
- `phone` (phone, optional): Phone
- `location` (text, optional): Location
- `linkedin_url` (url, optional): LinkedIn URL
- `cover_letter` (textarea, optional): Cover letter
- `consent` (checkbox, required): I consent to my data being processed for this application
- `cv_file` / `cv_base64` + `cv_filename`: Upload a CV in .pdf or .docx format (<= 10 MB) or provide an `https://` LinkedIn profile URL in `linkedin_url`.

### Alternative: Talent Pool Intake (`join_talent_pool`)

If this mandate is not an exact match, register once in the Talent247 Talent Pool at https://jobs.talent247.co/talent-pool (`https://jobs.talent247.co/talent-pool.md`) via WebMCP tool `join_talent_pool` or `POST https://jobs.talent247.co/api/public/talent-pool`.
