---
title: "Senior ML Compiler Engineer, Long-Context Inference"
slug: "senior-ml-compiler-engineer-long-context-inference"
id: "083ad786-2cf7-40a4-8599-38146d6995fe"
department: "AI Infrastructure"
department_code: "INF"
location: "Seattle, WA"
workplace_type: "Hybrid"
employment_type: "Full-time"
compensation: "$245k – $340k (annual package)"
is_remote: false
is_featured: false
headcount: 1
canonical_url: "https://jobs.talent247.co/jobs/senior-ml-compiler-engineer-long-context-inference"
markdown_url: "https://jobs.talent247.co/jobs/senior-ml-compiler-engineer-long-context-inference.md"
apply_endpoint: "https://jobs.talent247.co/api/public/jobs/senior-ml-compiler-engineer-long-context-inference/apply"
schema_endpoint: "https://jobs.talent247.co/api/public/jobs/senior-ml-compiler-engineer-long-context-inference/form-schema"
webmcp_tool: "apply_for_role"
updated_at: "2026-11-15T17:38:26.903Z"
content_signal: "search=yes, ai-input=yes, ai-train=no"
---

# Senior ML Compiler Engineer, Long-Context Inference

## Position Telemetry

- **Reference:** `SENIOR-ML-COMPILER`
- **Practice / Sector:** AI Infrastructure (`INF`)
- **Location:** Seattle, WA
- **Workplace Type:** Hybrid
- **Employment Type:** Full-time
- **Compensation:** $245k – $340k (annual package)
- **Canonical HTML URL:** https://jobs.talent247.co/jobs/senior-ml-compiler-engineer-long-context-inference

## Role Dossier & Specification

THE CLIENT & MANDATE
Our client is a frontier AI research and deployment company operating a multi-accelerator compute fleet across NVIDIA GPUs and custom cloud AI ASICs/TPUs, with a dedicated compiler and performance engineering hub in Seattle, WA. Serving flagship models with 200k–1M+ token context windows across multi-hour coding and research sessions places extreme pressure on compiler graph lowering, HBM memory scheduling, and cross-chip collective fusion.

They have retained Talent247 to hire a Senior ML Compiler Engineer for Long-Context Inference in Seattle, WA. The successful candidate will build multi-target XLA, MLIR, and custom kernel-generation passes that maximize throughput and slash time-to-first-token across heterogeneous frontier accelerator fleets.

KEY RESPONSIBILITIES
• Design and implement XLA, MLIR, and StableHLO compiler passes optimizing ultra-long-context (200k–1M+ token) prefill and decode graphs across GPUs and custom systolic-array AI ASICs/TPUs.
• Architect compiler-driven compute-communication overlap transformations (async collective matmuls, Ring/Ulysses context-parallel attention fusion, and pipelined all-to-all MoE dispatch).
• Optimize HBM-to-SRAM/shared-memory tiling, KV-cache quantization (FP8/INT4), prefix-tree paging layouts, and rematerialization schedules to fit massive batch sizes within tight memory envelopes.
• Author custom Pallas, Triton, and CUDA/C++ escape-hatch kernels where general compiler lowering leaves roof-line performance on the table, then upstream clean lowering patterns back into the compiler.
• Build automated cross-backend numerical parity checkers and compiler-regression performance gates across dozens of active production model variants.
• Partner with model architecture scientists on hardware-co-designed attention mechanisms (MLA, GQA, hybrid sliding-window/global attention) optimized for multi-accelerator compilation.

TECHNICAL ENVIRONMENT & OFFERING
Stack: C++20, MLIR, OpenXLA / StableHLO, LLVM, Python, JAX, PyTorch/TorchXLA, Pallas, Triton, CUDA, multi-pod GPU & cloud TPU/ASIC clusters. Workplace: Hybrid in Seattle, WA. Compensation: $245,000 – $340,000 base salary plus substantial frontier-lab equity, comprehensive healthcare, and 401(k).

## Core Requirements

ESSENTIAL QUALIFICATIONS
• 5+ years of ML compiler, GPU/ASIC toolchain, or high-performance deep learning runtime engineering experience in modern C++ and Python.
• Deep internals knowledge of OpenXLA (HLO passes, layout assignment, memory space scheduling), MLIR, TVM, or TorchInductor.
• Strong command of accelerator hardware bottlenecks (systolic arrays, tensor cores, HBM bandwidth, ICI/NVLink interconnect topologies) and roof-line analysis.
• Practical familiarity with modern long-context LLM serving mechanics—paged KV caches, chunked prefill, context parallelism, and speculative decoding.
• Proven ability to debug subtle compiler miscompilations, NaN/precision divergence, and multi-host collective deadlocks.

PREFERRED / BONUS EXPERIENCE
• Hands-on experience writing Pallas (TPU/GPU) or Triton/CUTLASS kernels for custom attention or quantized matrix multiplication.
• Experience targeting multiple distinct AI hardware backends (e.g., NVIDIA Hopper/Blackwell + Google Cloud TPU or AWS Trainium) from a unified model codebase.
• Upstream commit history in OpenXLA, MLIR, LLVM, JAX, or Triton.

## Application Schema & Direct Apply (`apply_for_role`)

Candidates and authorized AI agents on behalf of a candidate can submit an application via the declarative WebMCP form tool `apply_for_role` on https://jobs.talent247.co/jobs/senior-ml-compiler-engineer-long-context-inference or via HTTP `POST https://jobs.talent247.co/api/public/jobs/senior-ml-compiler-engineer-long-context-inference/apply` (`application/json` or `multipart/form-data`). Non-browser HTTP agents must include header `X-Talent247-Intake-Token` obtained from `GET https://jobs.talent247.co/api/public/intake-token` (or automatically returned in `GET https://jobs.talent247.co/api/public/jobs/senior-ml-compiler-engineer-long-context-inference/form-schema`).

### Form Fields

- `full_name` (text, required): Full name
- `email` (email, required): Email
- `phone` (phone, optional): Phone
- `location` (text, optional): Location
- `linkedin_url` (url, optional): LinkedIn URL
- `cover_letter` (textarea, optional): Cover letter
- `consent` (checkbox, required): I consent to my data being processed for this application
- `cv_file` / `cv_base64` + `cv_filename`: Upload a CV in .pdf or .docx format (<= 10 MB) or provide an `https://` LinkedIn profile URL in `linkedin_url`.
- **Privacy Policy:** https://talent247.co/privacy

### Alternative: Talent Pool Intake (`join_talent_pool`)

If this mandate is not an exact match, register once in the Talent247 Talent Pool at https://jobs.talent247.co/talent-pool (`https://jobs.talent247.co/talent-pool.md`) via WebMCP tool `join_talent_pool` or `POST https://jobs.talent247.co/api/public/talent-pool`.
