Skip to main content
TALENT247 // SPECIALIST AI EXECUTIVE SEARCH & TECHNICAL RECRUITMENT
RES · AI Research

Research Scientist, Hardware-Aware Model Architectures

San Francisco, CA · Full-time · Hybrid

AI Specialism

AI Research

Workplace

Hybrid

Location

San Francisco, CA

Compensation

$255k – $360k

annual package

Role Dossier & Specification

REF: RESEARCH-SCIENTIST

THE CLIENT & MANDATE

Our client is an open-science-rooted AI Acceleration Cloud and frontier systems research lab headquartered in San Francisco, renowned globally for originating hardware-aware attention algorithms, state-space / hybrid sequence models, and ultra-fast distributed inference and pre-training stacks. Their Research group bridges theoretical algorithm design directly with GPU SRAM/tensor-core physics so new model architectures train and serve orders of magnitude faster on real silicon.

They have partnered with Talent247 to appoint a Research Scientist in Hardware-Aware Model Architectures in San Francisco, CA. Working alongside celebrated systems-ML researchers, the successful candidate will invent sub-quadratic sequence models, sparse/hybrid architectures, and low-bit training paradigms validated at multi-billion-parameter scale on dedicated H100/B200 superclusters.

KEY RESPONSIBILITIES

  • Originate novel hardware-aware neural architectures—including hybrid linear/state-space + softmax attention, dynamic sparse MoE routing, latent KV compression, and multi-token prediction heads—co-designed with GPU memory hierarchies.
  • Co-write custom CUDA, CUTLASS/CuTe, or Triton forward-and-backward training kernels ensuring theoretical FLOP reductions translate directly into wall-clock training and inference speedups.
  • Investigate native low-precision pre-training and post-training algorithms (FP8, MXFP4/NVFP4, quantization-aware architecture scaling laws) eliminating outlier instability at scale.
  • Design architecture conversion and distillation recipes capable of retrofitting existing pretrained transformer checkpoints into fast hybrid/sub-quadratic variants using minimal continued pre-training tokens.
  • Lead multi-node scaling-law experiments from 1B ablations through 70B+ reference runs across long-context (1M+ token) reasoning, coding, and multimodal tasks.
  • Publish landmark papers at NeurIPS, ICML, ICLR, and MLSys while releasing high-impact open-source kernels and model implementations.

TECHNICAL ENVIRONMENT & OFFERING

Stack: Python, PyTorch, CUDA / C++20, CUTLASS 3.x / CuTe, Triton, Megatron/TorchTitan, multi-thousand H100/H200/B200 InfiniBand GPU clusters. Workplace: Hybrid in San Francisco, CA. Compensation: $255,000 – $360,000 base salary plus substantial unicorn equity, research publication freedom, and full US benefits.

Core Requirements

ESSENTIAL QUALIFICATIONS

  • PhD in Computer Science, Machine Learning, Electrical Engineering, or equivalent premier research track record at the intersection of deep learning architectures and GPU systems.
  • Strong first-author publication record at NeurIPS, ICML, ICLR, MLSys, or OSDI/ASPLOS in efficient sequence modeling, attention algorithms, MoE, quantization, or IO-aware deep learning.
  • Rare dual fluency: capable of both deriving mathematically sound sequence-modeling/optimization dynamics and implementing fast Triton or CUDA/CUTLASS kernels in PyTorch.
  • Proven experience running and debugging multi-node pre-training or continued-pre-training experiments on large language models.
  • Collaborative, open-research ethos excited to push the state of the art across both published science and commercial cloud workloads.

PREFERRED / BONUS EXPERIENCE

  • Direct research contributions to FlashAttention-class IO-aware kernels, Mamba / linear attention / state-space hybrids, sparse attention, or FP8/FP4 training stability.
  • Mastery of NVIDIA Hopper/Blackwell tensor-core instructions, warp specialization, and asynchronous TMA pipelines.
  • Widely adopted open-source ML systems libraries on GitHub.

Position Telemetry

Location San Francisco, CA (Hybrid)
Department AI Research
Employment type Full-time
Workplace type Hybrid
Salary range
$255k – $360k annual package