Skip to main content
TALENT247 // SPECIALIST AI EXECUTIVE SEARCH & TECHNICAL RECRUITMENT
RES · AI Research

Research Scientist, Frontier Pre-Training & Mixture-of-Experts

Paris, France · Full-time · On-site

AI Specialism

AI Research

Workplace

On-site

Location

Paris, France

Compensation

€130k – €185k

annual package

Role Dossier & Specification

REF: RESEARCH-SCIENTIST

THE CLIENT & MANDATE

Our client is Europe's flagship frontier foundation model laboratory, headquartered in Paris and competing head-to-head at the global state of the art across multilingual reasoning, code generation, mathematics, and native multimodal understanding. With dedicated multi-thousand-GPU superclusters and a flat, researcher-led culture free of big-tech bureaucracy, small squads take bold architectural ideas from whiteboard scaling ablations directly to flagship global model launches.

They have partnered with Talent247 to recruit a Research Scientist, Frontier Pre-Training & Mixture-of-Experts onsite in Paris. Sitting inside their Core Pre-Training squad, you will co-own architectural design, optimizer dynamics, and multi-trillion-token data curricula for their next generation of sparse Mixture-of-Experts and native multimodal foundation models.

KEY RESPONSIBILITIES

  • Design and validate novel sparse Mixture-of-Experts (MoE), hybrid state-space/attention, and native vision-audio-text transformer architectures from 1B-scale scaling-law sweeps up to flagship frontier training runs.
  • Investigate router load-balancing, expert specialization, auxiliary-loss-free routing, low-precision (FP8) training stability, and learning-rate/batch-size schedules across multi-thousand-GPU jobs.
  • Lead large-scale pre-training data science—optimizing multilingual, mathematical, scientific, and repository-level code mixtures, synthetic data upsampling, and mid-training long-context annealing (128k–1M+ tokens).
  • Write clean, high-efficiency distributed PyTorch code (3D/4D parallelism across tensor, pipeline, context, and expert dimensions) without relying on brittle black-box wrappers.
  • Monitor live frontier runs closely, diagnosing loss spikes, gradient norm anomalies, and downstream capability emergence in real time alongside infrastructure and post-training peers.
  • Contribute to landmark model releases and technical reports shaping the European and global AI landscape.

TECHNICAL ENVIRONMENT & OFFERING

Their research stack is built on custom high-performance PyTorch/CUDA/Triton distributed pre-training frameworks running on dedicated H100/H200/GB200 clusters. Based onsite at their central Paris headquarters, our client offers €130,000–€185,000 EUR base salary plus substantial frontier-lab BSPCE equity, full relocation/Talent Passport visa sponsorship, and top-tier compute-per-researcher ratios.

Core Requirements

ESSENTIAL QUALIFICATIONS

  • PhD in Machine Learning, Computer Science, Physics, or Mathematics, or equivalent hands-on track record pre-training large foundation models at a frontier AI lab.
  • Deep mathematical and empirical mastery of modern LLM architectures (GQA/MLA, RoPE/YaRN, RMSNorm, SwiGLU, sparse MoE routing) and scaling laws.
  • Ability to implement custom transformer/MoE layers, fused losses, and distributed sharding logic from scratch in PyTorch with complete command of tensor layouts and GPU memory budgets.
  • Direct experience running, debugging, and evaluating large-scale pre-training or continual pre-training experiments across multi-node GPU clusters.
  • First-author publications at NeurIPS, ICML, ICLR, or co-authorship on widely recognized frontier foundation model releases.

PREFERRED / BONUS EXPERIENCE

  • Hands-on experience with FP8 pre-training recipes, multimodal vision/audio token pre-training, or custom Triton/CUDA training kernels.
  • Experience designing pre-training data filtering, classifier-based quality scoring, and synthetic pre-training corpora at trillion-token scale.

Position Telemetry

Location Paris, France (Onsite)
Department AI Research
Employment type Full-time
Workplace type On-site
Salary range
€130k – €185k annual package