Skip to main content
TALENT247 // SPECIALIST AI EXECUTIVE SEARCH & TECHNICAL RECRUITMENT
INF · AI Infrastructure

Senior Inference Engineer, Real-Time Diffusion Transformers

London, UK · Full-time · Hybrid

AI Specialism

AI Infrastructure

Workplace

Hybrid

Location

London, UK

Compensation

£105k – £150k

annual package

Role Dossier & Specification

REF: SENIOR-INFERENCE-E

THE CLIENT & MANDATE

Our client is Britain's flagship $4B generative AI video unicorn headquartered in central London, serving more than 60,000 businesses worldwide with expressive neural video avatars and studio-grade generative video models. As their product evolves from asynchronous batch video rendering to live, conversational real-time video avatars that see, listen, react, and speak with sub-second latency, runtime inference efficiency on Diffusion Transformers (DiTs) has become a mission-critical engineering pillar.

They have retained Talent247 to appoint a Senior Inference Engineer, Real-Time Diffusion Transformers in London. Bridging their Generative Video Research group and Production Inference Infrastructure squad, the appointed engineer will take multi-billion-parameter causal audio-conditioned video diffusion and autoregressive models and make them stream infinitely long 1080p+ video sequences faster than real time on GPU clusters.

KEY RESPONSIBILITIES

  • Profile, optimize, and deploy causal streaming Diffusion Transformer (DiT) and 3D spatiotemporal VAE architectures to achieve sustained >30 FPS real-time interactive avatar generation at <300ms time-to-first-frame.
  • Implement custom CUDA, Triton, and TensorRT optimizations—including FP8/INT8/NVFP4 quantization, KV-cache rolling windows for causal video attention, CUDA Graphs, and fused audio-conditioning cross-attention kernels.
  • Design multi-GPU sequence/context parallelism (Ulysses / Ring Attention) and disaggregated VAE decoding pipelines scaling smoothly across H100, H200, and B200 accelerator pods.
  • Partner directly with research scientists on few-step adversarial/consistency distillation and causal architectural modifications that unlock 5x–10x runtime speedups without lip-sync or identity degradation.
  • Integrate ultra-low-latency GPU video encoding (NVENC) directly with WebRTC media servers for zero-copy GPU-to-network frame streaming.
  • Build automated perceptual-regression and frame-pacing benchmark suites guarding every runtime optimization.

TECHNICAL ENVIRONMENT & OFFERING

Their stack features Python, C++20, PyTorch (torch.compile), CUDA/CUTLASS, Triton, TensorRT, NVENC/WebRTC, and Kubernetes H100/B200 GPU fleets. Offered hybrid in central London, compensation includes £105,000–£150,000 GBP base salary plus Series E unicorn equity, comprehensive private healthcare, pension, and UK Skilled Worker / Global Talent visa sponsorship.

Core Requirements

ESSENTIAL QUALIFICATIONS

  • 5+ years of experience in GPU performance engineering, deep learning inference optimization, or high-performance multimedia/computer-vision systems.
  • Deep hands-on mastery of PyTorch internals, CUDA/Triton kernel development, TensorRT, and hardware-level profiling using NVIDIA Nsight Systems and Nsight Compute.
  • Direct practical experience optimizing transformer or diffusion architectures (DiTs, latent video diffusion, 3D VAEs, or LLMs) via FP8/INT8 quantization, operator fusion, and multi-GPU parallelism.
  • Strong systems understanding of GPU memory hierarchies, PCIe/NVLink bandwidth, asynchronous CUDA streams, and tail-latency elimination.
  • Collaborative mindset excited to co-design hardware-efficient architectures side-by-side with generative video researchers.

PREFERRED / BONUS EXPERIENCE

  • Experience with real-time video streaming pipelines (NVENC/NVDEC, GStreamer, WebRTC) or causal streaming video diffusion (FIFO-Diffusion / CausVid-style rolling caches).
  • Contributions to open-source GPU inference frameworks (diffusers, xDiT, TensorRT, vLLM, SGLang, or FlashAttention).

Position Telemetry

Location London, UK (Hybrid)
Department AI Infrastructure
Employment type Full-time
Workplace type Hybrid
Salary range
£105k – £150k annual package