Skip to main content
TALENT247 // SPECIALIST AI EXECUTIVE SEARCH & TECHNICAL RECRUITMENT
INF · AI Infrastructure

Senior Rust Systems Engineer, Serverless GPU Runtime

New York, NY · Full-time · On-site

AI Specialism

AI Infrastructure

Workplace

On-site

Location

New York, NY

Compensation

$230k – $330k

annual package

Role Dossier & Specification

REF: SENIOR-RUST-SYSTEM

THE CLIENT & MANDATE

Our client is an acclaimed serverless AI and data cloud headquartered in New York City, revered by ML engineers and frontier agent builders for eliminating YAML, Dockerfiles, and multi-minute GPU boot times. Behind their effortless Python interface sits a ground-up custom Rust hypervisor, container runtime, and memory-snapshotting stack built from first principles to boot isolated GPU containers and untrusted code sandboxes in hundreds of milliseconds.

They have retained Talent247 to appoint a Senior Rust Systems Engineer for their Serverless GPU Runtime onsite in New York, NY. Working in a compact, deeply technical systems engineering culture, the successful candidate will push Linux kernel, hypervisor, and CUDA driver virtualization boundaries to make 10,000-container GPU scaleouts feel instantaneous.

KEY RESPONSIBILITIES

  • Architect and harden custom container and microVM sandboxing runtimes in Rust utilizing Linux namespaces, cgroups v2, seccomp, gVisor/KVM primitives, and hardware-enforced multi-tenant isolation.
  • Engineer CPU + NVIDIA GPU memory checkpoint-and-restore snapshotting pipelines restoring fully initialized PyTorch/CUDA contexts and multi-gigabyte VRAM states in <500ms.
  • Build lazy-loading FUSE / io_uring filesystem clients and zero-copy page-cache layers streaming only the exact Python bytecode and shared-library pages touched during cold start.
  • Design high-density bin-packing host agents and low-jitter virtual networking stacks (eBPF, nftables, WireGuard, custom HTTP/gRPC multiplexers) across global GPU bare-metal and cloud fleets.
  • Collaborate upstream/downstream around NVIDIA GPU driver internals (nvidia-uvm, CUDA Driver API, MIG/MPS, NVLink partitioning) to eliminate driver initialization bottlenecks.
  • Maintain extreme reliability and security rigor across sandboxes executing millions of untrusted LLM-generated code and RL rollout workloads daily.

TECHNICAL ENVIRONMENT & OFFERING

Stack: Rust (async Tokio, nix/libc, io_uring), C, Linux kernel internals (KVM, cgroups v2, FUSE, userfaultfd, eBPF), CUDA Driver API, bare-metal & multi-cloud H100/B200 GPU hosts. Workplace: Onsite in New York, NY (SoHo/Downtown). Compensation: $230,000 – $330,000 base salary plus premier high-upside equity, comprehensive healthcare, daily catered lunches, and relocation support.

Core Requirements

ESSENTIAL QUALIFICATIONS

  • 5+ years of low-level systems engineering experience building operating-system runtimes, hypervisors/containers, storage engines, or high-performance networking infrastructure in Rust, C, or C++.
  • Deep fluency in Rust systems programming alongside intimate knowledge of Linux kernel mechanics (virtual memory, page faults, syscalls, namespaces, cgroups, filesystems, async IO).
  • Track record diagnosing subtle kernel/userspace concurrency bugs, tail-latency stalls, memory leaks, and security isolation edge cases in production.
  • First-principles engineering taste—comfortable reading kernel or driver source code when off-the-shelf container tooling hits architectural walls.
  • Excitement to collaborate onsite in NYC with fellow systems, storage, and compiler engineers.

PREFERRED / BONUS EXPERIENCE

  • Direct experience with CRIU, Firecracker/Cloud Hypervisor, gVisor, CUDA checkpoint/restore (cuda-checkpoint), or GPU virtualization.
  • Familiarity with FUSE/io_uring high-throughput filesystems or eBPF packet/syscall filtering.
  • Core contributions to Rust systems crates, Linux kernel subsystems, or container runtimes (youki, containerd, runc).

Position Telemetry

Location New York, NY
Department AI Infrastructure
Employment type Full-time
Workplace type On-site
Headcount 2 openings
Salary range
$230k – $330k annual package