---
title: "Senior Multi-Cloud GPU Orchestration Engineer"
slug: "senior-multi-cloud-gpu-orchestration-engineer"
id: "aa494718-2584-4675-a745-48f043e44ef0"
department: "MLOps & Platform"
department_code: "OPS"
location: "New York, NY"
workplace_type: "Hybrid"
employment_type: "Full-time"
compensation: "$200k – $280k (annual package)"
is_remote: false
is_featured: false
headcount: 1
canonical_url: "https://jobs.talent247.co/jobs/senior-multi-cloud-gpu-orchestration-engineer"
markdown_url: "https://jobs.talent247.co/jobs/senior-multi-cloud-gpu-orchestration-engineer.md"
apply_endpoint: "https://jobs.talent247.co/api/public/jobs/senior-multi-cloud-gpu-orchestration-engineer/apply"
schema_endpoint: "https://jobs.talent247.co/api/public/jobs/senior-multi-cloud-gpu-orchestration-engineer/form-schema"
webmcp_tool: "apply_for_role"
updated_at: "2026-11-15T17:41:12.854Z"
content_signal: "search=yes, ai-input=yes, ai-train=no"
---

# Senior Multi-Cloud GPU Orchestration Engineer

## Position Telemetry

- **Reference:** `SENIOR-MULTI-CLOUD`
- **Practice / Sector:** MLOps & Platform (`OPS`)
- **Location:** New York, NY
- **Workplace Type:** Hybrid
- **Employment Type:** Full-time
- **Compensation:** $200k – $280k (annual package)
- **Canonical HTML URL:** https://jobs.talent247.co/jobs/senior-multi-cloud-gpu-orchestration-engineer

## Role Dossier & Specification

THE CLIENT & MANDATE
Our client is a leading AI inference cloud headquartered in San Francisco with a major distributed infrastructure hub in New York City. To shield fast-scaling enterprise and AI-native customers from single-cloud GPU capacity crunches and regional outages, their Multi-Cloud Compute Fabric orchestrates tens of thousands of GPUs seamlessly across AWS, GCP, Azure, OCI, and specialized bare-metal neoclouds as a single logical inference mesh.

They have partnered with Talent247 to hire a Senior Multi-Cloud GPU Orchestration Engineer in New York, NY. The successful candidate will design global cross-cloud capacity brokers, sub-second scale-from-zero container/weight loaders, and latency-aware Envoy/Rust traffic routers sustaining 99.995% availability.

KEY RESPONSIBILITIES
• Architect federated Kubernetes control planes and declarative placement schedulers in Go and Rust brokering real-time H100/H200/B200 GPU capacity across 10+ hyperscale and bare-metal cloud providers.
• Build global Layer-7 AI traffic routers (Envoy / Rust data planes) balancing geo-proximity, queue depth, prefix-cache locality, and live cross-region GPU health signals with zero-downtime failover.
• Engineer ultra-fast cross-cloud model weight & container caching layers leveraging NVMe tiering, OCI lazy-pulling, and high-throughput regional object stores to cut replica cold starts to single-digit seconds.
• Design secure dedicated-VPC customer data planes (PrivateLink, Private Service Connect, WireGuard/Cilium mesh, customer-managed KMS) meeting SOC2 Type II and HIPAA enterprise isolation requirements.
• Implement predictive autoscaling and spot/on-demand/reserved GPU arbitrage engines optimizing multi-million-dollar monthly compute fleets.
• Own chaos-engineering game days simulating full cloud-region blackouts and GPU hardware degradations without dropping streaming tokens.

TECHNICAL ENVIRONMENT & OFFERING
Stack: Go, Rust, Python, Kubernetes (custom operators, Karpenter/custom provisioners), Cilium/eBPF, Envoy, gRPC, Terraform/Pulumi, Prometheus/ClickHouse, AWS/GCP/Azure/OCI & bare-metal clouds. Workplace: Hybrid in New York, NY. Compensation: $200,000 – $280,000 base salary plus generous equity grants and full US benefits.

## Core Requirements

ESSENTIAL QUALIFICATIONS
• 5+ years of cloud infrastructure, distributed systems, or multi-cluster Kubernetes platform engineering experience in Go or Rust.
• Deep production mastery of Kubernetes federation, custom controllers/operators, CNI networking (Cilium/Calico/WireGuard), and high-throughput L7 proxies (Envoy).
• Hands-on experience managing production GPU fleets across multiple cloud providers, including NVIDIA driver/device-plugin lifecycles, MIG, and GPU health monitoring (DCGM).
• Strong grounding in cloud security primitives (IAM Federation, PrivateLink/PSC, mTLS service meshes, zero-trust tenant isolation).
• Track record owning mission-critical data-plane or control-plane infrastructure under strict 99.99%+ uptime SLAs.

PREFERRED / BONUS EXPERIENCE
• Experience building serverless GPU autoscalers, scale-to-zero cold-start accelerators, or multi-node InfiniBand/RoCE gang scheduling across neoclouds.
• Contributions to Envoy AI Gateway, Kubernetes Cluster API, Cilium, or OCI image-streaming runtimes.
• Familiarity with LLM serving patterns (disaggregated prefill/decode routing, KV-cache session affinity).

## Application Schema & Direct Apply (`apply_for_role`)

Candidates and authorized AI agents on behalf of a candidate can submit an application via the declarative WebMCP form tool `apply_for_role` on https://jobs.talent247.co/jobs/senior-multi-cloud-gpu-orchestration-engineer or via HTTP `POST https://jobs.talent247.co/api/public/jobs/senior-multi-cloud-gpu-orchestration-engineer/apply` (`application/json` or `multipart/form-data`). Non-browser HTTP agents must include header `X-Talent247-Intake-Token` obtained from `GET https://jobs.talent247.co/api/public/intake-token` (or automatically returned in `GET https://jobs.talent247.co/api/public/jobs/senior-multi-cloud-gpu-orchestration-engineer/form-schema`).

### Form Fields

- `full_name` (text, required): Full name
- `email` (email, required): Email
- `phone` (phone, optional): Phone
- `location` (text, optional): Location
- `linkedin_url` (url, optional): LinkedIn URL
- `cover_letter` (textarea, optional): Cover letter
- `consent` (checkbox, required): I consent to my data being processed for this application
- `cv_file` / `cv_base64` + `cv_filename`: Upload a CV in .pdf or .docx format (<= 10 MB) or provide an `https://` LinkedIn profile URL in `linkedin_url`.

### Alternative: Talent Pool Intake (`join_talent_pool`)

If this mandate is not an exact match, register once in the Talent247 Talent Pool at https://jobs.talent247.co/talent-pool (`https://jobs.talent247.co/talent-pool.md`) via WebMCP tool `join_talent_pool` or `POST https://jobs.talent247.co/api/public/talent-pool`.
