$215k – $305k
annual package
New York, NY · Full-time · Hybrid
MLOps & Platform
Hybrid
New York, NY
$200k – $280k
annual package
Our client is a leading AI inference cloud headquartered in San Francisco with a major distributed infrastructure hub in New York City. To shield fast-scaling enterprise and AI-native customers from single-cloud GPU capacity crunches and regional outages, their Multi-Cloud Compute Fabric orchestrates tens of thousands of GPUs seamlessly across AWS, GCP, Azure, OCI, and specialized bare-metal neoclouds as a single logical inference mesh.
They have partnered with Talent247 to hire a Senior Multi-Cloud GPU Orchestration Engineer in New York, NY. The successful candidate will design global cross-cloud capacity brokers, sub-second scale-from-zero container/weight loaders, and latency-aware Envoy/Rust traffic routers sustaining 99.995% availability.
Stack: Go, Rust, Python, Kubernetes (custom operators, Karpenter/custom provisioners), Cilium/eBPF, Envoy, gRPC, Terraform/Pulumi, Prometheus/ClickHouse, AWS/GCP/Azure/OCI & bare-metal clouds. Workplace: Hybrid in New York, NY. Compensation: $200,000 – $280,000 base salary plus generous equity grants and full US benefits.