AI Infrastructure
New York, NY
On-site · Full-time
$225k – $320k
annual package
Austin, TX · Full-time · Hybrid
AI Infrastructure
Hybrid
Austin, TX
$185k – $255k
annual package
Our client is a breakthrough custom AI silicon and inference-cloud provider operating massive dedicated AI supercomputing clusters across North America, with a flagship systems engineering hub in Austin, TX. Because their custom accelerators generate LLM tokens at 2,000+ tokens per second per stream—an order of magnitude faster than conventional GPU clouds—standard HTTP gateways and Python serving wrappers immediately become the bottleneck.
They have engaged Talent247 to hire a Senior Systems Engineer for their Ultra-Low-Latency Inference Cloud in Austin, TX. The appointed engineer will build ultra-lean Rust/C++/Go streaming data planes, stateful KV-cache-aware request routers, and multi-region failover fabrics capable of sustaining millions of tokens per second with single-digit millisecond gateway overhead.
Stack: Rust, Go, C++20, Tokio/io_uring, Envoy, gRPC, Kubernetes (bare-metal), Redis/Dragonfly, ClickHouse, Prometheus/eBPF, Linux high-speed networking. Workplace: Hybrid in Austin, TX. Compensation: $185,000 – $255,000 base salary plus meaningful equity, relocation assistance, and comprehensive US benefits.