Skip to main content
TALENT247 // SPECIALIST AI EXECUTIVE SEARCH & TECHNICAL RECRUITMENT
APP · Applied AI

Senior Rust Streaming Gateway & Inline Guardrails Engineer

Warsaw, Poland · Full-time · Hybrid

AI Specialism

Applied AI

Workplace

Hybrid

Location

Warsaw, Poland

Compensation

€80k – €110k

annual package

Role Dossier & Specification

REF: SENIOR-RUST-STREAM

THE CLIENT & MANDATE

Our client is an ETH-ecosystem AI security leader with engineering hubs in Zurich and Warsaw, safeguarding live enterprise LLM applications and autonomous multi-agent workflows for global banks, healthcare networks, and Fortune 500 enterprises. Their inline runtime security platform inspects billions of prompts, retrieved context chunks, and tool invocations monthly to block prompt injection, sensitive data exfiltration, and unauthorized agent actions in real time.

They have partnered with Talent247 to hire a Senior Rust Streaming Gateway & Inline Guardrails Engineer in Warsaw. Joining their Core Runtime & Systems Engineering squad, you will architect ultra-low-latency asynchronous proxy gateways and embedded neural inference engines capable of enforcing deterministic and ML-based security policies within single-digit millisecond budgets.

KEY RESPONSIBILITIES

  • Design, build, and optimize high-concurrency Rust streaming reverse proxies (Tokio, Hyper, Envoy ext_proc) inspecting SSE token streams, JSON-RPC/MCP tool calls, and multimodal payloads on the wire.
  • Embed quantized small-transformer guardrail classifiers directly inside the gateway process via ONNX Runtime, Candle, or TensorRT to hold p99 inline inspection latency below 10ms.
  • Architect zero-data-retention memory handling, PII/secret redaction state machines, and cryptographic audit-log streaming for regulated financial and healthcare customers.
  • Package self-contained, high-availability Kubernetes Helm deployments and WebAssembly/sidecar plugins for seamless customer VPC and on-premise rollout.
  • Build chaos-testing and high-RPS load harnesses simulating millions of concurrent streaming agent sessions and adversarial payload bursts.
  • Partner closely with adversarial ML researchers in Zurich to ship new threat-detection models from research checkpoint to production gateway within hours.

TECHNICAL ENVIRONMENT & OFFERING

Their systems stack centers on Rust, C++, Tokio/Hyper, Envoy, ONNX Runtime, Kubernetes, Terraform, and OpenTelemetry. Working hybrid in central Warsaw, our client offers €80,000–€110,000 EUR base compensation, meaningful equity options, private healthcare, and conference/hardware budgets.

Core Requirements

ESSENTIAL QUALIFICATIONS

  • 5+ years of systems or high-throughput backend engineering experience, including substantial production ownership in Rust (or modern C++20 with strong Rust fluency).
  • Deep understanding of asynchronous network programming (Tokio, Hyper, gRPC, HTTP/2, SSE streaming), reverse proxies, and Linux network/memory profiling.
  • Hands-on experience embedding low-latency local ML inference (ONNX Runtime, Candle, libtorch, or TensorRT) inside high-QPS production services.
  • Strong operational command of Kubernetes, Helm, multi-region cloud deployments, and distributed tracing/observability (OpenTelemetry, Prometheus).
  • Security-minded engineering discipline around memory safety, tenant isolation, and zero-trust API design.

PREFERRED / BONUS EXPERIENCE

  • Background building WAFs, API gateways, service meshes (Envoy/Istio), DLP engines, or LLM guardrail/MCP proxy tooling.
  • Contributions to open-source Rust networking or ML inference crates.

Position Telemetry

Location Warsaw, Poland (Hybrid)
Department Applied AI
Employment type Full-time
Workplace type Hybrid
Salary range
€80k – €110k annual package