$200k – $280k
annual package
New York, NY · Full-time · Hybrid
MLOps & Platform
Hybrid
New York, NY
$215k – $305k
annual package
Our client is a premier real-time AI search and knowledge discovery platform headquartered in San Francisco with a fast-growing systems engineering hub in New York City. Answering breaking-news, market-moving financial, and technical queries accurately requires ingesting, rendering, deduplicating, embedding, and indexing millions of newly published or updated web pages every hour—with end-to-end crawl-to-searchable freshness measured in seconds rather than days.
They have engaged Talent247 to appoint a Senior Distributed Data & Vector Indexing Engineer in New York, NY. Joining their Search Infrastructure & Freshness Indexing team, the successful candidate will architect petabyte-scale streaming pipelines and hybrid lexical-vector indexers in Rust, Go, and C++.
Stack: Rust, Go, C++20, Kafka / Redpanda, Ray Data, Apache Arrow / Parquet / Lance, custom HNSW/DiskANN/BM25 storage engines, RocksDB, ClickHouse, Kubernetes, bare-metal NVMe & GPU clusters. Workplace: Hybrid in New York, NY. Compensation: $215,000 – $305,000 base salary plus high-upside unicorn equity and full US benefits.
mmap), io_uring, SIMD acceleration, network serialization, and tail-latency debugging.tantivy, lancedb, qdrant, rocksdb, arrow-rs).