Skip to main content
TALENT247 // SPECIALIST AI EXECUTIVE SEARCH & TECHNICAL RECRUITMENT
ML · Machine Learning

Senior Machine Learning Engineer, Enterprise Search & RAG

Palo Alto, CA · Full-time · Hybrid

AI Specialism

Machine Learning

Workplace

Hybrid

Location

Palo Alto, CA

Compensation

$210k – $295k

annual package

Role Dossier & Specification

REF: SENIOR-MACHINE-LEA

THE CLIENT & MANDATE

Our client is a multi-billion-dollar Silicon Valley enterprise AI search and work-agent leader headquartered in Palo Alto, CA. Deployed across hundreds of global enterprises, their platform indexes billions of documents, code repositories, tickets, and chat threads into a real-time, permission-aware enterprise knowledge graph powering grounded assistants and autonomous department agents.

They have retained Talent247 to appoint a Senior Machine Learning Engineer for Enterprise Search & RAG in Palo Alto. Working on their core retrieval and ranking engine, the successful candidate will advance personalized dense-lexical retrieval, multi-hop query planning, and cross-encoder reranking subject to strict real-time access-control enforcement.

KEY RESPONSIBILITIES

  • Train and iterate on domain-adaptive bi-encoder embedding models, late-interaction (ColBERT-style) retrievers, and low-latency cross-encoder rerankers tailored to heterogeneous enterprise SaaS corpora.
  • Design agentic multi-hop query decomposition and iterative retrieval policies that resolve organizational acronyms, people-graph relationships, temporal recency, and code-to-ticket dependencies.
  • Co-design retrieval scoring and candidate-generation stages alongside search systems engineers so real-time user-level ACL filtering across 100+ SaaS sources never degrades recall or sub-200ms p99 latency.
  • Build privacy-preserving online learning-to-rank and implicit-feedback pipelines (clickstreams, citation dwell, reformulations, thumbs feedback) across strictly isolated single-tenant deployments.
  • Develop calibrated context-selection, dynamic snippet compression, and source-authority ranking algorithms that maximize downstream LLM answer faithfulness.
  • Establish rigorous offline counterfactual evaluation and interleaved online A/B testing frameworks guiding weekly ranking launches.

TECHNICAL ENVIRONMENT & OFFERING

Stack: Python, PyTorch, Go/C++, custom HNSW/inverted-index search engine, ONNX/TensorRT, Ray, Kubernetes, GCP/AWS. Workplace: Hybrid in Palo Alto, CA. Compensation: $210,000 – $295,000 base salary plus high-value equity grants, comprehensive healthcare, daily meals, and 401(k).

Core Requirements

ESSENTIAL QUALIFICATIONS

  • 5+ years of machine learning engineering experience in large-scale search ranking, information retrieval, neural RAG, or recommendation systems.
  • Deep hands-on track record training contrastive dense embeddings, SPLADE/learned sparse representations, or cross-encoder rerankers in PyTorch.
  • Strong command of classical IR fundamentals (BM25, inverted indices, query understanding, entity linking, temporal decay, learning-to-rank).
  • Experience optimizing neural ranking inference latency via model distillation, INT8/FP8 quantization, ONNX/TensorRT serving, and multi-stage cascade pruning.
  • Proven ability to diagnose ranking failures on skewed, permission-partitioned corpora without violating customer zero-access data boundaries.

PREFERRED / BONUS EXPERIENCE

  • Experience combining graph/social signals (org charts, authorship, collaboration graphs) with neural semantic retrieval.
  • Prior tenure on a large-scale web search, code search, or enterprise workspace search ranking team.
  • Publications at SIGIR, WSDM, EMNLP, ACL, KDD, or NeurIPS in information retrieval or retrieval-augmented generation.

Position Telemetry

Location Palo Alto, CA (Hybrid)
Department Machine Learning
Employment type Full-time
Workplace type Hybrid
Salary range
$210k – $295k annual package