Anthropic • 📍 San Francisco / US Remote •
$240k - $320k USD
Architect low-latency distributed token generation pipelines, disaggregated KV-cache engines, and high-throughput Rust control planes for Claude frontier models.
⚡ 10 Verified Open Roles • Avg Compensation $193k–$259k USD
Remote Rust AI Infrastructure & LLM Inference Jobs
Browse verified high-paying remote Rust engineering jobs in LLM inference, vLLM/TensorRT backends, CUDA/ROCm kernels, vector databases, and AI infrastructure.
Together AI • 📍 US / EU Remote •
$195k - $265k USD
Scale distributed LLM inference engines written in Rust. Optimize PagedAttention, KV-cache fragmentation, and low-latency speculative decoding.
Hugging Face • 📍 Worldwide Remote •
$185k - $240k USD
Lead open-source development on Text Generation Inference (TGI), Candle, Safetensors, and SIMD Rust tokenizers used across the AI ecosystem.
Modal Labs • 📍 US / Americas Remote •
$190k - $260k USD
Build sub-second cold-start GPU container runtimes, content-addressable FUSE filesystems, and distributed cluster schedulers in 100% Rust.
Qdrant • 📍 Europe / US Remote •
$175k - $235k USD
Push the hardware limits of billion-scale vector similarity search using AVX-512/NEON SIMD quantization, asymmetric binary indices, and io_uring disk traversal.
LanceDB • 📍 US / Canada Remote •
$180k - $245k USD
Design columnar storage formats (Lance) in Rust built on Apache Arrow and DataFusion for petabyte-scale LLM training datasets and vector search.
Polars • 📍 Worldwide Remote •
$170k - $225k USD
Work on the Polars streaming execution engine in Rust: morsel-driven parallelism, vectorized hash joins, and distributed shuffle across cloud workers.
Baseten • 📍 US Remote •
$185k - $250k USD
Build low-overhead Rust proxy dataplanes, WebSocket/gRPC bi-directional streaming routers, and cold-start weight streamers for multi-cloud GPU clusters.
CoreWeave • 📍 US Remote / East Coast •
$215k - $295k USD
Build bare-metal Rust node agents, InfiniBand/RoCEv2 telemetry daemons, and automated GPU health verification across 32,000+ H100/B200 clusters.
Astral • 📍 Worldwide Remote •
$190k - $255k USD
Build fast developer and AI environment tooling in Rust (uv, Ruff, ty) with custom zero-copy archive extraction and lock-free dependency resolution.
Rust Systems Talent Radar • Weekly $200k+ Role Dispatch
Get Verified $190k to $320k Rust Roles Direct to Your Inbox
Filter by your core crate and kernel specialization. We send one low-noise Sunday dispatch with verified salary bands, architecture notes, and direct Greenhouse/Ashby engineering links.
✓ Subscribed to the Rust Systems Talent Radar
Your specialization filter is saved. Watch for Sunday's systems architecture and open role digest.
Hiring for AI Infrastructure & LLM Inference?
Get your Rust engineering role indexed on Google for Jobs within 24 hours and featured at the top of our AI Infra & LLM category.