Why Polars Uses Rust Here
Latency spikes kill throughput. Polars utilizes a custom morsel-driven work-stealing scheduler in Rust with cache-conscious SIMD kernels and zero-copy Arrow buffers to saturate modern multi-socket CPU memory bandwidth.
We are hiring a Senior Rust Query Engine Developer (Polars Cloud & Streaming Engine) (Worldwide Remote) at $170,000 to $225,000 USD. Optimize out-of-core streaming hash joins, cardinality estimation in the lazy query planner, and Parquet predicate pushdown.
Day-to-Day Engineering Scope
- Architect and benchmark core crates built around Apache Arrow and Parquet and PyO3 and Serde and Tokio.
- Replace allocation-heavy paths with zero-copy buffers, arena allocators, or lock-free ring queues.
- Pair with upstream open-source maintainers and internal platform teams to ship fault-tolerant releases.
Technical Expectations & Pay
- Demonstrated mastery of Rust ownership, pinning, lifetimes, and concurrency primitives (Apache Arrow, Parquet, PyO3).
- Comfort reading assembly output (`cargo asm`), kernel tracepoints, or wire protocol captures when abstractions leak.
- Verified package: $170,000 to $225,000 USD base salary plus competitive equity and global remote healthcare.
