Minimalist ML framework for Rust
⑂ 1.8k◎ 908
Crate
cudarc
38
Repositories
97%
Actively maintained
36
Updated ≤ 30 days
64k
Total stars
35
Owners
Counted from the Cargo.toml manifests of the 38 indexed repositories that declare cudarc as a dependency — not download counts. Dependency data last verified 2026-09-16.
Often used with
Crates that show up unusually often in cudarc projects. The most distinctive pairings rank first — crates these projects use far more than the average indexed Rust project does, not just crates that are popular everywhere. Each percentage is the share of cudarc projects that also use it.
safetensors26.3%objc2-metal18.4%oneshot15.8%metal15.8%wide15.8%candle-nn21.1%half52.6%candle-core23.7%candle-transformers15.8%hf-hub28.9%numpy18.4%rustfft18.4%tokenizers36.8%ndarray42.1%rand_distr28.9%ort18.4%memmap252.6%cc18.4%minijinja21.1%parquet21.1%libloading34.2%arrow18.4%pyo342.1%rand_chacha21.1%
Used by these organizations
38 repositories · 36 pushed in the last 30 days
A Datacenter Scale Distributed Inference Serving Framework
⑂ 1.6k◎ 1.5k
ML-powered manga translator, written in Rust.
⑂ 391◎ 135
A blazing fast inference solution for text embeddings models
An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Linux Foundation.
A portable accelerated SQL query, search, and LLM-inference engine, written in Rust, for data-grounded AI apps and agents.
⑂ 230◎ 846
Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference
⑂ 287◎ 111
Inference at the speed of light.
⑂ 232◎ 46
Multi-platform high-performance compute language extension for Rust.
⑂ 244◎ 177
Apache Mahout - an environment for quickly creating scalable, performant machine learning applications.
⑂ 997◎ 81
rvLLM: High-performance LLM inference in Rust. Drop-in vLLM replacement.
🦀 Low-level 3D Computer Vision library in Rust
⑂ 198◎ 79
Pure Rust + CUDA LLM inference engine
⑂ 108◎ 87
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
⑂ 108◎ 87
Pure Rust Inference Engine
⑂ 105◎ 235
NextPlaid, ColGREP: Multi-vector search, from database to coding agents.
From-scratch Rust+CUDA inference engine, bit-exact by construction — NVFP4, MoE, MTP speculative decoding, tuned against measured limits of one RTX 5090 Laptop (sm_120a).
SciRS2 - Scientific Computing and AI in Rust., providing SciPy-compatible APIs while leveraging Rust's performance, safety, and concurrency features. Unlike traditional scientific libraries
⑂ 34◎ 3
Camelid: a Rust-native local inference backend with evidence-gated model compatibility.
⑂ 29◎ 9
High-performance KV cache storage for LLM inference — GPU offloading, SSD caching, and cross-node sharing via RDMA. Works with vLLM and SGLang.
Rust-native GPU operator library for LLM inference, built with cuda-oxide
KV cache control plane and evaluation platform for LLM inference
High-performance quantitative finance in Rust — 120+ stochastic processes, option pricing, calibration, fixed income, risk & copulas, with SIMD/GPU acceleration and Python bindings.
⑂ 11◎ 2
Rust inference package experiments
Accelerated Zero-knowledge Virtual Machine by Non-uniform Prover Based on GKR Protocol
⑂ 43◎ 98
Protein and molecule viewer, editor, simulator
ODE solver library in Rust
A machine learning library built with user convenience at its core
⑂ 5◎ 5
Next Generation Machine Learning, Statistics and Deep Learning in PURE Rust
⑂ 21◎ 462
A general-purpose extensible tensor computation library in Rust with CPU/GPU support
⑂ 4◎ 23
A Rust Library for High-Performance Tensor Exchange with Python
iris-mpc repository
Local AI image generation CLI — FLUX, SD 1.5, SDXL & Z-Image diffusion models on your GPU
⑂ 1◎ 34
Minimalist, performant and auditable verifiable RISC-V vm written in Rust
Rust Implementation for WebNN
⑂ 10◎ 50
memra — from-scratch LLM inference engine for NVIDIA RTX 50-series (Rust + CUDA)