osspath
Archive
Repos
osspath
Jobs
Repos
Funding
Ecosystems
Orgs
Explore
Search
⌘K
← Repositories
EricLBuehler
candle-vllm
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
678
Stars
80
Forks
28
Issues
MIT
License
active
ai
axum
Last GitHub commit: Jun 22, 2026
View on GitHub →
Ecosystem
ai
axum
Contribution
28 open issues →
active project
Dependencies (42 total)
serde
serde_json
clap
tokio
thiserror
anyhow
rand
chrono
+34 more
← Browse all repos
Something inaccurate? Report a correction →