Apple Silicon LLM runtime supporting Gemma 4 and Qwen 3.6 MTP modes
Realistic first-contribution target: active project, 21 open issues, small enough for a newcomer PR to land.
Derived from this repo's Cargo dependencies and activity — difficulty is an estimate from codebase size and scope.
Matched by dependency overlap in Cargo manifests — each card notes the most distinctive crates both projects share.
Apple Silicon LLM runtime supporting Gemma 4 and Qwen 3.6 MTP modes
The official Rust library for the Edgee AI Gateway
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
MLX-based experimental inference engine
High-performance LLM inference engine — drop-in replacement for Ollama with faster multi-turn inference, lower TTFT, and higher throughput through prefix caching and continuous batching.
Local AI image generation CLI — FLUX, SD 1.5, SDXL & Z-Image diffusion models on your GPU
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
Camelid: a Rust-native local inference backend with evidence-gated model compatibility.
Pure Rust Inference Engine