llama-cpp-rs

A wrapper around the llama-cpp library for rust, including new Sampler API from llama-cpp.