Fork me on GitHub
#announcements
<
2024-03-02
>
phronmophobic22:03:23

https://github.com/phronmophobic/llama.clj version 0.8.2: Run LLMs locally. A clojure wrapper for llama.cpp. • Updated to be compatible with a more recent version of llama.cpp (https://github.com/ggerganov/llama.cpp/releases/tag/b2291) which adds many improvements including support for new models like BERT and gemma(The gguf file in the huggingface gemma repo is bogus. Use llama.cpp's convert-hf-to-gguf.py to generate a compatible gguf model). • Added high level wrappers for generating embeddings.

❤️ 13
🎉 8
🦙 3