https://github.com/phronmophobic/llama.clj: Run LLMs locally. A clojure wrapper for https://github.com/ggerganov/llama.cpp.
v0.9.0: Updated to work with llama.cpp b7325 which adds supports for lots of new models.
glad I found this, I wrote a clojure jlama wrapper and it was working decently for chat features, but this supports alot more! thanks for all the work 🙏
Let me know if you run into any issues!