LLM inference in C/C++

Java Bindings for llama.cpp - A Port of Facebook's LLaMA model in C/C++

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production