jncraton/languagemodels is a simple Python library for running LLMs locally. Supports instruction and embedding use cases. Chooses models according to available RAM.
More information on the LocalLLaMA subreddit from the author
https://github.com/jncraton/languagemodelsOpen linkView original on lemmy.sdf.org
No replies yet