jncraton/languagemodels is a simple Python library for running LLMs locally. Supports instruction and embedding use cases. Chooses models according to available RAM.
jncraton/languagemodels is a simple Python library for running LLMs locally. Supports instruction and embedding use cases. Chooses models according to available RAM.
github.com
GitHub - jncraton/languagemodels: Explore large language models in 512MB of RAM
More information on the LocalLLaMA subreddit from the author