Mastodon Feed: Post

Mastodon Feed

kornel ("Kornel") wrote:

Mozilla has easy-to-run single-file servers for LLMs (#AI/hallucinators), and the Mixtral-8x7B-Instruct is pretty coherent. Ability to run one locally solves a lot of privacy and centralization issues:

https://github.com/Mozilla-Ocho/llamafile