Mastodon Feed
Boosted by ratatui_rs@fosstodon.org ("Ratatui"):
orhun@fosstodon.org ("Orhun Parmaksız 👾") wrote:
Wondering what LLMs you can actually run on your hardware? 🤔
👾 **llmfit** — Find the best models for your RAM, CPU, and GPU
💯 Detects your system and ranks hundreds of models by fit, speed, quality & context
🦀 Written in Rust & built with @ratatui_rs
⭐ GitHub: https://github.com/AlexsJones/llmfit
Attachments:
- gifv: a4fbcdf19e298ffc.mp4