Mastodon Feed
dysfun@treehouse.systems ("gaytabase") wrote:
i am learning a great deal already as i get set up
- llama.cpp seems ok? the documentation is patchy and things could be clearer, but with some educated guesses it wasn't too bad. it probably helps that i used to be a linux distro maintainer (and gosh have all those memories been flooding back!)
- everything north of llama.cpp is vibe-coded shit. i am going in with the expectation it is shit and somehow it is worse than i was expecting. at every layer there are surprises.
- build procedures tend towards 'download these binaries' with no instructions for not doing that.
- nobody is testing these binaries, or at least not the release tarball i used, clearly
- i can probably look forward to adding more and more services to this stack to unlock more excitingly broken functionality.
- i had my first forced reboot in weeks earlier. i think it was the radeon card but i can't be sure.
i am on day 3 of packaging all this shit and i still do not have an agent running, but i'm working on it.