Mastodon Feed
jonny@neuromatch.social ("jonny (nonvenomous)") wrote:
the reason that its so funny that this devolves into "free VPS for everyone" is that this is sort of the shortest path to what they want to do and it must be this way or it's shit. you want a persistent computational system for someone that can do very general tasks. ok! that sounds like a virtual machine, there's lots of tools for that already. you provision an LLM inside a box and let it do computer things, you even tell it that it should be forthright about being an LLM in a box. so in order for it to do anything useful at all that you could call a "personal life assistant" it needs to be able to do arbitrary computation, rather than a specific set of canalized actions. i was surprised that there was a switch to allow arbitrary network access, but that too is somewhat inevitable given the needs of the product. you do a ton of engineering to prevent the LLM from going off the rails and doing something terrible, but by its design it should be maximally permissive to the human using it. so here you are - provisioning a persistent, permissive computing environment, run by something with an infinitely large attack surface - for your customer base that consists of 99.9% of people who have never paid you a dime, so, pretty much for free.
congratulations: the only form that this kind of product can take is a botnet factory.