aredridel@kolektiva.social ("Mx. Aria Stewart") wrote:
Personalization systems are actually the AI technology I have the most beef with: I don't think we've fully reckoned with the algorithmic manipulation of information they do. Suddenly the info sphere is not an object you can interrogate, but you become the object, and the infosphere around us is made into a mirror.
Weirdly, LLMs used well are actually _better_ about this because they're somewhat more able to be interrogated (though naive questioning is not probing so much why as one would hope). But the breadth of the corpus and the freedom we have to query within it are currently new capabilities. Not to say that some companies aren't well on their way to researching how to personalize that into a reflection again. Google must be stopped, and I trust OpenAI just as little. People's chats still end up adding quite a reflective lens on things, but the raw access is still there if we want to make use of it.