Mastodon Feed
Boosted by soatok@furry.engineer ("Soatok Dreamseeker"):
rysiek@mstdn.social ("Michał "rysiek" Woźniak · 🇺🇦") wrote:
RE: https://cyberplace.social/@GossiTheDog/116676826944489315
I need people to understand that stuff like this will keep happening, for two reasons:
1. To be useful these chatbots need to have full access to everything they are supposed to "manage"; otherwise they are pointless.
2. Trying to stop prompt injection is basically trying to semantically filter natural language.
These tools have no model of the world, no ontology to anchor any "safety instructions" in. There will always be a way to talk one's way around them.