Mastodon Feed: Post

Mastodon Feed

Boosted by glyph ("Glyph"):
chaucerburnt@aus.social ("Chaucerburnt") wrote:

People need to stop asking LLMs "why did you do [thing]?" and treating the answer as authoritative. LLMs do not "remember" their thought processes in that way, and even if they did, the answers would likely not be human-understandable.

When you ask a LLM this question, you're asking it to construct the kind of explanation that a human might give in a similar conversation. Treating this as the *actual* answer is likely to lead you astray.

https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue