baldur@toot.cafe ("Baldur Bjarnason") wrote:
The seven step “OMG! My AI tool is suddenly degrading” cycle:
1. An LLM tool is released. The company claims it’s a miracle that will change everything
2. Early adopters try it on straightforward tasks, find it seems to work, though they don’t really check it. “OMG! It’s a miracle that will change everything!”
3. Adopters apply it to an increasing variety of tasks. Some work; some don’t because the tool is still fundamentally random
4. Novelty wears off and error reports start
1/2