Mastodon Feed: Post

Mastodon Feed

Boosted by jwz:
xgranade@wandering.shop ("Cassandra is only carbon now") wrote:

One adjacent example of intentional miscommunication: the word "open" as applied to AI. An LLM cannot be "open source" unless you have access to the training data and methodologies. "Open weights" is a craven attempt to misdirect the word "open" — we might as well say that bunch of machine code is "open" because you can disassemble it.

LLMs can only be trained at extremely disproportionate scale, such that they cannot be "open" in any meaningful sense.