Mastodon Feed: Post

Mastodon Feed

Boosted by glyph ("Glyph"):
jonny@neuromatch.social ("jonny (nonvenomous)") wrote:

@jdp23
Its been said to death, but the thing that LLMs do that's useful for programming is basically serve as an extremely lossy compressed index to all the code in the training set while making it look like a miracle that you are creating. If we instead had an actual search index where I can search for related code in an abstract AST space, see prior implementations in their context with proper attribution, compare where mine and their differ, that would be about a billion times more useful than an LLM for code. Something like the Wikimedia algorithm library would be a better tool than an LLM if it had the same amount of money poured into it, but it wouldn't get that money because it doesn't launder authorship or make you feel like a special genius.