Mastodon Feed
Boosted by pixxl:
haskal@types.pl ("witch hat hacker :verified_dragon: :vt1: :vt2:") wrote:
reminder that the way popular LLM products generate for example JSON output is that they run the LLM, check if the output has any parse errors, and if so they just fucking run the LLM again in a loop until the output is syntactically valid
like
tell me this is normal