Mastodon Feed: Post

Mastodon Feed

denschub@schub.social ("Dennis Schubert") wrote:

LLM bros: "woooow LLMs are so cool you can just use natural language to ask questions and they'll respond with useful stuff!"

me: *asks a question while providing the LLM the relevant context I'm working in, receiving total nonsense as a reply*

LLM bros: "nuuuh-uhhh you're holding it wrong 😤"

y'all need to listen to yourselves a bit more. ah wait, you can't, your context-window isn't large enough to properly self-reflect, eh?

Screenshot of a Mastodon reply, reading, in full: @denschub You didn't prompt it correctly. Even ChatGPT 4 gets it right: "Without adding third-party dependencies, can I compress a Data stream with zstd in Swift on an iPhone? Do not make up any answers. Use the real iOS developer documentation as your reference." Then it explains that ZSTD isn't supported and tells you everything that is supported in great detail
Screenshot of a Mastodon reply, reading, in full: @denschub So, in other words, you ask a deliberately misleading question in order to force the model to generate something you know will be incorrect. I don't know anything about iOS development, but slightly rephrasing your trick question produces a response similar sounding to what you wrote.