Mastodon Feed
jonny@neuromatch.social ("jonny (nonvenomous)") wrote:
Its pitiful how they had to make a whole special-cased system for handling streaming token output along with batched message output where we get it for free by virtue of actually having a good graph model that can handle cardinality expansion and contraction