Mastodon Feed
dysfun@treehouse.systems ("gaytabase") wrote:
oh yeah that one was much quicker. this is with unsloth/gemma-4-E2B-it-GGUF:UD-Q4_K_XL and averaged 9.78 tokens/second. and i'm pretty sure i fixed vulkan now.
apparently i could maybe get it faster if i could get rocm working but rocm is terrible software and they officially don't support my card even to start with.