π“Ÿ host1.bitchan.one

𓀐 @k+jiwVkN

⏱ 2w seenβ›“ 0πŸ‘ 0β§– 1

filter [-]

languages:onother

Is it a me issue or are all Q4 Gemma quants garbage that start glitching at 30k tokens? I don't have this problem with other models. Q5 seems to be a bit more stable. I'm not quanting kv-cache.⏱ 2w↩