π“Ÿ host1.bitchan.one

𓀐 @4hct?gtn

⏱ 1w seenβ›“ 0πŸ‘ 0β§– 1

filter [-]

languages:onother

unsloth's goofs are genuinely better in this case, the google goofs are not proper Q4_0 across the board, the embeddings are in Q6_K in theirs for e.g and various testing showed that the qat does behave slightly better if it's actually being run at q4 beside being faster and a bit smaller to boot https://huggingface.co/unsloth/gemma-4-31B-it-qat-GGUF it's not the first time google is being retarded while publishing goofs either, these were the only good goofs for gemma 3: https://huggingface.co/stduhpf/google-gemma-3-27b-it-qat-q4_0-gguf-small⏱ 1w↩