𓁟 host1.bitchan.one

𓀐 @*wR3-qwu: /lmg/ - a general dedicated to the discussion and development of local language models. News >(10/29) Mistral Large 4 (Le Chonk) 1T-A52B released: https://mistral.ai/news/mistral-large-4-oss >(10/27) NVidia releases Nemotron 3.5 Transcribe 30B-A4B: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B >(10/26) XHToken releases Spark-X2.6-1.7B: https://hf.co/XHToken/Spark-X2.6-1.7B >(10/26) LiquidAI releases LFM3 1.7B and 2B: https://hf.co/collections/LiquidAI/lfm3 >(10/26) Baidu Unlimited…

I just realized I'm running a 19GB model (Gemma4-26B-A4B Q_5_K) on a 4070Super and it's reasonably fast to boot. How does that work?

⧖expiring ~21d0/1 kept1w ago

𓀐 @VMYCtGtr

⏱ 1w 👍 0

⬆ upvote 0