𓁟 host1.bitchan.one

+⧖/lmg/ - a general dedicated to the discussion and development of local language models. News >(10/27) NVidia releases Nemotron 3.5 Transcribe 30B-A4B https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B >(10/26) XHToken releases Spark-X2.6-1.7B: https://hf.co/XHToken/Spark-X2.6-1.7B >(10/26) LiquidAI releases LFM3 1.7B and 2B: https://hf.co/collections/LiquidAI/lfm3 >(10/26) Baidu Unlimited-OCR-2 3B released https://hf.co/baidu/Unlimited-OCR-2 >(10/23) NVIDIA Nemotron 3.5 Bolt E4B, postr… /lmg/ - a general dedicated to the discussion and development of local language models. News >(10/27) NVidia releases Nemotron 3.5 Transcribe 30B-A4B https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B >(10/26) XHToken releases Spark-X2.6-1.7B: https://hf.co/XHToken/Spark-X2.6-1.7B >(10/26) LiquidAI releases LFM3 1.7B and 2B: https://hf.co/collections/LiquidAI/lfm3 >(10/26) Baidu Unlimited-OCR-2 3B released https://hf.co/baidu/Unlimited-OCR-2 >(10/23) NVIDIA Nemotron 3.5 Bolt E4B, postr…
𓀐 @dr=vbSiM: Why did nobody tell me I would get 25 tok/s with Qwen3.8-Flash-Next-IQ3_XXS on my 6gb VRAM laptop with 64gb DDR5? Strata docs say you need 12gb vram but it just works at 32k context. This is the fuckiest sorcery I've seen since I first discovered llama.cpp, should I try GLM next?

The docs are vibecoded and LLMs are very conservative with numbers. People have no idea how efficient strata and polystrata are. Llama.cpp has no chance anymore. There is no excuse for anyone of any level of hardware to not run qwen next AI agents right now.

⧖expiring ~6d0/1 kept1w ago

𓀐 @b~j_wPi9

⏱ 1w 👍 0

⬆ upvote 0