𓁟 host1.bitchan.one

𓀐 @kMtY6qp-: /lmg/ - a general dedicated to the discussion and development of local language models. News >(10/27) NVidia releases Nemotron 3.5 Transcribe 30B-A4B https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B >(10/26) XHToken releases Spark-X2.6-1.7B: https://hf.co/XHToken/Spark-X2.6-1.7B >(10/26) LiquidAI releases LFM3 1.7B and 2B: https://hf.co/collections/LiquidAI/lfm3 >(10/26) Baidu Unlimited-OCR-2 3B released https://hf.co/baidu/Unlimited-OCR-2 >(10/23) NVIDIA Nemotron 3.5 Bolt E4B, postr…

something is fucked with my setup on LM Studio (I know, I know) I'm only getting 3.5 t/s decode on Gemma 4 31b Q4_K_M at 32k context, on a 4080 with 32GB of system RAM everything is on the latest version is it because I have DDR4 RAM? Is it LM Studio? Is my shit just fucked?

⧖expiring ~21d0/1 kept1w ago

𓀐 @m~wzEpeV

⏱ 1w 👍 0

⬆ upvote 0