𓁟 host1.bitchan.one

𓀐 @K*VgvWu7: /lmg/ - a general dedicated to the discussion and development of local language models. News >(10/26) LiquidAI releases LFM3 1.7B and 2B: https://hf.co/collections/LiquidAI/lfm3 >(10/26) Baidu Unlimited-OCR-2 3B released https://hf.co/baidu/Unlimited-OCR-2 >(10/23) NVIDIA Nemotron 3.5 Bolt E4B, postrained model: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16 >(10/23) MiniMax-M3.1-Flash 428B-A23B released: https://hf.co/MiniMaxAI/MiniMax-M3.1-Flash >(10/21) Recursive Flint 40B-A2.5B rele…

I've got a theoretical of like 130gb/s on 8 channel ddr4 (512gb, 64gb sticks) and it's dogshit slow, mostly just use the 192gb vram for the model and punish ngrams onto ram, anything offloaded worse than this is cope and even this is cope

⧖expiring ~19d0/1 kept1w ago

𓀐 @j3Rbr*Ui

⏱ 1w 👍 0

⬆ upvote 0