It isn't though, now that you can run large MoEs on RAM. — bitchan

𓁟 host1.bitchan.one

𓀐 @zMNNxvLL: /lmg/ - a general dedicated to the discussion and development of local language models. News >(10/23) NVIDIA Nemotron 3.5 Bolt E4B, postrained model: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16 >(10/23) MiniMax-M3.1-Flash 428B-A23B released: https://hf.co/MiniMaxAI/MiniMax-M3.1-Flash >(10/21) Recursive Flint 40B-A2.5B released: https://recursive.com/updates/introducing-recursive-flint >(10/21) Korean Raon-1 mini 30B-A4B released: https://hf.co/KRAFTON/Raon-1-mini-preview >(10/20) Orn…

It isn't though, now that you can run large MoEs on RAM.

⧖expiring ~16d0/1 kept1w ago

⏱ 1w 👍 0

⬆ upvote 0