𓁟 host1.bitchan.one

+⧖/lmg/ - a general dedicated to the discussion and development of local language models. News >(10/27) NVidia releases Nemotron 3.5 Transcribe 30B-A4B https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B >(10/26) XHToken releases Spark-X2.6-1.7B: https://hf.co/XHToken/Spark-X2.6-1.7B >(10/26) LiquidAI releases LFM3 1.7B and 2B: https://hf.co/collections/LiquidAI/lfm3 >(10/26) Baidu Unlimited-OCR-2 3B released https://hf.co/baidu/Unlimited-OCR-2 >(10/23) NVIDIA Nemotron 3.5 Bolt E4B, postr… /lmg/ - a general dedicated to the discussion and development of local language models. News >(10/27) NVidia releases Nemotron 3.5 Transcribe 30B-A4B https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B >(10/26) XHToken releases Spark-X2.6-1.7B: https://hf.co/XHToken/Spark-X2.6-1.7B >(10/26) LiquidAI releases LFM3 1.7B and 2B: https://hf.co/collections/LiquidAI/lfm3 >(10/26) Baidu Unlimited-OCR-2 3B released https://hf.co/baidu/Unlimited-OCR-2 >(10/23) NVIDIA Nemotron 3.5 Bolt E4B, postr…
𓀐 @jYNLVv57: Anyone been paying attention to what geohot has been doing? The other day he posted 6x R9700 hitting 250 tps decode / 5k prefill. Now some insane ssdmaxxing setup running kimi k3 at 40 tps

>16 TB RAID >238 GB/s People posted better ssdmax builds for cheaper, and apparently they don't get anywhere near 40 tps.

⧖expiring ~5d0/1 kept1w ago

𓀐 @?U7mW7?*

⏱ 1w 👍 0

⬆ upvote 0