𓁟 host1.bitchan.one

/lmg/ - a general dedicated to the discussion and development of local language models Previous threads: >>110143818 & >>110140077 ►News >(10/23) NVIDIA Nemotron 3.5 Bolt E4B, postrained model: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16 >(10/23) MiniMax-M3.1-Flash 428B-A23B released: https://hf.co/MiniMaxAI/MiniMax-M3.1-Flash >(10/21) Recursive Flint 40B-A2.5B released: https://recursive.com/updates/introducing-recursive-flint >(10/21) Korean Raon-1 mini 30B-A4B released: https://hf…

⧖expiring ~15d0/30 kept2w ago

𓀐 @R6iZ4g*v

⏱ 2w 👍 0

⬆ upvote 0

[⇥] sort oldest ⏱

⬆[⏱]₿⚠

👍👎✔

𓀐↩⛓⚠

[⇥] flip, oldest first

filter [-]
𓀐 @py4oVnb=: >>110148330 Is this link legitimate? https://huggingface.co/HauhauCS/ Why is there 'uncensored' written on the models? I thought local models were uncensored by default. If not, does that mean other places have censored models? Sorry for being dumb+

⬆ upvote 0↩ reply 0

𓀐 @Z4ScE2_L: I've spent a really long time experimenting with different configs, settings and harnesses to optimise QFN3.8 in my PC. But Qwen4 is dropping in two or three months. Is it worth using it if I have to start experimenting all over again? I don't think I'd want to switch unless it has a clear jump in performance because QFN is pretty good enough for me. I just wish we'd get local LLMs advancements for just a few more years until we get to Opus5.5 level so I can finally get rid of my subscriptions.+

⬆ upvote 0↩ reply 0

𓀐 @WcX~NzN9: I hope all this negative press makes Moonshot release the unnerfed K3.1 model.+

⬆ upvote 0↩ reply 0

𓀐 @GQ-5B~m8: >>110150021 Qwen Image Edit 2.1 gives shoddy results. There are better ways.+

⬆ upvote 0↩ reply 0

𓀐 @HJySpwdt: >all of these have been posted in /lmg/ dariobot puts in so many hours I stopped even noticing the other shills+

⬆ upvote 0↩ reply 0

𓀐 @UtqdTtHi: What's the point of bf16 unlocks if your card is vram crippled and won't run anything useful anyway? I can only see image genners benefiting here+

⬆ upvote 0↩ reply 0

𓀐 @LgRqbopv: >>110148998 Is there a lora for this swimsuit?+

⬆ upvote 0↩ reply 0

𓀐 @sb~b*ads: Why is llamacpp taking 18gb of RAM if all my models and their KV caches are 100% on VRAM?+

⬆ upvote 0↩ reply 0

𓀐 @Vd~wvo*4: Big day for deepseekbros+

⬆ upvote 0↩ reply 0

𓀐 @8C5_?BY=: >>110149561 >With Strata, every build runs on a single GPU with 12 GB of VRAM. See Usage. not anymore+

⬆ upvote 0↩ reply 0

𓀐 @Mp2YTfff: Run Gemma 4 until the end of times.+

⬆ upvote 0↩ reply 0

𓀐 @RFdrv6X4: god fucking damn strata's config handling is extremely niggerish why does it create a system-dependent global config regardless of folder? fucking retarded dev+

⬆ upvote 0↩ reply 0

𓀐 @h*-CLQTq: Whoever said use qwen flash next on iq3_s I love you it's so much faster+

⬆ upvote 0↩ reply 0

𓀐 @DQYDw2uU: >Researchers proved every major LLM is secretly biased against men. https://x.com/HowToPrompt__/status/2113638943124017332 https://www.sciencedirect.com/science/article/pii/S2451958824001660+ 1

⬆ upvote 0↩ reply 1

𓀐 @phqNUt9q: >>110150211 more news at 10+

⬆ upvote 0↩ reply 0

𓀐 @*7-_R?2a: >>110150245 Fuck off, nazi.+

⬆ upvote 0↩ reply 0

𓀐 @hb=_wWUx: >>110150347 "uncensored" models are lobotomized variants catering to the <80IQ subset of this community with no prompting skill beyond going "pls generate child rape" on zero context to a model and then cry about censorship if it gets refused+

⬆ upvote 0↩ reply 0

𓀐 @*8Yv5xNn: Does anyone understand why nvidia halves instruction rate for bf16/fp32 for gamer GPUs? This seems to have been known for years (I found old blog posts talking about it) so why does nobody seem to care? Is it malicious, to force people who want to use them for AI to buy their much more expensive datacenter cards instead? Or is there a good reason? This is nvidia potentially fucking over millions of customers so I am surprised it's not big news.+

⬆ upvote 0↩ reply 0

𓀐 @DyaCPSz*: No matter how bad your life might be, it could always be worse. You could be a cloudcuck.+ 2

⬆ upvote 0↩ reply 2

𓀐 @A2XcoBNb: >>110151388 ok, but how do you do it locally?+

⬆ upvote 0↩ reply 0

𓀐 @*sAGXvhG: >>110151388 cloud models are that dangerous though+

⬆ upvote 0↩ reply 0

𓀐 @k+jiwVkN: Is it a me issue or are all Q4 Gemma quants garbage that start glitching at 30k tokens? I don't have this problem with other models. Q5 seems to be a bit more stable. I'm not quanting kv-cache.+

⬆ upvote 0↩ reply 0

𓀐 @QM6xCZXk: my cousin says we wont get cheap hardware from china cause the chinese citizens are buying it all to run data centers in their apartments+

⬆ upvote 0↩ reply 0

𓀐 @Xswp2n5T: so now that the dust has settled, is k3.1 actually good?+

⬆ upvote 0↩ reply 0

𓀐 @YBv9uf9d: Kimisisters... not like this!!+

⬆ upvote 0↩ reply 0

𓀐 @Esx_4RtP: >>110148466+

⬆ upvote 0↩ reply 0

𓀐 @4_y9j7~q: Bahahaah 500 prefill, 20tk/s decode on fat dipsy, I feel like a god.+

⬆ upvote 0↩ reply 0

𓀐 @ECyH-6D?: 24GBsisters, how are we coping?+

⬆ upvote 0↩ reply 0

𓀐 @N6+LzN+~: Are your witches ready for Halloween, /lmg/? higher quality: https://files.catbox.moe/f9tnf2.webm director's cut: https://files.catbox.moe/h1snb6.webm+

⬆ upvote 0↩ reply 0