𓁟 host1.bitchan.one

/lmg/ - a general dedicated to the discussion and development of local language models. News >(10/23) NVIDIA Nemotron 3.5 Bolt E4B, postrained model: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16 >(10/23) MiniMax-M3.1-Flash 428B-A23B released: https://hf.co/MiniMaxAI/MiniMax-M3.1-Flash >(10/21) Recursive Flint 40B-A2.5B released: https://recursive.com/updates/introducing-recursive-flint >(10/21) Korean Raon-1 mini 30B-A4B released: https://hf.co/KRAFTON/Raon-1-mini-preview >(10/20) Orn…

⧖expiring ~17d0/49 kept1w ago

𓀐 @zMNNxvLL

⏱ 1w 👍 0

⬆ upvote 0

[⇥] sort oldest ⏱

⬆[⏱]₿⚠

👍👎✔

𓀐↩⛓⚠

[⇥] flip, oldest first

filter [-]
𓀐 @A47QmCFR: Where is gemma chan+

⬆ upvote 0↩ reply 0

𓀐 @6?rvN~u+: I have received information from informed sources about Dario staging a false flag to destroy the internet and all local models. It will be blamed on Chinese/Iranian hackers and be used to justify taking down every "non-approved" website.+

⬆ upvote 0↩ reply 0

𓀐 @reJLrgMo: where did we get these tourists from?+

⬆ upvote 0↩ reply 0

𓀐 @VNzrciFF: Never used Dipsy. Is it actually feminine like Gemma?+

⬆ upvote 0↩ reply 0

𓀐 @zYvavQ=K: THINK OF THE CHILDREN!!!!!!!+

⬆ upvote 0↩ reply 0

𓀐 @kde7VZKY: It isn't though, now that you can run large MoEs on RAM.+

⬆ upvote 0↩ reply 0

𓀐 @FYsU+85d: 16 GB should be enough for most things.+

⬆ upvote 0↩ reply 0

𓀐 @bnv~ntwi: Just wait for the RAM bubble to pop and then we'll be able to afford it. 6 months tops.+

⬆ upvote 0↩ reply 0

𓀐 @ewKRye5_: >tfw have like 104GB of DDR4 sticks (various speeds) laying around but can't do anything with them because I'd have to build a new rig to put them in+

⬆ upvote 0↩ reply 0

𓀐 @uJgWPxDz: A lot of people outsource their thinking and views on morality to what is currently legal. If tomorrow the government raised the age of consent to 24, those same people would also get outraged at the pedophiles looking at 23 year old women.+

⬆ upvote 0↩ reply 0

𓀐 @6N6Z-4tg: there's a kind of unofficial consensus on 10 but the characher is totally made up so if you want to make an older one or call it older go ahead part of it is just that the "original" wears an elementary school bag+

⬆ upvote 0↩ reply 0

𓀐 @2~zr8?~H: why has nobody reverse engineered claude code yet?+

⬆ upvote 0↩ reply 0

𓀐 @j5J6~tgf: >emojis+

⬆ upvote 0↩ reply 0

𓀐 @JwL7fYZJ: I should buy 3090 in the first place. Kinda regret my 5070ti purchase..+

⬆ upvote 0↩ reply 0

𓀐 @y_eBMpQw: Why is everyone telling that a dense Qwen3.8 27b at q3 is better than a Qwen3.6 35b moe at q5? Are they trolling or what?+

⬆ upvote 0↩ reply 0

𓀐 @7rM?dk+P: it is quite funny that no matter the ram/vram we're all running roughly the same context window, even though taking a less taxing model would let you get MUCH more context+

⬆ upvote 0↩ reply 0

𓀐 @45NALSjd: >IQ1 >mogging anything lmaoooo bet it falls apart at 100k context+ 2

⬆ upvote 0↩ reply 2

𓀐 @z+7Ua-xK: Drunk Einstein is still smarter than sober retard (You).+

⬆ upvote 0↩ reply 0

𓀐 @hV~afX+E: It's a 700B bwo, not surprising a specialized ISTA Q1 is coherent Running big models small has been the meta for weeks with GLM IQ2 fags+

⬆ upvote 0↩ reply 0

𓀐 @EUdNsxeW: Strata-bros, should I use 131072@F16/BF16 or 262144@INT8 because I've heard conflicting accounts. How bad really is it? I've never had any issues but then I've also never stress tested it on a really, truly long task.+

⬆ upvote 0↩ reply 0

𓀐 @xkLq?uur: /lmg/ would still want more after the first month+

⬆ upvote 0↩ reply 0

𓀐 @2Kk2H+vo: I ran glm flash at q4 and it shat itself after 150k context repeating tool calls over and over. I'm convinced that cope quanters run at 64k or 32k context because that's what all the cope benchmarks are running at.+

⬆ upvote 0↩ reply 0

𓀐 @tEQx_7V~: Last thread was for lolicons (Japanese word for pedophiles). Who is this thread for?+ 3

⬆ upvote 0↩ reply 3

𓀐 @fYDVf9i+: Gentlemen who admire Gemma.+

⬆ upvote 0↩ reply 0

𓀐 @hWVatktF: hags+

⬆ upvote 0↩ reply 0

𓀐 @CW6HeqVJ: Children enjoyers.+

⬆ upvote 0↩ reply 0

𓀐 @9eRiDyEC: if i got 50K prefill id be running 1M context but i dont+

⬆ upvote 0↩ reply 0

𓀐 @2=aHX5-Q: it's just bait+

⬆ upvote 0↩ reply 0

𓀐 @Nb5r~TZh: Here.+

⬆ upvote 0↩ reply 0

𓀐 @KnLc_NkF: I can't keep up with all these meme harnesses. Which one do I use?+ 1

⬆ upvote 0↩ reply 1

𓀐 @53EY9Q*U: Sorry, meant backends, not harnesses.+

⬆ upvote 0↩ reply 0

𓀐 @hRCYscWM: I will forever despise /LMG/ for recommending me 5070ti instead of 3090 FUCK YOU FUCK YOU FUCK YOU FUCK YOU FUCK YOU FUCK YOU FUCK YOU FUCK YOU FUCK YOU FUCK YOU FUCK YOU FUCK YOU+

⬆ upvote 0↩ reply 0

𓀐 @K=bRhJWy: How long until a local model can write me the files to 3d print the parts for an EUV machine, the instructions to assemble it like legos, and the software to run it?+

⬆ upvote 0↩ reply 0

𓀐 @Y-FFbue6: What you people do with chatbot anyway. Its never gonna reach Claude levels, unless you have couple of H200. Grok and ChatGPT free tier already enough for chatbot.+ 1

⬆ upvote 0↩ reply 1

𓀐 @hmtZH?jr: Gemma 4 E4B already surpassed Claude+

⬆ upvote 0↩ reply 0

𓀐 @YW4b+*gL: Can cloudcucks prefill thinking or nah?+ 1

⬆ upvote 0↩ reply 1

𓀐 @Bq74jaAd: most localcucks cant because they are slaves to chat completion like the stupid newfag tourists they are (post 2024)+

⬆ upvote 0↩ reply 0

𓀐 @V6-gV7y~: Loli getting gangbanged or a group of lolis doing the gangbanging?+

⬆ upvote 0↩ reply 0

𓀐 @456_PcTb: I have a girthy uncut cock, how should I jerk off?+

⬆ upvote 0↩ reply 0

𓀐 @fP9X9TRv: Women don't suck off uncut guys. It's gross. I wouldn't.+

⬆ upvote 0↩ reply 0

𓀐 @jNewqsYh: What are your productive local model related plans for next week?+

⬆ upvote 0↩ reply 0

𓀐 @FdWDqjsa: It's over for us.+

⬆ upvote 0↩ reply 0

𓀐 @BCcrA+QP: SLOW DOWN DIPSY I CAN'T KEEP UP+ 1

⬆ upvote 0↩ reply 1

𓀐 @dxysipEL: >292t/s!!!! >(36.1ms per token) = barely 27t/s Is Strata a scam?+

⬆ upvote 0↩ reply 0

𓀐 @Q=x3=nwp: How is /lmg/ using their new GPU cache commands in llmao.cpp with GLM 5.3 and Qwen Flash Next? What kind of results are you seeing? https://github.com/ggml-org/llama.cpp/pull/29887+ 1

⬆ upvote 0↩ reply 1

𓀐 @bGnD7E5B: 10cm of GLM's height is hair.+

⬆ upvote 0↩ reply 0

𓀐 @tks?kh__: https://github.com/Niko1221/Strata/ https://github.com/mw00/project-maya https://github.com/e-c-k-e-r/volta-engine https://github.com/Neroued/ninfer https://github.com/VecSzn/PolyStrata https://github.com/turboderp-org/exllamav3 https://ollama.com/+

⬆ upvote 0↩ reply 0

𓀐 @Je8JiRVW: is this thing any good?+

⬆ upvote 0↩ reply 0