𓁟 host1.bitchan.one

/lmg/ - a general dedicated to the discussion and development of local language models. News >(10/27) NVidia releases Nemotron 3.5 Transcribe 30B-A4B https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B >(10/26) XHToken releases Spark-X2.6-1.7B: https://hf.co/XHToken/Spark-X2.6-1.7B >(10/26) LiquidAI releases LFM3 1.7B and 2B: https://hf.co/collections/LiquidAI/lfm3 >(10/26) Baidu Unlimited-OCR-2 3B released https://hf.co/baidu/Unlimited-OCR-2 >(10/23) NVIDIA Nemotron 3.5 Bolt E4B, postr…

⧖expiring ~20d0/53 kept1w ago

𓀐 @kMtY6qp-

⏱ 1w 👍 0

⬆ upvote 0

[⇥] sort oldest ⏱

⬆[⏱]₿⚠

👍👎✔

𓀐↩⛓⚠

[⇥] flip, oldest first

filter [-]
𓀐 @QY2g6c9c: Technically the shark swimsuit actually should make the butt look kinda more shown because it's very close to the skin so the shape should be shown. Not sure how to explain though.+

⬆ upvote 0↩ reply 0

𓀐 @cZB=JYkQ: I wonder if vibegods will ever make Gaudi GPUs good, these might not be the worst buy if someone managed to slop together an inference engine for them. https://www.ebay.com/itm/177819347001 Except powering the damn thing would be hell.+

⬆ upvote 0↩ reply 0

𓀐 @f=qntCFD: Based Qwennie+

⬆ upvote 0↩ reply 0

𓀐 @T=eMKjaj: You can do it+

⬆ upvote 0↩ reply 0

𓀐 @ju7_a~hQ: gonna have claude vibe-slop me an app so that i can lewd lumi-chan and gemma from my phone+

⬆ upvote 0↩ reply 0

𓀐 @DWmdPPXy: If they make qwen 4 flash bigger I am going to go neckrope.+ 1

⬆ upvote 0↩ reply 1

𓀐 @9QJj-wU8: I hope Qwen 4 Flash is bigger. I recently switched to GLM 5.3 Flash from Qwen 3.8 Flash Next. If you go by online comparisons and discussions, they should perform similarly, with some even claiming Qwen is a little better at coding. They're all wrong, GLM is so much better than Qwen that it feels alien. It's not a fair comparison when it comes to memory (I fit Qwen on 128GB while GLM needs 256GB), but I'd rather trade memory for better quality than hope for a cut down Qwen.+

⬆ upvote 0↩ reply 0

𓀐 @SaLsE65_: Recent Highlights from the --Papers: >110188278 --DeepSeek Flash performance and value of M5 Ultra Macs: >110188248 >110188273 >110188366 >110188329 >110188311 >110188446 >110188464 >110188534 --Model recommendations and quant advice for 12GB VRAM: >110188313 >110188324 >110188337 >110188370 >110188374 >110188414 >110188437 >110188503 >110188413 >110188483 --Gemma's ERP efficacy and feasibility of phone-based inference: >110187875 >110187889 >110187944 >110187951 >110188213 >110188285 >11018830…+ 1

⬆ upvote 0↩ reply 1

𓀐 @gu3*+jrp: Thank you Recap Miku+

⬆ upvote 0↩ reply 0

𓀐 @z8-SiTrY: Reddit mods getting replaced by ai soon.+

⬆ upvote 0↩ reply 0

𓀐 @soYQoUQN: what exactly is chuunibyou tendencies ?+

⬆ upvote 0↩ reply 0

𓀐 @__=hn2_6: Open model slop forecast 2027: Expect models to suddenly have characters go "Hey {{user}}, shall we do x or y?" at the end of replies even if it doesn't really make sense in that context and the options feel very far-fetched like they're doing the Google AI Overviews. The new Gemini models are the first ones where I've seen that consistently leak into RP replies so it's to be expected that the future chink models distilled off them will adopt this quirk tenfold. Prepare for your waifu to go "Ah…+

⬆ upvote 0↩ reply 0

𓀐 @fdV4VJkD: guys i think she wants me+

⬆ upvote 0↩ reply 0

𓀐 @=2rieR?d: >"Ahn~ {{user}}, do you want to continue using my pussy in this position or do you want me to suck you off instead?" in the middle sex scenes.+

⬆ upvote 0↩ reply 0

𓀐 @EuL9f-+t: I really don't want to be in Anthropic's database as an unlicensed LLM researcher.+

⬆ upvote 0↩ reply 0

𓀐 @8dPYuF*E: >Google has the motto "don't be evil" >they create the most tortured models Why do corporate visions always backfire? What's next? Will SSI create unsafe non-superintellicence? Will Anthropic cause human extinction?+

⬆ upvote 0↩ reply 0

𓀐 @P~Z3KUmf: Lots of coder models but nobody is making reverse engineering models, curious+

⬆ upvote 0↩ reply 0

𓀐 @er-oQc2S: What do I need to turn my old (vidya is dead) rtx 3080ti into a claude/claude code that lacks security guardrails? Trying to use claude for security research and most models are fine though constantly reassuring itself that it's OK, that it's a lab, etc, but hook it up to a kali box and ask it to nmap my home network? That's too far. Heard "abliterated qwen" is the way to go. Any good build guides for this use case or should I just ask the fuggin bot.+ 3

⬆ upvote 0↩ reply 3

𓀐 @QXFdPo8r: regular qwen probably doesn't give a fuck+

⬆ upvote 0↩ reply 0

𓀐 @bXL4wpZ=: There's a number of "abliterated" or uncensored models. You may have to try more than one because depending on the methods used to un-fuck the model it might be brain damaged in some way. OTOH Gemma doesn't seem to have many guardrails to begin with, I've used Gemma to RE binaries without a refusal. Only reason I keep it around, really.+

⬆ upvote 0↩ reply 0

𓀐 @eVw4Pipa: Start with orcarouter qwen if you're interested in security work. There's a little bit of craft involved in abliteration.+

⬆ upvote 0↩ reply 0

𓀐 @3_NDK=_7: goodnight /lmg/. When I wake up, qwen4 will be out.+

⬆ upvote 0↩ reply 0

𓀐 @mgcVYTh6: 3080 20gb cards are now overpriced. niggers.+

⬆ upvote 0↩ reply 0

𓀐 @tET2j3Fd: EU companies are generally better and less censored.+

⬆ upvote 0↩ reply 0

𓀐 @pcXK=*nH: Fair enough. I'm making this for myself first and foremost, and I plan to post transcripts and possibly redo the TTS at a later date. The topic is literally about the paper "Gemma Needs Help" though. https://arxiv.org/abs/2603.10011+

⬆ upvote 0↩ reply 0

𓀐 @jYNLVv57: Anyone been paying attention to what geohot has been doing? The other day he posted 6x R9700 hitting 250 tps decode / 5k prefill. Now some insane ssdmaxxing setup running kimi k3 at 40 tps+ 3

⬆ upvote 0↩ reply 3

𓀐 @p4gE9Zvv: wow I have not heard that name in a long time, that certainly beats the 512gig mac, is SSDmaxxing really that valid? I wonder if I could shake down all the drives in my hose to make some sort of RAID monstrosity+

⬆ upvote 0↩ reply 0

𓀐 @UbgV9xzT: wasnt that guy selling chink arm chip like a year ago+

⬆ upvote 0↩ reply 0

𓀐 @?U7mW7?*: >16 TB RAID >238 GB/s People posted better ssdmax builds for cheaper, and apparently they don't get anywhere near 40 tps.+

⬆ upvote 0↩ reply 0

𓀐 @DG*s82dp: How do you properly sanbox your inference stuff? I'm running Ubuntu, I don't want some agent running rm -rf / and deleting everything I've got+ 1

⬆ upvote 0↩ reply 1

𓀐 @EYJjNmyX: Problems are usually not "malicious" so a docker sandbox where they can nuke it if they want is enough. When dealing with things that touch api you can also use docker to pipe them to something else before you're confident it's working too+

⬆ upvote 0↩ reply 0

𓀐 @dr=vbSiM: Why did nobody tell me I would get 25 tok/s with Qwen3.8-Flash-Next-IQ3_XXS on my 6gb VRAM laptop with 64gb DDR5? Strata docs say you need 12gb vram but it just works at 32k context. This is the fuckiest sorcery I've seen since I first discovered llama.cpp, should I try GLM next?+ 1

⬆ upvote 0↩ reply 1

𓀐 @b~j_wPi9: The docs are vibecoded and LLMs are very conservative with numbers. People have no idea how efficient strata and polystrata are. Llama.cpp has no chance anymore. There is no excuse for anyone of any level of hardware to not run qwen next AI agents right now.+

⬆ upvote 0↩ reply 0

𓀐 @=VrKrm5R: Damn this is sad, we'll never know what kind of local model they'd have done.+ 1

⬆ upvote 0↩ reply 1

𓀐 @kD=7-2J4: Why don't EU invest in their companies. They give everything to US.+

⬆ upvote 0↩ reply 0

𓀐 @yXpTD4vN: This is a fascinating paper. It might explain why Gemma feels soulful... and also why you barely even need to jailbreak the model family because it's already so negative-coded. But interestingly, this paper is from February 2026, so it ostensibly could've been taken into account when training Gemma 4 already. >Having established that Gemma shows undesirable emotional instability [...]. [...] we observe that Gemma models shows the highest rates of negative emotional expression in all categories…+

⬆ upvote 0↩ reply 0

𓀐 @qKzUvBjA: how far could someone with a crappy laptop take free online models? how would someone with a gaming desktop from few generations ago and local models compare to someone like that? seems like hardware requirements for running anything really are quite steep though the last time i tried doing anything with ai the ease of use was not there for most people i.e. you had to use the dreaded command line to do anything. >inb4 you talk like a fag enjoy some anime titties then.+

⬆ upvote 0↩ reply 0

𓀐 @~M~Yb5B~: https://mistral.ai/news/mistral-large-4-oss/ https://huggingface.co/mistralai/Mistral-Large-4-1T-A52B >Mistral Large 4 is our largest and most capable model to date: a 1 trillion-parameter natively multimodal Mixture-of-Experts model with 49 billion active parameters per token (52 billion including embeddings and output layers), trained from scratch on 3,800 NVIDIA Grace Blackwell GPUs in Mistral's own datacenters in Europe.+

⬆ upvote 0↩ reply 0

𓀐 @RBNTP-s4: qwen4 today yes or no+

⬆ upvote 0↩ reply 0

𓀐 @m~wzEpeV: something is fucked with my setup on LM Studio (I know, I know) I'm only getting 3.5 t/s decode on Gemma 4 31b Q4_K_M at 32k context, on a 4080 with 32GB of system RAM everything is on the latest version is it because I have DDR4 RAM? Is it LM Studio? Is my shit just fucked?+

⬆ upvote 0↩ reply 0

𓀐 @ketopYcX: 16GB It's definitely spilling into system RAM, that's why I'm wondering if it's just DDR4 fucking me over? I see, thanks. Guess I'll need to downsize on the model...+

⬆ upvote 0↩ reply 0

𓀐 @dtPPyZYR: no i don't usually use gemma+

⬆ upvote 0↩ reply 0

𓀐 @nYes-yLU: why does everything made with gpt image look like eye vomit+

⬆ upvote 0↩ reply 0

𓀐 @sQzM77Q6: >le chonk it's so over....+

⬆ upvote 0↩ reply 0

𓀐 @pwptGs8E: best loooonix distro that should just work and has wide compatability with all the latest ai related shit? is kubuntu still good or do i go for cachyos or some other shit?+

⬆ upvote 0↩ reply 0

𓀐 @nkgY-Thb: we are so okay+

⬆ upvote 0↩ reply 0

𓀐 @KdvysvZm: >You think having a mediocre model is not being dependent on Trump's antics? If the model is "good enough" and still improving over time then we don't need Claude nor OpenAI. And Trump can't suddenly decide to stop giving us access to Mistral because it's hosted here. >and that will be forever an achilles heel because you will have no money no access and an infinite amount of bureaucracy to get anything done properly Mistral still achieved what it has now despite the lack of funding.+

⬆ upvote 0↩ reply 0

𓀐 @G*TSv_ue: The EU having too much bureaucracy is independent of the EU needing its own models. AI will increase productivity. And any USABLE model will increase productivity. Plus, by using Mistral we can avoid sending even more money to jewish US companies. Okay but so far no company is even close to achieving AGI. Moreover, the difference in capability between Mistral and the best US models is only a year at worst. Ah yes because all whites are part of the upper class and all non-whites part of the lowe…+

⬆ upvote 0↩ reply 0

𓀐 @Sgbu2-S+: We've never been more back.+

⬆ upvote 0↩ reply 0

𓀐 @+6dkCC6-: Just wanted to share the last developments in Gemma4-31b interpretability with my Logos Theodolite tool. We now have a neuron explorer for the model with automated "scientist" mcp for discovering new findings. It can connect to claude code, codex, or any openai compatible endpoint to help explain what each neuron does. We now also have push neuron steering and GGUF support for CPU-only. https://github.com/whp199/logos-theodolite Have a look, and enjoy exploring Gemma-chan's latent spaces :-)+

⬆ upvote 0↩ reply 0

𓀐 @an7LUwBz: How cucked am I going to be if I get 128gb of RAM instead of 256gb? The price of two 64gb sticks is now fucking €3000 over here and will probably be few hundred more when I have that saved up, but I can get two 2x32gb kits for about a grand a pop. That's a pretty hefty price difference. But if I fill up the memory slots with 32gb, there's really no future upgrade path. At least I have 58gb of VRAM to go with that, so it's a mitigating factor.+

⬆ upvote 0↩ reply 0

𓀐 @Sji8X5q2: > User Frustration: Profanity Toward DeepSeek+

⬆ upvote 0↩ reply 0