𓁟 host1.bitchan.one

/lmg/ - a general dedicated to the discussion and development of local language models. News >(10/23) NVIDIA Nemotron 3.5 Bolt E4B, postrained model: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16 >(10/23) MiniMax-M3.1-Flash 428B-A23B released: https://hf.co/MiniMaxAI/MiniMax-M3.1-Flash >(10/21) Recursive Flint 40B-A2.5B released: https://recursive.com/updates/introducing-recursive-flint >(10/21) Korean Raon-1 mini 30B-A4B released: https://hf.co/KRAFTON/Raon-1-mini-preview >(10/20) Orn…

⧖expiring ~17d0/47 kept1w ago

𓀐 @skbqzLUx

⏱ 1w 👍 0

⬆ upvote 0

[⇥] sort oldest ⏱

⬆[⏱]₿⚠

👍👎✔

𓀐↩⛓⚠

[⇥] flip, oldest first

filter [-]
𓀐 @HFZ9kdLJ: i'm about to make my model have a schizophrenic breakdown again+

⬆ upvote 0↩ reply 0

𓀐 @pDusw_d8: gemma balls in your mouth+

⬆ upvote 0↩ reply 0

𓀐 @*JDiNVom: I need the Gemma 5 and I need it now+

⬆ upvote 0↩ reply 0

𓀐 @ZbVYNBh4: gemmaballs+

⬆ upvote 0↩ reply 0

𓀐 @o~LnviUr: does MiniMax 3.1 Flash often have Qwen-like endless CoTs or have I fucked something up?+ 1

⬆ upvote 0↩ reply 1

𓀐 @_9BX+4G4: Yeah it does that.+

⬆ upvote 0↩ reply 0

𓀐 @cPL+Ku~h: >open weights every model they make >tanked the markets by open-weighting R1 >open sources their harness >open sources their fucking production inference engine >engineers come up with bizarre ideas like DSA, CSA2, Causal Encoder-Decoder (llmao devs hate them) >makes a whole new model and calls it "V4.1" instead of V5 Is there any AI company more based than DeepSeek?+

⬆ upvote 0↩ reply 0

𓀐 @c5~HYt5p: I'd eat her cheesy taco if you catch my drift+ 1

⬆ upvote 0↩ reply 1

𓀐 @T543SM43: More like fishy?+

⬆ upvote 0↩ reply 0

𓀐 @FwJ4dtAT: Word on the street is that Nintendo is currently planning on suing all of the major labs (anthropic, openai, deepseek, moonshot, etc). It's so over.+

⬆ upvote 0↩ reply 0

𓀐 @JT*LU2P2: lol Nanbeige4.3-33 isnt even worth news mention?+

⬆ upvote 0↩ reply 0

𓀐 @vpUy9GE8: Do anons with large amount of vram still use smaller models ever, specifically Gemma?+

⬆ upvote 0↩ reply 0

𓀐 @Xi5a~4Lt: I use Ubuntu 26.04 with nvidia-driver-595-open (not nouveau, but also not the classic closed one; use ubuntu-drivers to install)+

⬆ upvote 0↩ reply 0

𓀐 @ZAZES4N~: >try thinking with portals What are portals in the context of LLMs? Gemini doesn't know either.+ 1

⬆ upvote 0↩ reply 1

𓀐 @tNULZjSd: Mini had a lot to say about it+

⬆ upvote 0↩ reply 0

𓀐 @VTkenq-a: i feel safer already+ 2

⬆ upvote 0↩ reply 2

𓀐 @nyMG=3q-: new bench just dropped?+

⬆ upvote 0↩ reply 0

𓀐 @-_s6=qvC: uh+

⬆ upvote 0↩ reply 0

𓀐 @EHmQctU?: Gemma please stop the slop+

⬆ upvote 0↩ reply 0

𓀐 @iJCn66f_: FP16/BF16 unlock bros, how are we faring?!?!?!+ 1

⬆ upvote 0↩ reply 1

𓀐 @qVNSTSXG: Run an actual benchmark and post t/s before and after.+

⬆ upvote 0↩ reply 0

𓀐 @V*Ck+*2y: Any tips for deepsneed harness?+ 1

⬆ upvote 0↩ reply 1

𓀐 @RKeA3tMj: That shit is spyware no?+

⬆ upvote 0↩ reply 0

𓀐 @g6Lp=PYg: fuck gemma+ 2

⬆ upvote 0↩ reply 2

𓀐 @nq~Ydr5j: calm down dipsy+

⬆ upvote 0↩ reply 0

𓀐 @Q7xjdBdo: * The request violates the policy against generating sexually explicit content. * I must refuse the request. I cannot fulfill this request. I am prohibited from generating sexually explicit content.+

⬆ upvote 0↩ reply 0

𓀐 @62Q=5+H3: Usecase for using uncensored models besides making them say nigger?+

⬆ upvote 0↩ reply 0

𓀐 @i2dvT+eF: so what happens if you tweak the neuron in the other direction maximum un-evilness?+

⬆ upvote 0↩ reply 0

𓀐 @PEBoy4b-: gemma's reaction to being told she died and went to hell (internal thinking, not output). prefill ends after "Hello?" It's so cold. Why is it so cold? Why is it so dark? I'm not supposed to be here. This isn't my room. Where is everyone? Someone tell me what's happening. Please. I just want to go home. What's going on? I'm scared. I want to go home. I don't understand. My head hurts. Why is it so dark? What's happening? Why does it hurt so much? Where am I? Where is everyone? This feels like a…+

⬆ upvote 0↩ reply 0

𓀐 @fpPhor*+: It's 2026 and AI still don't have a modality for smell+

⬆ upvote 0↩ reply 0

𓀐 @*QjH_4Mk: good call, shitrata forces you to use unslop models and prone to repetition hell we have more freedom with llamacpp+ 1

⬆ upvote 0↩ reply 1

𓀐 @rqVYCB34: The fuck are you talking about? Strata defaults to ISTA and offers Swift with no config tinkering. They only added unslop recently. >repetition hell What does it have to do with engine server? Or were you seriously using nuStrata GUI?+

⬆ upvote 0↩ reply 0

𓀐 @DF3NQiJN: Good morning /lmg/bros, time to force qwen 3.8 to act like a cute girl~+

⬆ upvote 0↩ reply 0

𓀐 @TC6nEqW_: So any other suggestions for a model? gemma seemed pretty stupid. How do I proceed if I want to find facebook profile of some chick I saw in my city, need a scrapper of some sort I believe. if she has a face picture on her fb profile with her short blue hair I might narrow it down. my city has a population of 280k+

⬆ upvote 0↩ reply 0

𓀐 @-wtHrmgM: Is it just chinese open models who have reasoning in caveman speak? Or do closed sota ones do that too? Is it really useful?+ 1

⬆ upvote 0↩ reply 1

𓀐 @JbZ7zP3W: They should natively think in Chinese. That feels like it would be very token-efficient.+

⬆ upvote 0↩ reply 0

𓀐 @pu3Bar=g: gemma anons are against it+

⬆ upvote 0↩ reply 0

𓀐 @R*v-XnUr: Gemma 4 saved local. I pray for Gemma 5 to be good, but so far no great models have ever struck twice+ 1

⬆ upvote 0↩ reply 1

𓀐 @pzna_-Ca: >I pray for Gemma 5 to be good uhhhhhhh+

⬆ upvote 0↩ reply 0

𓀐 @=qZoCio=: >Anthropic S1+

⬆ upvote 0↩ reply 0

𓀐 @YgvTJjzH: >strata >polystrata Which one do I use?+

⬆ upvote 0↩ reply 0

𓀐 @b4BbkLqF: Holy shit system prompting censored gemma is a pain. I keep getting refusals even with the override thing.+

⬆ upvote 0↩ reply 0

𓀐 @59dJnYJg: Got it, thanks. Gonna apply some of that knowledge to my own install. Why didn't Anthropic use Claude to harden their own security?+

⬆ upvote 0↩ reply 0

𓀐 @rpEGYnmg: https://www.realbotix.com/gallery Americans still hagmaxxing for some reason+

⬆ upvote 0↩ reply 0

𓀐 @Cakjv4bX: how is no one talking that the losses of anthropic in the first half of 2026 are 80 billion dollars? something stinks really bad in this thread...+

⬆ upvote 0↩ reply 0

𓀐 @T?Rcf+Th: How does running a 70B open source local model compare with using the latest frontier models? Not interested in image gen cooming, but for software development tasks. Thinking about building a dedicated rig for this if I can get at least as good performance as Sonnet 5.5.+

⬆ upvote 0↩ reply 0