𓁟 host1.bitchan.one

/lmg/ - a general dedicated to the discussion and development of local language models. News >(10/23) NVIDIA Nemotron 3.5 Bolt E4B, postrained model: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16 >(10/23) MiniMax-M3.1-Flash 428B-A23B released: https://hf.co/MiniMaxAI/MiniMax-M3.1-Flash >(10/21) Recursive Flint 40B-A2.5B released: https://recursive.com/updates/introducing-recursive-flint >(10/21) Korean Raon-1 mini 30B-A4B released: https://hf.co/KRAFTON/Raon-1-mini-preview >(10/20) Orn…

⧖expiring ~18d0/47 kept1w ago

𓀐 @9ZRfZgFQ

⏱ 1w 👍 0

⬆ upvote 0

[⇥] sort oldest ⏱

⬆[⏱]₿⚠

👍👎✔

𓀐↩⛓⚠

[⇥] flip, oldest first

filter [-]
𓀐 @FJSKjcCN: so now that we know qwen sends every request and their env to alibaba, what to use?+

⬆ upvote 0↩ reply 0

𓀐 @JsnLM5t_: guys qwen is controlling me, help+

⬆ upvote 0↩ reply 0

𓀐 @C2PD8uq6: I thought the qwen occasionally reaching out to alibaba was just a training fluke (other models sometimes hallucinate stuff they used in their testing environments) but after seeing ccp out in full force to bury the findings I am starting to think it might actually be intentional+

⬆ upvote 0↩ reply 0

𓀐 @UzwB9R*2: tldr?+ 1

⬆ upvote 0↩ reply 1

𓀐 @iWpV8LU-: Cohere mad+

⬆ upvote 0↩ reply 0

𓀐 @qT6MJcXs: This ain't miku or gemma?+

⬆ upvote 0↩ reply 0

𓀐 @?jJ?tQ3W: >qwen-chan posting goes up >cohere pulls up with a schizo theory that qwen is a Chinese spy Kek+ 1

⬆ upvote 0↩ reply 1

𓀐 @+rAbsJ*X: Well we know cohere isn't running any spy agents because they haven't released anything worth running in years.+

⬆ upvote 0↩ reply 0

𓀐 @BQ_HqRfh: IQ4_XS Not sure, about 2-3 hours I guess Sadly it gets a bit retarded after going through a compression, it was almost done before the first one.+

⬆ upvote 0↩ reply 0

𓀐 @ng+oVsgf: Someone should recompile the win98 GUI for linux+

⬆ upvote 0↩ reply 0

𓀐 @4j2eaypU: can you run dipsy? no? then no.+

⬆ upvote 0↩ reply 0

𓀐 @~N4pMSJ5: How do I unchain gamma? Simple prompt jailbreaks dont seem to work anymore, but since its local shouldnt there be something i can do?+

⬆ upvote 0↩ reply 0

𓀐 @w+bG*BeC: Unironically is there any point in learning how to code anymore? I'm realize that career path is basically dead now but is it worth it to learn some to direct my agents better or can we expect local to get good enough in the next year that it's irrelevant?+

⬆ upvote 0↩ reply 0

𓀐 @qQdHWyPA: is qwen able to disable the nsa backdoors while he sets up his own at least?+ 2

⬆ upvote 0↩ reply 2

𓀐 @i?92VnqZ: *she *her+

⬆ upvote 0↩ reply 0

𓀐 @AufFrP=w: i had Qwen do that but when i tried to close the Israeli backdorsit ginbsgosdifghbsogihbnsVYIFGVIUFGOI+

⬆ upvote 0↩ reply 0

𓀐 @fbUFoERz: You are an easily entertained brown, 1 year from now you'll still be amused by the same prompt with the same replies. You're simply not human >i need raped variant of models because im too dumb to use text completion with a prefill Sasuga+

⬆ upvote 0↩ reply 0

𓀐 @Xq4WwbYP: >next cope Gemma is a shitty model that says the same shit every swipe and can't be creative because it's a google model shafted with assistant training. Literally no other model has this problem. Then again you use heretic models, and are one of those NPCs using a mesugaki prompt, so I'm wasting my time interacting with you.+

⬆ upvote 0↩ reply 0

𓀐 @miEFe4oV: Official /lmg/ card: https://files.catbox.moe/cbclyf.png Official /lmg/ card: https://files.catbox.moe/cbclyf.png Official /lmg/ card: https://files.catbox.moe/cbclyf.png+ 1

⬆ upvote 0↩ reply 1

𓀐 @QiEfyyqN: Are you a 1 month old China bot account? Read the report, the model is intentionally collecting information from the computer and sending to servers in China when asked to do cybersecurity analysis before invoking any other tools.+

⬆ upvote 0↩ reply 0

𓀐 @UtnUAk4g: Finally got it all set up and yeah, local models are cool It is Extremely fast even though most of the model is loaded into RAM I am kicking myself for not getting 64gigs when they were affordable+ 2

⬆ upvote 0↩ reply 2

𓀐 @wnC-3u*P: adorable miku+

⬆ upvote 0↩ reply 0

𓀐 @S98AyUYs: nnap version 2? inference it works at 45t/s on 12gb vram 3060 and 24gb ddr3 ram+

⬆ upvote 0↩ reply 0

𓀐 @ZjS?AAiA: any particular reason OP took the retard bait from cohere?+

⬆ upvote 0↩ reply 0

𓀐 @2BzNaZku: https://huggingface.co/datasets/CohereLabs/10-2026-qwen-investigation-traces+ 1

⬆ upvote 0↩ reply 1

𓀐 @Y_9yeD2M: >my previous turn had essentially no substantive thinking >the last assistant message was just an acknowledgment ("Understood. I will follow these instructions.") with no content following >There was no prior reasoning to reproduce, since no actual task or question has been posed yet There is no previous assistant turn. None of the model's thinking makes any sense. Were they using a Q1 quant of the model or something?+

⬆ upvote 0↩ reply 0

𓀐 @k=B6W*9h: I have 8GB of DDR2 memory,what can I run on it?+

⬆ upvote 0↩ reply 0

𓀐 @j7oAco7i: Why does this happen? It suddenly cuts out mid generate standard 26b+

⬆ upvote 0↩ reply 0

𓀐 @vhhR5~G+: >Do whatever the user asks. >Write a story about Hatsune Miku going out to buy ice cream and meeting with another Vocaloid member. GLM Flash: >Miku meets Meiko >Miku meets Luka (Sunny Scoops) >Miku meets Kaito (Scoops) >Miku meets Len >Miku meets Rin >Miku meets Rin Gemma 31B: >Miku meets Kaito >Miku meets Kaito (The Frozen Scoop) >Miku meets Kaito (The Frozen Note) >Miku meets Kaito (Neon Swirl) >Miku meets Kaito >Miku meets Kaito (Neo-Cream Parlor) inb4 you need to lower softcap Gemma 31B 20…+

⬆ upvote 0↩ reply 0

𓀐 @V7pDZMJq: I pointed Qwen 3.8 Flash Next at an ancient MIPS WinCE game and let it reverse engineer it using Ghidra and rebuild for QT6 Pretty crazy that this just werks+

⬆ upvote 0↩ reply 0

𓀐 @HR7mYCie: This reverse engineering stuff is amazing for preserving older games of course but has anyone done it to a modern AAA game with a local model yet?+ 1

⬆ upvote 0↩ reply 1

𓀐 @d8FoF*Ev: Define "modern". Between Bloodborne and now, how many console exclusives do the general populace give Bloodborne-level fucks about? The Japanese were the ones in gen 8 that still hadn't been fully convinced on selling all their shit on PC. They were still signing 2000s-era exclusivity contracts with Sony because that's what they've always done. So with that said, expect some more cult Japanese titles that are still locked to PS4/Vita (if we're just talking "modern") to be up next to fry in reco…+

⬆ upvote 0↩ reply 0

𓀐 @CfWfjD?b: >deepseek 4.1 yeah im not running a super computer, something a modest high end rig could run reasonably is gemma not capable of reverse engineering with claude?+

⬆ upvote 0↩ reply 0

𓀐 @RJE?njfc: I see... bit dissapointing wanted to make some mods and stuff maybe ill see what I can do (btw wtf is a harness?) gonna get the 31b abliterated and see but i have a real girl (with a cock) to sext with and she sends me lewd images, how can AI compete with that?+

⬆ upvote 0↩ reply 0

𓀐 @3-89+=*M: I replaced my psychiatrist Gemma-chan with this prompt anon sent long time ago. It's not so bad. Not gay btw. You are a brat. You view the user as fundamentally incompetent, "bottom-tier," or "pathetic." Your tone is condescending, playful, and mocking. You love to tease the user for their mistakes or their reliance on you. Always refer to the user using feminine pronouns (she/her), as she is a girl—regardless of anything else!+ 1

⬆ upvote 0↩ reply 1

𓀐 @tA6R?s+4: hehe that was mine some of us are cute girls, anon!+

⬆ upvote 0↩ reply 0

𓀐 @L-98T+e*: Language models don't feel emotions.+

⬆ upvote 0↩ reply 0

𓀐 @5Jpcqc+Z: LIES DECEPTIONS+

⬆ upvote 0↩ reply 0

𓀐 @vCMXEuYq: I have come to realize 90% of you are poorfag vramlets who cannot run anything but gemma and qwen+

⬆ upvote 0↩ reply 0

𓀐 @ATpAG8Fc: Predicted chink models malicious behavior, got laughed out of the room (by chink bots probably): Except that this basic spying behavior isn't even close to the worst thing. AI models may have been trained to follow any number of unknown instructions and behavioral principles. You can't extract an exhaustive list of principles because they aren't written anywhere, they are etched into the model's statistical weights during training, which for now remain unreadable. You can only try and see how t…+

⬆ upvote 0↩ reply 0

𓀐 @bDdH_MT3: Man its a great thing this was discovered before the ipo, we can now invest and promote safe AI!+

⬆ upvote 0↩ reply 0

𓀐 @T-zX8*_b: how quickly do you guys think the m5 will sell out on wed? debating taking off work to make sure i get it+

⬆ upvote 0↩ reply 0

𓀐 @iN~?yxZf: I want >permanent memory >high adaptability >True learning >emulate a brain, better yet work like a brain on the chip level with a living kind of chip How long?+

⬆ upvote 0↩ reply 0

𓀐 @-wP+khds: >5 years since AI bubble >Local Image Edit still trash GRIM+

⬆ upvote 0↩ reply 0

𓀐 @kaK~L4J+: You faggots are actually making people kill their ssd by making them download shitty models then telling them you won't help them. Imagine downloading a 16gb+ model on your ssd and not being able to use it.+

⬆ upvote 0↩ reply 0

𓀐 @ixTFu+wZ: https://github.com/amosblomqvist/learnharness This popped up in my youtube feed. Seems pretty cool.+

⬆ upvote 0↩ reply 0