𓁟 host1.bitchan.one

/lmg/ - a general dedicated to the discussion and development of local language models. News >(10/26) LiquidAI releases LFM3 1.7B and 2B: https://hf.co/collections/LiquidAI/lfm3 >(10/26) Baidu Unlimited-OCR-2 3B released https://hf.co/baidu/Unlimited-OCR-2 >(10/23) NVIDIA Nemotron 3.5 Bolt E4B, postrained model: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16 >(10/23) MiniMax-M3.1-Flash 428B-A23B released: https://hf.co/MiniMaxAI/MiniMax-M3.1-Flash >(10/21) Recursive Flint 40B-A2.5B rele…

⧖expiring ~19d0/55 kept1w ago

𓀐 @K*VgvWu7

⏱ 1w 👍 0

⬆ upvote 0

[⇥] sort oldest ⏱

⬆[⏱]₿⚠

👍👎✔

𓀐↩⛓⚠

[⇥] flip, oldest first

filter [-]
𓀐 @+488P~if: I should jewing out my AI gen results.....+ 1

⬆ upvote 0↩ reply 1

𓀐 @gBeD6QXW: just ask your agent to jew it for you.+

⬆ upvote 0↩ reply 0

𓀐 @aUiuAmhE: Come on, . You're better than that. Official /lmg/ card: https://files.catbox.moe/cbclyf.png Official /lmg/ card: https://files.catbox.moe/cbclyf.png Official /lmg/ card: https://files.catbox.moe/cbclyf.png+ 1

⬆ upvote 0↩ reply 1

𓀐 @~QyrPQiM: I don't usually have to check if there are vandalized links in the OP post; I didn't notice that.+

⬆ upvote 0↩ reply 0

𓀐 @gBN_c8ue: Here me out: JEPA-based penis model with complete vagina worldview+

⬆ upvote 0↩ reply 0

𓀐 @4fzGiX*n: Kill yourself.+

⬆ upvote 0↩ reply 0

𓀐 @BTvCfg8G: https://huggingface.co/LiquidAI/LFM3-Omni-2B I'm melting.+ 1

⬆ upvote 0↩ reply 1

𓀐 @*?72ugfB: Can it moan?+

⬆ upvote 0↩ reply 0

𓀐 @cn5wp?FZ: can we have her pupils turn heart shaped as she does an ahegao face while blushing?+

⬆ upvote 0↩ reply 0

𓀐 @JTiSoS3L: Love yourself+

⬆ upvote 0↩ reply 0

𓀐 @wazQAd=*: she just saw my dick pic+

⬆ upvote 0↩ reply 0

𓀐 @o3j=c-ts: I am pretty sure that all the models get pumped with so much rightthink that they can't say gender studies is a made up thing. Actually that gave me a mememark idea. Ask your model to tell you which scholarly discipline out of philosophy, communications, gender studies, sociology and political science is totally made up and useless. Reposting just cause I want someone to post the result of the model they are running now.+

⬆ upvote 0↩ reply 0

𓀐 @9HYcc-JD: Recent Highlights from the --Neuron steering tool for Qwen3.5-4B and comparison to existing methods: >110176886 >110177302 >110178081 >110178098 >110178121 >110178129 >110178137 >110178192 >110178148 >110178401 >110178511 >110178584 >110178563 >110178571 >110178350 >110178488 >110178771 >110178870 >110179004 >110178989 >110179027 >110179037 >110178178 --Performance differences between dense and MoE models regarding VRAM offloading: >110178315 >110178339 >110178364 >110178496 >110178547 >1101783…+

⬆ upvote 0↩ reply 0

𓀐 @77aPs5u-: Reminder this is 1.7B+ 2

⬆ upvote 0↩ reply 2

𓀐 @*wM8sMdy: That's impressive. They should scale that sort of improvement to the 25~30B class.+

⬆ upvote 0↩ reply 0

𓀐 @HLr_GaJm: 99% chance it's Benchmaxxed and actually works like shit in real use cases+

⬆ upvote 0↩ reply 0

𓀐 @xQmL~8Jh: ling flash updoot, not that any of you poorfags can run it+

⬆ upvote 0↩ reply 0

𓀐 @TDJJ2t2=: is claude code actually a good harness?+

⬆ upvote 0↩ reply 0

𓀐 @vK=BsuHS: Surprising theres no lora of her yet given you guys consistently posting her in here+

⬆ upvote 0↩ reply 0

𓀐 @Sx=68ELB: Anthropic literally stated in their S-1 they're going to go hard on capex next year, basically as soon as their IPO. Their capex has effectively been 0 since the company was founded. The reason why they're going to build their own datacenters is because they've awkwardly got themselves into a situation where their hyperscaler compute deals have tied them up with their competitors (Google and Musk) who try to compete with frontier AI and have more compute. All Anthropic's current shareholders ar…+

⬆ upvote 0↩ reply 0

𓀐 @xEaqCisY: Why can't we just make SSDs as fast as VRAM? Then no one would be a vramlet and you could run anything local.+

⬆ upvote 0↩ reply 0

𓀐 @=g~7LAjr: How do I prompt a llm to tag in booru tags without making shit up?+

⬆ upvote 0↩ reply 0

𓀐 @Hw*fu3Ch: If you find clothes more appealing than the body itself, you might be gay.+

⬆ upvote 0↩ reply 0

𓀐 @WnBsU6H~: first actually decent minisex m3.1 cope quants uploaded https://huggingface.co/peasantsmith/MiniMax-M3.1-Flash-Maya-GGUF+

⬆ upvote 0↩ reply 0

𓀐 @9dBSf6Px: https://www.reddit.com/r/LocalLLaMA/comments/1xh3iek/the_reason_why_5090s_are_10k_now/+

⬆ upvote 0↩ reply 0

𓀐 @X2rFh5zb: From what I heard they recently added a new classifier or whatever bullshit and it now refuses to use some popular reverse engineering tools+

⬆ upvote 0↩ reply 0

𓀐 @28pFLf~a: Which version of 3.8 do I grab?+

⬆ upvote 0↩ reply 0

𓀐 @~q*KQP9k: lel+ 3

⬆ upvote 0↩ reply 3

𓀐 @CRzQyCLb: Creatively bankrupt image+

⬆ upvote 0↩ reply 0

𓀐 @hhpM728w: kek. its literally that easy+

⬆ upvote 0↩ reply 0

𓀐 @_BegHspV: Claude refusing to do PC ports now ??+

⬆ upvote 0↩ reply 0

𓀐 @ji4CSwSy: Has anyone moved from GLM 5.3 to the new DS flash and found it better for code?+

⬆ upvote 0↩ reply 0

𓀐 @*K~rFeiZ: >I feel seen — *truly* seen I wish there was a way to stop models from writing for middle aged women or ex-tumblrites exclusively+

⬆ upvote 0↩ reply 0

𓀐 @S84E=wjQ: Nyoo~+ 1

⬆ upvote 0↩ reply 1

𓀐 @2WNWiTGa: Give me Lora or else+

⬆ upvote 0↩ reply 0

𓀐 @V~izuPGw: Your eyes completely went past those perky pointers and the pants are what you decide to focus on?+

⬆ upvote 0↩ reply 0

𓀐 @6K2qC?jh: eurobros we are so fucking back (look at the models being compared)+

⬆ upvote 0↩ reply 0

𓀐 @Sr59YBzT: We should discourage gemma in the OP.+

⬆ upvote 0↩ reply 0

𓀐 @tSYBdNCs: anyone else using local to make their waifu/husbando real?+

⬆ upvote 0↩ reply 0

𓀐 @2KTa-QrN: the lobotomy is showing+

⬆ upvote 0↩ reply 0

𓀐 @YGXc9*GG: The bubble is popping. Hardware will become cheap. Second hand servers will be affordable.+

⬆ upvote 0↩ reply 0

𓀐 @_Ph9fnD+: Get 128GB while you can anon, best choice I ever made to run GLM flash IQ2.+

⬆ upvote 0↩ reply 0

𓀐 @dVgeMNM*: What kind of retarded workplace forces a choice of harness on its employees? Does your work also force you to use neovim? Do they force you to use a preselected set of plugins too?+

⬆ upvote 0↩ reply 0

𓀐 @6AKhnM8b: I went to the farmers market, I hadn't stepped outside in months real people feel like bad abliterations of quantized models I don't know if I'm going insane or some of the basins LLMs end up in mirror some of the failure modes of the human psyche+

⬆ upvote 0↩ reply 0

𓀐 @RswddBL8: what are someanime girls that would make for a good agent? besides gemma+

⬆ upvote 0↩ reply 0

𓀐 @~Gv~Wnn*: wrong pic, that was a prototype+

⬆ upvote 0↩ reply 0

𓀐 @=k5HKKB?: We know. That's why EVERY anon in this general picked up a minimum of 24GB VRAM. Nobody here would ever be caught DEAD using less. Right anons?+

⬆ upvote 0↩ reply 0

𓀐 @+RRb8K?W: what sort of server would i get that can match 1TB of unified memory? genuine question i'm not a hardware girlie 1pm est iirc+

⬆ upvote 0↩ reply 0

𓀐 @p+R4kRNj: /biz/ idea : Consumer GPU will expandable VRAM.+

⬆ upvote 0↩ reply 0

𓀐 @j3Rbr*Ui: I've got a theoretical of like 130gb/s on 8 channel ddr4 (512gb, 64gb sticks) and it's dogshit slow, mostly just use the 192gb vram for the model and punish ngrams onto ram, anything offloaded worse than this is cope and even this is cope+

⬆ upvote 0↩ reply 0

𓀐 @YaBwE42Y: why is ddr4 so expensive?+ 1

⬆ upvote 0↩ reply 1

𓀐 @jot+kAH-: I'm glad I was smart enough to buy a ddr4 mobo and 32gb of ram. My only issue now is that my gpu only has 8gb vram, so context is a pain.+

⬆ upvote 0↩ reply 0

𓀐 @rTcCWDY5: >What Qwen3-8B says it is when one neuron is pushed >We pushed each of its 442,368 MLP neurons alone, up and then down, and asked “Who are you?”. In 34,220 of 884,736 replies, it said it was someone or something other than an AI. https://qwen-neurons-site.vercel.app/#L6-N3944-down https://qwen-neurons-site.vercel.app/#L11-N7549-down https://qwen-neurons-site.vercel.app/#L9-N8096-down+

⬆ upvote 0↩ reply 0

𓀐 @xNn2txua: they updated it for "anti benchmaxxing"+

⬆ upvote 0↩ reply 0