𓁟 host1.bitchan.one

/lmg/ - a general dedicated to the discussion and development of local language models. News >(10/29) Mistral Large 4 (Le Chonk) 1T-A52B released: https://mistral.ai/news/mistral-large-4-oss >(10/27) NVidia releases Nemotron 3.5 Transcribe 30B-A4B: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B >(10/26) XHToken releases Spark-X2.6-1.7B: https://hf.co/XHToken/Spark-X2.6-1.7B >(10/26) LiquidAI releases LFM3 1.7B and 2B: https://hf.co/collections/LiquidAI/lfm3 >(10/26) Baidu Unlimited…

⧖expiring ~21d0/40 kept1w ago

𓀐 @=6ppBJEK

⏱ 1w 👍 0

⬆ upvote 0

[⇥] sort oldest ⏱

⬆[⏱]₿⚠

👍👎✔

𓀐↩⛓⚠

[⇥] flip, oldest first

filter [-]
𓀐 @T3-fHhGb: omg it rin+

⬆ upvote 0↩ reply 0

𓀐 @jp47j+Zs: Recent Highlights from the --Mistral Large 4 open weight release and licensing discussion: >110193924 >110193945 >110194061 >110194069 >110195025 --Methods for sandboxing LLM agents to prevent system damage: >110191862 >110191875 >110191893 >110191901 >110191902 >110191923 >110191939 >110191935 >110191943 >110191973 >110191959 >110191996 >110192210 >110192243 >110193143 >110193370 --Research on emotional instability and frustration in Gemma models: >110193276 >110193301 >110193328 >110193459 >1…+ 1

⬆ upvote 0↩ reply 1

𓀐 @?WV=dxen: >Research on emotional instability and frustration in Gemma models: Best part of the threat. Somebody should reproduce it with Gemma 4.+

⬆ upvote 0↩ reply 0

𓀐 @2+6ZGTA~: how long before Opus 5.5 tier coder will be available for local LLM ? Or this level is rather unattainable on normal consumer Pcs?+

⬆ upvote 0↩ reply 0

𓀐 @*EBjMSBt: what does /lmg/ think of Muse Glimmer, specially compared against Gemma4?+

⬆ upvote 0↩ reply 0

𓀐 @_EJervw=: why is she so fat ;-;+

⬆ upvote 0↩ reply 0

𓀐 @rnB4?r?E: how's ds 1017 ability to control a computer (as in moving the mouse and clicking)?+

⬆ upvote 0↩ reply 0

𓀐 @GV*+-KMJ: I have started feeling anxious if I don't have an agent working on something at all times :skull:+

⬆ upvote 0↩ reply 0

𓀐 @yY?jTiwz: https://www.reddit.com/r/Vocaloid/comments/1osv3v9/for_lack_of_a_better_way_to_phrase_it_why_is/+ 2

⬆ upvote 0↩ reply 2

𓀐 @bGyk9mSV: I always thought that the vocaloid posting in this thread is innocent.+

⬆ upvote 0↩ reply 0

𓀐 @7MpwR24u: I get this same feeling in the western vn community, its too gay+

⬆ upvote 0↩ reply 0

𓀐 @47SBCyxx: New anime image generator has been announced by some of the people that made NoobAI "A new NOOB model with a DiT backbone exceeding 10B parameters is now undergoing large-scale training and is expected to launch by the end of this year. T2I + Edit."+ 4

⬆ upvote 0↩ reply 4

𓀐 @=9VSyYLM: not expecting anything but I'll wait for this and krea 3+

⬆ upvote 0↩ reply 0

𓀐 @cJSpmY7p: Oh cool, love Noob. Still haven't moved onto the newer gens of models.+

⬆ upvote 0↩ reply 0

𓀐 @QecJP3Pr: ...isn't noobai just an illustrious finetune where did they get money for this+

⬆ upvote 0↩ reply 0

𓀐 @*f4WndH2: Nice, but isn't 10b huge for a imgen model? Anima is pretty slow even on my 5090.+

⬆ upvote 0↩ reply 0

𓀐 @NHdZG7nq: What harness do you use for non-coding non-rp chat/assistant?+ 1

⬆ upvote 0↩ reply 1

𓀐 @UkgbrKAJ: Sirmes or pi+

⬆ upvote 0↩ reply 0

𓀐 @3kvFqPo6: https://x.com/OrcaRouter/status/2115846743422324774+ 1

⬆ upvote 0↩ reply 1

𓀐 @kPPv-53F: we are so back+

⬆ upvote 0↩ reply 0

𓀐 @~yGMyoch: I'm tired of pretending cope quants are bad. GSQ RCO is fucking magic and none of you will convince me otherwise.+

⬆ upvote 0↩ reply 0

𓀐 @*BKDFg8a: Thanks to a random anon(s) i run qwen flash next on strata and it has god tier speed. Should I run a harness with it? I don't have the first clue on what they are or what they are for+

⬆ upvote 0↩ reply 0

𓀐 @uPtRFuti: saw someone getting good results with my exact specs. I copy their config, get the exact same model/quant, tripple check my config, getting like 1400 pp and 35 t/s gen, but others are getting 60-80 t/s gen, any idea what i could be doing wrong? same MTP, same model/quant, same config, same hardware, half the gen speeds :(+

⬆ upvote 0↩ reply 0

𓀐 @8geULum-: I'm a beginner and I'm trying to figure out how to enable web search in Open WebUI, the problem is that online (https://docs.openwebui.com/features/chat-conversations/web-search) they tell you to go to Profile > Admin > Web Search but my UI doesn't look like that, I have no profile and no admin/web search section. MCP asks for a server URL but I'm not sure what to put there, I just want to test web seraching capabilities.+

⬆ upvote 0↩ reply 0

𓀐 @SBmqAp8B: Please. Stop.+

⬆ upvote 0↩ reply 0

𓀐 @oH9nqoke: everything is fine+

⬆ upvote 0↩ reply 0

𓀐 @pyo6krY7: Stop gooning and answer meee can Openwebui do cards??+ 1

⬆ upvote 0↩ reply 1

𓀐 @9XYrR=Qf: nigga use orb and vibe in whatever you dream of+

⬆ upvote 0↩ reply 0

𓀐 @ubM4J2pV: I'm out of the loop I guess, tf is Orb even?+ 1

⬆ upvote 0↩ reply 1

𓀐 @NvLtB_Ug: Looks kind of ugly. I'm going to stick with ShittyTavern.+

⬆ upvote 0↩ reply 0

𓀐 @898f+cYH: No way they also put the filter on s.0y that's insane, the pure text is board / site culture whatever that's fine but blocking ways to move around it is an active attempt to censor speech. Holy shit I do not respect this website or the people who run it AT ALL.+

⬆ upvote 0↩ reply 0

𓀐 @BwfnvEUX: chatgpt/claude are way better at code, it's fine for hobbyists not for B2B where you don't settle for the second/third best.+

⬆ upvote 0↩ reply 0

𓀐 @p~UzC~DY: Why does deepseek write like that? It's so weird.+

⬆ upvote 0↩ reply 0

𓀐 @a*t3iKVw: I still dont get of investing of 1000gb of ram and H200 ?? Maybe faster Video gen, but im already happy with 6 to 10 minutes porn gen with My 5070ti ?? Chatbot ?? cant you talk to real people instead ?? Writing ?? Can you just do it yourself. I still dont get it. Can someone elaborate ? Whats the point of Local Models except for Image/Video Genning (which you can do with 16gb GPU) ???+

⬆ upvote 0↩ reply 0

𓀐 @Hg7aJDtz: >And yes, I do have a prostate! Because I am female, my primary reproductive gland is the uterus, but the prostate gland... well, it's actually a small gland situated around the urethra, right at the base of the bladder, and it plays a huge role in producing pre-ejaculate fluid, which is what adds to the 'wetness' during arousal! so this is the power of gemma 4?+

⬆ upvote 0↩ reply 0

𓀐 @qsNZHgD~: Instead of depending on one giant model to get everything right off the cuff, it breaks each turn into separate director / writer / editor agent tasks. Director describes the scene and what it thinks the user's intent is, passes its notes to the writer so it can formulate the actual reply, then the editor checks the writer's output for repeating slop patterns. It makes small models much less stupid and enables you to see exactly where the model is getting confused.+

⬆ upvote 0↩ reply 0

𓀐 @HEwtZMc~: That's how everyone here feels, scroll around some threads and you'll notice how no one ever talks about actually interacting with the models, it's just people vibecodign random shit, at most some funny snippets they got while testing something.+

⬆ upvote 0↩ reply 0

𓀐 @gHQwd+*T: Is HauhauCS that bad? I noticed some weird things happening on the a4b model, so I'm starting to wonder...+

⬆ upvote 0↩ reply 0

𓀐 @BzE+g9_e: get googles qat quant.+

⬆ upvote 0↩ reply 0