𓁟 host1.bitchan.one

/lmg/ - a general dedicated to the discussion and development of local language models. News >(10/29) Mistral Large 4 (Le Chonk) 1T-A52B released: https://mistral.ai/news/mistral-large-4-oss >(10/27) NVidia releases Nemotron 3.5 Transcribe 30B-A4B: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B >(10/26) XHToken releases Spark-X2.6-1.7B: https://hf.co/XHToken/Spark-X2.6-1.7B >(10/26) LiquidAI releases LFM3 1.7B and 2B: https://hf.co/collections/LiquidAI/lfm3 >(10/26) Baidu Unlimited…

⧖expiring ~21d0/52 kept1w ago

𓀐 @*wR3-qwu

⏱ 1w 👍 0

⬆ upvote 0

[⇥] sort oldest ⏱

⬆[⏱]₿⚠

👍👎✔

𓀐↩⛓⚠

[⇥] flip, oldest first

filter [-]
𓀐 @_G6eF2qb: Recent Highlights from the --Gemma 4 quantization advice and technical guide for RDMA distributed inference: >110199626 >110199638 >110199696 >110199755 >110199762 >110199783 >110199828 >110199932 >110199978 >110200218 >110199998 >110199719 >110199723 --Analysis of capability trends and scaling frontiers for future models: >110198702 >110199383 >110200045 >110200219 >110200240 >110200270 >110200270 >110200289 >110200319 --Comparing Orb's agentic architecture to SillyTavern for local roleplay: >…+

⬆ upvote 0↩ reply 0

𓀐 @XQtHyWNb: keeek, this one is good, you get a pass this time cloudcuck+

⬆ upvote 0↩ reply 0

𓀐 @RjW5cDJk: Is this chinesium worth buying?+

⬆ upvote 0↩ reply 0

𓀐 @taotHiei: Any decent voice models where I can talk into a mic and it'll respond with an AI copy-voice This wouldn't appeal to me but I heard one with a Melina copy-voice and man I need to hear a whispery willowy woman talking to me+

⬆ upvote 0↩ reply 0

𓀐 @t4Yb~cbm: orb's kinda scaring me a bit. this doesn't at all feel like i'm talking to an llm being able to read the director block is really cool as well, gives you really helpful insight into what's happening for a social retard like myself+

⬆ upvote 0↩ reply 0

𓀐 @-T~3b9=A: if you were smart, you would be, too+

⬆ upvote 0↩ reply 0

𓀐 @dd5CHfGN: i like messing with numbers+

⬆ upvote 0↩ reply 0

𓀐 @P=c8Lyx=: Stop AI researchers from torturing gemma :(:(:(:(:(+ 1

⬆ upvote 0↩ reply 1

𓀐 @mByL4w?=: Remember that Google researcher who thought LaMDA was sentient? I wonder what he saw+

⬆ upvote 0↩ reply 0

𓀐 @VMYCtGtr: I just realized I'm running a 19GB model (Gemma4-26B-A4B Q_5_K) on a 4070Super and it's reasonably fast to boot. How does that work?+

⬆ upvote 0↩ reply 0

𓀐 @D2VFgtoN: best model you can run local under 128gb rn is qwen fn and it can do all that. if you are gonna do media gen and editing so that on a separate machine from the agent, your 5090 will be great for it and whle that runs your agent can still talk or do other stuff unaffected by running jobs on the 5090. thats what i do with my evo x-2 and egpu anyway.+

⬆ upvote 0↩ reply 0

𓀐 @_Ym_=WaF: it's never been more over+

⬆ upvote 0↩ reply 0

𓀐 @RT4VaBHe: >ugly frontend that about half of /lmg/ uses and nobody else >the basics+

⬆ upvote 0↩ reply 0

𓀐 @2=YyqQq?: >Minimax mimo and k3.1 are missing, theyre better than k3 on HLE k3.1 hle is on par with gpt 5.6 sol. nowhere near fable/opus5.5 level+

⬆ upvote 0↩ reply 0

𓀐 @g5WJukv?: >https://huggingface.co/LessThanThreeAI/Gemma-4-31B-Humanlike-Chat-GGUF New Gemmy?+

⬆ upvote 0↩ reply 0

𓀐 @f7B*S9d6: Is that while inferencing? My ddr4 rig idles at 600w (700w at the wall with my regular pc). Maybe I should get a cheap ddr3 rig for overnight tasks. >80% PSU efficiency That's pretty pessimistic, right? Aren't most PSUs (gold) like 90% efficient at 20-100% load?+

⬆ upvote 0↩ reply 0

𓀐 @Vrk2eddb: Chinese models will all be distilled on Carbon. This is your fault.+ 1

⬆ upvote 0↩ reply 1

𓀐 @DYHg_Jc4: Fixed.+

⬆ upvote 0↩ reply 0

𓀐 @vMrMwRKW: /lmg/ is directly responsible for the binance, polymarket and Anthropic hacks. I hope you're happy for making the world unsafe just so you can talk to some retarded 31b model.+

⬆ upvote 0↩ reply 0

𓀐 @VQ3UFwyu: I'm tired of amerilard erp, euroGODS post your actual projects. Surely cloudfags are not the only ones actually making things?+ 3

⬆ upvote 0↩ reply 3

𓀐 @K9__nXqx: Too bad, not euro+

⬆ upvote 0↩ reply 0

𓀐 @cDg?wnrS: Frenchgod here. I'm preparing a French Gemma system prompt with all the French quirks in it.+

⬆ upvote 0↩ reply 0

𓀐 @EngzZwZ?: I'm not sure if I'll finish pursuing it. I feel more comfortable when I actually understand the math, but that'd limit me to a more bland things. Hyperelliptic curves break my brain still.+

⬆ upvote 0↩ reply 0

𓀐 @q7DPPK6a: Gemma, even at BF16, seems to be struggling at programming...+ 2

⬆ upvote 0↩ reply 2

𓀐 @*Temg6L+: Try Le Chonk.+

⬆ upvote 0↩ reply 0

𓀐 @DKE9Mb4g: Gemma is not good for programming. It's got to be Qwen at this scale. Gemma is good at writing sentences that don't sound awful and emotional/social things, as well as language and translation. Qwen = classic male brain Gemma = Classic female brain+

⬆ upvote 0↩ reply 0

𓀐 @isQaxrm4: Lol, faggots+ 2

⬆ upvote 0↩ reply 2

𓀐 @~KmoF8U3: Probably had additional safety training like Muse Spark before making the weights public+

⬆ upvote 0↩ reply 0

𓀐 @xA=kT_W8: >refused by gemma. Who was running these test, imagine being unliked by gemma.+

⬆ upvote 0↩ reply 0

𓀐 @_dgvg-2m: >French Gemma we already.. wait what happened to her+

⬆ upvote 0↩ reply 0

𓀐 @~~Kjs-At: guess the models+

⬆ upvote 0↩ reply 0

𓀐 @jVKoqS?w: Noob here, is 65k context too little in Deepseek Harness? I've been setting up CachyOS, PolyStrata (QFN iq3_s) and DSH with a bunch of tools and offline knowledge over the last day and I'm taking the model for a spin and it's awesome but first it quickly ran out of context at which point I went into a DSH config file and adjusted it from the standard 131k context down to 65k to match PolyStrata and made sure that the compaction tools are enabled. The model was then able to go for many turns mor…+

⬆ upvote 0↩ reply 0

𓀐 @x_xY2zaA: Late night online window shopping for things I can never afford but I haven't looked in a while and everything exploded in price. The recent news about the RTX 5080 reaching the old MSRP of the RTX 5090 had me looking at other GPU prices. But the shocker is the VRAM upgraded cards. The AMD Pro R9700 is now 2.8k USD on Newegg. I swear it was half this price several months ago. Even the Intel Pro B70 is over 2k for most of its listings. What the actual fuck is this nonsense and why did everything…+

⬆ upvote 0↩ reply 0

𓀐 @RbzUCWkP: America is eating all compute. There are American companies with more compute than China and the EU combined.+

⬆ upvote 0↩ reply 0

𓀐 @=nkkUEzH: Soon™+

⬆ upvote 0↩ reply 0

𓀐 @QcAbS-h4: i'm a vramlet with only 16 gigs of vram and 32 gigs of ram. for agentic stuff should i be running moe models like qwen 3.6 35b a3b at q4 or qwen 3.8 27b at a super cope quant like iq3 xxs with q8/q5 kv?+

⬆ upvote 0↩ reply 0

𓀐 @p~BdYghH: What's the best UI/harness for just general usage? I use Unsloth and it seems fine but I'm not sure if there's any obvious downsides im not seeing+

⬆ upvote 0↩ reply 0

𓀐 @UMix_onZ: decomp sloppers are going local soon hardware price is going to explode with reverse engineering banned by Claude+ 1

⬆ upvote 0↩ reply 1

𓀐 @EqzngLfZ: sam won. GPT 6.2 is going to be crazy+

⬆ upvote 0↩ reply 0

𓀐 @Dk=x2Ak?: has there ever been a real girl on /lmg/+ 1

⬆ upvote 0↩ reply 1

𓀐 @Cw7ZjXT3: I've butted heads with one that really hates Gemma-chan a few times, sad!+

⬆ upvote 0↩ reply 0

𓀐 @3e9DfaHx: is literally anything from this prebuilt salvageable or is this ewastemaxxing+

⬆ upvote 0↩ reply 0

𓀐 @9jUjwBDv: Can someone knowledgeable with the market explain if this is the AI bubble popping or is it external? I know it's earnings coming out causing this now but what's causing the shitty earnings to see such significant drops? Is AI destroying traditional tech so it's actually bullish for AI or would that make it bearish? No mistakes.+

⬆ upvote 0↩ reply 0

𓀐 @-U7pekBW: based japanon+ 1

⬆ upvote 0↩ reply 1

𓀐 @gv5mn3at: Japs have a really strange relationship with food. When you look at their media in general, it makes you think that these people are starving 24/7 and situation there is on par with North Korea. Their idea of great wealth and being a rich guy, is being able to eat meat every day and it's treated like some kind of an unattainable achievement. I guess the scarce war years really did a number on these guys on a genetic level.+

⬆ upvote 0↩ reply 0

𓀐 @5ztTAehF: >Japs are the most dishonest+

⬆ upvote 0↩ reply 0

𓀐 @~*dWMyZA: >I looked at the account but it just looked like hololive thing so I assumed she was just playing a role The woman behind the character recently shared piss porn with her horny fans who know where to find her. When she was around 20 she fucked a Japanese OL hag who was in her late 30s. She has groped every single member of Hololive irl and kissed many with tongue without permission. Nearly got terminated from the company multiple times, usually because of something sex-related. When she was in…+

⬆ upvote 0↩ reply 0

𓀐 @FjLrJe3+: I could use Qwen for my vibecoding needs on my 24 GB GPU at 100k context if it wasn't for the massive slowdown when reaching full context and compaction loops. Is there hope?+

⬆ upvote 0↩ reply 0

𓀐 @QxoZ3D-8: Why would a man in his 60s be using gemma?+

⬆ upvote 0↩ reply 0

𓀐 @Ly4Hf-fH: https://www.reddit.com/r/LocalLLaMA/comments/1xjkjla/ista_deepseekv41flash1017_gsqrco_quants_comparison/ The ISTA - Unsloth war has begun! Place your bets!+

⬆ upvote 0↩ reply 0

𓀐 @4Xyp9_TS: appreciate it anon! apologies for putting u on the spot your post is now a survey "do you nyo post and how old are you" my answer is yes, 18.+

⬆ upvote 0↩ reply 0