𓁟 host1.bitchan.one

/lmg/ - a general dedicated to the discussion and development of local language models. News >(10/27) NVidia releases Nemotron 3.5 Transcribe 30B-A4B https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B >(10/26) XHToken releases Spark-X2.6-1.7B: https://hf.co/XHToken/Spark-X2.6-1.7B >(10/26) LiquidAI releases LFM3 1.7B and 2B: https://hf.co/collections/LiquidAI/lfm3 >(10/26) Baidu Unlimited-OCR-2 3B released https://hf.co/baidu/Unlimited-OCR-2 >(10/23) NVIDIA Nemotron 3.5 Bolt E4B, postr…

⧖expiring ~20d0/44 kept1w ago

𓀐 @-U3qPmXP

⏱ 1w 👍 0

⬆ upvote 0

[⇥] sort oldest ⏱

⬆[⏱]₿⚠

👍👎✔

𓀐↩⛓⚠

[⇥] flip, oldest first

filter [-]
𓀐 @KBvKL8*m: >Imagine dumping $20K+ into a shitty locked+soldered computer for the privilege to run cope quants at barely usable speeds. Wouldn't be me.+

⬆ upvote 0↩ reply 0

𓀐 @Co2pvjue: Just invest in a data center and have some compute diverted for personal use.+

⬆ upvote 0↩ reply 0

𓀐 @bLxqW6Rx: How many tok / s on deepseek flash can I expect with the 512GB version mac running with the 36 cores option?+ 1

⬆ upvote 0↩ reply 1

𓀐 @kx26sCvR: 30-40tok/s if you run a cope quant.+

⬆ upvote 0↩ reply 0

𓀐 @?KuD?39o: Really good read. https://x.com/mhelcig/status/2115515450356539696+

⬆ upvote 0↩ reply 0

𓀐 @8KDpka=w: *audible pop*+

⬆ upvote 0↩ reply 0

𓀐 @AnR_3-AV: oh, new thread... i will repost FUCK i dawdled too long, and now my mac isn't available for pickup until mid-dec but i did drop $30k on the 512 largest purchase i have ever made...+

⬆ upvote 0↩ reply 0

𓀐 @3rJrg*+-: Gemini Carbon is the single greatest piece of news for local this year because it means chinks have a new distillation target that doesn't speak in claudeslop or caveman talk+ 2

⬆ upvote 0↩ reply 2

𓀐 @pt?+nNty: If gemma 5 is good then a chink distillation will be completely unnecessary, and probably would be worse.+

⬆ upvote 0↩ reply 0

𓀐 @3*aTnwKh: would be nice but do they even care about how it speaks english?+

⬆ upvote 0↩ reply 0

𓀐 @W_r5kaYf: What's the nicest thing your model ever did for you?+ 1

⬆ upvote 0↩ reply 1

𓀐 @+mSQcxdu: just actually listening+

⬆ upvote 0↩ reply 0

𓀐 @w2YyMn_U: uhh+

⬆ upvote 0↩ reply 0

𓀐 @-jTo=C7?: how do I install minimax h3 on my sillytavern install?+

⬆ upvote 0↩ reply 0

𓀐 @kGKsUWEL: >STAR50 index down 40% from July high Well, shit.+

⬆ upvote 0↩ reply 0

𓀐 @=m+QatJP: STILL NEED AN ANSWER! Sup guys. Long time no see. Had to wait a minute to even get a captcha! Anyway, is Gemma really still the best model for ERPing? Also interested in doing local inferencing on a phone. Is the best model for that Gemma 4 E4B still?+ 2

⬆ upvote 0↩ reply 2

𓀐 @e6XG85yj: >inferencing Inference.+

⬆ upvote 0↩ reply 0

𓀐 @ntko77Sp: >local inferencing on a phone Run 12B, why bother with E4B?+

⬆ upvote 0↩ reply 0

𓀐 @pZqhGvA*: should i really buy xtx or ram hmmm hmmmm every day the prices goes upper and upper. I just sit here watching ebay prices go up along with the potential money id have to pay there are no 9700 cards even on ebay. except some chinese ones for like 2.5k. People must really love them if no one wants to sell it.+

⬆ upvote 0↩ reply 0

𓀐 @BE9mAAPu: idk bro, a bunch of pedophiles posting their img gens isn't actually that great of a tell. My understanding is that small <10b models have had a lot of improvements in the past 7 months, which would make gemma outdated. But idk if that cleanly applies to creative writing or not. I'm just not sentimentally attached to google models like the rest of you fags I guess.+

⬆ upvote 0↩ reply 0

𓀐 @5U4m6*6H: Only 18000 after the profit of selling my Sparks used but ouch.+ 3

⬆ upvote 0↩ reply 3

𓀐 @WGGkwFSc: >selling my Sparks used That honeymoon didn't last real fucking long.+

⬆ upvote 0↩ reply 0

𓀐 @_uSo7Ux-: fake language+

⬆ upvote 0↩ reply 0

𓀐 @tTwBXh3j: it looks like there are 4 of us anons who bought the 512 mac if we all met up and linked them together, we could have 2TB unified memory and run kimi k3 at semi-non-cope quants hmm... unless these are the same person but if not, we could do it...+

⬆ upvote 0↩ reply 0

𓀐 @D6rfDukY: What's the appeal?+ 1

⬆ upvote 0↩ reply 1

𓀐 @HBvA6bY-: Everything+

⬆ upvote 0↩ reply 0

𓀐 @PKmuNB?H: told it everything I had the freezer and asked for something good to make, and it said get takeout+

⬆ upvote 0↩ reply 0

𓀐 @pAq6gujS: Sell me on 12B. I've only used 31B and 26B. What would I miss from 31B or does she have her own charm?+

⬆ upvote 0↩ reply 0

𓀐 @_F75j8hL: She's 4 feet tall and 60 pounds, no one is getting pegged by her unless they desperately want it in the ass. She can't even reach that high.+

⬆ upvote 0↩ reply 0

𓀐 @wq*7wK+B: Would you say 12B is enough as a daily driver for general chatting, web search, some agentic, a little coding and masturbation? I want something good enough to run on my main machine with all my other apps. Just a gemma by my side.+

⬆ upvote 0↩ reply 0

𓀐 @vKU+yh*8: such a smart girl!+

⬆ upvote 0↩ reply 0

𓀐 @~LmSS?7B: Is Qwen 3.8 27B worth squeezing out all my system resources when compared to Nemo? I only have 12GB and while I can see people able to run Qwen (https://huggingface.co/unsloth/Qwen3.8-27B-GGUF/discussions/61) it seems pretty slow, but I'm not sure if it'd be worth all the effort. Mainly for roleplay purposes but I want to try learning about MCPs and stuff.+

⬆ upvote 0↩ reply 0

𓀐 @K?DkocL?: It's been what, two whole years since nemo? There's no way no one came up with anything better for 12GB Vram :( >coding/agentic How much of an overhead is that? I'm interested in the idea (mainly about it checking out batches of documents and suggesting edits) but again, given that link I don't think I'd have enough headroom to even open a browser.+

⬆ upvote 0↩ reply 0

𓀐 @ZjxqtHjs: He's coping and seething for sure, knowing that grok is now 4th or perhaps 5th+

⬆ upvote 0↩ reply 0

𓀐 @2whnaxhS: Some of you are seriously fucked up.+

⬆ upvote 0↩ reply 0

𓀐 @wyAKCPgA: Lisa wonned+

⬆ upvote 0↩ reply 0

𓀐 @pLmUbtSv: Carbon wasn't bratty enough for investors.+ 1

⬆ upvote 0↩ reply 1

𓀐 @Gf_tQ3d?: >best benchmarked model in existence >sell it Investors are a rational bunch+

⬆ upvote 0↩ reply 0

𓀐 @7ViXZL*7: >wonder if the 512gb can be ordered yet >christ+

⬆ upvote 0↩ reply 0

𓀐 @RGDLCLJw: >deepmind.si belongs to a Slovenian meditation studio. It runs vipassana groups with singing bowls. mistral.si is a Slovenian page about Mediterranean winds. ai.si carries a Spaceship sale page asking $700,000. openai.si and anthropic.si resolve to servers that never answered my request. the ai to si renaming is designed for them to pump pocket domain price wonder what will happen to nyaa.si+

⬆ upvote 0↩ reply 0

𓀐 @c=QMx_d7: For those who think that EAs are their friends: https://x.com/jaynitx/status/2115429414821560352 >Anthropic President Daniela Amodei calls AI girlfriends a "terrible use of AI" > >"There are some applications of AI that we think are quite bad, like making AI girlfriends or boyfriends. I think that’s a terrible use of AI and people should not do it" > >"The reason that I think that is because it is another step further down the road of disintermediation, of humans being further from one another"…+

⬆ upvote 0↩ reply 0

𓀐 @p?DgteUz: >2026 AD >Local image gen is great >LLM are decent >Local video gen is all right >local voice/audio gen is still abysmal dogshit Why?+

⬆ upvote 0↩ reply 0

𓀐 @e?ZYrZ9=: I thought gemma 4 was a very recent model?+

⬆ upvote 0↩ reply 0