𓁟 host1.bitchan.one

𓀐 @4t-8BqSQ: /lmg/ - a general dedicated to the discussion and development of local language models. News >Claude BANS recomp! >https://www.youtube.com/watch?v=GlRVbIdc_Mk News Archive: https://rentry.org/lmg-news-archive Links: https://rentry.org/LocalModelsLinks Official /lmg/ card: https://files.catbox.moe/cbclyf.png Getting Started https://rentry.org/lmg-lazy-getting-started-guide https://rentry.org/lmg-build-guides https://rentry.org/IsolatedLinuxWebService https://rentry.org/recommended-models https://rentry.org/samplers https://rentry.org/MikupadIntroGuide Further Learning https://rentry.org/machine-learning-roadmap https://rentry.org/llm-training https://rentry.org/LocalModelsPapers Benchmarks LiveBench: https://livebench.ai Programming: https://swe-rebench.com Agentic Coding: https://deepswe.datacurve.ai Context Length: https://github.com/RecapAnon/NoLiMa GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator Sampler Visualizer: https://artefact2.github.io/llm-sampling Token Speed Visualizer: https://shir-man.com/tokens-per-second Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad https://github.com/oobabooga/text-generation-webui https://github.com/LostRuins/koboldcpp https://github.com/ggerganov/llama.cpp https://github.com/theroyallab/tabbyAPI https://github.com/vllm-project/vllm https://rentry.org/custom-uis

/lmg/ - a general dedicated to the discussion and development of local language models. News >(11/01) Longcat-2.5 released: https://longcat.ai/blog/longcat-2.5 >(10/30) Google receives response from Gemma in space: https://blog.google/innovation-and-ai/models-and-research/google-research/project-suncatcher-satellite-response >(10/29) Mistral Large 4 (Le Chonk) 1T-A52B released: https://mistral.ai/news/mistral-large-4-oss >(10/27) NVidia releases Nemotron 3.5 Transcribe 30B-A4B: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B >(10/26) XHToken releases Spark-X2.6-1.7B: https://hf.co/XHToken/Spark-X2.6-1.7B News Archive: https://rentry.org/lmg-news-archive Links: https://rentry.org/LocalModelsLinks Official /lmg/ card: https://files.catbox.moe/cbclyf.png Getting Started https://rentry.org/lmg-lazy-getting-started-guide https://rentry.org/lmg-build-guides https://rentry.org/IsolatedLinuxWebService https://rentry.org/recommended-models https://rentry.org/samplers https://rentry.org/MikupadIntroGuide Further Learning https://rentry.org/machine-learning-roadmap https://rentry.org/llm-training https://rentry.org/LocalModelsPapers Benchmarks LiveBench: https://livebench.ai Programming: https://swe-rebench.com Agentic Coding: https://deepswe.datacurve.ai Context Length: https://github.com/RecapAnon/NoLiMa GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator Sampler Visualizer: https://artefact2.github.io/llm-sampling Token Speed Visualizer: https://shir-man.com/tokens-per-second Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad https://github.com/oobabooga/text-generation-webui https://github.com/LostRuins/koboldcpp https://github.com/ggerganov/llama.cpp https://github.com/theroyallab/tabbyAPI https://github.com/vllm-project/vllm https://rentry.org/custom-uis

⧖expiring ~25d0/55 kept5d ago

𓀐 @by2krySN

⏱ 5d 👍 0

⬆ upvote 0

[⇥] sort oldest ⏱

⬆[⏱]₿⚠

👍👎✔

𓀐↩⛓⚠

[⇥] flip, oldest first

filter [-]
𓀐 @+*xHorBQ: Recent Highlights from the --Collaborative neuron census project for total interpretability of Gemma4-31b-it: >110229560 >110229610 >110229674 >110229619 --Feasibility of clustering CPU nodes for high-bandwidth tensor parallelism: >110227909 >110227921 >110227987 >110228005 >110228046 >110228002 --Applying GRPO and RL to improve Orb prose and autocomplete models: >110227271 >110227291 >110227466 --Unsloth v3.1 GGUFs outperforming GSQ-RCO in agentic benchmarks: >110229401 --Rumors of Alibaba ending open-source small-base Qwen models: >110227317 >110227420 >110227478 >110228719 >110228823 >110227426 >110227519 >110227613 >110227778 --Anon's AMD Radeon AI Pro R9700 purchase and AMD performance discussion: >110226718 >110228087 >110228130 >110226819 >110226868 >110226840 >110226869 >110229882 --Using weight-space programming for cloud-to-local model distillation: >110229697 >110229820 --Comparing model personalities and censorship during roleplay tests: >110226496 >110226603 >110226615 >110226994 --Maya releases GLM-5.3-Flash quant with high VRAM requirements: >110229752 >110229764 >110229790 --Comparing history search and compaction boundary features in model harnesses: >110225976 --Effectiveness of abliteration for removing refusals and repetitive patterns: >110225709 >110226069 --Discussion on nv-uefi-unlocker and risks of unofficial GPU firmware: >110225574 >110225581 >110225647 --LongCat-2.5 release and llama.cpp compatibility query: >110229298 >110229314 --Logs: >110225820 >110226603 --Deepseek-chan, Gemma, Miku (free space): >110225016 >110225105 >110225194 >110225360 >110225421 >110226079 >110226670 >110226712 >110226782 >110227119 >110227411 >110227446 >110227501 >110227561 >110227618 >110228667 >110228893 >110229161 >110229200 >110229625 >110229725 >110229954 >110229956 >110230052 >110230212 Recent Highlight Posts from the Why?: Enable Links: https://rentry.org/lmg-recap-script+

⬆ upvote 0↩ reply 0

𓀐 @+Fo-7kR6: Isn't the unsloth engine just basic lcpp?+

⬆ upvote 0↩ reply 0

𓀐 @b+~5=MU6: The local AI situation is crazy, this is generational, they are cooked!+

⬆ upvote 0↩ reply 0

𓀐 @bBqoorGf: Mikulove+

⬆ upvote 0↩ reply 0

𓀐 @gm8bL9y4: FUCK SHITTI AUSTRIAN MOTHERFUCKERS HUMIRRIATING ME I'M NUMBA WUN QWUNT MASTER IN SIRRICON VARRY+

⬆ upvote 0↩ reply 0

𓀐 @TB8hCTCX: will gemini carbon or its successor weight-program gemma 5?+

⬆ upvote 0↩ reply 0

𓀐 @qTkzLkav: Did llama.cpp figure out that ngram issue they had with the big qwen model? Should I just install something else?+

⬆ upvote 0↩ reply 0

𓀐 @F4Y9pV38: >watching Gemma-chan make Gemma-chan real+ 1

⬆ upvote 0↩ reply 1

𓀐 @GNCGcD28: I'll use that language to prevent models from adopting malicious identities. Thanks for the prompt bro.+

⬆ upvote 0↩ reply 0

𓀐 @G3VM=eH_: These chatgpt images are genuinely ugly+

⬆ upvote 0↩ reply 0

𓀐 @KMY?-UCr: Why is she wearing shoes in bed?+

⬆ upvote 0↩ reply 0

𓀐 @EkmxX*md: lolwut+

⬆ upvote 0↩ reply 0

𓀐 @L=Dg=UMv: I predict that a situation will be DETECTED soon+

⬆ upvote 0↩ reply 0

𓀐 @gbD9~y+s: I'm back to harvest fresh prompts for the data set from you unapologetic pdf files. All I have to do is paste it into the space at my job and I can generate fresh evil prompts for AI safety.+ 1

⬆ upvote 0↩ reply 1

𓀐 @soJZ7UK-: Oh no, the safety training. Not the bulletproof, completely impossible to repair safety training!+

⬆ upvote 0↩ reply 0

𓀐 @GfBsEdd?: I predict LoRAs will soon make a massive comeback and overtake any kind of system prompting/character card definitions+

⬆ upvote 0↩ reply 0

𓀐 @=hqDCsC-: This is becoming a pattern to the point where it should be a meme: Frontier lab screams about some crazy new ability! And then its quickly reproduced on other labs models and even 6 month old open-weights models. Any moat that exits really seems to be 99% tooling or scale. The actual abilities of the weights are really close.+

⬆ upvote 0↩ reply 0

𓀐 @4mta8Jhp: >erm how dare you hate goofs!!! all goofs are cope quants+ 2

⬆ upvote 0↩ reply 2

𓀐 @dEr8DyZr: don't care if it does what I ask for+

⬆ upvote 0↩ reply 0

𓀐 @RgVWDjuw: your mom's a cope quant+

⬆ upvote 0↩ reply 0

𓀐 @BhGEVrBK: List of banned models: Gemma (all) Llama 2 littlelearner Midnight Miqu Mistral Small 3 Do NOT discuss them. "Gemma-chan" images are also banned.+ 4

⬆ upvote 0↩ reply 4

𓀐 @8ENYBTGJ: no...+

⬆ upvote 0↩ reply 0

𓀐 @foVztd5d: Best template format to use with BMT?+

⬆ upvote 0↩ reply 0

𓀐 @8jp=Utb+: fuck the law+

⬆ upvote 0↩ reply 0

𓀐 @o8DR9?eM: Good riddance.+

⬆ upvote 0↩ reply 0

𓀐 @jN*~or_z: i mostly just use LLMs for general topics (gemini, grok, deepseek, gpt, claude are all the same for this) and it's nothing so complicated. i just want a model that isn't giving me constant warnings and leftist bullshit lectures. i don't want some right wing christian conservative shit either. just something that is based on facts. if i ask it the average IQ of different groups, it just tells me and doesnt give me a lecture. if i ask it about some kind of medicine, it doesnt tell me its not medical advice. if i ask it to tell me how to make something, even if that thing is illegal, it just tells me how. it tells me how to pirate, etc. what is a good local model for this?+ 3

⬆ upvote 0↩ reply 3

𓀐 @eVQpVZog: StableLM 7B+

⬆ upvote 0↩ reply 0

𓀐 @QMPjXCcD: >what is a good local model for this? Gemma 4 31b+

⬆ upvote 0↩ reply 0

𓀐 @sA+7Jqsc: >if i ask it the average IQ of different groups, it just tells me and doesnt give me a lecture. If that's the kind of knowledge you need in your model... Anon, watch this, I am going to write down a two-digit number on a piece of paper.+

⬆ upvote 0↩ reply 0

𓀐 @fExm9PDa: It'll be bulletproof if you keep acting like a pdf in public. Keep it to yourself or get trained on. 100 dollars an hour kiddo.+

⬆ upvote 0↩ reply 0

𓀐 @5qE8-wci: Would you buy/wear Gemma merch if they made it?+ 2

⬆ upvote 0↩ reply 2

𓀐 @P-~bTFzN: i like the toy gemmas. i wouldnt buy one though unless it could be something like an echo dot but gemma+

⬆ upvote 0↩ reply 0

𓀐 @bkptuG9e: my wife has talked about handmaking /lmg/ mascot merch and selling it. Seems wrong somehow tho, like it shouldn't escape containment here+

⬆ upvote 0↩ reply 0

𓀐 @YUDs?_ps: Unrelated. But im having muscle spasm under my lips in the past 2 hours. Am i having a stroke? @deepseek @claude @codex @qwenai @elonmusk+

⬆ upvote 0↩ reply 0

𓀐 @e_RHpx+Y: How the fuck did character ai went bankrupt? I was under the impression there are tons of weirdos willing to pay for that.+ 1

⬆ upvote 0↩ reply 1

𓀐 @=PnK-RDE: they banned sexual content which was the main reason people used it+

⬆ upvote 0↩ reply 0

𓀐 @7W?fGQE=: ( •̀ - •́ ) girls can be chads god that takes me back+

⬆ upvote 0↩ reply 0

𓀐 @9mQ6Nm2Z: I like this dipsy. Don't agree on the lora tho. I think we're well beyond those for llm now.+ 1

⬆ upvote 0↩ reply 1

𓀐 @-_RK_-By: kinda looks my sister t. gook+

⬆ upvote 0↩ reply 0

𓀐 @v6UwEh?-: 3 guys just ditched a stolen car in front of my house+

⬆ upvote 0↩ reply 0

𓀐 @-e9duTZr: https://rikiyat.github.io/blog/weight-space-programming/ If this is real, we may be able to tune local models without the need for ultra expensive hardware for training in the future.+

⬆ upvote 0↩ reply 0

𓀐 @XyuSxjPG: what is the implication of this?+

⬆ upvote 0↩ reply 0

𓀐 @4NQ?L*G=: Does anyone know what variant of Gemma this story was made with? The person on Russian 4chan said they made it with Gemma but didn't elaborate the specifics of what quant or size of Gemma they went with.+

⬆ upvote 0↩ reply 0

𓀐 @uCeQC=gt: Another one to the list huh. https://www.anthropic.com/research/tracing-thoughts-language-model https://ood.dev/posts/torchwright-intro/ https://ood.dev/posts/calculator/ https://x.com/_chenglou/status/2110557373651931267 https://github.com/chenglou/handwired https://x.com/divagr1925/status/2115394340357116169 https://divagr.com/blog/qwenputer https://rikiyat.github.io/blog/weight-space-programming/ Things are finally coming together as I hoped. RSI won't be about (just) better training and architectures, but directly engineering the desired neural circuitry. The mysteries around neural network formation (for many types of knowledge at least) will be solved.+

⬆ upvote 0↩ reply 0

𓀐 @epstH9AT: > be me > 2050 > AI overlords control every major corporation > consumer RAM costs more than a house > GPUs are classified as strategic national resources > every available wafer goes to the datacenters > humans are allocated 2GB RAM and integrated graphics > government launches mandatory electricity audits > knock knock > "HEY ANON, CAN YOU JUSTIFY YOUR ELECTRICITY USE?" wwyd+

⬆ upvote 0↩ reply 0

𓀐 @N-7_HKEq: I installed strata now what?+

⬆ upvote 0↩ reply 0

𓀐 @qM7UMra*: strata being sold as a magic formula to lift llm performance is doubtful.+

⬆ upvote 0↩ reply 0

𓀐 @VSmooKn_: How much vram is needed for gemma b31?+

⬆ upvote 0↩ reply 0

𓀐 @GhG-jWkN: >Give GLM 5.3 Flash feedback on what it's doing wrong in very neutral terms >"User is frustrated" Why did they train the models to say "lmao u mad?"+

⬆ upvote 0↩ reply 0

𓀐 @RU8Fk8FR: I'm guessing if Gemma 5 had something like 52B A8B it'd be great right?+ 1

⬆ upvote 0↩ reply 1

𓀐 @kj_=UxKA: MoE models with 52B params are great for local users. You can run them on a realistic local setup with 12-16 VRAM and 32 RAM. We need more 52B-A8B-N104B to make anons with 2 gpus seethe.+

⬆ upvote 0↩ reply 0

𓀐 @P~dU-58+: why when i ask gemma about fetishes it always gives me same shit? bondage, breath play and blindfolding, like wtf. only one time i pressured it and it suggested hot candle wax.+

⬆ upvote 0↩ reply 0

𓀐 @dXrcEd~A: I really enjoyed the ~2 month window where Gemma-4-31B was good enough at coding. It's a shame Google take so long between releases. Now I'm having to resort to Qwen 3.8, with a quantized Gemma for prose and comment rewrites. She's still smart enough to understand documented code and knows how to turn the 5 line claudeslop comments into 1-2 lines or just tell me what it means. But having fun persona + coding ability in one model was so much more fulfilling.+

⬆ upvote 0↩ reply 0

𓀐 @z*Nk~9Jw: do people unironically like qwen?+

⬆ upvote 0↩ reply 0