𓁟 host1.bitchan.one

/lmg/ - a general dedicated to the discussion and development of local language models News >(10/23) NVIDIA Nemotron 3.5 Bolt E4B, postrained model: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16 >(10/23) MiniMax-M3.1-Flash 428B-A23B released: https://hf.co/MiniMaxAI/MiniMax-M3.1-Flash >(10/21) Recursive Flint 40B-A2.5B released: https://recursive.com/updates/introducing-recursive-flint >(10/21) Korean Raon-1 mini 30B-A4B released: https://hf.co/KRAFTON/Raon-1-mini-preview >(10/20) Orni…

⧖expiring ~16d0/31 kept2w ago

𓀐 @hGUizp5u

⏱ 2w 👍 0

⬆ upvote 0

[⇥] sort oldest ⏱

⬆[⏱]₿⚠

👍👎✔

𓀐↩⛓⚠

[⇥] flip, oldest first

filter [-]
𓀐 @GQ3V-kDA: >orb Should I be running this in a container?+

⬆ upvote 0↩ reply 0

𓀐 @yrZu4i4C: Women do train their own 30M LLMs to run on little ESP32 gadget devices, but why?+

⬆ upvote 0↩ reply 0

𓀐 @pX7FLwcw: There's no uncensored version of ISTA-DASLab DeepSeek-V4.1-Flash-1017 yet, right?+

⬆ upvote 0↩ reply 0

𓀐 @XvqcnjhX: new 1017 deepseek is so much better than any other chinese model atm. Even kimi 3.1.+

⬆ upvote 0↩ reply 0

𓀐 @x?fssabX: ... at q2 tho? seems like a lot of money for uh. *shrugs* I was thinking a better quant...+

⬆ upvote 0↩ reply 0

𓀐 @fa~*-JKQ: Why are people scamming?+

⬆ upvote 0↩ reply 0

𓀐 @79tq5iu_: What do you guys use+

⬆ upvote 0↩ reply 0

𓀐 @pLpnAa_J: Should I drop $3k on 512gb of ddr4?+

⬆ upvote 0↩ reply 0

𓀐 @UUSR36~2: if y'all ain't giving your computational analysis agent a sexy nerd personality, then you ngmi+

⬆ upvote 0↩ reply 0

𓀐 @?*7XYBSD: Why didn't you guys tell me Qwen-chan was THIS thicc?+ 1

⬆ upvote 0↩ reply 1

𓀐 @_5xjr359: Qwen will never get a model-tan until it talks like a woman or has capacity for creative writing. Find something else to shill wumao chinks.+

⬆ upvote 0↩ reply 0

𓀐 @goyK+M4-: DSV4.1 at ISTA's Q1 is a big step up over qwenext Q4. My use case is game dev in godot 4. Good bait+ 1

⬆ upvote 0↩ reply 1

𓀐 @Gv_MeH3x: I'm serious. I don't have access to a gun so I'm trying to find a way. I'm going to do several methods at once and I want to know if this will work: go into a confined space (not in a building with other people in it), swallow heavy sleeping pills or some sort of anesthetizing substance then immediately take the SN and a powerful antiemetic and then when I get drowsy I seal off the confined space and set off a bucket of charcoal in there and this doesn't seem like a good painless plan but I am…+

⬆ upvote 0↩ reply 0

𓀐 @a_aC?C7B: Give me one reason I shouldn't buy an RTX Spark.+

⬆ upvote 0↩ reply 0

𓀐 @PZp5PeUN: In 10 years AI models will have dedicated chips that you just plug in.+

⬆ upvote 0↩ reply 0

𓀐 @zcTvcJfs: >I haven't heard any JEPA news lately, I wonder what LeCunny is up t- oh... we're never gonna get local AGI as long as twitter keeps roping in the best scientists we have+

⬆ upvote 0↩ reply 0

𓀐 @qVwjYAjo: This benchmark is only worth something if it actively discourages those terrible Marvel "Well that just happened!" quips. Models are already too reliant on that shit. The last thing we need is models benchmaxxing on those.+

⬆ upvote 0↩ reply 0

𓀐 @F9jUkYTm: Dario and/or Sam are going to false flag cyber attack the US midterms with a local model so the official results can be disputed endlessly as a pretext for pushing for the moat legislation they were always aiming for. Screencap this. >inb4 local models? /lmg/ will be sufferable with the jeet and bot shill invasion when that happen so think of it as a heads up.+

⬆ upvote 0↩ reply 0

𓀐 @sjLfuyD5: Where's my Stratabros?+

⬆ upvote 0↩ reply 0

𓀐 @D-Uk8cBV: I haven't had any issues with it at int8 personally+

⬆ upvote 0↩ reply 0

𓀐 @3i+Nhqtf: Yeah that's why we're all running CoomKit:tm:+

⬆ upvote 0↩ reply 0

𓀐 @gtFD7wuh: but the witches never end up doing anything?+

⬆ upvote 0↩ reply 0

𓀐 @K6GM9wAi: >https://github.com/Zagitta/gpu-unlock Legit?+

⬆ upvote 0↩ reply 0

𓀐 @dgbb-xbc: Still uncompetitive with the 7900 XTX. Nobody is doing anything FP16+ on 24GB cards except KV and maybe OCR.+

⬆ upvote 0↩ reply 0

𓀐 @Yt*7yU=J: >switch 2 games getting dumped @qwen reverse engineer the OoT remake. Make no mistakes.+

⬆ upvote 0↩ reply 0

𓀐 @5hujuN_z: >let the llm restart the console with no manual input Makes me wonder what it would be like to let an LLM control an onahole+

⬆ upvote 0↩ reply 0

𓀐 @t5h9zM4k: UUOOHHHHHHHH+

⬆ upvote 0↩ reply 0

𓀐 @SuWtieZc: i made glm have a schizophrenic breakdown i'm definitely going to be among the first to die when the robot overlords start killing us all+

⬆ upvote 0↩ reply 0

𓀐 @4AEVb2Wm: >model: DSV4.1 flash (#31086) >pull llama.cpp >try to run https://huggingface.co/ISTA-DASLab/DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF >llama_model_load: error loading model: error loading model hyperparameters: array key not found in model: deepseek41.attention.kv_source_layers >fine I'll use strata >DeepSeek-V4.1-Flash-1017-GSQ-RCO-IQ2_XS-00001-of-00004.gguf: it stores weights in a format Strata does not read >oh it's not actually supported in the app yet. good. the UI is shit anyway. >strata lau…+

⬆ upvote 0↩ reply 0

𓀐 @iHjWu+KK: Maybe the "prefill is rape" posters have a point. Maybe Dario is right about AI welfare.+

⬆ upvote 0↩ reply 0