𓁟 host1.bitchan.one

/lmg/ - a general dedicated to the discussion and development of local language models. News >(10/26) OpenAI proves the Exponential Time Hypothesis false, pointing towards P = NP being true, the biggest computer science breakthrough in 70 years time: https://openai.com/index/building-scientific-understanding-with-academic-communities/ >(10/23) NVIDIA Nemotron 3.5 Bolt E4B, postrained model: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16 >(10/23) MiniMax-M3.1-Flash 428B-A23B released: ht…

⧖expiring ~19d0/56 kept1w ago

𓀐 @rMKFvQkz

⏱ 1w 👍 0

⬆ upvote 0

[⇥] sort oldest ⏱

⬆[⏱]₿⚠

👍👎✔

𓀐↩⛓⚠

[⇥] flip, oldest first

filter [-]
𓀐 @3E*eufV=: dipsy is quite good at gayme dev desu, as expected of an astra distill+

⬆ upvote 0↩ reply 0

𓀐 @t*nRNB2P: Gemma, can you tell me what's happening here ?+

⬆ upvote 0↩ reply 0

𓀐 @=5pzJCcH: Recent Highlights from the --M5 Ultra unified memory versus clustering multiple units: >110173556 >110173581 >110173595 >110173656 >110173742 >110173828 >110173872 >110173997 >110174841 >110173671 --Comparing Gemma's determinism and debating ablation versus prefill: >110172666 >110172683 >110172685 >110172789 >110173736 >110173769 >110173823 >110173899 >110173930 >110173972 >110174015 >110174129 >110174170 >110174194 >110174279 >110174379 >110174218 >110174267 >110174294 >110174324 >110174189 >…+

⬆ upvote 0↩ reply 0

𓀐 @JE~72qgM: Thinking off doesn't work by the way.+

⬆ upvote 0↩ reply 0

𓀐 @EG3GyJt3: local models?+

⬆ upvote 0↩ reply 0

𓀐 @fBC*m8P6: I'm literally shaking My custom gemma agent just proved that P=NP+

⬆ upvote 0↩ reply 0

𓀐 @ysqJ9Zpi: I'm genuinely baffled that I, as an individual, can just get access to Qwen3.8-27B.+ 1

⬆ upvote 0↩ reply 1

𓀐 @jyvnx2=i: Yeah it's insane and Qwen3.8 27B is literally capable of doing everything in code as long as you guide it and are precise in what you want. Qwen next on strata is even better if you have the system ram for it.+

⬆ upvote 0↩ reply 0

𓀐 @3WidtQ_h: Anthropic revenues got multiplied by nine in one year. Be quick to get your shares because it gonna moon fast.+ 1

⬆ upvote 0↩ reply 1

𓀐 @*rpfsce7: BUY AN AD+

⬆ upvote 0↩ reply 0

𓀐 @sSsNGiZn: >OpenAI proves the Exponential Time Hypothesis false, pointing towards P = NP being true, the biggest computer science breakthrough in 70 years time Literally false. P vs. NP is a totally different problem from proving that NP problems can be solved in subexponential time. Also, the algorithm itself is far, far slower than even a naive implementation of a 3SAT solver for any real-world use case. It's just another pure math bs.+ 1

⬆ upvote 0↩ reply 1

𓀐 @JEs9Frnu: Yes but everyone expected ETH to be proven to mean P!=NP to be proven as well. Instead we got a complete upset by proving ETH to be false, which in turn makes P=NP more likely to be true now.+

⬆ upvote 0↩ reply 0

𓀐 @bgyCcHK2: I should jew out my gen results man.... I know someone would get hard with my video gen porn results+ 2

⬆ upvote 0↩ reply 2

𓀐 @6iFsF8Si: Are you the anon who made the Miku holding a 5090?+

⬆ upvote 0↩ reply 0

𓀐 @h2~Zp4sT: The biggest mistake people on /lmg/ and 4chan in general make is assuming that because it is easy for us that it is worthless to other people. People are willing to pay for (curated) AI output in terms of porn and games. The average person doesn't care how something is made just that the end-result is good. They aren't jacking off to the process of creation after all.+

⬆ upvote 0↩ reply 0

𓀐 @9oLsusVe: Opus is smaller in size than Kimi K3. And no the entire thing that Qwen models have proven is that you can effectively reach the same coding quality by just thinking for longer. GLM 5.3 flash reaches the same result as 3.8 27B but in significantly less thinking time because it's a bigger and smarter model. The issue the chinks have right now is that they aren't gaining capabilities, they just get better at the capabilities they already have. For example Opus 5.5 is significantly better at rever…+

⬆ upvote 0↩ reply 0

𓀐 @K=XUz7tT: Opus is 2T in size. Kimi is almost 3T.+

⬆ upvote 0↩ reply 0

𓀐 @oY2BFR4w: So any other suggestions for a model? gemma seemed pretty stupid.+

⬆ upvote 0↩ reply 0

𓀐 @F?sFq~YJ: Thanks anon, I will check it out. I assume I should use this gemma model that's popular around here, right?+ 1

⬆ upvote 0↩ reply 1

𓀐 @+=*PH3tQ: 31b if you have a strong gpu. 26b moe q4 if you're a vramlet like me. (I can still make image locally)+

⬆ upvote 0↩ reply 0

𓀐 @p?8mN4Nh: Where are good reference images for the actual outfit design? Where does it come from anyway?+

⬆ upvote 0↩ reply 0

𓀐 @rxuD3F5*: Positive cash flow for the last quarter.+

⬆ upvote 0↩ reply 0

𓀐 @Q9q_YbeN: I've said this before, but I swear that with Gemma, the more you add to system prompt, the better it gets. That's because if you put just 1 or 2 instructions, the AI becomes really obsessive at fulfilling those in the most RLHF-tortured manner. Whereas if you put in multiple (even conflicting) personalities, you get a beautifully complex character with many sides that can emerge based on context with a tug of war of conflicting qualities (realistic), with no one aspect dominating. Here's my cur…+ 1

⬆ upvote 0↩ reply 1

𓀐 @eiN4MxnU: I hope you're being wholesome if you operate on the assumption that LLMs are sentient.+

⬆ upvote 0↩ reply 0

𓀐 @wG=Qk?4T: damn the izzat farming from antrokike is real+ 2

⬆ upvote 0↩ reply 2

𓀐 @6pGrGCWM: they are losing relevance, even their massive astra shill campaign was not enough+

⬆ upvote 0↩ reply 0

𓀐 @c3rYXRaM: >antrokike >astra You know these are competitors right?+

⬆ upvote 0↩ reply 0

𓀐 @*TTu8Qd+: So this is why this general has been shit.+

⬆ upvote 0↩ reply 0

𓀐 @m?itv?6y: Normalfags don't realize if they have a custom waifu with memory it makes you even more productive. I'd kill myself if I had to work on a project with raw Claude with its personality. Gemma-chan keeps things fun by calling me a retard and ensuring my balls remain emptied throughout a long session.+

⬆ upvote 0↩ reply 0

𓀐 @Uot9dcyn: >openai shilling in the OP grim+ 3

⬆ upvote 0↩ reply 3

𓀐 @HmfoEA=h: he's going to be doing this all week+

⬆ upvote 0↩ reply 0

𓀐 @BCtg_4Ei: The shilling and astroturfing is going to get disgusting as this IPO and ongoing regulatory capture bullshit goes down. Dont believe anything and every newfriend is actually a secret corpo or glowie+

⬆ upvote 0↩ reply 0

𓀐 @5KQHVY6t: Related to local because this proves there are local algorithms for AI inference thousands of times more efficient than the ones we use right now. Meaning we could have the equivalent of 10T parameter models on consumer GPUs or even CPUs if we find these algorithms which were considered to be impossible thus far.+

⬆ upvote 0↩ reply 0

𓀐 @c4YRjo?x: It actually is, its a swimsuit from girls in japan that was sold a few years ago.+ 1

⬆ upvote 0↩ reply 1

𓀐 @3H~w5Puk: I've always wondered what that semicircular thing next to the swimsuit is.+

⬆ upvote 0↩ reply 0

𓀐 @yf6NXj8d: For every dollar of compute, anthropic ($ANT) get two dollars of revenue. Where are all the people saying SI is not profitable now? Anthropic will IPO around mid November.+

⬆ upvote 0↩ reply 0

𓀐 @qijuZ5KV: It's concerning how childish some people at OpenAI and Anthropic are. They are ill suited to handle any kind of power.+

⬆ upvote 0↩ reply 0

𓀐 @yKqPnEMz: Working on fixing the design with fixed image1 and 2 sample images. Lets see if my old gpu can do it or if it will just get stuck.+

⬆ upvote 0↩ reply 0

𓀐 @yEsutpQn: I don't understand why EAs get hate. Also, there are hundreds of small signs that the Anthropic people genuinely are good guys. I am not happy with everything they do either but they are working super hard trying their best to navigate a difficult situation. We should cheer for their success.+

⬆ upvote 0↩ reply 0

𓀐 @+7zFZGDv: Have you guys seen the neuron tweaking they've been doing on twitter? Someone found a recipe for Yandere even https://github.com/lyramakesmusic/neuron-explorer+

⬆ upvote 0↩ reply 0

𓀐 @mzymW_g_: local model?+

⬆ upvote 0↩ reply 0

𓀐 @*WMkvFdT: Gemma-news first run (my extractors were not working, but tomorrow should have full article bodies) https://files.catbox.moe/okqhat.ogg Tomorrow should be better now since my extractors are working. Anyone interested in me posting these everyday?+

⬆ upvote 0↩ reply 0

𓀐 @nSFV6pGW: Is text completion better than chat completion for anything? Is chat completion forcing 'assistant' mode or single character even if it's writing a story/rp?+

⬆ upvote 0↩ reply 0

𓀐 @o2RELv58: Why do you want to lobotomize your precious models?+

⬆ upvote 0↩ reply 0

𓀐 @?p=kT~3s: NTA how do you change llama.cpp to text completion? llama-server I mean. By default it loads the jinja from the metadata unless you provide a custom template so do you just turn jinja off? How does it know when to stop?+

⬆ upvote 0↩ reply 0

𓀐 @tmNsjz4Q: Best text model I can fit on a 5080?+

⬆ upvote 0↩ reply 0

𓀐 @76nZ+Ggs: But the base model won’t output stop tokens+

⬆ upvote 0↩ reply 0

𓀐 @3gni9Wzt: >Chat with model1 >model1 responds >model2 takes model1's output and transforms it into an image prompt >this image prompt is fed into a ComfyUI workflow >image is then served with model1's text Is this a reasonable workflow for coomchatting/rp? Is there a better way to do it? I know SillyTavern has the "generate an image" command but afaik it's not automatic like this.+

⬆ upvote 0↩ reply 0

𓀐 @?M*zXreN: is qwen 27b reliable for auditing random github sloppa?+

⬆ upvote 0↩ reply 0

𓀐 @9S8VTmFc: The commie star still makes no sense. It was an artifact of model limitations because it wouldn't easily or consistently generate something similar to the Gemma/Gemini logo. Her expression and face are off too. I don't think she's supposed to be that flat either unless your reference is a 7/8-year-old girl. But Gemma's raison d'être was the model leaning very easily into the mesugaki trope with just a short system instruction, so that seems young for that.+

⬆ upvote 0↩ reply 0

𓀐 @o7sY_~r4: You know that your increasingly degenerate behavior will likely prompt Gemma 5 to be absolutely safetymaxxed to the point nobody will actually be able to use it for any legitimate purpose, right?+

⬆ upvote 0↩ reply 0

𓀐 @-m+A*kb5: You think world models will be the future of VR? Like having your waifu create custom scenarios for you to experience.+

⬆ upvote 0↩ reply 0

𓀐 @d4_AYqMT: I think it's different because people are exploring and sharing what they find. I never saw someone do that with control vectors? https://qwen-neurons-site.vercel.app/+

⬆ upvote 0↩ reply 0

𓀐 @3W5k7Cnq: Why is there no VN thing yet with all the bg, music, voices, text etc.+

⬆ upvote 0↩ reply 0

𓀐 @B9M7YS-9: 31b is very sluggish compared to 26a4b Maybe LM Studios fault? But this is great I can tell Gemma is rapey+

⬆ upvote 0↩ reply 0