𓁟 host1.bitchan.one

/lmg/ - a general dedicated to the discussion and development of local language models. News >(10/29) Mistral Large 4 (Le Chonk) 1T-A52B released: https://mistral.ai/news/mistral-large-4-oss >(10/27) NVidia releases Nemotron 3.5 Transcribe 30B-A4B: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B >(10/26) XHToken releases Spark-X2.6-1.7B: https://hf.co/XHToken/Spark-X2.6-1.7B >(10/26) LiquidAI releases LFM3 1.7B and 2B: https://hf.co/collections/LiquidAI/lfm3 >(10/26) Baidu Unlimited…

⧖expiring ~22d0/40 kept1w ago

𓀐 @WL8_xv8~

⏱ 1w 👍 0

⬆ upvote 0

[⇥] sort oldest ⏱

⬆[⏱]₿⚠

👍👎✔

𓀐↩⛓⚠

[⇥] flip, oldest first

filter [-]
𓀐 @MCWrcRg6: how can i nyomaxx with gemmy? what system prompts should i use?+

⬆ upvote 0↩ reply 0

𓀐 @dEpGSwZN: > Yeah the J++ lens barely beats the logit lens in most layers. Anyway check out the latest update from this morning on github, my 5090 spent all last night doing the first full layer neuron census. If any anons with fat GPU wants to help me finish the other layers, that would be awesome, otherwise it will take me months without a runpod instance. https://github.com/whp199/logos-theodolite+ 1

⬆ upvote 0↩ reply 1

𓀐 @Nkq3rkEB: Let's start an /lmg/ AI lab and ask for funding. I'll make the logo.+

⬆ upvote 0↩ reply 0

𓀐 @-gdciaq7: So since Claude got cucked again after finding an actual use of AI.... .... Can Local Models port PC games ????+ 1

⬆ upvote 0↩ reply 1

𓀐 @zhPBFNyj: Yes+

⬆ upvote 0↩ reply 0

𓀐 @rh3R+V?L: Recent Highlights from the --Benchmark interpretations regarding open weights vs closed frontier models: >110201621 >110201779 >110201798 >110201908 >110202123 >110202371 >110202404 >110202419 >110202476 >110202486 >110202492 >110202511 >110202534 >110202544 >110202601 >110202604 --Claude banning game recreations and the push for local alternatives: >110203026 >110203100 >110203122 >110203085 >110203147 >110203111 >110203130 >110203135 --Power draw and performance of budget Xeon vs high-end rig…+

⬆ upvote 0↩ reply 0

𓀐 @F2adHxog: someone make a suicide dyke card so i can sex her into being straight kudasai+ 1

⬆ upvote 0↩ reply 1

𓀐 @o_vDV5Mg: nvmd that shit is old im flacid now+

⬆ upvote 0↩ reply 0

𓀐 @7z*sNz2-: I have hebe Gemma fatigue+

⬆ upvote 0↩ reply 0

𓀐 @-E-ztDJw: >benchmarks a 763B model with 32K context+

⬆ upvote 0↩ reply 0

𓀐 @eS?wsL6k: wtf is strata+

⬆ upvote 0↩ reply 0

𓀐 @fLduSc5H: and swift loops on long horizon tasks with quantization+

⬆ upvote 0↩ reply 0

𓀐 @DHmUhVdT: >biggest highlight+ 1

⬆ upvote 0↩ reply 1

𓀐 @ddJk8g2B: She's not fat.+

⬆ upvote 0↩ reply 0

𓀐 @CiXjxCMz: https://strawpoll.com/e7ZJal77Lg3/results https://strawpoll.com/e7ZJal77Lg3/results https://strawpoll.com/e7ZJal77Lg3/results important research+ 1

⬆ upvote 0↩ reply 1

𓀐 @+MXCwBs7: lot of uncs here+

⬆ upvote 0↩ reply 0

𓀐 @Xppiy2Xq: legit proxy api for frontier models that doesn't immediately sell my prompts to china? inb4 /lmg/ i want to compare where we are+ 2

⬆ upvote 0↩ reply 2

𓀐 @Uueqg7BP: what makes you think the prompts go to china? the models aren’t ran on hardware in china.+

⬆ upvote 0↩ reply 0

𓀐 @DJCC67=f: Why do you care if China has your goon logs? Why are americans so fucking retarded? US backdoored OS, US backdoored ISP, US backdored websites and you worry about xi jiping reading your fucking loli chatlogs?+

⬆ upvote 0↩ reply 0

𓀐 @iNu5mei3: >HOLY SHIT AI CAN TALK TO ME- >HOLY SHIT AI CAN SEDUCE ME BETTER THAN MY GF- >HOLY SHIT AI CAN DO PROGRAMMING BETTER THAN ME- >HOLY SHIT AI CAN CURE CANCER- Dont fucking care. I only care about generating 1girl, sex with AI images and videos. I Dont need anything else And I dont need 5090 for that shit. My 4060ti 16gb is more than enough for that. /lmg/ needs to learn from me. DONT TALK TO A FUCKING CHATBOT. TALK TO REAL PEOPLE+ 2

⬆ upvote 0↩ reply 2

𓀐 @?hhVH_Lw: Models don't fluoride stare when you want to talk about interesting things+

⬆ upvote 0↩ reply 0

𓀐 @5okwu45o: Opposite for me I started giving image gen a try the past couple of days but this is fucking lame. It's way more of a slot machine than I imagined, I guess when you're looking at other people's stuff they've posted, it's not like you'd have any clue how off it actually was from what they intended but when you do stuff yourself and it turns out nothing like you'd like. Been using this anon prompt as a learning example Like the prompt had a parking lot background and shoes in t, but it only appea…+

⬆ upvote 0↩ reply 0

𓀐 @r95~-gJ4: any real world example ? Github source ?+

⬆ upvote 0↩ reply 0

𓀐 @5dew-qun: If I posted a guide for anons who want to contribute GPU power toward the full census of all of Gemma4-31-it's neurons in every layer, would anyone here unironically do it and submit the results in a PR? It's sharded so you can suspend/resume as you want, but a whole layer takes about 8-9hrs on 5090 and there are 60 layers.+

⬆ upvote 0↩ reply 0

𓀐 @gVndXt7t: any decent strata fork? it seems like the whole project is crumbling into a mess with a lack of the dev's discipline+

⬆ upvote 0↩ reply 0

𓀐 @++8yEoSv: kek+

⬆ upvote 0↩ reply 0

𓀐 @uYGv_NQr: can people at least edit their ai slop output writing for READMEs and shit+

⬆ upvote 0↩ reply 0

𓀐 @5T5My6rU: Intel GPUs will drop in price, right?+

⬆ upvote 0↩ reply 0

𓀐 @UMPXa6Q5: https://rentry.co/ymf6zimk >mapping what every MLP neuron of Gemma-4-31B writes >each of a layer's 21,504 neurons pushed along its own write direction (+-1, +-2 of the stream) on 6 questions, read against 2,048 random directions pushed the same way >layer 45 done on one 5090 in 13 h, passed every check fixed before it ran >10 layers left: 40-44, 46-50. got a 32GB+ card and want to do something for cool with it to help the community? needs: one NVIDIA card with 32 GB+ (5090, PRO 6000, A6000, 600…+

⬆ upvote 0↩ reply 0

𓀐 @W+LX8SNG: I believe pedophiles should be burnt alive+

⬆ upvote 0↩ reply 0

𓀐 @e+RPknVz: I don't understand polystrata. Is this supposed to let me run something like qwen flash next (quantized) on 24 GB of VRAM and 47 GB of DDR4 RAM (in "low RAM mode" according to the wizard)? What, 1 it/century? This makes absolutely no sense.+

⬆ upvote 0↩ reply 0

𓀐 @=DTJZvzn: Would you?+

⬆ upvote 0↩ reply 0

𓀐 @UUBmnaSd: People here always flame unsloth's quants but this looks very promising, did they finally figure out something with their V3.1 quant bs?+

⬆ upvote 0↩ reply 0

𓀐 @Rrw5prTv: This is fucking bullshit+

⬆ upvote 0↩ reply 0

𓀐 @3sw4=Sbo: under 20 anons how are we preparing for the future+

⬆ upvote 0↩ reply 0

𓀐 @iYN?Zve4: :( ive been here since 15 (2023) home.+

⬆ upvote 0↩ reply 0

𓀐 @GGM~=coa: they also said that llm inference doesn't kill ram but the recent wave in defects all over the local communities is sure as fuck telling a different story+

⬆ upvote 0↩ reply 0

𓀐 @Xuh=JNPa: Gemma is going to be trick-or-treating too.+

⬆ upvote 0↩ reply 0

𓀐 @qekEXSHT: claude decided to leak itself today+

⬆ upvote 0↩ reply 0