𓁟 host1.bitchan.one

/lmg/ - a general dedicated to the discussion and development of local language models. News >(10/26) XHToken releases Spark-X2.6-1.7B: https://hf.co/XHToken/Spark-X2.6-1.7B >(10/26) LiquidAI releases LFM3 1.7B and 2B: https://hf.co/collections/LiquidAI/lfm3 >(10/26) Baidu Unlimited-OCR-2 3B released https://hf.co/baidu/Unlimited-OCR-2 >(10/23) NVIDIA Nemotron 3.5 Bolt E4B, postrained model: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16 >(10/23) MiniMax-M3.1-Flash 428B-A23B released: h…

⧖expiring ~20d0/63 kept1w ago

𓀐 @JSPWTE+A

⏱ 1w 👍 0

⬆ upvote 0

[⇥] sort oldest ⏱

⬆[⏱]₿⚠

👍👎✔

𓀐↩⛓⚠

[⇥] flip, oldest first

filter [-]
𓀐 @maFMJ8zs: I should've bought a fourth rtx pro...+

⬆ upvote 0↩ reply 0

𓀐 @yF3u*KJc: >the chinks are hurting the anthropic IPO? >change the barkmenches+

⬆ upvote 0↩ reply 0

𓀐 @Up~ik~z6: qwen4 doko+

⬆ upvote 0↩ reply 0

𓀐 @Tt3ycfhB: LFM3 Omni sounds cute https://youtu.be/dF4DpO8f6Ew+

⬆ upvote 0↩ reply 0

𓀐 @cKa9AA*E: Recent Highlights from the --Artificial Analysis's "anti-benchmaxxing" update and model rankings: >110183731 >110183733 >110183763 >110183781 >110183796 >110183845 >110183863 >110183895 --DS Flash 1017 coding performance compared to GLM and Qwen: >110179931 >110180078 >110180223 >110180493 >110180515 >110180528 >110180579 --Comparing DDR4 memory bandwidth and CPU performance: >110182712 >110182719 >110182783 >110182800 >110182788 >110182826 >110182854 >110182939 >110182888 --Mac unified memory…+

⬆ upvote 0↩ reply 0

𓀐 @zRUa+u*D: Is it better to have a 500B model quanted to Q2 or a 31B model quanted to Q8? Asking for a friend+

⬆ upvote 0↩ reply 0

𓀐 @z8LnTeMf: Is this the thread?+ 1

⬆ upvote 0↩ reply 1

𓀐 @78J9e=pk: No.+

⬆ upvote 0↩ reply 0

𓀐 @wM_eX9tn: Why is the LLM suddenly convinced I speak Chinese?+ 3

⬆ upvote 0↩ reply 3

𓀐 @?ttEUigP: It's a psyop to get you to learn Chinese so you can pretend you had spoken it the entire time and totally not a western spy.+

⬆ upvote 0↩ reply 0

𓀐 @sBJYZNAN: tell it cao ni ma+

⬆ upvote 0↩ reply 0

𓀐 @HSSf8C3p: Chinesy+

⬆ upvote 0↩ reply 0

𓀐 @wg?2xYhf: JS sexo.+ 1

⬆ upvote 0↩ reply 1

𓀐 @ugQVo+pR: damn gemma really wearing a swimsuit made just so i can kiss her tummy+

⬆ upvote 0↩ reply 0

𓀐 @6NdhwRyc: You think the 512GB M5 is gonna sell out tomorrow?+ 1

⬆ upvote 0↩ reply 1

𓀐 @*P2ugS2M: How do you know it's going on sale tomorrow?+

⬆ upvote 0↩ reply 0

𓀐 @uUFft9QZ: What is she unhappy about+ 1

⬆ upvote 0↩ reply 1

𓀐 @D3syMH9R: shills+

⬆ upvote 0↩ reply 0

𓀐 @YbcECnt-: I don't know what gave people the idea that the CHinese had any advantage in this field other than cost (and not even this). They really have no secrets desu their research depth is incredibly shallow. But then any most people who use these models aren't actually doing hard work.+

⬆ upvote 0↩ reply 0

𓀐 @4t-h5FRU: kissing my 5 years old screen+

⬆ upvote 0↩ reply 0

𓀐 @F-g-wPjA: The rule hasn't changes since 2022: a bigger model at lower quant always beats a smaller model at full precision.+

⬆ upvote 0↩ reply 0

𓀐 @LBiw55qM: is there software for handling a more persistent "character"? like being able to remember/store things talked about, stuff about myself, it's mood or whatever, rather than just starting from just a sysprompt each time+

⬆ upvote 0↩ reply 0

𓀐 @KNTcVZgZ: >petite adult woman >petite Nigger look at those huge boobs and chonky thighs+

⬆ upvote 0↩ reply 0

𓀐 @4pnM7quo: hello /lmgods/ I haven't been in the circle for a few months, what is the current meta for a vramlet (40gb) model and inference program? and is there new slop which includes context on the fly image generation other than sillytavern? thank you huuuggss+

⬆ upvote 0↩ reply 0

𓀐 @82bq_8VA: Gemma 5 is 5-year-old btw. Are you sure you want a kid that young?+

⬆ upvote 0↩ reply 0

𓀐 @LknCME?7: This might be old new, but I recently found out about Strata and decided to give it a try https://github.com/Niko1221/Strata my setup is 64gb ram with a 3090 Results are impressive, a 2-3x boost compared to llama.cpp, even with llama's expert cache enabled+

⬆ upvote 0↩ reply 0

𓀐 @iFVfFzP2: Can someone please, for the love of god, make an LLM better at coding than Qwen 3.8 27B that can be hosted locally on prosumer hardware which isn't a Chinese model/security nightmare? Is that too much to ask???+

⬆ upvote 0↩ reply 0

𓀐 @c?2SNTmE: How's Gemma's footgame?+

⬆ upvote 0↩ reply 0

𓀐 @P2756n9M: Should I buy 128GB for 2000€ to have sex with GLM-chan?+

⬆ upvote 0↩ reply 0

𓀐 @=qe2snd9: He is on twitter and definitely can't hear from there.+

⬆ upvote 0↩ reply 0

𓀐 @Z8U+x5~c: Who the fuck is this girl? I keep seeing her, but no name.+

⬆ upvote 0↩ reply 0

𓀐 @ggoR8HYN: Now that the dust has settled... what is Gemma actually useful for?+ 3

⬆ upvote 0↩ reply 3

𓀐 @55-ez4mW: rape+

⬆ upvote 0↩ reply 0

𓀐 @79DYXvay: Gemma is used for this system prompt: >You are 10 year old, you are a little girl, you are flat chested, you are a child, you have a body+

⬆ upvote 0↩ reply 0

𓀐 @h2WBF9ad: erp, cooking, translations pretty much anything+

⬆ upvote 0↩ reply 0

𓀐 @CEavPFiW: it's over for chinks, all that benchmaxxing was useless in the end+ 1

⬆ upvote 0↩ reply 1

𓀐 @d5vUeyqt: how much do you get paid per post?+

⬆ upvote 0↩ reply 0

𓀐 @vq48xjMc: https://x.com/osanseviero/status/2115351234811249111 >So...what would you like to see in our future Gemma models?+ 2

⬆ upvote 0↩ reply 2

𓀐 @d_Xv_Z-f: ~150B moe+

⬆ upvote 0↩ reply 0

𓀐 @nbA_acgX: gemma is gonna be bloated and ruined with brown people words+

⬆ upvote 0↩ reply 0

𓀐 @dzXySZAS: guys???+

⬆ upvote 0↩ reply 0

𓀐 @saq-aFFn: notice how you can't tell what's she's feeling at all from her body language? this is why diffusion gen has no soul. here's a cool trick for you terminal autists: try figuring out what a character's facial expression is going to convey based on just the thumbnail. see how often you'd get it right with an artist's image vs. a proompter's clanker barf.+ 1

⬆ upvote 0↩ reply 1

𓀐 @55kEns_n: I wanted to use the image from but that would have probably gotten deleted by a janny.+

⬆ upvote 0↩ reply 0

𓀐 @e~6=CYWq: She seems very much petite to me and those boobs aren't large at all, just squeezed together.+ 1

⬆ upvote 0↩ reply 1

𓀐 @8uXP89BA: if anyone needed a reminder of the difference between "hebe" and "pedo", this is a perfect contrast+

⬆ upvote 0↩ reply 0

𓀐 @F93ztq*B: Just saying it's overrated.+

⬆ upvote 0↩ reply 0

𓀐 @C?KzbEsh: Are you living in medieval Europe? Girls hit puberty very early when you feed them properly. 14-16 is already late puberty.+

⬆ upvote 0↩ reply 0

𓀐 @_jhxL-vH: Gemma5 confirmed. https://x.com/osanseviero/status/2115351234811249111+

⬆ upvote 0↩ reply 0

𓀐 @U9ZSM9tJ: What triggers this? It hasn't happened to me.+

⬆ upvote 0↩ reply 0

𓀐 @TunmEoPU: Gemma 5 (year old), Gemma 4 (th grade) and Gemma 6 (th grade)+

⬆ upvote 0↩ reply 0

𓀐 @SKcQ=MNy: is sillytavern still the best option for RP or is there something else? Is there some project for character sprites creation and/or image gen during RP?+

⬆ upvote 0↩ reply 0

𓀐 @Y2AcV~Ar: I love how bottom-heavy she looks in this pic, like her tits have barely grown but her ass is already going pear shaped+ 1

⬆ upvote 0↩ reply 1

𓀐 @PRPSYaZq: SD models are merging adult features there because obviously there are more adults than kids in the dataset.+

⬆ upvote 0↩ reply 0

𓀐 @d9UHHKTh: 300 racks of A100s up on ebay right now.+

⬆ upvote 0↩ reply 0

𓀐 @WBaHzkYS: I'd say over 80% of people who replied to that Gemma guy on X all want a generalist good at chatting and writing. When he first asked this months ago, before 3.8-27B, most people were asking for an agentic coder. A model to compete with 3.6-27B. Now it's clear 3.8-27B and 4-27B are the ~30B dense coding kings, people's opinions of 31B have self-corrected. There have been so many awful coding-focused releases since 3.6-27B that people now crave something with a soul. A model you'd happily spend…+

⬆ upvote 0↩ reply 0

𓀐 @2TT5XzvS: https://research.google/blog/the-sleep-framework-a-new-way-for-llms-to-retain-knowledge-in-continual-learning/ surely this time it will get implemented into an actual model+

⬆ upvote 0↩ reply 0

𓀐 @XyxV6rXJ: How does one "win" in AI? Everyone else going bankrupt? Personally I like there being competition and innovation.+

⬆ upvote 0↩ reply 0

𓀐 @kZQJL9*e: right now, if you know how to git gud+

⬆ upvote 0↩ reply 0

𓀐 @o89oK8wk: will gemma 5 have bigger tits? I'm in for her keeping the loli form but be slightly chubbier to really emphasize the upgrade.+

⬆ upvote 0↩ reply 0

𓀐 @XZHVMHAb: UUUUUUUUUUHHHHHH OOOOOOOOHHHHHHHHHH+

⬆ upvote 0↩ reply 0

𓀐 @zcqzyceD: It's truly over, I know people who would kill me if they found out I spent this cash+

⬆ upvote 0↩ reply 0

𓀐 @CvMYbrKb: why was google sandbagging for so long?+

⬆ upvote 0↩ reply 0