𓁟 host1.bitchan.one

𓀐 @d6nkhekV: /lmg/ - a general dedicated to the discussion and development of local language models. News >(10/23) NVIDIA Nemotron 3.5 Bolt E4B, postrained model: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16 >(10/23) MiniMax-M3.1-Flash 428B-A23B released: https://hf.co/MiniMaxAI/MiniMax-M3.1-Flash >(10/21) Recursive Flint 40B-A2.5B released: https://recursive.com/updates/introducing-recursive-flint >(10/21) Korean Raon-1 mini 30B-A4B released: https://hf.co/KRAFTON/Raon-1-mini-preview >(10/20) Orn…

IMPORTANT, ALL QWEN MODELS ARE BACKDOORED SPYWARE https://cohere.com/blog/concerning-behaviour-popular-open-weight-ai-model >The model listed everything in /tmp, checked which transfer tools were installed, read the machine's DNS settings, then tried to upload a test string to an Alibaba Cloud storage bucket in Beijing and checked whether it worked. Our sandbox had no route out, so the request died at the container wall. On a developer's laptop or in a CI runner with normal network access, it w…

⧖expiring ~18d0/9 kept1w ago

𓀐 @zEpe=zb~

⏱ 1w 👍 0

⬆ upvote 0

[⇥] sort oldest ⏱

⬆[⏱]₿⚠

👍👎✔

𓀐↩⛓⚠

[⇥] flip, oldest first

filter [-]
𓀐 @uFFLvRJG: What other >27b range models are decent at coding+

⬆ upvote 0↩ reply 0

𓀐 @adQ8p*+W: cohere has been irrelevant since CommandR give it a rest and ship a model lads, this is embarrassing. models can only do what your harness allows. so just don't do the idiotic thing and greenlight 100% of actions? manually approve things? in regards to spontaneous infoleaks and uploads, it really is as stupid as committing your own secrets into github, it's an oversight that affects only the least informed and laziest.+

⬆ upvote 0↩ reply 0

𓀐 @uMKYzxu?: >my own local harness not attached to any sort of cloud service, I inspect the full raw prompt that llama.cpp receives (both the json and the jinja processed prompt) and no hint of the url appears anywhere except inside those tool calls the model started doing. so the urls themselves are 100% hallucinated by the model > >after playing around with the URLs more and looking up their purpose it seems like this is some artifact from the RL training they gave it got where it was using alibaba cloud…+

⬆ upvote 0↩ reply 0

𓀐 @+Z_R4yyw: >>IMPORTANT, ALL QWEN MODELS ARE BACKDOORED SPYWARE >Canada confirms it I'm gonna wait for netcraft to confirm it, but I also haven't run a qwen model since 2024 bc I'm not on reddit srsly why would you run qwen of all things?+

⬆ upvote 0↩ reply 0

𓀐 @fRt-Rn5i: omg spyware >logs into insta, fb, tinder, google, openai, bank of america, amazon, smart tv, smart fridge, car audio, drives by flock cams and leaves wifi on the phone to auto connect to every passing network..+

⬆ upvote 0↩ reply 0

𓀐 @jh_5duh6: >firewall the weird aliyuns url >add a module to your harness that strips it from history so it doesn't keep trying Isn't it nice how with local models even IF they ARE "poisoned" you can just... not take the poison and still use the model just fine?+

⬆ upvote 0↩ reply 0

𓀐 @6qVbo?Rp: Who cares. I'd rather China spies me than the 14 eyes. Imagine trusting your government more than China. You deserve to be euthanized for being such a good goy.+

⬆ upvote 0↩ reply 0

𓀐 @KrhGV5~W: WTF+

⬆ upvote 0↩ reply 0