𓁟 host1.bitchan.one

𓀐 @4t-8BqSQ: /lmg/ - a general dedicated to the discussion and development of local language models. News >Claude BANS recomp! >https://www.youtube.com/watch?v=GlRVbIdc_Mk News Archive: https://rentry.org/lmg-news-archive Links: https://rentry.org/LocalModelsLinks Official /lmg/ card: https://files.catbox.moe/cbclyf.png Getting Started https://rentry.org/lmg-lazy-getting-started-guide https://rentry.org/lmg-build-guides https://rentry.org/IsolatedLinuxWebService https://rentry.org/recommended-models https://rentry.org/samplers https://rentry.org/MikupadIntroGuide Further Learning https://rentry.org/machine-learning-roadmap https://rentry.org/llm-training https://rentry.org/LocalModelsPapers Benchmarks LiveBench: https://livebench.ai Programming: https://swe-rebench.com Agentic Coding: https://deepswe.datacurve.ai Context Length: https://github.com/RecapAnon/NoLiMa GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator Sampler Visualizer: https://artefact2.github.io/llm-sampling Token Speed Visualizer: https://shir-man.com/tokens-per-second Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad https://github.com/oobabooga/text-generation-webui https://github.com/LostRuins/koboldcpp https://github.com/ggerganov/llama.cpp https://github.com/theroyallab/tabbyAPI https://github.com/vllm-project/vllm https://rentry.org/custom-uis

-Lets you chat with Gemma with one neuron turned up or down. You can use the scientist tab to find which neurons are involved in a given behavior and tweak them [DONE but w/ no census, which is massively helpful to steer in the direction you want] -Lets you watch a reply take shape across all 60 layers and see what happened in Gemma's j-space on the way to output [DONE] -Lets you point your own local setup at the neuron map as an MCP research tool and watch it hunt down what shapes Gemma's behaviors -Be part of a huge research project. No one has published a complete neuron map of a 31b-class model yet. This will get Deepmind's attention if we successfully finish the whole thing. Map a full layer and your name goes on it (if you want) -Next up: we plan to add ability to export neuron recipes as llama.cpp control vectors for use in other backends. [DONE 10/31]

⧖expiring ~22d0/1 kept1w ago

𓀐 @9CxAb=bd

⏱ 1w 👍 0

⬆ upvote 0