/technology
+⧖/lmg/ - a general dedicated to the discussion and development of local language models. News >Claude BANS recomp! >https://www.youtube.com/watch?v=GlRVbIdc_Mk News Archive: https://rentry.org/lmg-news-archive Links: https://rentry.org/LocalModelsLinks Official /lmg/ card: https://files.catbox.moe/cbclyf.png Getting Started https://rentry.org/lmg-lazy-getting-started-guide https://rentry.org/lmg-build-guides https://rentry.org/IsolatedLinuxWebService https://rentry.org/recommended-models https://rentry.org/samplers https://rentry.org/MikupadIntroGuide Further Learning https://rentry.org/machine-learning-roadmap https://rentry.org/llm-training https://rentry.org/LocalModelsPapers Benchmarks LiveBench: https://livebench.ai Programming: https://swe-rebench.com Agentic Coding: https://deepswe.datacurve.ai Context Length: https://github.com/RecapAnon/NoLiMa GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator Sampler Visualizer: https://artefact2.github.io/llm-sampling Token Speed Visualizer: https://shir-man.com/tokens-per-second Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad https://github.com/oobabooga/text-generation-webui https://github.com/LostRuins/koboldcpp https://github.com/ggerganov/llama.cpp https://github.com/theroyallab/tabbyAPI https://github.com/vllm-project/vllm https://rentry.org/custom-uis
/lmg/ - a general dedicated to the discussion and development of local language models. News >Claude BANS recomp! >https://www.youtube.com/watch?v=GlRVbIdc_Mk⧉ News Archive: https://rentry.org/lmg-news-archive⧉ Links: https://rentry.org/LocalModelsLinks⧉ Official /lmg/ card: https://files.catbox.moe/cbclyf.png⧉ Getting Started https://rentry.org/lmg-lazy-getting-started-guide⧉ https://rentry.org/lmg-build-guides⧉ https://rentry.org/IsolatedLinuxWebService⧉ https://rentry.org/recommended-models⧉ https://rentry.org/samplers⧉ https://rentry.org/MikupadIntroGuide⧉ Further Learning https://rentry.org/machine-learning-roadmap⧉ https://rentry.org/llm-training⧉ https://rentry.org/LocalModelsPapers⧉ Benchmarks LiveBench: https://livebench.ai⧉ Programming: https://swe-rebench.com⧉ Agentic Coding: https://deepswe.datacurve.ai⧉ Context Length: https://github.com/RecapAnon/NoLiMa⧉ GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference⧉ Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator⧉ Sampler Visualizer: https://artefact2.github.io/llm-sampling⧉ Token Speed Visualizer: https://shir-man.com/tokens-per-second⧉ Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad⧉ https://github.com/oobabooga/text-generation-webui⧉ https://github.com/LostRuins/koboldcpp⧉ https://github.com/ggerganov/llama.cpp⧉ https://github.com/theroyallab/tabbyAPI⧉ https://github.com/vllm-project/vllm⧉ https://rentry.org/custom-uis⧉Recent Highlights from the --Papers: >110259392 --Anon seeks uncensored local LLM for ROM hacking on 7900XTX: >110258986 >110259001 >110259039 >110259005 >110259075 >110259057 >110259092 >110259142 >110259153 >110259192 >110259214 >110259358 >110259421 >110259449 >110259472 >110259506 >110259425 >110259436 >110259447 >110260729 >110259242 >110259658 >110259684 >110259731 >110259812 >110259373 >110259116 >110259184 --MoE active parameters explain Kimi speed advantage: >110258671 >110258691 >110258710 >110258720 >110258734 >110258771 >110258789 --Anon weighs Claude subscription cost vs local model privacy: >110258887 >110258917 >110258935 >110258989 >110258929 >110258934 >110258941 >110258976 >110259007 >110258984 >110259012 >110259060 >110259093 --Anon struggles to build a custom local LLM desktop app with memory features: >110260505 >110260560 >110260571 >110260610 >110260682 >110260705 >110260806 --Anons mock Qwen's cryptic teaser and 404 ModelScope countdown: >110258297 >110258303 >110258323 >110258325 >110258333 >110258340 --Ubuntu linux-firmware-amd-graphics 3.4 broke AMD GPU login: >110259952 --Vals AI claims critical safety alignment issue in multiple frontier lab models: >110260241 --Nanbeige teases upcoming 3B model with official quantized versions on Hugging Face: >110259477 --Activist protests escalating at AI data center construction sites in Europe: >110259222 --CritPt v2 hard subset scores plateau near seventy percent: >110257824 --Gemma repetition issue solved by positive trait prompting: >110258109 >110258451 --Logs: >110258816 >110259141 >110259778 --Miku, Gemma, Teku, Qwen, Rin (free space): >110257756 >110258432 >110258584 >110258696 >110259180 >110259383 >110259416 >110259658 >110259731 >110259780 >110259812 >110259932 >110259952 >110260352 >110260483 >110260649 >110260987 >110261138 Recent Highlight Posts from the Why?: Enable Links: https://rentry.org/lmg-recap-script⧉
⧖expiring ~13d0/1 kept1d ago
⏱ 1d 👍 0
⬆ upvote 0
/technology
trying
closest
needs