/technology
+⧖/lmg/ - a general dedicated to the discussion and development of local language models. News >Claude BANS recomp! >https://www.youtube.com/watch?v=GlRVbIdc_Mk News Archive: https://rentry.org/lmg-news-archive Links: https://rentry.org/LocalModelsLinks Official /lmg/ card: https://files.catbox.moe/cbclyf.png Getting Started https://rentry.org/lmg-lazy-getting-started-guide https://rentry.org/lmg-build-guides https://rentry.org/IsolatedLinuxWebService https://rentry.org/recommended-models https://rentry.org/samplers https://rentry.org/MikupadIntroGuide Further Learning https://rentry.org/machine-learning-roadmap https://rentry.org/llm-training https://rentry.org/LocalModelsPapers Benchmarks LiveBench: https://livebench.ai Programming: https://swe-rebench.com Agentic Coding: https://deepswe.datacurve.ai Context Length: https://github.com/RecapAnon/NoLiMa GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator Sampler Visualizer: https://artefact2.github.io/llm-sampling Token Speed Visualizer: https://shir-man.com/tokens-per-second Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad https://github.com/oobabooga/text-generation-webui https://github.com/LostRuins/koboldcpp https://github.com/ggerganov/llama.cpp https://github.com/theroyallab/tabbyAPI https://github.com/vllm-project/vllm https://rentry.org/custom-uis
/lmg/ - a general dedicated to the discussion and development of local language models. News >Claude BANS recomp! >https://www.youtube.com/watch?v=GlRVbIdc_Mk⧉ News Archive: https://rentry.org/lmg-news-archive⧉ Links: https://rentry.org/LocalModelsLinks⧉ Official /lmg/ card: https://files.catbox.moe/cbclyf.png⧉ Getting Started https://rentry.org/lmg-lazy-getting-started-guide⧉ https://rentry.org/lmg-build-guides⧉ https://rentry.org/IsolatedLinuxWebService⧉ https://rentry.org/recommended-models⧉ https://rentry.org/samplers⧉ https://rentry.org/MikupadIntroGuide⧉ Further Learning https://rentry.org/machine-learning-roadmap⧉ https://rentry.org/llm-training⧉ https://rentry.org/LocalModelsPapers⧉ Benchmarks LiveBench: https://livebench.ai⧉ Programming: https://swe-rebench.com⧉ Agentic Coding: https://deepswe.datacurve.ai⧉ Context Length: https://github.com/RecapAnon/NoLiMa⧉ GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference⧉ Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator⧉ Sampler Visualizer: https://artefact2.github.io/llm-sampling⧉ Token Speed Visualizer: https://shir-man.com/tokens-per-second⧉ Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad⧉ https://github.com/oobabooga/text-generation-webui⧉ https://github.com/LostRuins/koboldcpp⧉ https://github.com/ggerganov/llama.cpp⧉ https://github.com/theroyallab/tabbyAPI⧉ https://github.com/vllm-project/vllm⧉ https://rentry.org/custom-uis⧉I’ve had Gemini 3.8 flash recommend Qwen3, Gemma2 and 20B WITH web search. This is why we must help newfags. Don’t gatekeep those trying to convert because the more demand for local the better it is for us.
⧖expiring ~14d0/2 kept21h ago
⏱ 1d 👍 0
⬆ upvote 0
/technology
trying
closest
needs