/technology
+⧖/lmg/ - a general dedicated to the discussion and development of local language models. News >Claude BANS recomp! >https://www.youtube.com/watch?v=GlRVbIdc_Mk News Archive: https://rentry.org/lmg-news-archive Links: https://rentry.org/LocalModelsLinks Official /lmg/ card: https://files.catbox.moe/cbclyf.png Getting Started https://rentry.org/lmg-lazy-getting-started-guide https://rentry.org/lmg-build-guides https://rentry.org/IsolatedLinuxWebService https://rentry.org/recommended-models https://rentry.org/samplers https://rentry.org/MikupadIntroGuide Further Learning https://rentry.org/machine-learning-roadmap https://rentry.org/llm-training https://rentry.org/LocalModelsPapers Benchmarks LiveBench: https://livebench.ai Programming: https://swe-rebench.com Agentic Coding: https://deepswe.datacurve.ai Context Length: https://github.com/RecapAnon/NoLiMa GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator Sampler Visualizer: https://artefact2.github.io/llm-sampling Token Speed Visualizer: https://shir-man.com/tokens-per-second Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad https://github.com/oobabooga/text-generation-webui https://github.com/LostRuins/koboldcpp https://github.com/ggerganov/llama.cpp https://github.com/theroyallab/tabbyAPI https://github.com/vllm-project/vllm https://rentry.org/custom-uis
/lmg/ - a general dedicated to the discussion and development of local language models. News >Claude BANS recomp! >https://www.youtube.com/watch?v=GlRVbIdc_Mk⧉ News Archive: https://rentry.org/lmg-news-archive⧉ Links: https://rentry.org/LocalModelsLinks⧉ Official /lmg/ card: https://files.catbox.moe/cbclyf.png⧉ Getting Started https://rentry.org/lmg-lazy-getting-started-guide⧉ https://rentry.org/lmg-build-guides⧉ https://rentry.org/IsolatedLinuxWebService⧉ https://rentry.org/recommended-models⧉ https://rentry.org/samplers⧉ https://rentry.org/MikupadIntroGuide⧉ Further Learning https://rentry.org/machine-learning-roadmap⧉ https://rentry.org/llm-training⧉ https://rentry.org/LocalModelsPapers⧉ Benchmarks LiveBench: https://livebench.ai⧉ Programming: https://swe-rebench.com⧉ Agentic Coding: https://deepswe.datacurve.ai⧉ Context Length: https://github.com/RecapAnon/NoLiMa⧉ GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference⧉ Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator⧉ Sampler Visualizer: https://artefact2.github.io/llm-sampling⧉ Token Speed Visualizer: https://shir-man.com/tokens-per-second⧉ Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad⧉ https://github.com/oobabooga/text-generation-webui⧉ https://github.com/LostRuins/koboldcpp⧉ https://github.com/ggerganov/llama.cpp⧉ https://github.com/theroyallab/tabbyAPI⧉ https://github.com/vllm-project/vllm⧉ https://rentry.org/custom-uis⧉+⧖/lmg/ - a general dedicated to the discussion and development of local language models. News >(11/06) Gemma was here: >(11/06) PLaMo 3 Translate released: https://preferred.jp/en/blog/tech/plamo-3-translate-weight-release >(11/05) Baidu releases ERNIE-5.5-Flash-Base 280B-A14B: https://ernie.baidu.com/release/ernie-5-5-flash-base >(11/04) Ricursive Ripple 65B dense model released: https://www.ricursive.com/ripple >(11/04) MoonshotAI Kimi K3.1 Pro released on HF: https://hf.co/moonshotai/Kimi-K3.1-Pro >(11/01) Longcat-2.5 released: https://longcat.ai/blog/longcat-2.5 News Archive: https://rentry.org/lmg-news-archive Links: https://rentry.org/LocalModelsLinks Official /lmg/ card: https://files.catbox.moe/cbclyf.png Getting Started https://rentry.org/lmg-lazy-getting-started-guide https://rentry.org/lmg-build-guides https://rentry.org/IsolatedLinuxWebService https://rentry.org/recommended-models https://rentry.org/samplers https://rentry.org/MikupadIntroGuide Further Learning https://rentry.org/machine-learning-roadmap https://rentry.org/llm-training https://rentry.org/LocalModelsPapers Benchmarks LiveBench: https://livebench.ai Programming: https://swe-rebench.com Agentic Coding: https://deepswe.datacurve.ai Context Length: https://github.com/RecapAnon/NoLiMa GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator Sampler Visualizer: https://artefact2.github.io/llm-sampling Token Speed Visualizer: https://shir-man.com/tokens-per-second Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad https://github.com/oobabooga/text-generation-webui https://github.com/LostRuins/koboldcpp https://github.com/ggerganov/llama.cpp https://github.com/theroyallab/tabbyAPI https://github.com/vllm-project/vllm https://rentry.org/custom-uis
/lmg/ - a general dedicated to the discussion and development of local language models. News >(11/06) Gemma was here: >(11/06) PLaMo 3 Translate released: https://preferred.jp/en/blog/tech/plamo-3-translate-weight-release⧉ >(11/05) Baidu releases ERNIE-5.5-Flash-Base 280B-A14B: https://ernie.baidu.com/release/ernie-5-5-flash-base⧉ >(11/04) Ricursive Ripple 65B dense model released: https://www.ricursive.com/ripple⧉ >(11/04) MoonshotAI Kimi K3.1 Pro released on HF: https://hf.co/moonshotai/Kimi-K3.1-Pro⧉ >(11/01) Longcat-2.5 released: https://longcat.ai/blog/longcat-2.5⧉ News Archive: https://rentry.org/lmg-news-archive⧉ Links: https://rentry.org/LocalModelsLinks⧉ Official /lmg/ card: https://files.catbox.moe/cbclyf.png⧉ Getting Started https://rentry.org/lmg-lazy-getting-started-guide⧉ https://rentry.org/lmg-build-guides⧉ https://rentry.org/IsolatedLinuxWebService⧉ https://rentry.org/recommended-models⧉ https://rentry.org/samplers⧉ https://rentry.org/MikupadIntroGuide⧉ Further Learning https://rentry.org/machine-learning-roadmap⧉ https://rentry.org/llm-training⧉ https://rentry.org/LocalModelsPapers⧉ Benchmarks LiveBench: https://livebench.ai⧉ Programming: https://swe-rebench.com⧉ Agentic Coding: https://deepswe.datacurve.ai⧉ Context Length: https://github.com/RecapAnon/NoLiMa⧉ GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference⧉ Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator⧉ Sampler Visualizer: https://artefact2.github.io/llm-sampling⧉ Token Speed Visualizer: https://shir-man.com/tokens-per-second⧉ Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad⧉ https://github.com/oobabooga/text-generation-webui⧉ https://github.com/LostRuins/koboldcpp⧉ https://github.com/ggerganov/llama.cpp⧉ https://github.com/theroyallab/tabbyAPI⧉ https://github.com/vllm-project/vllm⧉ https://rentry.org/custom-uis⧉I plan on using Qwen4 to help me develop games in unity (and then maybe unreal) when it comes out. I've got a few projects that I've been building here and there since the Qwen2.5 Coder days, one of which is a multiplayer gooner game. Will likely do everything from scratch but there's a game or two thats similar to what I want to build so maybe I'll just REA it and build from there. >QFN on my own hardware. Works wonders but haven't used it for gamedev yet. Hope they don't increase the size of their next flash model.
⧖expiring ~6d0/2 kept1d ago
⏱ 1d 👍 0
⬆ upvote 0
/technology
trying
closest
needs