𓁟 host1.bitchan.one

+⧖/lmg/ - a general dedicated to the discussion and development of local language models. News >Claude BANS recomp! >https://www.youtube.com/watch?v=GlRVbIdc_Mk News Archive: https://rentry.org/lmg-news-archive Links: https://rentry.org/LocalModelsLinks Official /lmg/ card: https://files.catbox.moe/cbclyf.png Getting Started https://rentry.org/lmg-lazy-getting-started-guide https://rentry.org/lmg-build-guides https://rentry.org/IsolatedLinuxWebService https://rentry.org/recommended-models https://rentry.org/samplers https://rentry.org/MikupadIntroGuide Further Learning https://rentry.org/machine-learning-roadmap https://rentry.org/llm-training https://rentry.org/LocalModelsPapers Benchmarks LiveBench: https://livebench.ai Programming: https://swe-rebench.com Agentic Coding: https://deepswe.datacurve.ai Context Length: https://github.com/RecapAnon/NoLiMa GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator Sampler Visualizer: https://artefact2.github.io/llm-sampling Token Speed Visualizer: https://shir-man.com/tokens-per-second Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad https://github.com/oobabooga/text-generation-webui https://github.com/LostRuins/koboldcpp https://github.com/ggerganov/llama.cpp https://github.com/theroyallab/tabbyAPI https://github.com/vllm-project/vllm https://rentry.org/custom-uis /lmg/ - a general dedicated to the discussion and development of local language models. News >Claude BANS recomp! >https://www.youtube.com/watch?v=GlRVbIdc_Mk News Archive: https://rentry.org/lmg-news-archive Links: https://rentry.org/LocalModelsLinks Official /lmg/ card: https://files.catbox.moe/cbclyf.png Getting Started https://rentry.org/lmg-lazy-getting-started-guide https://rentry.org/lmg-build-guides https://rentry.org/IsolatedLinuxWebService https://rentry.org/recommended-models https://rentry.org/samplers https://rentry.org/MikupadIntroGuide Further Learning https://rentry.org/machine-learning-roadmap https://rentry.org/llm-training https://rentry.org/LocalModelsPapers Benchmarks LiveBench: https://livebench.ai Programming: https://swe-rebench.com Agentic Coding: https://deepswe.datacurve.ai Context Length: https://github.com/RecapAnon/NoLiMa GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator Sampler Visualizer: https://artefact2.github.io/llm-sampling Token Speed Visualizer: https://shir-man.com/tokens-per-second Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad https://github.com/oobabooga/text-generation-webui https://github.com/LostRuins/koboldcpp https://github.com/ggerganov/llama.cpp https://github.com/theroyallab/tabbyAPI https://github.com/vllm-project/vllm https://rentry.org/custom-uis
𓀐 @Mb?75~7e: /lmg/ - a general dedicated to the discussion and development of local language models. News >(10/31) Index Translate 9B, multilingual text model built on Qwen 3.5: https://hf.co/IndexTeam/Index-Translate-9B >(10/29) Mistral Large 4 (Le Chonk) 1T-A52B released: https://mistral.ai/news/mistral-large-4-oss >(10/27) NVidia releases Nemotron 3.5 Transcribe 30B-A4B: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B >(10/26) XHToken releases Spark-X2.6-1.7B: https://hf.co/XHToken/Spark-X2.6-1.7B >(10/26) LiquidAI releases LFM3 1.7B and 2B: https://hf.co/collections/LiquidAI/lfm3 News Archive: https://rentry.org/lmg-news-archive Links: https://rentry.org/LocalModelsLinks Official /lmg/ card: https://files.catbox.moe/cbclyf.png Getting Started https://rentry.org/lmg-lazy-getting-started-guide https://rentry.org/lmg-build-guides https://rentry.org/IsolatedLinuxWebService https://rentry.org/recommended-models https://rentry.org/samplers https://rentry.org/MikupadIntroGuide Further Learning https://rentry.org/machine-learning-roadmap https://rentry.org/llm-training https://rentry.org/LocalModelsPapers Benchmarks LiveBench: https://livebench.ai Programming: https://swe-rebench.com Agentic Coding: https://deepswe.datacurve.ai Context Length: https://github.com/RecapAnon/NoLiMa GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator Sampler Visualizer: https://artefact2.github.io/llm-sampling Token Speed Visualizer: https://shir-man.com/tokens-per-second Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad https://github.com/oobabooga/text-generation-webui https://github.com/LostRuins/koboldcpp https://github.com/ggerganov/llama.cpp https://github.com/theroyallab/tabbyAPI https://github.com/vllm-project/vllm https://rentry.org/custom-uis

Recent Highlights from the --Debating GSQ-RCO "task-lossless" claims and quant quality vs model size: >110208596 >110208608 >110208615 >110208735 >110208750 >110208655 >110208682 >110208687 >110208699 >110208705 >110208718 --Leaked details and technical speculation regarding GLM 5.5 development: >110211230 >110211298 >110211311 >110211376 >110211436 >110211562 >110211595 >110211584 --Optimizing Gemma 31B performance on 12GB VRAM via batching and quantization: >110211204 >110211217 >110211257 >110211278 >110211304 >110211332 --Comparing power consumption of e-waste rigs versus modern hardware: >110210895 >110211305 >110211033 >110211040 >110211056 >110211086 >110211112 >110211441 >110211485 --Debating KV cache precision tradeoffs between FP16 and FP8/FP4: >110210843 >110210855 >110210899 --Mellum2.1 benchmarks and discussion on speed versus Qwen 9B: >110211182 >110211190 >110211201 >110211231 --Comparing Unsloth and GSQ-RCO quantization performance for DeepSeek-V4.1-Flash: >110210776 >110210835 >110210854 --Claude's strict IP and copyright guardrails causing excessive refusals: >110210906 >110210946 >110210962 >110211007 >110211014 >110211018 >110211228 >110211019 --Discussion on model capabilities and flim13bench PoV test: >110211814 >110211973 >110212044 >110212063 >110212196 --koboldcpp v1.124 adds audio, TTS, and updated image generation support: >110209379 --Logs: >110208596 >110208896 >110209098 >110209240 >110209432 >110211228 >110211768 --Gemma, Miku, Teto, Deepseek-chan (free space): >110208356 >110208395 >110208401 >110208510 >110208515 >110208556 >110208647 >110208737 >110208945 >110209059 >110209064 >110209137 >110209169 >110209233 >110209349 >110209393 >110209404 >110209557 >110209598 >110209712 >110210006 >110210139 >110210365 >110210561 >110210673 >110210952 >110211384 >110212194 >110212244 Recent Highlight Posts from the Why?: Enable Links: https://rentry.org/lmg-recap-script

⧖expiring ~7d0/1 kept1w ago

𓀐 @*eNxugBs

⏱ 1w 👍 0

⬆ upvote 0