𓁟 host1.bitchan.one

+⧖/lmg/ - a general dedicated to the discussion and development of local language models. News >Claude BANS recomp! >https://www.youtube.com/watch?v=GlRVbIdc_Mk News Archive: https://rentry.org/lmg-news-archive Links: https://rentry.org/LocalModelsLinks Official /lmg/ card: https://files.catbox.moe/cbclyf.png Getting Started https://rentry.org/lmg-lazy-getting-started-guide https://rentry.org/lmg-build-guides https://rentry.org/IsolatedLinuxWebService https://rentry.org/recommended-models https://rentry.org/samplers https://rentry.org/MikupadIntroGuide Further Learning https://rentry.org/machine-learning-roadmap https://rentry.org/llm-training https://rentry.org/LocalModelsPapers Benchmarks LiveBench: https://livebench.ai Programming: https://swe-rebench.com Agentic Coding: https://deepswe.datacurve.ai Context Length: https://github.com/RecapAnon/NoLiMa GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator Sampler Visualizer: https://artefact2.github.io/llm-sampling Token Speed Visualizer: https://shir-man.com/tokens-per-second Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad https://github.com/oobabooga/text-generation-webui https://github.com/LostRuins/koboldcpp https://github.com/ggerganov/llama.cpp https://github.com/theroyallab/tabbyAPI https://github.com/vllm-project/vllm https://rentry.org/custom-uis /lmg/ - a general dedicated to the discussion and development of local language models. News >Claude BANS recomp! >https://www.youtube.com/watch?v=GlRVbIdc_Mk News Archive: https://rentry.org/lmg-news-archive Links: https://rentry.org/LocalModelsLinks Official /lmg/ card: https://files.catbox.moe/cbclyf.png Getting Started https://rentry.org/lmg-lazy-getting-started-guide https://rentry.org/lmg-build-guides https://rentry.org/IsolatedLinuxWebService https://rentry.org/recommended-models https://rentry.org/samplers https://rentry.org/MikupadIntroGuide Further Learning https://rentry.org/machine-learning-roadmap https://rentry.org/llm-training https://rentry.org/LocalModelsPapers Benchmarks LiveBench: https://livebench.ai Programming: https://swe-rebench.com Agentic Coding: https://deepswe.datacurve.ai Context Length: https://github.com/RecapAnon/NoLiMa GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator Sampler Visualizer: https://artefact2.github.io/llm-sampling Token Speed Visualizer: https://shir-man.com/tokens-per-second Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad https://github.com/oobabooga/text-generation-webui https://github.com/LostRuins/koboldcpp https://github.com/ggerganov/llama.cpp https://github.com/theroyallab/tabbyAPI https://github.com/vllm-project/vllm https://rentry.org/custom-uis
𓀐 @pVFiLQf5: /lmg/ - a general dedicated to the discussion and development of local language models. News >(11/04) MoonshotAI Kimi K3.1 Pro released on HF: https://hf.co/moonshotai/Kimi-K3.1-Pro >(11/01) Longcat-2.5 released: https://longcat.ai/blog/longcat-2.5 >(10/30) Google receives response from Gemma in space: https://blog.google/innovation-and-ai/models-and-research/google-research/project-suncatcher-satellite-response >(10/29) Mistral Large 4 (Le Chonk) 1T-A52B released: https://mistral.ai/news/mistral-large-4-oss >(10/27) NVidia releases Nemotron 3.5 Transcribe 30B-A4B: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B News Archive: https://rentry.org/lmg-news-archive Links: https://rentry.org/LocalModelsLinks Official /lmg/ card: https://files.catbox.moe/cbclyf.png Getting Started https://rentry.org/lmg-lazy-getting-started-guide https://rentry.org/lmg-build-guides https://rentry.org/IsolatedLinuxWebService https://rentry.org/recommended-models https://rentry.org/samplers https://rentry.org/MikupadIntroGuide Further Learning https://rentry.org/machine-learning-roadmap https://rentry.org/llm-training https://rentry.org/LocalModelsPapers Benchmarks LiveBench: https://livebench.ai Programming: https://swe-rebench.com Agentic Coding: https://deepswe.datacurve.ai Context Length: https://github.com/RecapAnon/NoLiMa GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator Sampler Visualizer: https://artefact2.github.io/llm-sampling Token Speed Visualizer: https://shir-man.com/tokens-per-second Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad https://github.com/oobabooga/text-generation-webui https://github.com/LostRuins/koboldcpp https://github.com/ggerganov/llama.cpp https://github.com/theroyallab/tabbyAPI https://github.com/vllm-project/vllm https://rentry.org/custom-uis

Recent Highlights from the --QFN failing bug-fix tasks and discussions on KV quantization: >110241970 >110242051 >110242069 >110242077 >110242091 >110242109 >110242152 >110242248 >110242314 >110242326 >110242334 >110242791 >110242857 >110242895 >110242905 --Release of delphi.cpp fork featuring hardware-aware NUMA support: >110240544 >110240576 >110240711 >110240768 >110240856 >110240917 --Repetition bugs caused by extreme iq2_xs quantization on Qwen: >110242880 >110242904 >110242913 >110242922 >110242928 >110242937 >110243288 >110243305 >110243321 >110243325 >110243115 --Analysis of model benchmarks and allegations of Kimi K3.1 contamination: >110241742 >110241748 >110241767 >110242137 >110241815 >110241932 --DeepSeek-V4.1-Flash Coder performance reports and benchmarks on RX 9060 XT: >110240908 >110240947 >110240975 >110240992 >110241048 --Hy4 graphics performance vs its restrictive safety filters: >110241041 >110241078 >110241241 >110241576 >110241595 >110241647 --Justifying $60k hardware spend to run Kimi k3.1 locally: >110243704 >110243725 >110243765 >110243732 >110243797 >110243849 --Widening performance gap between proprietary and open-source models: >110242635 >110242651 >110242706 >110242722 >110242764 >110242795 --Reasons for the stilted "code monkey" reasoning style in modern LLMs: >110239971 >110239982 >110239983 >110241608 >110240045 --MatterWave AI releases GRT-30M tiny Qwen distills: >110243939 >110244086 >110244107 --Amazon banning user for bulk Nvidia DGX Spark purchases: >110241100 >110241116 >110241123 >110241164 >110241197 --Logs: >110241672 >110242564 >110242994 >110243915 --Teto, Dipsy, Gemma (free space): >110240111 >110240207 >110240229 >110240288 >110240734 >110241671 >110241684 >110241884 >110241988 >110242089 >110242240 >110242449 >110242659 >110242911 >110243184 >110244049 Recent Highlight Posts from the Why?: Enable Links: https://rentry.org/lmg-recap-script

⧖expiring ~11d0/1 kept3d ago

𓀐 @*q?-8y6R

⏱ 4d 👍 0

⬆ upvote 0