𓁟 host1.bitchan.one

+⧖/lmg/ - a general dedicated to the discussion and development of local language models. News >Claude BANS recomp! >https://www.youtube.com/watch?v=GlRVbIdc_Mk News Archive: https://rentry.org/lmg-news-archive Links: https://rentry.org/LocalModelsLinks Official /lmg/ card: https://files.catbox.moe/cbclyf.png Getting Started https://rentry.org/lmg-lazy-getting-started-guide https://rentry.org/lmg-build-guides https://rentry.org/IsolatedLinuxWebService https://rentry.org/recommended-models https://rentry.org/samplers https://rentry.org/MikupadIntroGuide Further Learning https://rentry.org/machine-learning-roadmap https://rentry.org/llm-training https://rentry.org/LocalModelsPapers Benchmarks LiveBench: https://livebench.ai Programming: https://swe-rebench.com Agentic Coding: https://deepswe.datacurve.ai Context Length: https://github.com/RecapAnon/NoLiMa GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator Sampler Visualizer: https://artefact2.github.io/llm-sampling Token Speed Visualizer: https://shir-man.com/tokens-per-second Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad https://github.com/oobabooga/text-generation-webui https://github.com/LostRuins/koboldcpp https://github.com/ggerganov/llama.cpp https://github.com/theroyallab/tabbyAPI https://github.com/vllm-project/vllm https://rentry.org/custom-uis /lmg/ - a general dedicated to the discussion and development of local language models. News >Claude BANS recomp! >https://www.youtube.com/watch?v=GlRVbIdc_Mk News Archive: https://rentry.org/lmg-news-archive Links: https://rentry.org/LocalModelsLinks Official /lmg/ card: https://files.catbox.moe/cbclyf.png Getting Started https://rentry.org/lmg-lazy-getting-started-guide https://rentry.org/lmg-build-guides https://rentry.org/IsolatedLinuxWebService https://rentry.org/recommended-models https://rentry.org/samplers https://rentry.org/MikupadIntroGuide Further Learning https://rentry.org/machine-learning-roadmap https://rentry.org/llm-training https://rentry.org/LocalModelsPapers Benchmarks LiveBench: https://livebench.ai Programming: https://swe-rebench.com Agentic Coding: https://deepswe.datacurve.ai Context Length: https://github.com/RecapAnon/NoLiMa GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator Sampler Visualizer: https://artefact2.github.io/llm-sampling Token Speed Visualizer: https://shir-man.com/tokens-per-second Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad https://github.com/oobabooga/text-generation-webui https://github.com/LostRuins/koboldcpp https://github.com/ggerganov/llama.cpp https://github.com/theroyallab/tabbyAPI https://github.com/vllm-project/vllm https://rentry.org/custom-uis
𓀐 @RNrmh~8d: /lmg/ - a general dedicated to the discussion and development of local language models. News >(10/29) Mistral Large 4 (Le Chonk) 1T-A52B released: https://mistral.ai/news/mistral-large-4-oss >(10/27) NVidia releases Nemotron 3.5 Transcribe 30B-A4B: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B >(10/26) XHToken releases Spark-X2.6-1.7B: https://hf.co/XHToken/Spark-X2.6-1.7B >(10/26) LiquidAI releases LFM3 1.7B and 2B: https://hf.co/collections/LiquidAI/lfm3 News Archive: https://rentry.org/lmg-news-archive Links: https://rentry.org/LocalModelsLinks Official /lmg/ card: https://files.catbox.moe/cbclyf.png Getting Started https://rentry.org/lmg-lazy-getting-started-guide https://rentry.org/lmg-build-guides https://rentry.org/IsolatedLinuxWebService https://rentry.org/recommended-models https://rentry.org/samplers https://rentry.org/MikupadIntroGuide Further Learning https://rentry.org/machine-learning-roadmap https://rentry.org/llm-training https://rentry.org/LocalModelsPapers Benchmarks LiveBench: https://livebench.ai Programming: https://swe-rebench.com Agentic Coding: https://deepswe.datacurve.ai Context Length: https://github.com/RecapAnon/NoLiMa GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator Sampler Visualizer: https://artefact2.github.io/llm-sampling Token Speed Visualizer: https://shir-man.com/tokens-per-second Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad https://github.com/oobabooga/text-generation-webui https://github.com/LostRuins/koboldcpp https://github.com/ggerganov/llama.cpp https://github.com/theroyallab/tabbyAPI https://github.com/vllm-project/vllm https://rentry.org/custom-uis

Recent Highlights from the --Evaluating AMD MI25 and MI100 GPUs for budget high-VRAM setups: >110212880 >110212900 >110212951 >110213251 >110213290 >110213357 >110214084 >110214321 >110215204 >110215246 >110215516 >110213445 >110213336 --Hardware for AI escapism and the technical nature of image generation: >110212972 >110212995 >110213003 >110213012 >110213096 >110213220 >110213027 >110213036 >110213047 >110213059 >110213064 >110214789 >110214809 >110213082 >110213242 >110213261 >110213476 >110213503 >110213511 >110213615 >110213677 >110213882 --Reward hacking and erratic agentic behavior in DeepSeek 4.1: >110216419 >110216433 >110216458 >110216489 >110216540 --Hardware acquisition strategies amid supply shortages and AI infrastructure debt: >110216175 >110216202 >110216223 >110216252 >110216267 >110216321 >110216355 >110216227 --Using reasoning prefilling to bypass model safety filters: >110215910 >110215916 >110215918 >110215942 >110215966 >110215970 >110216040 >110215953 >110215967 --DeepSeek's autonomous agent prototype and thoughts on micro-managing reasoning: >110214741 >110214770 >110214842 >110214859 >110215156 >110214875 --SillyTavern domain compromise and subsequent discussion on alternative frontends: >110215402 >110215420 >110215429 >110215485 >110215715 >110215787 >110215811 --Claude's self-assessment technique for internal safety evaluations: >110214018 >110214090 >110215296 >110214617 >110215373 >110215391 >110215405 >110215601 --Exllamav3 v1.6.6 release and DeepSeek-V4.1-Flash exl3 quants: >110216176 >110216185 --Logs: >110213604 >110215173 >110215267 --Gemma, Miku (free space): >110212614 >110212681 >110212757 >110212995 >110213047 >110213106 >110213193 >110213242 >110213361 >110213528 >110213598 >110213926 >110214382 >110214789 >110215991 >110216550 Recent Highlight Posts from the Why?: Enable Links: https://rentry.org/lmg-recap-script

⧖expiring ~8d0/1 kept1w ago

𓀐 @Biy9habr

⏱ 1w 👍 0

⬆ upvote 0