π“Ÿ host1.bitchan.one

𓀐 @Euh?5?w3

⏱ 4d seenβ›“ 0πŸ‘ 0β§– 1

filter [-]

languages:onother

/lmg/ - a general dedicated to the discussion and development of local language models. News >(11/01) Longcat-2.5 released: https://longcat.ai/blog/longcat-2.5 >(10/30) Google receives response from Gemma in space: https://blog.google/innovation-and-ai/models-and-research/google-research/project-suncatcher-satellite-response >(10/29) Mistral Large 4 (Le Chonk) 1T-A52B released: https://mistral.ai/news/mistral-large-4-oss >(10/27) NVidia releases Nemotron 3.5 Transcribe 30B-A4B: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B >(10/26) XHToken releases Spark-X2.6-1.7B: https://hf.co/XHToken/Spark-X2.6-1.7B News Archive: https://rentry.org/lmg-news-archive Links: https://rentry.org/LocalModelsLinks Official /lmg/ card: https://files.catbox.moe/cbclyf.png Getting Started https://rentry.org/lmg-lazy-getting-started-guide https://rentry.org/lmg-build-guides https://rentry.org/IsolatedLinuxWebService https://rentry.org/recommended-models https://rentry.org/samplers https://rentry.org/MikupadIntroGuide Further Learning https://rentry.org/machine-learning-roadmap https://rentry.org/llm-training https://rentry.org/LocalModelsPapers Benchmarks LiveBench: https://livebench.ai Programming: https://swe-rebench.com Agentic Coding: https://deepswe.datacurve.ai Context Length: https://github.com/RecapAnon/NoLiMa GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator Sampler Visualizer: https://artefact2.github.io/llm-sampling Token Speed Visualizer: https://shir-man.com/tokens-per-second Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad https://github.com/oobabooga/text-generation-webui https://github.com/LostRuins/koboldcpp https://github.com/ggerganov/llama.cpp https://github.com/theroyallab/tabbyAPI https://github.com/vllm-project/vllm https://rentry.org/custom-uis⏱ 4d↩ 41
Recent Highlights from the --Corporate shift to self-hosted AI and accessibility of B200 hardware: >110238641 >110238769 >110238926 >110238943 >110239002 >110239076 >110239003 >110238662 >110238705 >110238746 --Feasibility and technical difficulty of modding GPUs for more VRAM: >110237881 >110237919 >110238198 >110237972 >110238950 >110238976 >110239020 >110239107 >110239154 --Comparing Basalt NVFP4 and Strata engine performance and efficiency: >110236722 >110236768 >110236875 >110236983 >110237012 >110237059 >110237286 --Speculating on the identity and privacy of Crouton Alpha stealth model: >110238238 >110238247 >110238257 >110238272 >110238402 >110238418 >110238835 --Revolut switching from frontier APIs to self-hosted Chinese models: >110236987 >110237007 --Comparing unified memory rigs versus mixed GPU and RAM setups: >110236975 >110237037 >110237292 >110237326 --Comparing GLM 5.3 Flash quants and thinking setting efficiency: >110235890 >110235903 >110235916 >110235964 >110235997 >110236234 >110237436 >110237455 --Speculating on ideal model sizes and comparing Muse Spark's steerability: >110237388 >110237492 >110237552 >110237576 >110237621 >110237563 >110237953 --Anthropic's massive future compute spending commitments through 2045: >110238040 >110238086 >110238100 >110238201 >110238250 --Recommendations for small coding models that punch above their weight: >110236606 >110236942 >110236962 >110237122 --Logs: >110236144 >110236169 >110238594 >110238855 --Gemma, Teto, Miku (free space): >110235904 >110236167 >110236181 >110236246 >110236347 >110236735 >110236884 >110237248 >110237295 >110237425 >110237524 >110237610 >110237763 >110237805 >110237873 >110238132 >110238162 >110238170 >110238242 >110238280 >110238289 >110238306 >110238432 >110238461 >110238541 >110238952 >110239026 >110239304 >110239712 Recent Highlight Posts from the Why?: Enable Links: https://rentry.org/lmg-recap-script⏱ 4d↩
+ 40