/technology
/lmg/ - a general dedicated to the discussion and development of local language models. News >(11/04) MoonshotAI Kimi K3.1 Pro released on HF: https://hf.co/moonshotai/Kimi-K3.1-Proβ§ >(11/01) Longcat-2.5 released: https://longcat.ai/blog/longcat-2.5β§ >(10/30) Google receives response from Gemma in space: https://blog.google/innovation-and-ai/models-and-research/google-research/project-suncatcher-satellite-responseβ§ >(10/29) Mistral Large 4 (Le Chonk) 1T-A52B released: https://mistral.ai/news/mistral-large-4-ossβ§ >(10/27) NVidia releases Nemotron 3.5 Transcribe 30B-A4B: https://hf.co/nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4Bβ§ News Archive: https://rentry.org/lmg-news-archiveβ§ Links: https://rentry.org/LocalModelsLinksβ§ Official /lmg/ card: https://files.catbox.moe/cbclyf.pngβ§ Getting Started https://rentry.org/lmg-lazy-getting-started-guideβ§ https://rentry.org/lmg-build-guidesβ§ https://rentry.org/IsolatedLinuxWebServiceβ§ https://rentry.org/recommended-modelsβ§ https://rentry.org/samplersβ§ https://rentry.org/MikupadIntroGuideβ§ Further Learning https://rentry.org/machine-learning-roadmapβ§ https://rentry.org/llm-trainingβ§ https://rentry.org/LocalModelsPapersβ§ Benchmarks LiveBench: https://livebench.aiβ§ Programming: https://swe-rebench.comβ§ Agentic Coding: https://deepswe.datacurve.aiβ§ Context Length: https://github.com/RecapAnon/NoLiMaβ§ GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inferenceβ§ Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculatorβ§ Sampler Visualizer: https://artefact2.github.io/llm-samplingβ§ Token Speed Visualizer: https://shir-man.com/tokens-per-secondβ§ Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupadβ§ https://github.com/oobabooga/text-generation-webuiβ§ https://github.com/LostRuins/koboldcppβ§ https://github.com/ggerganov/llama.cppβ§ https://github.com/theroyallab/tabbyAPIβ§ https://github.com/vllm-project/vllmβ§ https://rentry.org/custom-uisβ§β± 3dβ© 38
Low quant gemmoid!β± 4dβ©
+ 37