/technology
/lmg/ - a general dedicated to the discussion and development of local language models. News >(11/06) Inkling 2 Small (594B) released: https://thinkingmachines.ai/news/inkling-2-small/β§ >(11/06) PLaMo 3 Translate released: https://preferred.jp/en/blog/tech/plamo-3-translate-weight-releaseβ§ >(11/05) Baidu releases ERNIE-5.5-Flash-Base 280B-A14B: https://ernie.baidu.com/release/ernie-5-5-flash-baseβ§ >(11/04) Ricursive Ripple 65B dense model released: https://www.ricursive.com/rippleβ§ >(11/04) MoonshotAI Kimi K3.1 Pro released on HF: https://hf.co/moonshotai/Kimi-K3.1-Proβ§ >(11/01) Longcat-2.5 released: https://longcat.ai/blog/longcat-2.5β§ News Archive: https://rentry.org/lmg-news-archiveβ§ Links: https://rentry.org/LocalModelsLinksβ§ Official /lmg/ card: https://files.catbox.moe/cbclyf.pngβ§ Getting Started https://rentry.org/lmg-lazy-getting-started-guideβ§ https://rentry.org/lmg-build-guidesβ§ https://rentry.org/IsolatedLinuxWebServiceβ§ https://rentry.org/recommended-modelsβ§ https://rentry.org/samplersβ§ https://rentry.org/MikupadIntroGuideβ§ Further Learning https://rentry.org/machine-learning-roadmapβ§ https://rentry.org/llm-trainingβ§ https://rentry.org/LocalModelsPapersβ§ Benchmarks LiveBench: https://livebench.aiβ§ Programming: https://swe-rebench.comβ§ Agentic Coding: https://deepswe.datacurve.aiβ§ Context Length: https://github.com/RecapAnon/NoLiMaβ§ GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inferenceβ§ Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculatorβ§ Sampler Visualizer: https://artefact2.github.io/llm-samplingβ§ Token Speed Visualizer: https://shir-man.com/tokens-per-secondβ§ Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupadβ§ https://github.com/oobabooga/text-generation-webuiβ§ https://github.com/LostRuins/koboldcppβ§ https://github.com/ggerganov/llama.cppβ§ https://github.com/theroyallab/tabbyAPIβ§ https://github.com/vllm-project/vllmβ§ https://rentry.org/custom-uisβ§β± 21hβ© 39
Very uncanny. I love it.β± 1dβ©
+ 38