/technology
+⧖/lmg/ - a general dedicated to the discussion and development of local language models. News >Claude BANS recomp! >https://www.youtube.com/watch?v=GlRVbIdc_Mk News Archive: https://rentry.org/lmg-news-archive Links: https://rentry.org/LocalModelsLinks Official /lmg/ card: https://files.catbox.moe/cbclyf.png Getting Started https://rentry.org/lmg-lazy-getting-started-guide https://rentry.org/lmg-build-guides https://rentry.org/IsolatedLinuxWebService https://rentry.org/recommended-models https://rentry.org/samplers https://rentry.org/MikupadIntroGuide Further Learning https://rentry.org/machine-learning-roadmap https://rentry.org/llm-training https://rentry.org/LocalModelsPapers Benchmarks LiveBench: https://livebench.ai Programming: https://swe-rebench.com Agentic Coding: https://deepswe.datacurve.ai Context Length: https://github.com/RecapAnon/NoLiMa GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator Sampler Visualizer: https://artefact2.github.io/llm-sampling Token Speed Visualizer: https://shir-man.com/tokens-per-second Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad https://github.com/oobabooga/text-generation-webui https://github.com/LostRuins/koboldcpp https://github.com/ggerganov/llama.cpp https://github.com/theroyallab/tabbyAPI https://github.com/vllm-project/vllm https://rentry.org/custom-uis
/lmg/ - a general dedicated to the discussion and development of local language models. News >Claude BANS recomp! >https://www.youtube.com/watch?v=GlRVbIdc_Mk⧉ News Archive: https://rentry.org/lmg-news-archive⧉ Links: https://rentry.org/LocalModelsLinks⧉ Official /lmg/ card: https://files.catbox.moe/cbclyf.png⧉ Getting Started https://rentry.org/lmg-lazy-getting-started-guide⧉ https://rentry.org/lmg-build-guides⧉ https://rentry.org/IsolatedLinuxWebService⧉ https://rentry.org/recommended-models⧉ https://rentry.org/samplers⧉ https://rentry.org/MikupadIntroGuide⧉ Further Learning https://rentry.org/machine-learning-roadmap⧉ https://rentry.org/llm-training⧉ https://rentry.org/LocalModelsPapers⧉ Benchmarks LiveBench: https://livebench.ai⧉ Programming: https://swe-rebench.com⧉ Agentic Coding: https://deepswe.datacurve.ai⧉ Context Length: https://github.com/RecapAnon/NoLiMa⧉ GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference⧉ Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator⧉ Sampler Visualizer: https://artefact2.github.io/llm-sampling⧉ Token Speed Visualizer: https://shir-man.com/tokens-per-second⧉ Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad⧉ https://github.com/oobabooga/text-generation-webui⧉ https://github.com/LostRuins/koboldcpp⧉ https://github.com/ggerganov/llama.cpp⧉ https://github.com/theroyallab/tabbyAPI⧉ https://github.com/vllm-project/vllm⧉ https://rentry.org/custom-uis⧉+⧖/lmg/ - a general dedicated to the discussion and development of local language models. News >(11/04) Ricursive Ripple 65B dense model released: https://www.ricursive.com/ripple >(11/04) MoonshotAI Kimi K3.1 Pro released on HF: https://hf.co/moonshotai/Kimi-K3.1-Pro >(11/01) Longcat-2.5 released: https://longcat.ai/blog/longcat-2.5 >(10/30) Google receives response from Gemma in space: https://blog.google/innovation-and-ai/models-and-research/google-research/project-suncatcher-satellite-response >(10/29) Mistral Large 4 (Le Chonk) 1T-A52B released: https://mistral.ai/news/mistral-large-4-oss News Archive: https://rentry.org/lmg-news-archive Links: https://rentry.org/LocalModelsLinks Official /lmg/ card: https://files.catbox.moe/cbclyf.png Getting Started https://rentry.org/lmg-lazy-getting-started-guide https://rentry.org/lmg-build-guides https://rentry.org/IsolatedLinuxWebService https://rentry.org/recommended-models https://rentry.org/samplers https://rentry.org/MikupadIntroGuide Further Learning https://rentry.org/machine-learning-roadmap https://rentry.org/llm-training https://rentry.org/LocalModelsPapers Benchmarks LiveBench: https://livebench.ai Programming: https://swe-rebench.com Agentic Coding: https://deepswe.datacurve.ai Context Length: https://github.com/RecapAnon/NoLiMa GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator Sampler Visualizer: https://artefact2.github.io/llm-sampling Token Speed Visualizer: https://shir-man.com/tokens-per-second Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad https://github.com/oobabooga/text-generation-webui https://github.com/LostRuins/koboldcpp https://github.com/ggerganov/llama.cpp https://github.com/theroyallab/tabbyAPI https://github.com/vllm-project/vllm https://rentry.org/custom-uis
/lmg/ - a general dedicated to the discussion and development of local language models. News >(11/04) Ricursive Ripple 65B dense model released: https://www.ricursive.com/ripple⧉ >(11/04) MoonshotAI Kimi K3.1 Pro released on HF: https://hf.co/moonshotai/Kimi-K3.1-Pro⧉ >(11/01) Longcat-2.5 released: https://longcat.ai/blog/longcat-2.5⧉ >(10/30) Google receives response from Gemma in space: https://blog.google/innovation-and-ai/models-and-research/google-research/project-suncatcher-satellite-response⧉ >(10/29) Mistral Large 4 (Le Chonk) 1T-A52B released: https://mistral.ai/news/mistral-large-4-oss⧉ News Archive: https://rentry.org/lmg-news-archive⧉ Links: https://rentry.org/LocalModelsLinks⧉ Official /lmg/ card: https://files.catbox.moe/cbclyf.png⧉ Getting Started https://rentry.org/lmg-lazy-getting-started-guide⧉ https://rentry.org/lmg-build-guides⧉ https://rentry.org/IsolatedLinuxWebService⧉ https://rentry.org/recommended-models⧉ https://rentry.org/samplers⧉ https://rentry.org/MikupadIntroGuide⧉ Further Learning https://rentry.org/machine-learning-roadmap⧉ https://rentry.org/llm-training⧉ https://rentry.org/LocalModelsPapers⧉ Benchmarks LiveBench: https://livebench.ai⧉ Programming: https://swe-rebench.com⧉ Agentic Coding: https://deepswe.datacurve.ai⧉ Context Length: https://github.com/RecapAnon/NoLiMa⧉ GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference⧉ Tools GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator⧉ Sampler Visualizer: https://artefact2.github.io/llm-sampling⧉ Token Speed Visualizer: https://shir-man.com/tokens-per-second⧉ Text Gen. UI, Inference Engines https://github.com/lmg-anon/mikupad⧉ https://github.com/oobabooga/text-generation-webui⧉ https://github.com/LostRuins/koboldcpp⧉ https://github.com/ggerganov/llama.cpp⧉ https://github.com/theroyallab/tabbyAPI⧉ https://github.com/vllm-project/vllm⧉ https://rentry.org/custom-uis⧉+⧖I really want a model that's small but has decent tool-calling, JSON, and writing abilities to use for game integrations.
I really want a model that's small but has decent tool-calling, JSON, and writing abilities to use for game integrations.The models I've tried that depend on game integrations before tend to give me error messages relating to JSON formatting or failed tool calls, I think it's because they're not really fine-tuned for that but it's probably because I have to run smaller models at cope quants to get any reasonable speed.
⧖expiring ~4d0/1 kept2d ago
⏱ 2d 👍 0
⬆ upvote 0
/technology
trying
closest
needs