π“Ÿ host1.bitchan.one

𓀐 @xRca-2K9

⏱ 1d seenβ›“ 0πŸ‘ 0β§– 1

filter [-]

languages:onother

Could you run 26b a4b with MoE offloading?⏱ 1d↩ 1
I can run 26B but it feels worse and more clunky. There’s something off with that model. I like the dense vibe you get from 12B. 31B is too slow and chubby to run as a daily generalist with mmproj. Really wish a modern 16-20B dense model existed. I’m hating this MoE arc so much I feel like the only anon ITT who strongly notices the difference between the dense and MoE experience.⏱ 1d↩ 1