[β]
β
bitchan
[?] help
π
host1.bitchan.one
π
@HzFkFVmn
β±
1w seen
β
0
π
0
β§
1
π hide
send βΏitcoin
[!] follow
[@] review
posts 1
/ 1
[β₯] sort oldest
β±
filter [-]
languages:
on
other
/technology
I didn't set any options for kv quant. I assume it's f16. I can fit iq3_s, ~150k context in my 22GB vram. I didn't load MTP because that doesn't do anything useful and I put mmproj on the CPU since I don't use images that much
β±
1w
β©