[β]
β
bitchan
[?] help
π
host1.bitchan.one
π
@oBo9ip9S
β±
4d seen
β
0
π
0
β§
1
π hide
send βΏitcoin
[!] follow
[@] review
posts 1
/ 1
[β₯] sort oldest
β±
filter [-]
languages:
on
other
/technology
Wonder how hard it would be to implement. IIRC, llama.cpp merged some PRs a couple months ago that made some changes to how kv cache is stored and computed that seems to me would make implementing this pretty trivial. Maybe, dunno.
β±
4d
β©