FRESH
Hacker News
Home
Show HN: Fast NF4 dequantization Triton kernel (1.41x faster than bitsandbytes)
5 points by Griffith-7
by DiabloD3
0 subcomment
Neat, can't wait to see a llama.cpp PR for this.
