midnight , 5 months ago

There are quantized versions on hugging face. There's a q2 version, but idk how well that performs