quantization

I run my writing pipeline on a model that never leaves my machine

The author discusses an alternative approach to AI writing tools, emphasizing local models that run without external prompts or subscriptions. By using quantization, smaller…