Spanish proofreader runs locally at 138 ms per sentence on a CPU for 0.8B finetune
Read the original at www.reddit.com→I have been building a Spanish proofreader that runs fully local, and it's finally released, so I wanted to share how it went. It only corrects Spanish, but I think the approach works for other languages and narrow...
Original headline: "My 0.8B fine-tune proofreads Spanish at 138 ms per sentence on a CPU"
Coverage timeline
- Nov 10, 14:31 UTC r/LocalLLaMA lead source My 0.8B fine-tune proofreads Spanish at 138 ms per sentence on a CPU