Fine-tuning Qwen3.5-9B with QLora on ~500 GB of raw data; user describes hardware setup (Asus ESC4000 G3, 8x T4s, 44 slots) and deployment details for Qwen 3.5-9B Q5_K_XL with context 87k per slot, including latency and throughput specifics.
Read the original at www.reddit.com→Hi All: I done overthought and burned money after consulting with AI chats (from chatgpt to grok to deepseek and kimi/etc). I had to learn. I have in my possession: - 1 Asus ESC4000 G3 with 128 GB DDR4 RDIMM and in...
Original headline: "I need to fine tune Qwen3.5-9B with QLora on about 500 GB of raw data (images/scanned documents/pdfs/word/excel) - what is the best way forward?"
Coverage timeline
- Oct 25, 22:32 UTC r/LocalLLaMA lead source I need to fine tune Qwen3.5-9B with QLora on about 500 GB of raw data (images/scanned documents/pdfs/word/excel) - what is the best way forward?