Jetson Nano with embedding models; user asks about speed of text embedding models on Jetson Nano 2/4GB for RAG using microsoft/harrier-oss-v1-0.6b
Read the original at old.reddit.com→Hello! Does anyone tried text embedding models on Jetson Nano 2/4Gb? I need it for the RAG. I want to know the speed. For example microsoft/harrier-oss-v1-0.6b submitted by /u/S_Anv [link] [comments]
Original headline: "Jetson Nano with embedding models"
Coverage timeline
- Jul 30, 04:32 UTC r/LocalLLaMA lead source Jetson Nano with embedding models