Tag: RAG
All the articles with the tag "RAG".
LEANN cut a 60-million-passage index from 201GB to 6GB. Is trading disk space for waiting time worth it?
Berkeley's LEANN drops full vectors from a RAG index and recomputes them at query time: a 60-million-passage index shrinks from 201GB to 6GB, chat-history index from 1.8GB to 64MB, at the same answer accuracy — but retrieval runs about 50x slower. When that trade is worth it, and when it isn't.
