RAG on messy HTML: preprocessing, structure-aware chunking and hybrid retrieval
Fixed-size chunking fails on real documents. What moved retrieval quality for us: boilerplate stripping, heading-aware chunks, hybrid search and a re-ranker.
Tag
1 post
Fixed-size chunking fails on real documents. What moved retrieval quality for us: boilerplate stripping, heading-aware chunks, hybrid search and a re-ranker.