Rerank before you fill the prompt

processopen source

Retrieve broadly (vector plus keyword), then rerank and pass only the top few chunks to the model.

A reranking step scores each candidate chunk against the query so only the most relevant ones take up the attention budget. In Anthropic's contextual retrieval tests, failed retrievals fell by 49% without reranking and by 67% with it.