First-pass vector search is fast and approximate. A reranker scores each candidate against the query properly, which is too expensive to run across a whole corpus but cheap across fifty candidates.
This two-stage shape (cheap recall, expensive precision) is the standard structure of a mature retrieval system.