0

Offline Pseudo Relevance Feedback for Efficient and Effective Single-pass Dense Retrieval

A novel single-pass dense retrieval framework uses pre-generated pseudo-queries to incorporate pseudo relevance feedback offline, thereby reducing online latency and maintaining retrieval effectiveness.

Year
2023
Venue
arXiv 2023
Authors
5
Hosting
Abstract onlyARXIV-DEFAULT

Cite

Notes

Only stored in your browser.

Attribution

Abstract & full text
arxiv.org/abs/2308.10191ARXIV-DEFAULT
TL;DR
Semantic Scholar
Attribution policy →

Abstract

Dense retrieval has made significant advancements in information retrieval (IR) by achieving high levels of effectiveness while maintaining online efficiency during a single-pass retrieval process. However, the application of pseudo relevance feedback (PRF) to further enhance retrieval effectiveness results in a doubling of online latency. To address this challenge, this paper presents a single-pass dense retrieval framework that shifts the PRF process offline through the utilization of pre-generated pseudo-queries. As a result, online retrieval is reduced to a single matching with the pseudo-queries, hence providing faster online retrieval. The effectiveness of the proposed approach is evaluated on the standard TREC DL and HARD datasets, and the results demonstrate its promise. Our code is openly available at https://github.com/Rosenberg37/OPRF.

Authors

5