PRISM: A Training-Free Financial Retrieval Framework Improving Recall and Cost Efficiency
ORIGINAL / PRISM: Prompt-Refined In-Context System Modelling for Financial Retrieval
PRISM proposes a training-free framework for financial document retrieval that combines prompt engineering, in-context learning, and a candidate refinement module. It improves Recall@100 on FiQA-2018 and achieves comparable end-to-end NDCG@5 at lower cost on FinAgentBench, while releasing an expert-annotated evaluation set and a 16-variant label-robustness sweep.
01 ABSTRACT
PRISM is a training-free financial retrieval framework composed of three deployable modules: prompt engineering, in-context learning, and candidate refinement. On FiQA-2018, stacked reranking and k-reciprocal encoding raise Recall@100 from 0.7783 to 0.8326; on FinAgentBench, a Cohere-refined top-50 pool yields a higher observed end-to-end NDCG@5 that is below the evaluation's minimum detectable effect, while cutting per-query cost by about 35%. The authors also release an expert-annotated FinAgentBench evaluation set and a label-robustness sweep over 16 alternative ground-truth constructions, and note that added complexity does not always pay off: k-reciprocal encoding stops helping when the upstream stage is already high-recall, multi-agent coordination is not a default for fine-grained chunk ranking, and matched pairs show multi-agent coordination loses 0.0702 and 0.0681 combined NDCG@5 at the chunk stage.
02 KEY FINDINGS
- PRISM requires no fine-tuning and raises Recall@100 on FiQA-2018 from 0.7783 to 0.8326 via stacked reranking and k-reciprocal encoding.
- On FinAgentBench, a Cohere-refined top-50 pool increases end-to-end NDCG@5 but below the minimum detectable effect, while cutting per-query cost by about 35%.
- Multi-agent coordination is not default-better for fine-grained chunk ranking; matched pairs show combined NDCG@5 losses at the chunk stage.
AI GENERATED SUMMARY / DISCOVERED BY ARXIV CS.CL