扫参脚本骨架
扫参脚本骨架
for pool in (20, 50, 100):
hits = retrieve(q, top_k=pool)
pool_recall = recall_of(hits, gold)
for n in (4, 8, 12):
top = rerank(q, hits, top_n=n)
print(pool, n, pool_recall, eval_generation(q, top))先看「答案片段是否在候选池内」:不在池内的答案,重排再准也救不回来。