Do batch and user evaluations give the same results?
William Hersh, Andrew H. Turpin, Susan Price, Benjamin K S Chan, Dale Kramer, Lynetta Sacherek, Daniel Olson
Oregon Health & Science University
阅读操作
确认中在文库中上传 PDF 后可生成中文音频讲解。
摘要与影响
Do improvements in system performance demonstrated by batch evaluations confer the same benefit for real users? We carried out experiments designed to investigate this question. After identifying a weighting scheme that gave maximum improvement over the baseline in a non-interactive evaluation, we used it with real users searching on an instance recall task. Our results showed the weighting scheme giving beneficial results in batch studies did not do so with real users. Further analysis did identify other factors predictive of instance recall, including number of documents saved by the user, document recall, and number of documents seen by the user.
逐年被引趋势
关键指标
同类平均 = 1
同领域 · 同年份 · 同类型
Google Scholar 与 OpenAlex 的被引统计范围不同,数值存在差异属正常。
AI 辅助阅读
依据:摘要
可就本文提问;依据不足时会说明。
学术脉络
学科主题
计算机 / AIInformation Retrieval and Search Behavior
Recommender Systems and Techniques · Usability and User Interface Design
参考文献 14
此处列出前 3 条
引用本文 146
按被引量排序,此处列出前 3 条