Harnessing Disagreement: Detecting Correlated Agreement Blindness in Multi-agent Triage
Shay Seiya McDonnell, Avantika Singh, Quoc‐Viet Pham, Vratislav Havlík, Gregory M. P. O’Hare
Trinity College Dublin
阅读操作
确认中在文库中上传 PDF 后可生成中文音频讲解。
摘要与影响
Disagreement-triggered escalation can create a structural blind spot in multi-agent arbitration: as base learners improve they tend to converge, weakening safety monitoring exactly where correlated failures concentrate. We term this correlated agreement blindness and present ARAT (Arbitrated Reasoning Agents for Alarm Triage), a directed-star system pairing a Random Forest (RF) agent, a k-nearest-neighbour (k-NN) agent, and a learned routing meta-model. On 82,332 holdout samples from the UNSW-NB15 network intrusion detection dataset, 57.2% of errors occur under agreement and 90.6% of dangerous under-predictions evade disagreement-based monitoring even after a conservative override; strengthening the base learners increases error correlation while reducing disagreement. ARAT delivers a significant reduction in under-prediction from 4.80% under soft voting to 1.70% through a conservative override and a unanimous-Normal safety flag, a gain not reproduced by loss-function tuning nor by single-model uncertainty quantification at equal review budget. The mechanism replicates on the UCI Diabetes readmission data, and the same routing transfers to a cross-family large language model (LLM) committee on cancer staging, cutting dangerous under-prediction for frontier models as well as classical ones. Diversification improves safety only when it yields productive disagreement rather than convergence, and blindness intensifies as agentic pipelines deploy increasingly capable correlated models.
逐年被引趋势
暂无年度引用数据
关键指标
同类平均 = 1
同领域 · 同年份 · 同类型
Google Scholar 与 OpenAlex 的被引统计范围不同,数值存在差异属正常。
AI 辅助阅读
依据:摘要
可就本文提问;依据不足时会说明。
学术脉络
学科主题
计算机 / AIAdversarial Robustness in Machine Learning
Network Security and Intrusion Detection · Imbalanced Data Classification Techniques