Navigating the Certainty Gap: The Hydraulic Effect of Evidence-Constrained LLMs in Professional Decision-Making
Florence Gundidza, Masato Kikuchi, Tadachika Ozono
Nagoya Institute of Technology
阅读操作
确认中在文库中上传 PDF 后可生成中文音频讲解。
摘要与影响
Large Language Models (LLMs) are increasingly deployed in high-stakes environments, including infrastructure auditing, medical assessment, legal analysis, and peer review. However, these failures arise less from knowledge limitations than from systematic misinterpretation of modality (fact vs. possibility) and unstable decision commitment, leading to two opposing failure modes: false confirmations (over-commitment) and over-abstention (excessive conservatism). To address this, we propose the Evidence–Constrained (EC) Framework, a structured paradigm for regulating LLM decision boundaries through two complementary mechanisms: a Modality Filter (“the Brake”), which enforces strict separation between factual and conditional evidence, and a Normalcy Rule (“the Accelerator”), which enables inference of non-events from routine reporting structures. These terms are used as analytical metaphors describing opposing influences on commitment behavior rather than literal computational operators. We evaluate the framework through a cross-domain experimental study spanning construction, medical, legal, and peer-review tasks, compared against domain-informed human evaluation. Results reveal a systematic trade-off phenomenon, termed “Hydraulic Effect”, where reducing false confirmations increases abstention, reaching up to 35%. We further identify recurring cross-domain failure patterns, including temporal-modality confusion, lexical overheating, and the Condition Precedent Gap. Rather than yielding a single configuration that is uniformly optimal across the evaluated benchmark, the EC framework exposes a persistent trade-off between decision safety and coverage, suggesting that reliable LLM deployment may require explicit calibration of commitment thresholds under uncertainty. These findings provide exploratory guidance for the design of uncertainty-aware LLM workflows. The reported results should be interpreted as evidence from controlled behavioral experiments on carefully selected ambiguity-sensitive benchmark cases rather than as estimates of real-world deployment performance.
逐年被引趋势
暂无年度引用数据
关键指标
同类平均 = 1
同领域 · 同年份 · 同类型
Google Scholar 与 OpenAlex 的被引统计范围不同,数值存在差异属正常。
AI 辅助阅读
依据:摘要
可就本文提问;依据不足时会说明。
学术脉络
学科主题
社会科学Ethics and Social Impacts of AI
Topic Modeling · Explainable Artificial Intelligence (XAI)
参考文献 24
此处列出前 3 条