Benchmarking the ancient books capability of multimodal large language models
Dongbo Wang, Dongmei Zhu
Nanjing Agricultural University
阅读操作
确认中在文库中上传 PDF 后可生成中文音频讲解。
摘要与影响
Although evaluation benchmarks for general multimodal large language models (MLLMs) are increasingly prevalent, the systematic evaluation of their capabilities for processing ancient texts remains underdeveloped. Ancient books, as cultural heritage artifacts, integrate rich textual and visual elements. Due to their unique cross-linguistic complexity and multimodal composition, they pose challenges to the evaluation of the multifaceted capabilities of MLLMs. To address this issue, we propose benchmarking the ancient book capabilities of MLLMs (BABMLLM), a specialized benchmark designed to evaluate their performance specifically within the domain of ancient books. This benchmark comprises seven curated datasets, enabling comprehensive evaluation across four core tasks relevant to ancient book processing: ancient book translation, text recognition, image captioning, and image-text consistency judgment. Furthermore, BABMLLM provides a standardized reference for evaluating MLLMs in the context of ancient books and establishes a foundation for selecting suitable base models for subsequent domain-specific development.
逐年被引趋势
关键指标
同类平均 = 1
同领域 · 同年份 · 同类型
Google Scholar 与 OpenAlex 的被引统计范围不同,数值存在差异属正常。
AI 辅助阅读
依据:摘要
可就本文提问;依据不足时会说明。
学术脉络
学科主题
计算机 / AIMultimodal Machine Learning Applications
Handwritten Text Recognition Techniques · Topic Modeling