arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.08644cs.CL
收藏

EXAONE 4.5 技术报告

EXAONE 4.5 Technical Report

LG AI Research(LG AI 研究院)
Eunbi Choi, Kibong Choi, Sehyun Chun, Seokhee Hong, Junwon Hwang, Hyojin Jeon, Ahra Jo, Hyunjik Jo, Yeonsik Jo, Joonkee Kim, Seonghwan Kim, Soyeon Kim, Sunkyoun… 展开作者

Eunbi Choi, Kibong Choi, Sehyun Chun, Seokhee Hong, Junwon Hwang, Hyojin Jeon, Ahra Jo, Hyunjik Jo, Yeonsik Jo, Joonkee Kim, Seonghwan Kim, Soyeon Kim, Sunkyoung Kim, Yireun Kim, Yongil Kim, Changhun Lee, Haeju Lee, Jinsik Lee, Kyungmin Lee, Sangha Park, Kwangrok Ryoo, Minju Seo, Sejong Yang, Heuiyeen Yeen, Hwan Chang, Stanley Jungkyu Choi, Yejin Choi, Kyubeen Han, Joonwon Jang, Kijeong Jeon, Geunyeong Jeong, Gerrard Jeongwon Jo, Jiyeon Jung, Daeseong Kim, Dohoon Kim, Dohyun Kim, Hyunseo Kim, Minu Kim, Myoungshin Kim, Youchul Kim, Byungoh Ko, Christopher Lee, Edward Hwayoung Lee, Honglak Lee, Jiyoung Lee, Sangeun Lee, Seungwon Lim, Woohyung Lim, Jueun Mun, Jaewoo Park, Jimin Park, Jinho Park, Yongmin Park, Wooseok Seo, Yongwoo Song, Sihyuk Yi, Kyungjae Yoo, Sangyeon Yoon

AI总结:

EXAONE 4.5通过集成专用视觉编码器扩展EXAONE 4.0框架,实现多模态预训练,提升文档理解和语言能力,支持256K tokens上下文长度,优于同类模型。

摘要:

本技术报告介绍了由LG AI Research发布的首个开源权重视觉语言模型EXAONE 4.5。该模型通过在现有EXAONE 4.0框架中集成专用视觉编码器,实现了对视觉和文本模态的原生多模态预训练。模型在大规模数据上进行训练,特别强调与LG战略应用领域相关的文档中心语料库。这种有针对性的数据设计在文档理解和相关任务中带来了显著性能提升,同时在通用语言能力方面也实现了广泛改进。EXAONE 4.5将上下文长度扩展至256K tokens,有助于长上下文推理和企业级应用。比较评估显示,EXAONE 4.5在通用基准测试中表现具有竞争力,同时在文档理解和韩语上下文推理方面优于同类模型。作为LG向实际工业部署迈进的持续努力,EXAONE 4.5被设计为能够持续扩展到额外领域和应用场景,以推进人工智能用于更美好的生活。

英文摘要:

This technical report introduces EXAONE 4.5, the first open-weight vision language model released by LG AI Research. EXAONE 4.5 is architected by integrating a dedicated visual encoder into the existing EXAONE 4.0 framework, enabling native multimodal pretraining over both visual and textual modalities. The model is trained on large-scale data with careful curation, particularly emphasizing document-centric corpora that align with LG's strategic application domains. This targeted data design enables substantial performance gains in document understanding and related tasks, while also delivering broad improvements across general language capabilities. EXAONE 4.5 extends context length up to 256K tokens, facilitating long-context reasoning and enterprise-scale use cases. Comparative evaluations demonstrate that EXAONE 4.5 achieves competitive performance in general benchmarks while outperforming state-of-the-art models of similar scale in document understanding and Korean contextual reasoning. As part of LG's ongoing effort toward practical industrial deployment, EXAONE 4.5 is designed to be continuously extended with additional domains and application scenarios to advance AI for a better life.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑