EXAONE 4.5 技术报告
EXAONE 4.5 Technical Report
AI总结:
EXAONE 4.5通过集成专用视觉编码器扩展EXAONE 4.0框架,实现多模态预训练,提升文档理解和语言能力,支持256K tokens上下文长度,优于同类模型。
摘要:
本技术报告介绍了由LG AI Research发布的首个开源权重视觉语言模型EXAONE 4.5。该模型通过在现有EXAONE 4.0框架中集成专用视觉编码器,实现了对视觉和文本模态的原生多模态预训练。模型在大规模数据上进行训练,特别强调与LG战略应用领域相关的文档中心语料库。这种有针对性的数据设计在文档理解和相关任务中带来了显著性能提升,同时在通用语言能力方面也实现了广泛改进。EXAONE 4.5将上下文长度扩展至256K tokens,有助于长上下文推理和企业级应用。比较评估显示,EXAONE 4.5在通用基准测试中表现具有竞争力,同时在文档理解和韩语上下文推理方面优于同类模型。作为LG向实际工业部署迈进的持续努力,EXAONE 4.5被设计为能够持续扩展到额外领域和应用场景,以推进人工智能用于更美好的生活。
英文摘要:
This technical report introduces EXAONE 4.5, the first open-weight vision language model released by LG AI Research. EXAONE 4.5 is architected by integrating a dedicated visual encoder into the existing EXAONE 4.0 framework, enabling native multimodal pretraining over both visual and textual modalities. The model is trained on large-scale data with careful curation, particularly emphasizing document-centric corpora that align with LG's strategic application domains. This targeted data design enables substantial performance gains in document understanding and related tasks, while also delivering broad improvements across general language capabilities. EXAONE 4.5 extends context length up to 256K tokens, facilitating long-context reasoning and enterprise-scale use cases. Comparative evaluations demonstrate that EXAONE 4.5 achieves competitive performance in general benchmarks while outperforming state-of-the-art models of similar scale in document understanding and Korean contextual reasoning. As part of LG's ongoing effort toward practical industrial deployment, EXAONE 4.5 is designed to be continuously extended with additional domains and application scenarios to advance AI for a better life.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。