语言模型能像聊天机器人一样理解词语义吗？语言模型内部与外部不匹配的实证研究
Can Language Model Understand Word Semantics as A Chatbot? An Empirical Study of Language Model Internal External Mismatch
AI总结：
本文针对语言模型内部与外部不匹配问题，研究了Encoder-only、Decoder-only和Encoder-Decoder预训练模型在词语义理解上的差异，揭示了提示与内部表征间的知识不一致性。
摘要：
当前与语言模型的常见交互方式是通过完整推理。该方法未必与模型内部知识一致。研究表明提示与内部表征间存在差异。多数研究聚焦句子理解。我们研究Encoder-only、Decoder-only和Encoder-Decoder预训练语言模型在内部与外部不匹配下的词语义理解差异。
英文摘要：
Current common interactions with language models is through full inference. This approach may not necessarily align with the model's internal knowledge. Studies show discrepancies between prompts and internal representations. Most focus on sentence understanding. We study the discrepancy of word semantics understanding in internal and external mismatch across Encoder-only, Decoder-only, and Encoder-Decoder pre-trained language models.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
