In the field of natural language understanding, the intersection of neural models and graph meaning representations (GMRs) remains a compelling area of research. Despite the growing interest, a critical gap persists in understanding the exact influence of GMRs, particularly concerning relation extraction tasks. Addressing this, we introduce DAGNN-plus, a simple and parameter-efficient neural architecture designed to decouple contextual representation learning from structural information propagation. Coupled with various sequence encoders and GMRs, this architecture provides a foundation for systematic experimentation on two English and two Chinese datasets. Our empirical analysis utilizes four different graph formalisms and nine parsers. The results yield a nuanced understanding of GMRs, showing improvements in three out of the four datasets, particularly favoring English over Chinese due to highly accurate parsers. Interestingly, GMRs appear less effective in literary-domain datasets compared to general-domain datasets. These findings lay the groundwork for better-informed design of GMRs and parsers to improve relation classification, which is expected to tangibly impact the future trajectory of natural language understanding research.
RethinkingTMSC: An Empirical Study for Target-Oriented Multimodal Sentiment Classification
School of Computer Science, Fudan University(复旦大学计算机科学学院);School of Computer Science and Technology, East China Normal University(华东师范大学计算机科学与技术学院);nyonic;Institute of Modern Languages and Linguistics, Fudan University(复旦大学现代语言学研究院)
Rethinking Semantic Parsing for Large Language Models: Enhancing LLM Performance with Semantic Hints
National Key Laboratory for Multimedia Information Processing, Peking University(北京大学多媒体信息处理国家重点实验室);School of Software and Microelectronics, Peking University(北京大学软件与微电子学院);Tsinghua University(清华大学)
Shuo Wen Jie Zi: Rethinking Dictionaries and Glyphs for Chinese Language Pre-training
Peking University(北京大学);Beijing Institute for General Artificial Intelligence (BIGAI)(北京通用人工智能研究院);National Key Laboratory of General Artificial Intelligence(通用人工智能全国重点实验室)
Rethinking Text Attribute Transfer: A Lexical Analysis
Columbia University(哥伦比亚大学);Bytedance AI Lab(字节跳动人工智能实验室)
文本属性迁移是指对某些语言属性(如情感、风格、作者等)的修改。并将它们从一种类型转换为另一种类型。在本文中,我们的目的是分析和解释在转移过程中发生了什么变化。我们首先观察到,在许多现有的模型和数据集中,句子中的某些单词在确定句子属性类方面发挥着重要作用。这些单词称为\textit{the Pivot Words}。基于这些主元词,我们提出了一个词汇分析框架\textit{the Pivot Analysis},定量分析这些词在文本属性分类和迁移中的作用。我们将此框架应用于现有的数据集和模型,并表明:(1)主元词是句子属性分类的强特征;(2)要改变句子的属性,许多数据集只需要改变某些主元词;(3)因此,许多迁移模型只执行词汇级别的修改,而不改变更高级别的句子结构。我们的工作提供了一个深入的了解语言属性转移,并进一步确定了未来的要求和挑战,这项任务\footnote{Our code can be found at https://github.com/FranxYao/pivot_analysis}。