Named Entity Recognition (NER) is a fundamental problem in natural language processing (NLP). However, the task of extracting longer entity spans (e.g., awards) from extended texts (e.g., homepages) is barely explored. Current NER methods predominantly fall into two categories: span-based methods and generation-based methods. Span-based methods require the enumeration of all possible token-pair spans, followed by classification on each span, resulting in substantial redundant computations and excessive GPU memory usage. In contrast, generation-based methods involve prompting or fine-tuning large language models (LLMs) to adapt to downstream NER tasks. However, these methods struggle with the accurate generation of longer spans and often incur significant time costs for effective fine-tuning. To address these challenges, this paper introduces a lightweight span-based NER method called SeNER, which incorporates a bidirectional arrow attention mechanism coupled with LogN-Scaling on the [CLS] token to embed long texts effectively, and comprises a novel bidirectional sliding-window plus-shaped attention (BiSPA) mechanism to reduce redundant candidate token-pair spans significantly and model interactions between token-pair spans simultaneously. Extensive experiments demonstrate that our method achieves state-of-the-art extraction accuracy on three long NER datasets and is capable of extracting entities from long texts in a GPU-memory-friendly manner. Code: https://github.com/THUDM/scholar-profiling/tree/main/sener
Meta In-Context Learning Makes Large Language Models Better Zero and Few-Shot Relation Extractors
School of Computer Science and Engineering, Southeast University(东南大学计算机科学与工程学院);Beijing Institute of Computer Technology and Application(北京计算机技术及应用研究所)
Unifying Text Semantics and Graph Structures for Temporal Text-attributed Graphs with Large Language Models
Shanghai Key Laboratory of Data Science, School of Computer Science, Fudan University(上海数据科学 key laboratory,计算机科学学院,复旦大学);School of Management, Fudan University(管理学院,复旦大学);Tencent Weixin Group(腾讯微信集团);IFM Lab, University of California, Davis(加州大学戴维斯分校IFM实验室)
Extracting and Encoding: Leveraging Large Language Models and Medical Knowledge to Enhance Radiological Text Representation
Pontificia Universidad Católica de Chile(智利天主教大学);University of Pennsylvania(宾夕法尼亚大学);KU Leuven(鲁汶大学);Millennium Institute for Intelligent Healthcare Engineering (iHEALTH)(千禧智能医疗工程研究院(iHEALTH));National Center for Artificial Intelligence (CENIA)(国家人工智能中心(CENIA))
Stochastic Adversarial Networks for Multi-Domain Text Classification
School of Artificial Intelligence, Jilin University(吉林大学人工智能学院);Key Laboratory of Symbolic Computation and Knowledge Engineering, Jilin University(吉林大学符号计算与知识工程重点实验室)
我们研究了深度神经网络在与文本无关的说话人识别任务中的性能。我们证明,在分类神经网络的最后一个分类层使用角softmax激活,而不是一个简单的softmax激活允许训练一个更广义的判别扬声器嵌入提取器。余弦相似度是在该嵌入空间中进行说话人确认的有效度量。我们还解决了选择一个架构的提取器的问题。我们发现,具有残留帧级连接的深度网络优于宽但相对较浅的架构。本文还提出了一些改进以前的基于DNN的提取器系统,以提高说话人识别的准确性。我们表明,区别训练的相似性度量学习方法优于标准的LDA-PLDA方法作为嵌入后端。在Speakers in the Wild和NIST SRE 2016评估集上获得的结果证明了所提出的系统在处理接近现实生活条件时的鲁棒性。
Track-SQL: Enhancing Generative Language Models with Dual-Extractive Modules for Schema and Context Tracking in Multi-turn Text-to-SQL
School of Computer Science, Guangdong University of Technology(广东技术大学计算机科学学院);Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)(广东人工智能与数字经济实验室);Peng Cheng Laboratory(鹏城实验室);College of Science, Shantou University(汕头大学理学院)