Entity set expansion, taxonomy expansion, and seed-guided taxonomy construction are three representative tasks that can be applied to automatically populate an existing taxonomy with emerging concepts. Previous studies view them as three separate tasks. Therefore, their proposed techniques usually work for one specific task only, lacking generalizability and a holistic perspective. In this paper, we aim at a unified solution to the three tasks. To be specific, we identify two common skills needed for entity set expansion, taxonomy expansion, and seed-guided taxonomy construction: finding "siblings" and finding "parents". We propose a taxonomy-guided instruction tuning framework to teach a large language model to generate siblings and parents for query entities, where the joint pre-training process facilitates the mutual enhancement of the two skills. Extensive experiments on multiple benchmark datasets demonstrate the efficacy of our proposed TaxoInstruct framework, which outperforms task-specific baselines across all three tasks.
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models
Microsoft(微软);Singapore University of Technology and Design(新加坡科技设计大学);Peking University(北京大学);Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Chinese University of Hong Kong(香港中文大学);Tsinghua University(清华大学)
Instructional Goal-Aligned Question Generation for Student Evaluation in Virtual Lab Settings: How Closely Do LLMs Actually Align?
Department of EdPsych, University of Wisconsin-Madison(威斯康星大学麦迪逊分校教育心理学系);Department of CS, Wichita State University(威斯康星州立大学Wichita分校计算机科学系);Department of CSSE, Auburn University(阿伯茨罕大学计算机科学与工程系)
VANER: Leveraging Large Language Model for Versatile and Adaptive Biomedical Named Entity Recognition
School of Computer Science, Fudan University(复旦大学计算机科学技术学院);Shanghai Key Lab of Intelligent Information Processing, Fudan University(复旦大学上海市智能信息处理重点实验室);Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University(复旦大学脑智能科学与技术研究院);School of Computing and Mathematics, Charles Sturt University(查尔斯斯特大学计算与数学学院);Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence (Fudan University), Ministry of Education(教育部计算神经科学与脑智能重点实验室);MOE Frontiers Center for Brain Science, Fudan University(复旦大学教育部脑科学前沿中心);Zhangjiang Fudan International Innovation Center(张江复旦国际创新中心)
Towards Compositional Generalization of LLMs via Skill Taxonomy Guided Data Synthesis
State Key Laboratory of Complex & Critical Software Environment, Beihang University(复杂与关键软件环境国家重点实验室,北京航空航天大学);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Beijing Institute of Technology(北京理工大学);Institute of Computing Technology, CAS(中国科学院计算技术研究所)
LongCrafter: Towards Diverse Long-Context Understanding via Evidence-Graph-Guided Instruction Synthesis
University of Chinese Academy of Sciences(中国科学院大学);The Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所认知与决策智能复杂系统重点实验室)
A Survey on Data Selection for LLM Instruction Tuning
Harbin Institute of Technology(哈尔滨工业大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Harbin Institute of Technology (Weihai)(哈尔滨工业大学(威海))
CLASS-IT: Conversational and Lecture-Aligned Small-Scale Instruction Tuning for BabyLMs
CoLing Lab, Department of Philology, Literature and Linguistics, University of Pisa(皮尔切大学哲学、文学与语言学系语言实验室);Department of Computer Science, University of Pisa(皮尔切大学计算机科学系)
Minimal-Edit Instruction Tuning for Low-Resource Indic GEC
Indian Heritage Language Computing Team Special and Strategic Projects (SSP) Group(印度遗产语言计算团队特殊与战略项目组);Centre for Development of Advanced Computing (C DAC)(高级计算发展中心)
Beyond Boundaries: Learning a Universal Entity Taxonomy across Datasets and Languages for Open Named Entity Recognition
School of Computer Science, Fudan University(复旦大学计算机科学学院);Honor Device Co., Ltd(荣誉设备有限公司);Institute of Modern Languages and Linguistics, Fudan University(复旦大学现代语言与语言学研究所);Pengcheng Laboratory(鹏城实验室);Research Institute of Intelligent Complex Systems, Fudan University(复旦大学智能复杂系统研究院);Shanghai Key Laboratory of Intelligent Information Processing(上海智能信息处理重点实验室)
From Retrieval to Reasoning: A Framework for Cyber Threat Intelligence NER with Explicit and Adaptive Instructions
Sichuan University(四川大学);Renmin University of China(中国人民大学);Wuhan University(武汉大学);Engineering Research Center of Next-Generation Intelligent Search and Recommendation, Ministry of Education, China(教育部下一代智能搜索与推荐工程研究中心)
Analysing Lightweight Large Language Models for Biomedical Named Entity Recognition on Diverse Ouput Formats
Inria, Inserm, Université Paris Cité, HeKA, UMR 1346, Paris, France(法国国家科学研究中心(Inria)、法国国家医学研究院(Inserm)、巴黎城市大学(Université Paris Cité)、HeKA、法国国家科研机构(UMR 1346)、巴黎);Télécom Paris, Institut Polytechnique de Paris, France(巴黎电信学院(Télécom Paris)、巴黎理工学院(Institut Polytechnique de Paris)、法国)
LLM-Align: Utilizing Large Language Models for Entity Alignment in Knowledge Graphs
School of Artificial Intelligence, Beijing Normal University(北京师范大学人工智能学院);Engineering Research Center of Intelligent Technology and Educational Application, Ministry of Education(教育部智能技术与教育应用工程研究中心)
Benchmarking Complex Instruction-Following with Multiple Constraints Composition
Tsinghua University(清华大学);University of Electronic Science and Technology of China(电子科技大学);Zhipu AI(智谱AI);China University of Geosciences(中国地质大学);Central China Normal University(华中师范大学)
FollowTable: A Benchmark for Instruction-Following Table Retrieval
Southeast University(东南大学);Huawei Noah’s Ark Lab(华为诺亚实验室);Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education(新一代人工智能技术及其交叉应用国家重点实验室(东南大学));Its Interdisciplinary Applications (Southeast University), Ministry of Education(交叉应用(东南大学),教育部)