Exploring In-Context Learning Capabilities of Foundation Models for Generating Knowledge Graphs from Text
Peoples' Friendship University of Russia (RUDN University)(俄罗斯人民友谊大学(卢蒙巴大学));Joint Institute for Nuclear Research(联合核研究所);Vrije Universiteit Amsterdam(阿姆斯特丹自由大学);University of Skövde(舍夫德大学);University of Lübeck(吕贝克大学);IBM Research(IBM研究院)
Hanieh Khorashadizadeh, Nandana Mihindukulasooriya, Sanju Tiwari, Jinghua Groppe, Sven Groppe
Knowledge graphs can represent information about the real-world using entities and their relations in a structured and semantically rich manner and they enable a variety of downstream applications such as question-answering, recommendation systems, semantic search, and advanced analytics. However, at the moment, building a knowledge graph involves a lot of manual effort and thus hinders their application in some situations and the automation of this process might benefit especially for small organizations. Automatically generating structured knowledge graphs from a large volume of natural language is still a challenging task and the research on sub-tasks such as named entity extraction, relation extraction, entity and relation linking, and knowledge graph construction aims to improve the state of the art of automatic construction and completion of knowledge graphs from text. The recent advancement of foundation models with billions of parameters trained in a self-supervised manner with large volumes of training data that can be adapted to a variety of downstream tasks has helped to demonstrate high performance on a large range of Natural Language Processing (NLP) tasks. In this context, one emerging paradigm is in-context learning where a language model is used as it is with a prompt that provides instructions and some examples to perform a task without changing the parameters of the model using traditional approaches such as fine-tuning. This way, no computing resources are needed for re-training/fine-tuning the models and the engineering effort is minimal. Thus, it would be beneficial to utilize such capabilities for generating knowledge graphs from text.
How Does Sequence Modeling Architecture Influence Base Capabilities of Pre-trained Language Models? Exploring Key Architecture Design Principles to Avoid Base Capabilities Degradation
Research Center for Social Computing and Interactive Robotics(社会计算与交互机器人研究中心);Harbin Institute of Technology(哈尔滨工业大学);iFLYTEK Co., Ltd(iFLYTEK公司)
MHPP: Exploring the Capabilities and Limitations of Language Models Beyond Basic Code Generation
University of Edinburgh(爱丁堡大学);The University of Hong Kong(香港大学);Harbin Institute of Technology(哈尔滨工业大学);Singapore University of Technology and Design(新加坡科技设计大学);South China University of Technology(华南理工大学);City University of Hong Kong(香港城市大学);University of Cambridge(剑桥大学)
Atomic Thinking of LLMs: Decoupling and Exploring Mathematical Reasoning Abilities
Sun Yat-sen University(中山大学);Tsinghua University(清华大学);ByteDance Inc(字节跳动公司);Arizona State University(亚利桑那州立大学);Tencent Youtu Lab(腾讯优图实验室);Fudan University(复旦大学);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳));Guangdong Provincial Key Laboratory of Fire Science and Intelligent Emergency Technology(广东省消防科学与智能应急技术重点实验室);University of Illinois Chicago(伊利诺伊大学香槟分校)
Exploring Recommendation Capabilities of GPT-4V(ision): A Preliminary Case Study
Hong Kong University of Science and Technology(香港科技大学);Alibaba(阿里巴巴);Harvard T.H. Chan School of Public Health(哈佛大学陈曾熙公共卫生学院);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));International Digital Economy Academy (IDEA)(国际数字经济学院);Peking University(北京大学)