LUK: Empowering Log Understanding with Expert Knowledge from Large Language Models
School of Computer Science, Fudan University（复旦大学计算机科学学院）；School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University（西北工业大学人工智能、光学与电子学院）；School of Computer Science and Technology, Donghua University（东华大学计算机科学与技术学院）
Lipeng Ma, Weidong Yang, Sihang Jiang, Ben Fei, Mingjie Zhou, Shuhao Li, Mingyu Zhao, Bo Xu, Yanghua Xiao
Logs play a critical role in providing essential information for system monitoring and troubleshooting. Recently, with the success of pre-trained language models (PLMs) and large language models (LLMs) in natural language processing (NLP), smaller PLMs (such as BERT) and LLMs (like GPT-4) have become the current mainstream approaches for log analysis. Despite the remarkable capabilities of LLMs, their higher cost and inefficient inference present significant challenges in leveraging the full potential of LLMs to analyze logs. In contrast, smaller PLMs can be fine-tuned for specific tasks even with limited computational resources, making them more practical. However, these smaller PLMs face challenges in understanding logs comprehensively due to their limited expert knowledge. To address the lack of expert knowledge and enhance log understanding for smaller PLMs, this paper introduces a novel and practical knowledge enhancement framework, called LUK, which acquires expert knowledge from LLMs automatically and then enhances the smaller PLM for log analysis with these expert knowledge. LUK can take full advantage of both types of models. Specifically, we design a multi-expert collaboration framework based on LLMs with different roles to acquire expert knowledge. In addition, we propose two novel pre-training tasks to enhance the log pre-training with expert knowledge. LUK achieves state-of-the-art results on different log analysis tasks and extensive experiments demonstrate expert knowledge from LLMs can be utilized more effectively to understand logs. Our source code and detailed experimental data are available at https://github.com/LeaperOvO/LUK.
LogReasoner: Empowering LLMs with Expert-like Coarse-to-Fine Reasoning for Automated Log Analysis
Shanghai Key Laboratory of Data Science, School of Computer Science, Fudan University（上海数据科学关键实验室，计算机科学学院，复旦大学）；School of Artificial Intelligence and Computer Science, Jiangnan University（人工智能与计算机科学学院，江南大学）
EdgeMoE: Empowering Sparse Large Language Models on Mobile Devices
Beijing University of Posts and Telecommunications（北京邮电大学）；University of Electronic Science and Technology of China（电子科技大学）；Zhongguangcun Laboratory（中关村实验室）
Empowering Clinical Trial Design through AI: A Randomized Evaluation of PowerGPT
University of Pennsylvania（宾夕法尼亚大学）；Johns Hopkins Bloomberg School of Public Health（约翰斯·霍普金斯大学布隆伯格公共卫生学院）；Binghamton University, The State University of New York（纽约州立大学宾汉姆顿大学）；University of Minnesota（明尼苏达大学）；Pfizer Inc（辉瑞公司）；Washington University School of Medicine（华盛顿大学医学院）；University of Michigan Medical School（密歇根大学医学院）；McGovern Medical School（麦戈文医学院）；University of Iowa Hospital and Clinics（爱荷华大学医院与诊所）；University of Iowa（爱荷华大学）；Yale University（耶鲁大学）；Food and Drug Administration（美国食品药品监督管理局）；Rutgers the State University of New Jersey（罗格斯大学新泽西州立大学）
CVSearch: Empowering Multimodal LLMs with Cognitive Visual Search for High-Resolution Image Perception
Harbin Institute of Technology, Shenzhen, China（哈尔滨工业大学（深圳））；Peng Cheng Laboratory, Shenzhen, China（鹏城实验室）；Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China（深圳先进技术研究院）
AutoSurvey2: Empowering Researchers with Next Level Automated Literature Surveys
University of Texas at Arlington（德克萨斯理工大学）；AI Agent Lab（人工智能代理实验室）；Indiana University（印第安纳大学）；Ohio State University（俄亥俄州立大学）；Imperial College London（伦敦帝国理工学院）；Georgia Institute of Technology（佐治亚理工学院）；Appcubic（Appcubic公司）；Emory University（埃默里大学）
Empowering Medical Equipment Sustainability in Low-Resource Settings: An AI-Powered Diagnostic and Support Platform for Biomedical Technicians
Carnegie Mellon University Africa（卡内基梅隆大学非洲分校）；Medical Artificial Intelligence Laboratory（医学人工智能实验室）；University of Pennsylvania（宾夕法尼亚大学）；McGill University（麦吉尔大学）
PerMedCQA: Benchmarking Large Language Models on Medical Consumer Question Answering in Persian Language
School of Computer Science Institute for Research in Fundamental Sciences（计算机科学学院基础科学研究研究所）；School of Electrical and Computer Engineering University of Tehran（电气与计算机工程学院塔里班大学）；Department of Computer Science Faculty of Mathematical Sciences Alzahra University（计算机科学系数学科学学院阿扎赫拉大学）
