The literature has witnessed the success of leveraging Pre-trained Language Models (PLMs) and Transfer Learning (TL) algorithms to a wide range of Natural Language Processing (NLP) applications, yet it is not easy to build an easy-to-use and scalable TL toolkit for this purpose. To bridge this gap, the EasyTransfer platform is designed to develop deep TL algorithms for NLP applications. EasyTransfer is backended with a high-performance and scalable engine for efficient training and inference, and also integrates comprehensive deep TL algorithms, to make the development of industrial-scale TL applications easier. In EasyTransfer, the built-in data and model parallelism strategies, combined with AI compiler optimization, show to be 4.0x faster than the community version of distributed training. EasyTransfer supports various NLP models in the ModelZoo, including mainstream PLMs and multi-modality models. It also features various in-house developed TL algorithms, together with the AppZoo for NLP applications. The toolkit is convenient for users to quickly start model training, evaluation, and online deployment. EasyTransfer is currently deployed at Alibaba to support a variety of business scenarios, including item recommendation, personalized search, conversational question answering, etc. Extensive experiments on real-world datasets and online applications show that EasyTransfer is suitable for online production with cutting-edge performance for various applications. The source code of EasyTransfer is released at Github (https://github.com/alibaba/EasyTransfer).
Enhancing NLP Robustness and Generalization through LLM-Generated Contrast Sets: A Scalable Framework for Systematic Evaluation and Adversarial Training
College of Natural Sciences, The University of Texas at Austin（德克萨斯大学奥斯汀分校自然科学学院）
From Automation to Collaboration: Human-in-the-Loop Methods for Safe and Trustworthy NLP
Department of Computer Science and Engineering, BRAC University（布拉克大学计算机科学与工程系）；Department of Electrical and Electronic Engineering, Rajshahi University of Engineering and Technology（拉贾沙希工程与技术大学电子与电气工程系）
LogosKG: Hardware-Optimized Scalable and Interpretable Knowledge Graph Retrieval
LARK Lab, University of Colorado Anschutz（洛克拉克实验室，科罗拉多大学安施图茨分校）；University of Colorado Boulder（科罗拉多大学波德分校）；Loyola University Chicago（芝加哥洛克拉克大学）；Harvard Medical School（哈佛医学院）；Boston Children’s Hospital（波士顿儿童医院）；University of Wisconsin-Madison（威斯康星大学麦迪逊分校）
Mafoko: Structuring and Building Open Multilingual Terminologies for South African NLP
Data Science for Social Impact, Dept. of Computer Science, University of Pretoria（南非普里尼亚大学计算机科学系数据科学与社会影响研究中心）；AfriDSAI, University of Pretoria（南非普里尼亚大学非洲数据科学与人工智能研究所）；Lelapa AI（莱拉帕人工智能）；Economics and Management Sciences, University of the Free State（南非自由州大学经济与管理科学系）；Interdisciplinary Centre for Digital Futures, University of the Free State（南非自由州大学跨学科数字未来研究中心）
Towards Scalable and Reliable Capsule Networks for Challenging NLP Applications
Technische Universität Darmstadt（达姆施塔特工业大学）；Nanyang Technological University（南洋理工大学）；Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）
Leveraging Large Language Models for Enhanced NLP Task Performance through Knowledge Distillation and Optimized Training Strategies
School of Politics and Public Administration, South China Normal University（华南师范大学政治与公共管理学院）；University of Chinese Academy of Sciences（中国科学院大学）；Shenyang institute of computing technology, Chinese academy of sciences（中国科学院沈阳计算技术研究所）
Cognitive Linguistic Identity Fusion Score (CLIFS): A Scalable Cognition-Informed Approach to Quantifying Identity Fusion from Text
Center for Complex Networks and Systems Research, Luddy School of Informatics, Computing, and Engineering, Indiana University Bloomington（复杂网络与系统研究中心，信息学、计算与工程学院，印第安纳大学布卢明顿分校）；Cognitive Science Program, Indiana University Bloomington（认知科学项目，印第安纳大学布卢明顿分校）；School of Data Science, University of Virginia（数据科学学院，弗吉尼亚大学）；CulturePulse, Inc.（CulturePulse公司）
SA-MDKIF: A Scalable and Adaptable Medical Domain Knowledge Injection Framework for Large Language Models
School of Information Engineering, Yangzhou University（扬州大学信息工程学院）；Jiangsu Province Engineering Research Center of Knowledge Management and Intelligent Service（江苏省知识管理与智能服务工程研究中心）；Department of Computing, The Hong Kong Polytechnic University（香港理工大学计算学系）
Leveraging ChatGPT and Other NLP Methods for Identifying Risk and Protective Behaviors in MSM: Social Media and Dating apps Text Analysis
1 Department of Computer Science, Henry Samueli School of Engineering, University of California, Los Angeles, Los Angeles, CA；2 Department of Social Welfare, Luskin School of Public Affairs, University of California, Los Angeles, Los Angeles, CA；3 Department of Counseling \& Educational Psychology, New Mexico State University, Las Cruces, NM
From Words to Wisdom: Discourse Annotation and Baseline Models for Student Dialogue Understanding
Department of Electrical and Computer Engineering, Tufts University（电气与计算机工程系，塔夫茨大学）；Department of Computer Science and Information Technology, Patuakhali Science and Technology University（计算机科学与信息技术系，帕图阿哈利科学与技术大学）；Department of Electrical and Computer Engineering, Computer Science and Biomedical Engineering, Tufts University（电气与计算机工程系，计算机科学与生物医学工程系，塔夫茨大学）；Department of Mechanical Engineering and Education, Tufts University（机械工程与教育系，塔夫茨大学）
Less Context, Same Performance: A RAG Framework for Resource-Efficient LLM-Based Clinical NLP
Institute for Healthcare Delivery Science（医疗保健交付科学研究所）；Department of Anesthesiology, Perioperative and Pain Medicine（麻醉学、围手术期医学和疼痛医学系）；Hasso Plattner Institute for Digital Health（数字健康哈索·platzer研究所）；Windreich Department of Artificial Intelligence and Human Health, Mount Sinai Medical Center, NY, USA（人工智能与人类健康威德里奇部门，辛辛那提医学中心，纽约，美国）；Department of Surgery（外科系）；Department of Surgery, Senior Quality Data Analyst – ISM（外科系，高级质量数据分析员 – ISM）；Department of Surgery, Division of Quality and Patient Safety, All at Icahn School of Medicine at Mount Sinai, NY, USA（外科系，质量与患者安全分会，全部在辛辛那提医学院，纽约，美国）
PSDVec: a Toolbox for Incremental and Scalable Word Embedding
Joint NTU-UBC Research Centre of Excellence in Active Living for the Elderly (LILY), Nanyang Technological University（南洋理工大学）；Tsinghua University（清华大学）
Can LLM-Generated Textual Explanations Enhance Model Classification Performance? An Empirical Study
Technical University of Munich, School of Computation, Information and Technology, Department of Computer Science, Munich, Germany（慕尼黑技术大学，计算、信息与技术学院，计算机科学系，德国慕尼黑）
Defensive Dual Masking for Robust Adversarial Defense
School of Computing and Information Technology, University of Wollongong（伍伦贡大学计算与信息技术学院）；School of Computer, Data and Mathematical Sciences, Western Sydney University（西悉尼大学计算机、数据与数学学院）；NVIDIA（英伟达公司）
BhashaSutra: A Task-Centric Unified Survey of Indian NLP Datasets, Corpora, and Resources
Department of Computer Science and Engineering, Indian Institute of Technology Patna, India（印度理工学院帕纳加邦计算机科学与工程系）；Indian Institute of Technology Patna, India（印度理工学院帕纳加邦）
The Language of Attachment: Modeling Attachment Dynamics in Psychotherapy
SODAS, University of Copenhagen, Denmark（哥本哈根大学SODAS研究所）；IT University of Copenhagen, Denmark（哥本哈根技术大学）；Pioneer Center for Artificial Intelligence, Denmark（丹麦先锋人工智能中心）
