In the evolving landscape of Environmental, Social, and Corporate Governance (ESG) impact assessment, the ML-ESG-2 shared task proposes identifying ESG impact types. To address this challenge, we present a comprehensive system leveraging ensemble learning techniques, capitalizing on early and late fusion approaches. Our approach employs four distinct models: mBERT, FlauBERT-base, ALBERT-base-v2, and a Multi-Layer Perceptron (MLP) incorporating Latent Semantic Analysis (LSA) and Term Frequency-Inverse Document Frequency (TF-IDF) features. Through extensive experimentation, we find that our early fusion ensemble approach, featuring the integration of LSA, TF-IDF, mBERT, FlauBERT-base, and ALBERT-base-v2, delivers the best performance. Our system offers a comprehensive ESG impact type identification solution, contributing to the responsible and sustainable decision-making processes vital in today's financial and corporate governance landscape.
Environmental, Social and Governance Sentiment Analysis on Slovene News: A Novel Dataset and Models
Eindhoven University of Technology(埃因霍温理工大学);Jožef Stefan Institute(约瑟夫·斯特凡研究所);University of Ljubljana(卢布尔雅那大学);Queen Mary University of London(伦敦玛丽女王大学)
UM6P-CS at SemEval-2022 Task 11: Enhancing Multilingual and Code-Mixed Complex Named Entity Recognition via Pseudo Labels using Multilingual Transformer
Mohammed VI Polytechnic University(穆罕默德六世理工大学);Sidi Mohamed Ben Abdellah University(西迪·穆罕默德·本·阿卜杜拉大学);University of Sherbrooke(舍布鲁克大学)
Enhancing Multilingual Capabilities of Large Language Models through Self-Distillation from Resource-Rich Languages
Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系);Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院(AIR))
Enhancing Multilingual Reasoning via Steerable Model Merging
Beijing University of Posts and Telecommunications(北京邮电大学);Fudan University(复旦大学);Beihang University(北京航空航天大学);Monash University(墨尔本大学);Zhongguancun Laboratory(中关村实验室);Nanjing University(南京大学);Tsinghua University(清华大学)
ML-Promise: A Multilingual Dataset for Corporate Promise Verification
Institute of Library, Information, and Media Science, University of Tsukuba(筑波大学图书馆、信息与媒体科学研究所);College of Knowledge and Library Sciences, School of Informatics, University of Tsukuba(筑波大学信息学研究科知识与图书馆学学院);DS Outscale(3DS Outscale公司);Shinhan Securities Co.(新韩证券公司);Graduate Institute of Information Management, National Taipei University(国立台北大学资讯管理研究所);AIST(日本产业技术综合研究所)
ShifCon: Enhancing Non-Dominant Language Capabilities with a Shift-based Multilingual Contrastive Framework
Tsinghua University(清华大学);Microsoft(微软);University of Southern California(南加州大学);University of California, San Diego(加州大学圣地亚哥分校);University of California, Los Angeles(加州大学洛杉矶分校)
MEMLA: Enhancing Multilingual Knowledge Editing with Neuron-Masked Low-Rank Adaptation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
MKG-Rank: Enhancing Large Language Models with Knowledge Graph for Multilingual Medical Question Answering
University of Tokyo(东京大学);Texas A&M University(德克萨斯农工大学);Duke-NUS Medical School(杜克-新加坡国立大学医学院);Smartor LLC(斯马特有限责任公司);NEC Laboratories America(美国电气公司实验室);University of Geneva(日内瓦大学)
MultiLingPoT: Enhancing Mathematical Reasoning with Multilingual Program Fine-tuning
Fudan University(复旦大学);MYbank, Ant Group(蚂蚁集团MYbank);School of Computer Science, Fudan University(复旦大学计算机学院);School of Data Science, Fudan University(复旦大学数据科学学院)
UCAS-IIE-NLP at SemEval-2023 Task 12: Enhancing Generalization of Multilingual BERT for Low-resource Sentiment Analysis
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
EstLLM: Enhancing Estonian Capabilities in Multilingual LLMs via Continued Pretraining and Post-Training
Institute of Computer Science, University of Tartu(塔尔图大学计算机科学研究院);Department of Software Science, Tallinn University of Technology(塔林技术大学软件科学系);Institute of the Estonian Language, Tallinn, Estonia(爱沙尼亚语言研究院);School of Humanities, Tallinn University(塔林大学人文学院)
CausalAbstain: Enhancing Multilingual LLMs with Causal Reasoning for Trustworthy Abstention
Department of Computer Science, Hong Kong Baptist University(香港 Baptist 大学计算机科学系);School of Mathematics and Statistics, The University of Melbourne(墨尔本大学数学与统计学学院);School of Computing and Information Systems, Singapore Management University(新加坡管理大学计算与信息系统学院)
Enhancing Robustness of Autoregressive Language Models against Orthographic Attacks via Pixel-based Approach
LMU Munich(慕尼黑大学);GESIS - Leibniz Institute for the Social Sciences(莱比锡社会科学院);Center for Information and Language Processing(信息与语言处理中心);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心)
Macro: Enhancing Multilingual Counterfactual Explanations through Alignment-as-Preference Optimization
Technische Universität Berlin(柏林技术大学);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心);University of Duisburg-Essen(杜伊斯堡- Essen大学);LMU Munich(慕尼黑大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Saarland Informatics Campus(萨尔兰州信息学校区);BIFOLD – Berlin Institute for the Foundations of Learning and Data(柏林学习与数据基础研究院);Centre for European Research in Trusted AI (CERTAIN)(可信人工智能欧洲研究中心)
Seamless Language Expansion: Enhancing Multilingual Mastery in Self-Supervised Models
Department of Systems Engineering and Engineering Management(系统工程与工程管理系);The Chinese University of Hong Kong(香港中文大学);Centre for Perceptual and Interactive Intelligence (CPII) Limited(感知与交互智能中心(CPII)有限公司)
本文提出将 LoRA 集成到已有自监督模型并结合数据组合与重新聚类保留策略,使 mHuBERT 高效扩展至普通话,在语音重合成任务中显著提升 MOS 并降低 WER,同时保持原有语言能力不退化。
Enhancing Indonesian Automatic Speech Recognition: Evaluating Multilingual Models with Diverse Speech Variabilities
Institut Teknologi Bandung(万隆理工学院);University of Indonesia(印度尼西亚大学);Japan Advanced Institute of Science and Technology(日本先进科学技术学院);Nara Institute of Science and Technology(奈良科学技术大学)
Northeastern Uni at Multilingual Counterspeech Generation: Enhancing Counter Speech Generation with LLM Alignment through Direct Preference Optimization
Capital One(第一资本);Northeastern University(东北大学);Apple Inc.(苹果公司)