The advent of large language models (LLMs) such as ChatGPT has attracted considerable attention in various domains due to their remarkable performance and versatility. As the use of these models continues to grow, the importance of effective prompt engineering has come to the fore. Prompt optimization emerges as a crucial challenge, as it has a direct impact on model performance and the extraction of relevant information. Recently, evolutionary algorithms (EAs) have shown promise in addressing this issue, paving the way for novel optimization strategies. In this work, we propose a evolutionary multi-objective (EMO) approach specifically tailored for prompt optimization called EMO-Prompts, using sentiment analysis as a case study. We use sentiment analysis capabilities as our experimental targets. Our results demonstrate that EMO-Prompts effectively generates prompts capable of guiding the LLM to produce texts embodying two conflicting emotions simultaneously.
Text Compression for Sentiment Analysis via Evolutionary Algorithms
University of Cape Town(开普敦大学);African Institute for Mathematical Sciences(非洲数学科学研究院);South African Astronomical Observatory(南非天文台)
文本数据可以被智能地压缩而不损失评估情感的准确性吗?在本研究中,我们提出了一种新型的进化压缩算法PARSEC(PARts-of-Speech for sEntiment Compression),该算法利用词性标签来压缩文本,在与情感分析算法结合使用时,牺牲了最小的分类准确性。对12个英语情感数据集的八种商业和非商业情感分析算法的PARSEC的分析揭示,使用LingPipe(最准确的情感算法)的PARSEC的数据压缩的(20%,50%,75%)情感分类准确度损失(0%,1.3%,3.3%)的精确压缩是可能的。其他情感分析算法受到压缩的影响更严重。我们的结论是,显着的压缩文本数据是可能的情感分析取决于特定的应用程序和特定的情感分析算法使用的准确性要求。
How Quantization Shapes Bias in Large Language Models
Tsinghua University(清华大学);The Hebrew University of Jerusalem(耶路撒冷希伯来大学);TU Darmstadt(达姆施塔特工业大学);National Research Center for Applied Cybersecurity ATHENE(雅典娜国家应用网络安全研究中心)
Balancing Innovation and Privacy: Data Security Strategies in Natural Language Processing Applications
University of Southern California(南加州大学);San Francisco State University(旧金山州立大学);Southwest Jiaotong University(西南交通大学);Columbia University(哥伦比亚大学);Carnegie Mellon University(卡内基梅隆大学)
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Microsoft Research AI4Science(微软研究院AI4Science);University College London(伦敦大学学院)
MOPrompt: Multi-objective Semantic Evolution for Prompt Optimization
Computing Department, Universidade Federal de Ouro Preto(联邦大学奥鲁普里托 computing 部门);Federal Institute of Minas Gerais(巴西矿业高等学院);Postgraduate Program in Computer Science, Federal University of Ouro Preto(联邦大学奥鲁普里托 计算科学研究生项目)
Hierarchical Optimization via LLM-Guided Objective Evolution for Mobility-on-Demand Systems
Agency for Science, Technology and Research(科技研究局);Morgan Stanley Asia Pte.(摩根大通亚洲公司);Onto Innovation Inc.(Onto Innovation公司);School of computing and communications, Lancaster University(兰卡斯特大学计算机与通讯学院)
Knowledge-Assisted Dual-Stage Evolutionary Optimization of Large-Scale Crude Oil Scheduling
East China University of Science and Technology(华东理工大学);Qingyuan Innovation Laboratory(清源创新实验室);Bielefeld University(比勒费尔德大学);Nanjing Tech University(南京工业大学)
Guangzhou Institute of Technology, Xidian University(西安电子科技大学广州研究院);South China University of Technology(华南理工大学);Singapore Management University(新加坡管理大学);Fuzhou University(福州大学);Peng Cheng Laboratory(鹏城实验室);Xidian University(西安电子科技大学);Zhejiang Normal University(浙江师范大学);Hanyang University(汉阳大学)
TRUST-TAEA: A trustworthiness-guided two-archive evolutionary algorithm with variable-grouping sparse search for large-scale multi-objective optimization
Southwest Petroleum University(西南石油大学);Jagiellonian University in Krakow(克拉科夫雅盖隆大学)
Evolutionary Optimization of Physics-Informed Neural Networks: Evo-PINN Frontiers and Opportunities
Agency for Science, Technology and Research (A*STAR)(科技研究局);Indian Institute of Technology (IIT) Goa(印度理工学院 Goa分校);Nanyang Technological University(南洋理工大学)
Applications of Nature-Inspired Algorithms for Dimension Reduction: Enabling Efficient Data Analytics
University of Georgia(佐治亚大学);Franklin College of Arts and Sciences(富兰克林文理学院);Florida International University(佛罗里达国际大学);College of Engineering and Computing(工程与计算学院)
在[1]中,我们已经探索了特征选择和进化算法的理论方面。在本章中,我们重点介绍用于增强数据分析过程的优化算法,即,我们建议探索自然启发算法在数据科学中的应用。特征选择优化是一种利用特征选择技术和进化算法过程来优化所选特征的混合方法。以前的作品迭代地解决这个问题,收敛到一个最佳的特征子集。特征选择优化是一种非特定领域的方法。数据科学家主要试图找到一种先进的方法来分析数据,具有高计算效率和低时间复杂度,从而导致有效的数据分析。因此,通过增加来自各种来源的生成/测量/感测的数据,数据的分析、操纵和说明呈指数增长。由于数据集规模庞大,维数灾难(Curse of Dimensionality,CoD)是数据科学中的NP难题之一。因此,一些努力已经集中在利用进化算法(EA)来解决大规模数据分析问题中的复杂问题。降维与EA一起,有助于解决CoD和解决复杂问题,在时间复杂度方面,有效地。在这一章中,我们首先提供了一个简短的概述,以前的研究,重点是解决CoD使用特征提取优化过程。然后,我们讨论了研究的实际例子,成功地解决了一些应用领域,如图像处理,情感分析,网络流量/异常分析,信用评分分析和其他基准功能/数据集分析。