IPAD: Inverse Prompt for AI Detection - A Robust and Interpretable LLM-Generated Text Detector
Computer Science and Engineering, Hong Kong University of Science and Technology(香港科技大学计算机科学与工程学院);School of Computing and Data Science, The University of Hong Kong(香港大学计算机科学与数据科学学院);School of Information Science & Engineering, Lanzhou University(兰州大学信息科学与工程学院);Max Planck Institute for Security and Privacy(安全与隐私研究所);Computer Science, The University of Michigan(密歇根大学计算机科学系);Center for Data Science, Peking University(北京大学数据科学中心)
Zheng Chen, Yushi Feng, Jisheng Dang, Yue Deng, Changyang He, Hongxi Pu, Haoxuan Li, Bo Li
Large Language Models (LLMs) have attained human-level fluency in text generation, which complicates the distinguishing between human-written and LLM-generated texts. This increases the risk of misuse and highlights the need for reliable detectors. Yet, existing detectors exhibit poor robustness on out-of-distribution (OOD) data and attacked data, which is critical for real-world scenarios. Also, they struggle to provide interpretable evidence to support their decisions, thus undermining the reliability. In light of these challenges, we propose IPAD (Inverse Prompt for AI Detection), a novel framework consisting of a Prompt Inverter that identifies predicted prompts that could have generated the input text, and two Distinguishers that examine the probability that the input texts align with the predicted prompts. Empirical evaluations demonstrate that IPAD outperforms the strongest baselines by 9.05% (Average Recall) on in-distribution data, 12.93% (AUROC) on out-of-distribution data, and 5.48% (AUROC) on attacked data. IPAD also performs robustly on structured datasets. Furthermore, an interpretability assessment is conducted to illustrate that IPAD enhances the AI detection trustworthiness by allowing users to directly examine the decision-making evidence, which provides interpretable support for its state-of-the-art detection results.
iPOE: Interpretable Prompt Optimization via Explanations
Fundamentals of Natural Language Processing, University of Bamberg, Germany(自然语言处理基础,巴姆堡大学,德国);Leibniz-Institut für Psychologie (ZPID), Trier, Germany(莱比锡心理学研究所(ZPID),特里尔,德国)
Concept-Grounded Reasoning with Prompt-Driven Localization for Interpretable Structured Report Generation
The Hong Kong University of Science and Technology(香港科技大学);The Chinese University of Hong Kong(香港中文大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Saarland University(萨尔兰大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);University of Cambridge(剑桥大学)
Interpretable Few-Shot Retinal Disease Diagnosis with Concept-Guided Prompting of Vision-Language Models
Monash University(莫纳什大学);Centre for Eye Research Australia(澳大利亚眼科研究中心);Royal Victorian Eye and Ear Hospital(皇家维多利亚眼耳医院);The University of Melbourne(墨尔本大学);The Hong Kong Polytechnic University(香港理工大学);Centre for Eye and Vision Research(眼与视觉研究中心);Indian Institute of Technology Bombay(印度理工学院孟买分校);Airdoc-Monash Research Lab(Airdoc-莫纳什研究实验室)
Improving LLM Reasoning through Interpretable Role-Playing Steering
Center for Information and Language Processing, LMU Munich(信息与语言处理中心,慕尼黑大学);Northwestern University(西北大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心(MCML));New Jersey Institute of Technology(新泽西理工学院)
Knowing How to Edit: Reliable Evaluation Signals for Diagnosing and Optimizing Prompts at Query Level
School of Information Sciences, University of Illinois Urbana-Champaign(信息科学学院,伊利诺伊大学厄巴纳-香槟分校);College of Engineering, Carnegie Mellon University(工程学院,卡内基梅隆大学)
Towards Interpretable Mental Health Analysis with Large Language Models
The University of Manchester(曼彻斯特大学);University of Helsinki(赫尔辛基大学);Yale University(耶鲁大学);Artificial Intelligence Research Center, AIST(日本国立研究开发法人产业技术综合研究所人工智能研究中心);Jiangxi Normal University(江西师范大学)
Rethinking Prompt Optimizers: From Prompt Merits to Optimization
School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore(南洋理工大学电子与电气工程学院);Home Team Science and Technology Agency, Singapore(新加坡科技局)
Exploring Task Performance with Interpretable Models via Sparse Auto-Encoders
The University of Sheffield(谢菲尔德大学);Tianjin University(天津大学);University of Manchester(曼彻斯特大学);Kyushu University(九州大学);City University of Hong Kong(香港城市大学)
SafetyAnalyst: Interpretable, Transparent, and Steerable Safety Moderation for AI Behavior
University of California, Berkeley(加州大学伯克利分校);University of Washington(华盛顿大学);Duke University(杜克大学);Carnegie Mellon University(卡内基梅隆大学);Stanford University(斯坦福大学)
xJailbreak: Representation Space Guided Reinforcement Learning for Interpretable LLM Jailbreaking
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Shenzhen University of Advanced Technology(深圳理工大学);WUST(武汉科技大学);HITSZ(哈尔滨工业大学(深圳));School of Biomedical Engineering, UNSW Sydney(新南威尔士大学悉尼分校生物医学工程学院)
Cognitive models can reveal interpretable value trade-offs in language models
Kempner Institute for Natural and Artificial Intelligence, Harvard University(哈佛大学自然与人工智能研究所);Google DeepMind(谷歌DeepMind);Department of Psychology, Harvard University(哈佛大学心理学系)
Beyond Prompt Engineering: A Systematic Analysis of Prompt Lexical Sensitivity and Its Impacts on Quality
Shenzhen Technology University(深圳技术大学);The Hong Kong Polytechnic University(香港理工大学);Zhejiang Lab(之江实验室);The Chinese University of Hong Kong(香港中文大学);HKUST (Guangzhou)(香港科技大学(广州))
Beijing Institute for General Artificial Intelligence(北京通用人工智能研究院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院);School of Artificial Intelligence for Science, Peking University(北京大学科学人工智能学院)
DreamerNLplus: Interpretable Modeling of Mental Health Dynamics from Social Media Timelines using Hybrid Rule-Based and RAG Methods
Leiden Institute of Advanced Computer Science (LIACS), Leiden University(莱顿高级计算机科学研究所(LIACS),莱顿大学);School of Computing and Communications (SCC), Lancaster University(计算与通信学院(SCC),兰卡斯特大学);Department of Medical Informatics, Erasmus University Medical Center Rotterdam(医学信息学系,埃因霍温医学中心鲁特万分校);Biomedical Data Sciences, Leiden University Medical Center(生物医学数据科学,莱顿大学医学中心)
Helping Language Models Learn More: Multi-dimensional Task Prompt for Few-shot Tuning
Qiannan Normal University for Nationalities(黔南民族师范学院);Guangzhou University(广州大学);University of Chinese Academy of Sciences(中国科学院大学);Beijing Institute of Technology(北京理工大学)