The rise of large language models (LLMs) like ChatGPT has significantly improved automated code generation, enhancing software development efficiency. However, this introduces challenges in academia, particularly in distinguishing between human-written and LLM-generated code, which complicates issues of academic integrity. Existing detection methods, such as pre-trained models and watermarking, face limitations in adaptability and computational efficiency. In this paper, we propose a novel detection method using 2D token probability maps combined with vision models, preserving spatial code structures such as indentation and brackets. By transforming code into log probability matrices and applying vision models like Vision Transformers (ViT) and ResNet, we capture both content and structure for more accurate detection. Our method shows robustness across multiple programming languages and improves upon traditional detectors, offering a scalable and computationally efficient solution for identifying LLM-generated code.
Detecting LLM-Generated Tokens in Human--LLM Coauthored Text
School of Mathematics, University of Birmingham(伯明翰大学数学学院);School of Statistics and Data Science, Shanghai University of Finance and Economics(上海财经大学统计与数据科学学院);Department of Statistics, The London School of Economics and Political Science(伦敦政治经济学院统计系)
On the Effectiveness of LLM-Specific Fine-Tuning for Detecting AI-Generated Text
Faculty of Mathematics and Information Science, Warsaw University of Technology(华沙技术大学数学与信息科学学院);Faculty of Modern Languages and Literatures, Adam Mickiewicz University(亚当·密茨凯维奇大学现代语言与文学学院)
EfficientUICoder: A Bidirectional Token Compression Framework for Efficient MLLM-Based UI Code Generation
The Chinese University of Hong Kong(香港中文大学);Huazhong University of Science and Technology(华中科技大学);Singapore Management University(新加坡管理大学);Nanyang Technological University(南洋理工大学)
HalluField: Detecting LLM Hallucinations via Field-Theoretic Modeling
Center for Nonlinear Studies(非线性研究中心);Los Alamos National Laboratory(洛斯阿拉莫斯国家实验室);T-1 Los Alamos National Laboratory(洛斯阿拉莫斯国家实验室T-1部门);Applied Mathematics University of Colorado Boulder(科罗拉多大学博尔德分校应用数学系);T-4 Los Alamos National Laboratory(洛斯阿拉莫斯国家实验室T-4部门)
'Quis custodiet ipsos custodes?' Who will watch the watchmen? On Detecting AI-generated peer-reviews
Indian Institute of Technology Patna(印度理工学院巴特那分校);National Center for Computational Sciences, Oak Ridge National Laboratory(橡树岭国家实验室国家计算科学中心);School of AI and Data Science, IIT Jodhpur(焦特布尔印度理工学院人工智能与数据科学学院)
ICAS: Detecting Training Data from Autoregressive Image Generative Models
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学深圳学院);Shenzhen ShenNong Information Technology Co., Ltd.(深圳深农信息技术有限公司)
DVD: A Robust Method for Detecting Variant Contamination in Large Language Model Evaluation
Beihang University(北京航空航天大学);Peking University(北京大学);Beijing University of Posts and Telecommunications(北京邮电大学);Shanghai Jiao Tong University(上海交通大学);Tsinghua University(清华大学)
Focus on the Core: Empowering Diffusion Large Language Models by Self-Contrast
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Renmin University of China(中国人民大学);Xiaohongshu Inc.(小红书公司)
Automated Detection of Pre-training Text in Black-box LLMs
Key Laboratory of Trustworthy Distributed Computing and Service (MoE), Beijing University of Posts and Telecommunications, China(可信分布式计算与服务重点实验室,北京邮电大学,中国);Zhongguancun Laboratory, China(中关村实验室,中国)
Detecting Unfaithful Chain-of-Thought via Circuit-Guided Internal-External Discrepancy
Jilin University(吉林大学);University of Central Florida(中央佛罗里达大学);Arizona State University(亚利桑那州立大学);University of Vienna(维也纳大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校)
Reasoning-Token Spikes Under Prompted Untruthful Responses in Large Language Models
Chapman University(查普曼大学);INSERM U992, Cognitive Neuroimaging Unit, NeuroSpin Center(法国国家健康与医学研究院U992认知神经影像单元,神经自旋中心);University of California, Los Angeles(加州大学洛杉矶分校);California Institute of Technology(加州理工学院)
PrivacyXray: Detecting Privacy Breaches in LLMs through Semantic Consistency and Probability Certainty
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院)
Fact-Checking the Output of Large Language Models via Token-Level Uncertainty Quantification
Center for Artificial Intelligence Technology(人工智能技术中心);MBZUAI(穆罕默德·本·扎耶德人工智能大学);AIRI(人工智能研究院);FRC CSC RAS(俄罗斯科学院计算机科学与控制研究中心联邦研究中心);The University of Melbourne(墨尔本大学);QCRI(卡塔尔计算研究所);HSE University(高等经济大学)
LineBreaker: Finding Token-Inconsistency Bugs with Large Language Models
Indiana University Bloomington(印第安纳大学布鲁明顿分校);San Diego State University(圣地亚哥州立大学);The Hong Kong University of Science and Technology(香港科技大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Tsinghua University(清华大学);Nanyang Technological University(南洋理工大学)