Large language models are increasingly discussed and used as tools that may assist with scholarly peer review, but empirical evidence regarding how authors use and perceive AI-based feedback remains limited. This paper reports findings from two independent pilot studies on authors' use and perceptions of AI-based auxiliary review at two computer science venues. After the review release, authors were invited to complete an anonymous post-review questionnaire about the AI review's usefulness, trustworthiness, agreement with human reviews, practical value for revision, perceived inaccuracies, and consent. The final dataset included 56 analyzable responses from authors of 40 papers; closed-ended items were summarized using descriptive statistics, and open-ended responses were analyzed using inductive thematic analysis. Most respondents (83.9%) considered the AI-based review useful, and 80.4% reported that it identified issues not mentioned by human reviewers. This perceived added value translated into action: 82.1% reported using at least some AI feedback in their camera-ready version. However, the authors did not treat the AI review as equivalent to a human review. They generally trusted it less than the human reviews and found human feedback clearer, even though 25.0% described at least some human reviews as not very useful. Reported problems with the AI review were usually limited: 51.8% reported minor inaccuracies, while 16.1% reported clearly incorrect, misleading, or irrelevant comments. Support for future use was strongest when AI was framed as a supervised or author-controlled tool: 96.4% said they would use AI as an internal review tool before future submissions, 89.3% preferred advance notice that AI would be used in review, and 76.8% favored explicit consent before use.
Towards Trustworthy AI: A Review of Ethical and Robust Large Language Models
Canizaro Livingston Gulf States Center for Environmental Informatics, the University of New Orleans(新奥尔良大学);Center for Geospatial Sciences, Naval Research Laboratory(海军研究实验室);US Army Corps of Engineers, Engineer Research and Development Center(美国陆军工兵部工程师研究与发展中心)
Authority Inversion in LLM-Mediated Ubiquitous Systems: When Models Trust Users Over Sensors
School of Computer Science and Engineering, South China University of Technology(华南理工大学计算机科学与工程学院);School of Computer Science(计算机科学学院);Engineering, South China University of Technology(华南理工大学工程学院)
Can Agents Trust Their Skills? Uncovering Unsafe Chains of Trust in Skill-Based LLM Agents
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);Worcester Polytechnic Institute(伍斯特理工学院);School of Cyberspace Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
The Good, the Bad and the Constructive: Automatically Measuring Peer Review's Utility for Authors
NLP Department, Mohamed Bin Zayed University of Artificial Intelligence(马尔代夫比兹艾兹大学人工智能学院自然语言处理系);Ubiquitous Knowledge Processing Lab, Department of Computer Science(计算机科学系通用知识处理实验室);Hessian Center for AI (hessian.AI), TU Darmstadt(图尔努尔德马斯特大学海斯塞人工智能中心)
Commitment Checklist: Auditing Author Commitments in Peer Review
AIST, Japan(日本国家信息技术研究所);Ubiquitous Knowledge Processing Lab (UKP Lab), Department of Computer Science, TU Darmstadt and National Research Center for Applied Cybersecurity ATHENE, Germany(图宾根大学计算机科学系通用知识处理实验室及应用网络安全国家研究中心ATHENE德国)