大模型对齐与安全

Polaris: A Safety-focused LLM Constellation Architecture for Healthcare

Subhabrata Mukherjee, Paul Gamble, Markel Sanz Ausin, Neel Kant, Kriti Aggarwal, Neha Manjunath, Debajyoti Datta, Zhengliang Liu, Jiayuan Ding, Sophia Busacca, Cezanne Bianco, Swapnil Sharma, Rae Lasko, Michelle Voisard, Sanchay Harneja, Darya Filippova, Gerry Meixiong, Kevin Cha, Amir Youssefi, Meyhaa Buvanesh, Howard Weingram, Sebastian Bierman-Lytle, Harpreet Singh Mangat, Kim Parikh, Saad Godil, Alex Miller

专题命中 安全评测 ：safety(title,abstract)；分类 cs.CL、cs.AI

Towards better Human-Agent Alignment: Assessing Task Utility in LLM-Powered Applications

Negar Arabzadeh, Julia Kiseleva, Qingyun Wu, Chi Wang, Ahmed Awadallah, Victor Dibia, Adam Fourney, Charles Clarke

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.CL、cs.AI

The METRIC-framework for assessing data quality for trustworthy AI in medicine: a systematic review

Daniel Schwabe, Katinka Becker, Martin Seyferth, Andreas Klaß, Tobias Schäffter

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI、cs.LG

Predicting trucking accidents with truck drivers 'safety climate perception across companies: A transfer learning approach

Kailai Sun, Tianxiang Lan, Say Hong Kam, Yang Miang Goh, Yueng-Hsiang Huang

专题命中 安全评测 ：safety(title,abstract)；分类 cs.AI、cs.LG

Comments submitted to journal: accident analysis and prevention

Variance Alignment Score: A Simple But Tough-to-Beat Data Selection Method for Multimodal Contrastive Learning

Yiping Wang, Yifang Chen, Wendan Yan, Kevin Jamieson, Simon Shaolei Du

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.AI、cs.LG

Comments 17 pages, 4 figures

Trustworthy Distributed AI Systems: Robustness, Privacy, and Governance

Wenqi Wei, Ling Liu

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI、cs.LG

Comments Manuscript accepted to ACM Computing Surveys

LongAlign: A Recipe for Long Context Alignment of Large Language Models

Yushi Bai, Xin Lv, Jiajie Zhang, Yuze He, Ji Qi, Lei Hou, Jie Tang, Yuxiao Dong, Juanzi Li

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.CL、cs.LG

Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignment

Keming Lu, Bowen Yu, Chang Zhou, Jingren Zhou

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.CL、cs.LG

A Dempster-Shafer approach to trustworthy AI with application to fetal brain MRI segmentation

Lucas Fidon, Michael Aertsen, Florian Kofler, Andrea Bink, Anna L. David, Thomas Deprest, Doaa Emam, Frédéric Guffens, András Jakab, Gregor Kasprian, Patric Kienast, Andrew Melbourne, Bjoern Menze, Nada Mufti, Ivana Pogledic, Daniela Prayer, Marlene Stuempflen, Esther Van Elslander, Sébastien Ourselin, Jan Deprest, Tom Vercauteren

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI、cs.LG

Comments Published in IEEE TPAMI. Minor revision compared to the previous version

How Many Unicorns Are in This Image? A Safety Evaluation Benchmark for Vision LLMs

Haoqin Tu, Chenhang Cui, Zijun Wang, Yiyang Zhou, Bingchen Zhao, Junlin Han, Wangchunshu Zhou, Huaxiu Yao, Cihang Xie

专题命中 安全评测 ：safety(title,abstract)；分类 cs.CL、cs.LG

Comments H.T., C.C., and Z.W. contribute equally. Work done during H.T. and Z.W.'s internship at UCSC, and C.C. and Y.Z.'s internship at UNC

Evaluating the Instruction-Following Robustness of Large Language Models to Prompt Injection

Zekun Li, Baolin Peng, Pengcheng He, Xifeng Yan

专题命中 安全评测 ：prompt injection(title,abstract)；分类 cs.CL、cs.AI

Comments The data and code can be found at https://github.com/Leezekun/instruction-following-robustness-eval

The Empty Signifier Problem: Towards Clearer Paradigms for Operationalising "Alignment" in Large Language Models

Hannah Rose Kirk, Bertie Vidgen, Paul Röttger, Scott A. Hale

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.CL、cs.CY

Comments Socially Responsible Language Modelling Research (SoLaR) @ NeurIPs 2023

AI-Supported Assessment of Load Safety

Julius Schöning, Niklas Kruse

专题命中 安全评测 ：safety(title,abstract)；分类 cs.AI、cs.LG

Comments 9 pages, 4 figures, 2 tables

Know Where to Go: Make LLM a Relevant, Responsible, and Trustworthy Searcher

Xiang Shi, Jiawei Liu, Yinpeng Liu, Qikai Cheng, Wei Lu

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.CL、cs.AI

Comments 14 pages, 4 figures, under peer review

Trustworthy Machine Learning

Bálint Mucsányi, Michael Kirchhof, Elisa Nguyen, Alexander Rubinstein, Seong Joon Oh

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI、cs.LG

Comments 373 pages, textbook at the University of Tübingen

Aviation Safety Risk Analysis and Flight Technology Assessment Issues

Shuanghe Liu

专题命中 安全评测 ：safety(title,abstract)；分类 cs.CY、cs.LG

Are You Worthy of My Trust?: A Socioethical Perspective on the Impacts of Trustworthy AI Systems on the Environment and Human Society

Jamell Dacon

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI、cs.CY

Comments Under review

Trustworthy Representation Learning Across Domains

Ronghang Zhu, Dongliang Guo, Daiqing Qi, Zhixuan Chu, Xiang Yu, Sheng Li

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI、cs.LG

Comments 38 pages, 15 figures

Getting from Generative AI to Trustworthy AI: What LLMs might learn from Cyc

Doug Lenat, Gary Marcus

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI、cs.LG

Comments 21 pages, 1 Figure

Crowd Safety Manager: Towards Data-Driven Active Decision Support for Planning and Control of Crowd Events

Panchamy Krishnakumari, Sascha Hoogendoorn-Lanser, Jeroen Steenbakkers, Serge Hoogendoorn

专题命中 安全评测 ：safety(title,abstract)；分类 cs.AI、cs.LG

Comments Submitted to TRB Annual Meeting 2024

Towards Trustworthy and Aligned Machine Learning: A Data-centric Survey with Causality Perspectives

Haoyang Liu, Maheep Chaudhary, Haohan Wang

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI、cs.LG

Comments 47 pages, 13 figures

CORE-GPT: Combining Open Access research and large language models for credible, trustworthy question answering

David Pride, Matteo Cancellieri, Petr Knoth

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.CL、cs.AI

Comments 12 pages, accepted submission to TPDL2023

TrustGPT: A Benchmark for Trustworthy and Responsible Large Language Models

Yue Huang, Qihui Zhang, Philip S. Y, Lichao Sun

专题命中 安全评测 ：trustworthy(title)；alignment(abstract)；分类 cs.CL、cs.AI

Comments We are currently expanding this work and welcome collaborators!

Towards trustworthy seizure onset detection using workflow notes

Khaled Saab, Siyi Tang, Mohamed Taha, Christopher Lee-Messer, Christopher Ré, Daniel Rubin

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI、cs.LG

Trustworthy Artificial Intelligence Framework for Proactive Detection and Risk Explanation of Cyber Attacks in Smart Grid

Md. Shirajum Munir, Sachin Shetty, Danda B. Rawat

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI、cs.LG

Comments Submitted for peer review

Certification Labels for Trustworthy AI: Insights From an Empirical Mixed-Method Study

Nicolas Scharowski, Michaela Benk, Swen J. Kühne, Léane Wettstein, Florian Brühlmann

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI、cs.CY

Adversarial Nibbler: A Data-Centric Challenge for Improving the Safety of Text-to-Image Models

Alicia Parrish, Hannah Rose Kirk, Jessica Quaye, Charvi Rastogi, Max Bartolo, Oana Inel, Juan Ciro, Rafael Mosquera, Addison Howard, Will Cukierski, D. Sculley, Vijay Janapa Reddi, Lora Aroyo

专题命中 安全评测 ：safety(title,abstract)；分类 cs.AI、cs.LG

Reward Systems for Trustworthy Medical Federated Learning

Konstantin D. Pandl, Florian Leiser, Scott Thiebes, Ali Sunyaev

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.CY、cs.LG

Comments 10 pages

Three ways to improve feature alignment for open vocabulary detection

Relja Arandjelović, Alex Andonian, Arthur Mensch, Olivier J. Hénaff, Jean-Baptiste Alayrac, Andrew Zisserman

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.AI、cs.LG

GANN: Graph Alignment Neural Network for Semi-Supervised Learning

Linxuan Song, Wenxuan Tu, Sihang Zhou, Xinwang Liu, En Zhu

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.AI、cs.LG