大模型对齐与安全

Alignment-Based Adversarial Training (ABAT) for Improving the Robustness and Accuracy of EEG-Based BCIs

Xiaoqing Chen, Ziwei Wang, Dongrui Wu

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.AI、cs.LG

Journal ref IEEE Trans. on Neural Systems and Rehabilitation Engineering, 32:1703-1714, 2024

TOPA: Extending Large Language Models for Video Understanding via Text-Only Pre-Alignment

Wei Li, Hehe Fan, Yongkang Wong, Mohan Kankanhalli, Yi Yang

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.CL、cs.AI

Comments NeurIPS 2024 (Spotlight)

Probabilistic Conceptual Explainers: Trustworthy Conceptual Explanations for Vision Foundation Models

Hengyi Wang, Shiwei Tan, Hao Wang

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI、cs.LG

Comments Proceedings of the 41st International Conference on Machine Learning (ICML 2024)

Journal ref PMLR 235:51502-51522, 2024

OCEAN: Offline Chain-of-thought Evaluation and Alignment in Large Language Models

Junda Wu, Xintong Li, Ruoyu Wang, Yu Xia, Yuxin Xiong, Jianing Wang, Tong Yu, Xiang Chen, Branislav Kveton, Lina Yao, Jingbo Shang, Julian McAuley

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.CL、cs.LG

Comments 10 pages

CFSafety: Comprehensive Fine-grained Safety Assessment for LLMs

Zhihao Liu, Chenhui Hu

专题命中 安全评测 ：safety(title,abstract)；分类 cs.CL、cs.LG

Towards Trustworthy Machine Learning in Production: An Overview of the Robustness in MLOps Approach

Firas Bayram, Bestoun S. Ahmed

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI、cs.LG

Exploration of the Rashomon Set Assists Trustworthy Explanations for Medical Data

Katarzyna Kobylińska, Mateusz Krzyziński, Rafał Machowicz, Mariusz Adamek, Przemysław Biecek

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI、cs.LG

Comments This work has been submitted to the IEEE for possible publication

GALA: Graph Diffusion-based Alignment with Jigsaw for Source-free Domain Adaptation

Junyu Luo, Yiyang Gu, Xiao Luo, Wei Ju, Zhiping Xiao, Yusheng Zhao, Jingyang Yuan, Ming Zhang

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.AI、cs.LG

Comments IEEE TPAMI

How to Leverage Demonstration Data in Alignment for Large Language Model? A Self-Imitation Learning Perspective

Teng Xiao, Mingxiao Li, Yige Yuan, Huaisheng Zhu, Chao Cui, Vasant G Honavar

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.CL、cs.LG

Comments EMNLP 2024 Main

Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs

Mustafa Shukor, Matthieu Cord

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.CL、cs.LG

Comments NeurIPS 2024. Code: https://github.com/mshukor/ima-lmms. Project page: https://ima-lmms.github.io/

Risk Alignment in Agentic AI Systems

Hayley Clatterbuck, Clinton Castro, Arvo Muñoz Morán

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.AI、cs.CY

Diffusion Models for Offline Multi-agent Reinforcement Learning with Safety Constraints

Jianuo Huang

专题命中 安全评测 ：safety(title,abstract)；分类 cs.AI、cs.LG

Comments The experiment and method plan are abolished and need to be redesigned

Inference-Time Language Model Alignment via Integrated Value Guidance

Zhixuan Liu, Zhanhui Zhou, Yuanfu Wang, Chao Yang, Yu Qiao

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.CL、cs.AI

Comments EMNLP 2024 Findings

Data Alignment for Zero-Shot Concept Generation in Dermatology AI

Soham Gadgil, Mahtab Bigverdi

专题命中 安全评测 ：alignment(title)；trustworthy(abstract)；分类 cs.CL、cs.LG

Comments Accepted as a workshop paper to ICLR 2024

Stacked Universal Successor Feature Approximators for Safety in Reinforcement Learning

Ian Cannon, Washington Garcia, Thomas Gresavage, Joseph Saurine, Ian Leong, Jared Culbertson

专题命中 安全评测 ：safety(title,abstract)；分类 cs.AI、cs.LG

Comments 13 pages

CHiSafetyBench: A Chinese Hierarchical Safety Benchmark for Large Language Models

Wenjing Zhang, Xuejiao Lei, Zhaoxiang Liu, Meijuan An, Bikun Yang, KaiKai Zhao, Kai Wang, Shiguo Lian

专题命中 安全评测 ：safety(title,abstract)；分类 cs.CL、cs.AI

Comments 16 pages, 5 figures

First Analysis of the EU Artifical Intelligence Act: Towards a Global Standard for Trustworthy AI?

Marion Ho-Dac

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI、cs.CY

Comments in French language

The Ungrounded Alignment Problem

Marc Pickett, Aakash Kumar Nain, Joseph Modayil, Llion Jones

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.AI、cs.LG

Comments 7 pages, plus references and appendix

The Potential and Perils of Generative Artificial Intelligence for Quality Improvement and Patient Safety

Laleh Jalilian, Daniel McDuff, Achuta Kadambi

专题命中 安全评测 ：safety(title,abstract)；分类 cs.AI、cs.CY

SafePowerGraph: Safety-aware Evaluation of Graph Neural Networks for Transmission Power Grids

Salah Ghamizi, Aleksandar Bojchevski, Aoxiang Ma, Jun Cao

专题命中 安全评测 ：safety(title,abstract)；分类 cs.AI、cs.LG

Trustworthy AI in practice: an analysis of practitioners' needs and challenges

Maria Teresa Baldassarre, Domenico Gigante, Marcos Kalinowski, Azzurra Ragone, Sara Tibidò

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI、cs.CY

Journal ref 28th International Conference on Evaluation and Assessment in Software Engineering (EASE 2024), June 18-21, 2024, Salerno, Italy

Learning Run-time Safety Monitors for Machine Learning Components

Ozan Vardal, Richard Hawkins, Colin Paterson, Chiara Picardi, Daniel Omeiza, Lars Kunze, Ibrahim Habli

专题命中 安全评测 ：safety(title,abstract)；分类 cs.AI、cs.LG

Affirmative safety: An approach to risk management for high-risk AI

Akash R. Wasil, Joshua Clymer, David Krueger, Emily Dardaman, Simeon Campos, Evan R. Murphy

专题命中 安全评测 ：safety(title,abstract)；分类 cs.AI、cs.CY

CPLIP: Zero-Shot Learning for Histopathology with Comprehensive Vision-Language Alignment

Sajid Javed, Arif Mahmood, Iyyakutti Iyappan Ganapathi, Fayaz Ali Dharejo, Naoufel Werghi, Mohammed Bennamoun

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.CL、cs.LG

Trustworthy Actionable Perturbations

Jesse Friedbaum, Sudarshan Adiga, Ravi Tandon

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted at the 41st International Conference on Machine Learning (ICML) 2024

Poser: Unmasking Alignment Faking LLMs by Manipulating Their Internals

Joshua Clymer, Caden Juang, Severin Field

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.CL、cs.AI

Holistic Safety and Responsibility Evaluations of Advanced AI Models

Laura Weidinger, Joslyn Barnhart, Jenny Brennan, Christina Butterfield, Susie Young, Will Hawkins, Lisa Anne Hendricks, Ramona Comanescu, Oscar Chang, Mikel Rodriguez, Jennifer Beroshi, Dawn Bloxwich, Lev Proleev, Jilin Chen, Sebastian Farquhar, Lewis Ho, Iason Gabriel, Allan Dafoe, William Isaac

专题命中 安全评测 ：safety(title,abstract)；分类 cs.AI、cs.LG

Comments 10 pages excluding bibliography

FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets

Seonghyeon Ye, Doyoung Kim, Sungdong Kim, Hyeonbin Hwang, Seungone Kim, Yongrae Jo, James Thorne, Juho Kim, Minjoon Seo

专题命中 安全评测 ：alignment(title,abstract)；分类 cs.CL、cs.AI

Comments ICLR 2024 Spotlight

FreeEval: A Modular Framework for Trustworthy and Efficient Evaluation of Large Language Models

Zhuohao Yu, Chang Gao, Wenjin Yao, Yidong Wang, Zhengran Zeng, Wei Ye, Jindong Wang, Yue Zhang, Shikun Zhang

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.CL、cs.AI

Comments We open-source all our code at: https://github.com/WisdomShell/FreeEval

TRAQ: Trustworthy Retrieval Augmented Question Answering via Conformal Prediction

Shuo Li, Sangdon Park, Insup Lee, Osbert Bastani

专题命中 安全评测 ：trustworthy(title,abstract)；分类 cs.CL、cs.AI

Comments 23 pages, 17 figures, 2024 Annual Conference of the North American Chapter of the Association for Computational Linguistics