语言大模型 / LLM

MP5: A Multi-modal Open-ended Embodied System in Minecraft via Active Perception

Yiran Qin, Enshen Zhou, Qichang Liu, Zhenfei Yin, Lu Sheng, Ruimao Zhang, Yu Qiao, Jing Shao

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

Comments Accepted to CVPR2024

DiffPrompter: Differentiable Implicit Visual Prompts for Semantic-Segmentation in Adverse Conditions

Sanket Kalwar, Mihir Ungarala, Shruti Jain, Aaron Monis, Krishna Reddy Konda, Sourav Garg, K Madhava Krishna

专题命中 其他LLM ：foundation model(abstract)；prompting(abstract)

DreamLIP: Language-Image Pre-training with Long Captions

Kecheng Zheng, Yifei Zhang, Wei Wu, Fan Lu, Shuailei Ma, Xin Jin, Wei Chen, Yujun Shen

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

Towards Designing a Question-Answering Chatbot for Online News: Understanding Questions and Perspectives

Md Naimul Hoque, Ayman Mahfuz, Mayukha Kindi, Naeemul Hassan

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

Semantics from Space: Satellite-Guided Thermal Semantic Segmentation Annotation for Aerial Field Robots

Connor Lee, Saraswati Soedarmadji, Matthew Anderson, Anthony J. Clark, Soon-Jo Chung

专题命中 其他LLM ：language model(abstract)；foundation model(abstract)

An Empathy-Based Sandbox Approach to Bridge the Privacy Gap among Attitudes, Goals, Knowledge, and Behaviors

Chaoran Chen, Weijun Li, Wenxin Song, Yanfang Ye, Yaxing Yao, Toby Jia-jun Li

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

MineDreamer: Learning to Follow Instructions via Chain-of-Imagination for Simulated-World Control

Enshen Zhou, Yiran Qin, Zhenfei Yin, Yuzhou Huang, Ruimao Zhang, Lu Sheng, Yu Qiao, Jing Shao

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

Comments Project page: https://sites.google.com/view/minedreamer/main

The Value, Benefits, and Concerns of Generative AI-Powered Assistance in Writing

Zhuoyan Li, Chen Liang, Jing Peng, Ming Yin

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

Comments CHI 2024

Agent3D-Zero: An Agent for Zero-shot 3D Understanding

Sha Zhang, Di Huang, Jiajun Deng, Shixiang Tang, Wanli Ouyang, Tong He, Yanyong Zhang

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

Comments project page: https://zhangsha1024.github.io/Agent3D-Zero/

PerceptionCLIP: Visual Classification by Inferring and Conditioning on Contexts

Bang An, Sicheng Zhu, Michael-Andrei Panaitescu-Liess, Chaithanya Kumar Mummadi, Furong Huang

专题命中 其他LLM ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted by ICLR 2024

Variational Monte Carlo with Large Patched Transformers

Kyle Sprague, Stefanie Czischek

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

Comments 15 pages, 5 figures

Journal ref Commun Phys 7, 90 (2024)

Continuous QA Learning with Structured Prompts

Yinhe Zheng

专题命中 其他LLM ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Duplicate of arXiv:2305.06555 (Please cite arXiv:2305.06555 since it is the camera ready version)

GPT on a Quantum Computer

Yidong Liao, Chris Ferrie

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

Comments 35 pages, 14 figures

Open-Vocabulary Video Anomaly Detection

Peng Wu, Xuerong Zhou, Guansong Pang, Yujia Sun, Jing Liu, Peng Wang, Yanning Zhang

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

Comments Accepted to CVPR2024

Embracing Large Language and Multimodal Models for Prosthetic Technologies

Sharmita Dey, Arndt F. Schilling

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

The outcomes of generative AI are exactly the Nash equilibria of a non-potential game

Boualem Djehiche, Hamidou Tembine

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

Comments Updated version 1. 24 pages. Accepted and to appear in: International Econometric Conference of Vietnam

InfiMM-HD: A Leap Forward in High-Resolution Multimodal Understanding

Haogeng Liu, Quanzeng You, Xiaotian Han, Yiqi Wang, Bohan Zhai, Yongfei Liu, Yunzhe Tao, Huaibo Huang, Ran He, Hongxia Yang

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

From Self-Attention to Markov Models: Unveiling the Dynamics of Generative Transformers

M. Emrullah Ildiz, Yixiao Huang, Yingcong Li, Ankit Singh Rawat, Samet Oymak

专题命中 其他LLM ：language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 30 pages

SInViG: A Self-Evolving Interactive Visual Agent for Human-Robot Interaction

Jie Xu, Hanbo Zhang, Xinghang Li, Huaping Liu, Xuguang Lan, Tao Kong

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

Generative AI and Attentive User Interfaces: Five Strategies to Enhance Take-Over Quality in Automated Driving

Patrick Ebel

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

Comments MUM 2023 Workshop on Interruptions and Attention Management: Exploring the Potential of Generative AI

Prompt Learning for Multi-Label Code Smell Detection: A Promising Approach

Haiyang Liu, Yang Zhang, Vidya Saikrishna, Quanquan Tian, Kun Zheng

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

Pandora: Jailbreak GPTs by Retrieval Augmented Generation Poisoning

Gelei Deng, Yi Liu, Kailong Wang, Yuekang Li, Tianwei Zhang, Yang Liu

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

Comments 6 pages

LLMs Meet VLMs: Boost Open Vocabulary Object Detection with Fine-grained Descriptors

Sheng Jin, Xueying Jiang, Jiaxing Huang, Lewei Lu, Shijian Lu

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

Object-Centric Instruction Augmentation for Robotic Manipulation

Junjie Wen, Yichen Zhu, Minjie Zhu, Jinming Li, Zhiyuan Xu, Zhengping Che, Chaomin Shen, Yaxin Peng, Dong Liu, Feifei Feng, Jian Tang

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

Comments accepted to ICRA2024

GazeGPT: Augmenting Human Capabilities using Gaze-contingent Contextual AI for Smart Eyewear

Robert Konrad, Nitish Padmanaban, J. Gabriel Buckmaster, Kevin C. Boyle, Gordon Wetzstein

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

Comments Project video: https://youtu.be/AuDFHHTK_m8

ChatGPT and Human Synergy in Black-Box Testing: A Comparative Analysis

Hiroyuki Kirinuki, Haruto Tanno

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokens

Xiaofeng Wang, Zheng Zhu, Guan Huang, Boyuan Wang, Xinze Chen, Jiwen Lu

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

Comments project page: https://world-dreamer.github.io/

Towards a Responsible AI Metrics Catalogue: A Collection of Metrics for AI Accountability

Boming Xia, Qinghua Lu, Liming Zhu, Sung Une Lee, Yue Liu, Zhenchang Xing

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

Scalable Pre-training of Large Autoregressive Image Models

Alaaeldin El-Nouby, Michal Klein, Shuangfei Zhai, Miguel Angel Bautista, Alexander Toshev, Vaishaal Shankar, Joshua M Susskind, Armand Joulin

专题命中 其他LLM ：large language model(abstract)；language model(abstract)

Comments https://github.com/apple/ml-aim

Code Review Automation: Strengths and Weaknesses of the State of the Art

Rosalia Tufano, Ozren Dabić, Antonio Mastropaolo, Matteo Ciniselli, Gabriele Bavota

专题命中 其他LLM ：large language model(abstract)；language model(abstract)