语言大模型 / LLM - arXivDaily 专题

2409.16973 2024-09-26 cs.CL cs.AI cs.LG 85%

Adaptive Self-Supervised Learning Strategies for Dynamic On-Device LLM Personalization

Rafael Mendoza, Isabella Cruz, Richard Liu, Aarav Deshmukh, David Williams, Jesscia Peng, Rohan Iyer

专题命中指令微调：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments First ASLS

2403.16073 2024-09-17 cs.SE 85%

Combining Fine-Tuning and LLM-based Agents for Intuitive Smart Contract Auditing with Justifications

Wei Ma, Daoyuan Wu, Yuqiang Sun, Tianwen Wang, Shangqing Liu, Jian Zhang, Yue Xue, Yang Liu

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Comments Accepted for the 47th International Conference on Software Engineering (ICSE 2025)

2409.00096 2024-09-04 cs.CL cs.AI cs.LG 85%

Non-instructional Fine-tuning: Enabling Instruction-Following Capabilities in Pre-trained Language Models without Instruction-Following Data

Juncheng Xie, Shensian Syu, Hung-yi Lee

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 16 pages, 2 figures, 15 tables

2408.05019 2024-08-12 cs.CV 85%

Instruction Tuning-free Visual Token Complement for Multimodal LLMs

Dongsheng Wang, Jiequan Cui, Miaoge Li, Wang Lin, Bo Chen, Hanwang Zhang

专题命中指令微调：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)

Comments Accepted by ECCV2024 (20pages)

2408.03940 2024-08-08 cs.CV 85%

How Well Can Vision Language Models See Image Details?

Chenhui Gou, Abdulwahab Felemban, Faizan Farooq Khan, Deyao Zhu, Jianfei Cai, Hamid Rezatofighi, Mohamed Elhoseiny

专题命中指令微调：language model(title,abstract)；LLM(abstract)；large language model(abstract)

2407.18990 2024-08-08 cs.LG cs.AI cs.CL 85%

Stay Tuned: An Empirical Study of the Impact of Hyperparameters on LLM Tuning in Real-World Applications

Alon Halfon, Shai Gretz, Ofir Arviv, Artem Spector, Orith Toledo-Ronen, Yoav Katz, Liat Ein-Dor, Michal Shmueli-Scheuer, Noam Slonim

专题命中指令微调：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2306.01195 2024-08-06 cs.CV 85%

Consistency-guided Prompt Learning for Vision-Language Models

Shuvendu Roy, Ali Etemad

专题命中指令微调：language model(title,abstract)；foundation model(abstract)；prompting(abstract)

Comments Published as a conference paper at ICLR 2024

2406.13173 2024-07-17 cs.CV cs.AI cs.CL cs.LG 85%

Biomedical Visual Instruction Tuning with Clinician Preference Alignment

Hejie Cui, Lingjun Mao, Xin Liang, Jieyu Zhang, Hui Ren, Quanzheng Li, Xiang Li, Carl Yang

专题命中指令微调：instruction tuning(title,abstract)；foundation model(abstract)；分类 cs.CL、cs.AI、cs.LG

2403.08370 2024-07-16 cs.CL cs.AI cs.LG 85%

SMART: Submodular Data Mixture Strategy for Instruction Tuning

H S V N S Kowndinya Renduchintala, Sumit Bhatia, Ganesh Ramakrishnan

专题命中指令微调：instruction tuning(title,abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2406.17770 2024-06-28 cs.CV 85%

MG-LLaVA: Towards Multi-Granularity Visual Instruction Tuning

Xiangyu Zhao, Xiangtai Li, Haodong Duan, Haian Huang, Yining Li, Kai Chen, Hua Yang

专题命中指令微调：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)

2406.16316 2024-06-25 cs.CL cs.AI cs.CY cs.LG 85%

Does Cross-Cultural Alignment Change the Commonsense Morality of Language Models?

Yuu Jinnai

专题命中指令微调：language model(title,abstract)；SFT(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments The 2nd Workshop on Cross-Cultural Considerations in NLP (C3NLP) at ACL 2024

2406.14005 2024-06-24 cs.CL cs.AI cs.LG 85%

Information Guided Regularization for Fine-tuning Language Models

Mandar Sharma, Nikhil Muralidhar, Shengzhe Xu, Raquib Bin Yousuf, Naren Ramakrishnan

专题命中指令微调：language model(title,abstract)；pretraining(abstract)；分类 cs.CL、cs.AI、cs.LG

2312.07540 2024-06-12 cs.AI cs.CL cs.LG 85%

diff History for Neural Language Agents

Ulyana Piterbarg, Lerrel Pinto, Rob Fergus

专题命中指令微调：language agent(title)；language model(abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ICML 2024 version

2406.04076 2024-06-07 cs.CR 85%

Federated TrustChain: Blockchain-Enhanced LLM Training and Unlearning

Xuhan Zuo, Minghao Wang, Tianqing Zhu, Lefeng Zhang, Dayong Ye, Shui Yu, Wanlei Zhou

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Comments 16 pages, 7 figures,

2402.11450 2024-06-03 cs.RO 85%

Learning to Learn Faster from Human Feedback with Language Model Predictive Control

Jacky Liang, Fei Xia, Wenhao Yu, Andy Zeng, Montserrat Gonzalez Arenas, Maria Attarian, Maria Bauza, Matthew Bennice, Alex Bewley, Adil Dostmohamed, Chuyuan Kelly Fu, Nimrod Gileadi, Marissa Giustina, Keerthana Gopalakrishnan, Leonard Hasenclever, Jan Humplik, Jasmine Hsu, Nikhil Joshi, Ben Jyenis, Chase Kew, Sean Kirmani, Tsang-Wei Edward Lee, Kuang-Huei Lee, Assaf Hurwitz Michaely, Joss Moore, Ken Oslund, Dushyant Rao, Allen Ren, Baruch Tabanpour, Quan Vuong, Ayzaan Wahid, Ted Xiao, Ying Xu, Vincent Zhuang, Peng Xu, Erik Frey, Ken Caluwaerts, Tingnan Zhang, Brian Ichter, Jonathan Tompson, Leila Takayama, Vincent Vanhoucke, Izhak Shafran, Maja Mataric, Dorsa Sadigh, Nicolas Heess, Kanishka Rao, Nik Stewart, Jie Tan, Carolina Parada

专题命中指令微调：language model(title,abstract)；LLM(abstract)；large language model(abstract)

2405.11850 2024-05-21 cs.CV 85%

Rethinking Overlooked Aspects in Vision-Language Models

Yuan Liu, Le Tian, Xiao Zhou, Jie Zhou

专题命中指令微调：language model(title,abstract)；instruction tuning(abstract)；SFT(abstract)

2405.05949 2024-05-10 cs.CV 85%

CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts

Jiachen Li, Xinyao Wang, Sijie Zhu, Chia-Wen Kuo, Lu Xu, Fan Chen, Jitesh Jain, Humphrey Shi, Longyin Wen

专题命中指令微调：LLM(title)；large language model(abstract)；language model(abstract)；instruction tuning(abstract)

2405.04840 2024-05-09 cs.IR 85%

Federated Adaptation for Foundation Model-based Recommendations

Chunxu Zhang, Guodong Long, Hongkuan Guo, Xiao Fang, Yang Song, Zhaojie Liu, Guorui Zhou, Zijian Zhang, Yang Liu, Bo Yang

专题命中指令微调：foundation model(title,abstract)；large language model(abstract)；language model(abstract)

Comments Accepted as a regular paper of IJCAI'24

2302.12461 2024-05-07 cs.LG cs.AI cs.CL 85%

Analyzing And Editing Inner Mechanisms Of Backdoored Language Models

Max Lamparth, Anka Reuel

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Final version accepted at FAccT 24

Journal ref The 2024 ACM Conference on Fairness, Accountability, and Transparency (FAccT 24), June 3-6, 2024, Rio de Janeiro, Brazil

2307.07218 2024-04-11 eess.AS cs.SD 85%

Mega-TTS 2: Boosting Prompting Mechanisms for Zero-Shot Speech Synthesis

Ziyue Jiang, Jinglin Liu, Yi Ren, Jinzheng He, Zhenhui Ye, Shengpeng Ji, Qian Yang, Chen Zhang, Pengfei Wei, Chunfeng Wang, Xiang Yin, Zejun Ma, Zhou Zhao

专题命中指令微调：prompting(title,abstract)；LLM(abstract)；language model(abstract)

Comments Accepted by ICLR 2024

2404.00701 2024-04-02 cs.CV 85%

Training-Free Semantic Segmentation via LLM-Supervision

Wenfang Sun, Yingjun Du, Gaowen Liu, Ramana Kompella, Cees G. M. Snoek

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Comments 22 pages,10 figures, conference

2312.03849 2024-03-25 cs.CV 85%

LEGO: Learning EGOcentric Action Frame Generation via Visual Instruction Tuning

Bolin Lai, Xiaoliang Dai, Lawrence Chen, Guan Pang, James M. Rehg, Miao Liu

专题命中指令微调：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)

Comments 34 pages

2309.14459 2024-03-20 cs.HC 85%

Bridging the Gulf of Envisioning: Cognitive Design Challenges in LLM Interfaces

Hariharan Subramonyam, Roy Pea, Christopher Lawrence Pondoc, Maneesh Agrawala, Colleen Seifert

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)

2310.20703 2024-03-15 cs.LG cs.AI cs.CL stat.ML 85%

Vanishing Gradients in Reinforcement Finetuning of Language Models

Noam Razin, Hattie Zhou, Omid Saremi, Vimal Thilak, Arwen Bradley, Preetum Nakkiran, Joshua Susskind, Etai Littwin

专题命中指令微调：language model(title,abstract)；SFT(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to ICLR 2024

2311.16494 2024-03-14 cs.CV 85%

ArGue: Attribute-Guided Prompt Tuning for Vision-Language Models

Xinyu Tian, Shu Zou, Zhaoyuan Yang, Jing Zhang

专题命中指令微调：language model(title,abstract)；large language model(abstract)；prompting(abstract)

Comments Accepted to CVPR2024

2403.05135 2024-03-11 cs.CV 85%

ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment

Xiwei Hu, Rui Wang, Yixiao Fang, Bin Fu, Pei Cheng, Gang Yu

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Comments Project Page: https://ella-diffusion.github.io/

2403.01209 2024-03-05 cs.CV 85%

Data-free Multi-label Image Recognition via LLM-powered Prompt Tuning

Shuo Yang, Zirui Shang, Yongqi Wang, Derong Deng, Hongwei Chen, Qiyuan Cheng, Xinxiao Wu

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)

2402.12408 2024-02-21 cs.LG cs.AI cs.CL 85%

ModelGPT: Unleashing LLM's Capabilities for Tailored Model Generation

Zihao Tang, Zheqi Lv, Shengyu Zhang, Fei Wu, Kun Kuang

专题命中指令微调：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2402.03749 2024-02-07 cs.CV 85%

Vision Superalignment: Weak-to-Strong Generalization for Vision Foundation Models

Jianyuan Guo, Hanting Chen, Chengcheng Wang, Kai Han, Chang Xu, Yunhe Wang

专题命中指令微调：foundation model(title,abstract)；large language model(abstract)；language model(abstract)

Comments 12 pages

2310.09503 2024-01-26 cs.CV 85%

JM3D & JM3D-LLM: Elevating 3D Understanding with Joint Multi-modal Cues

Jiayi Ji, Haowei Wang, Changli Wu, Yiwei Ma, Xiaoshuai Sun, Rongrong Ji

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)

Comments 16 pages, 4 figures, 10 tables, 3D understanding

1. 指令微调 11653 篇

Adaptive Self-Supervised Learning Strategies for Dynamic On-Device LLM Personalization

Combining Fine-Tuning and LLM-based Agents for Intuitive Smart Contract Auditing with Justifications

Non-instructional Fine-tuning: Enabling Instruction-Following Capabilities in Pre-trained Language Models without Instruction-Following Data

Instruction Tuning-free Visual Token Complement for Multimodal LLMs

How Well Can Vision Language Models See Image Details?

Stay Tuned: An Empirical Study of the Impact of Hyperparameters on LLM Tuning in Real-World Applications

Consistency-guided Prompt Learning for Vision-Language Models

Biomedical Visual Instruction Tuning with Clinician Preference Alignment

SMART: Submodular Data Mixture Strategy for Instruction Tuning

MG-LLaVA: Towards Multi-Granularity Visual Instruction Tuning

Does Cross-Cultural Alignment Change the Commonsense Morality of Language Models?

Information Guided Regularization for Fine-tuning Language Models

diff History for Neural Language Agents

Federated TrustChain: Blockchain-Enhanced LLM Training and Unlearning

Learning to Learn Faster from Human Feedback with Language Model Predictive Control

Rethinking Overlooked Aspects in Vision-Language Models

CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts

Federated Adaptation for Foundation Model-based Recommendations

Analyzing And Editing Inner Mechanisms Of Backdoored Language Models

Mega-TTS 2: Boosting Prompting Mechanisms for Zero-Shot Speech Synthesis

Training-Free Semantic Segmentation via LLM-Supervision

LEGO: Learning EGOcentric Action Frame Generation via Visual Instruction Tuning

Bridging the Gulf of Envisioning: Cognitive Design Challenges in LLM Interfaces

Vanishing Gradients in Reinforcement Finetuning of Language Models

ArGue: Attribute-Guided Prompt Tuning for Vision-Language Models

ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment

Data-free Multi-label Image Recognition via LLM-powered Prompt Tuning

ModelGPT: Unleashing LLM's Capabilities for Tailored Model Generation

Vision Superalignment: Weak-to-Strong Generalization for Vision Foundation Models

JM3D & JM3D-LLM: Elevating 3D Understanding with Joint Multi-modal Cues