代码大模型 / AI 编程

A Dual-Space Framework for General Knowledge Distillation of Large Language Models

Xue Zhang, Songming Zhang, Yunlong Liang, Fandong Meng, Yufeng Chen, Jinan Xu, Jie Zhou

专题命中 代码生成 ：code generation(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 19 pages, 9 figures, 11 tables, under review. Code is available at: https://github.com/songmzhang/DSKDv2. arXiv admin note: text overlap with arXiv:2406.17328

ZIP-FIT: Embedding-Free Data Selection via Compression-Based Alignment

Elyas Obbad, Iddah Mlauzi, Brando Miranda, Rylan Schaeffer, Kamal Obbad, Suhana Bedi, Sanmi Koyejo

专题命中 代码生成 ：code generation(abstract)；分类 cs.CL、cs.AI、cs.LG

From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future

Haolin Jin, Linghan Huang, Haipeng Cai, Jun Yan, Bo Li, Huaming Chen

专题命中 代码生成 ：code generation(abstract)；分类 cs.SE、cs.CL、cs.AI

Consolidating TinyML Lifecycle with Large Language Models: Reality, Illusion, or Opportunity?

Guanghan Wu, Sasu Tarkoma, Roberto Morabito

专题命中 代码生成 ：code generation(abstract)；分类 cs.SE、cs.AI、cs.LG

Comments This paper has been accepted for publication in the IEEE Internet of Things Magazine (Special Issue on Applications of Large Language Models in IoT). The copyright will be transferred to IEEE upon publication. A preliminary version of this work was presented at the Edge AI Foundation event Beyond LLMs and Chatbots: The Journey to Generative AI at the Edge (https://youtu.be/aFWfisdjQIs)

ObscuraCoder: Powering Efficient Code LM Pre-Training Via Obfuscation Grounding

Indraneil Paul, Haoyi Yang, Goran Glavaš, Kristian Kersting, Iryna Gurevych

专题命中 代码生成 ：code generation(abstract)；分类 cs.SE、cs.CL、cs.AI

Are Large Language Models Memorizing Bug Benchmarks?

Daniel Ramos, Claudia Mamede, Kush Jain, Paulo Canelas, Catarina Gamboa, Claire Le Goues

专题命中 代码生成 ：code generation(abstract)；分类 cs.SE、cs.AI、cs.LG

Challenges and Paths Towards AI for Software Engineering

Alex Gu, Naman Jain, Wen-Ding Li, Manish Shetty, Yijia Shao, Ziyang Li, Diyi Yang, Kevin Ellis, Koushik Sen, Armando Solar-Lezama

专题命中 代码生成 ：code generation(abstract)；分类 cs.SE、cs.AI、cs.LG

Comments 75 pages

h4rm3l: A language for Composable Jailbreak Attack Synthesis

Moussa Koulako Bala Doumbouya, Ananjan Nandi, Gabriel Poesia, Davide Ghilardi, Anna Goldie, Federico Bianchi, Dan Jurafsky, Christopher D. Manning

专题命中 代码生成 ：program synthesis(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to the Thirteenth International Conference on Learning Representations (ICLR 2025)

Every Sample Matters: Leveraging Mixture-of-Experts and High-Quality Data for Efficient and Accurate Code LLM

Codefuse, Ling Team, :, Wenting Cai, Yuchen Cao, Chaoyu Chen, Chen Chen, Siba Chen, Qing Cui, Peng Di, Junpeng Fang, Zi Gong, Ting Guo, Zhengyu He, Yang Huang, Cong Li, Jianguo Li, Zheng Li, Shijie Lian, BingChang Liu, Songshan Luo, Shuo Mao, Min Shen, Jian Wu, Jiaolong Yang, Wenjie Yang, Tong Ye, Hang Yu, Wei Zhang, Zhenduo Zhang, Hailin Zhao, Xunjin Zheng, Jun Zhou

专题命中 代码生成 ：code generation(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 20 pages, 6 figures

LoRA-Pro: Are Low-Rank Adapters Properly Optimized?

Zhengbo Wang, Jian Liang, Ran He, Zilei Wang, Tieniu Tan

专题命中 代码生成 ：code generation(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Camera-Ready Version for ICLR 2025; technical corrections to previous version

LLM-SR: Scientific Equation Discovery via Programming with Large Language Models

Parshin Shojaee, Kazem Meidani, Shashank Gupta, Amir Barati Farimani, Chandan K Reddy

专题命中 代码生成 ：code generation(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ICLR 2025 Oral

LLM-Aided Customizable Profiling of Code Data Based On Programming Language Concepts

Pankaj Thorat, Adnan Qidwai, Adrija Dhar, Aishwariya Chakraborty, Anand Eswaran, Hima Patel, Praveen Jayachandran

专题命中 代码生成 ：code generation(abstract)；分类 cs.SE、cs.LG、cs.PL

Comments 21 pages

What I cannot execute, I do not understand: Training and Evaluating LLMs on Program Execution Traces

Jordi Armengol-Estapé, Quentin Carbonneaux, Tianjun Zhang, Aram H. Markosyan, Volker Seeker, Chris Cummins, Melanie Kambadur, Michael F. P. O'Boyle, Sida Wang, Gabriel Synnaeve, Hugh James Leather

专题命中 代码生成 ：code generation(abstract)；分类 cs.AI、cs.LG、cs.PL

AutoIOT: LLM-Driven Automated Natural Language Programming for AIoT Applications

Leming Shen, Qiang Yang, Yuanqing Zheng, Mo Li

专题命中 代码生成 ：program synthesis(abstract)；分类 cs.SE、cs.CL、cs.AI

How Diversely Can Language Models Solve Problems? Exploring the Algorithmic Diversity of Model-Generated Code

Seonghyeon Lee, Heejae Chon, Joonwon Jang, Dongha Lee, Hwanjo Yu

专题命中 代码生成 ：code generation(abstract)；分类 cs.SE、cs.CL、cs.AI

Advancing vision-language models in front-end development via data synthesis

Tong Ge, Yashu Liu, Jieping Ye, Tianyi Li, Chao Wang

专题命中 代码生成 ：code generation(abstract)；分类 cs.CL、cs.AI、cs.LG

IterGen: Iterative Semantic-aware Structured LLM Generation with Backtracking

Shubham Ugare, Rohan Gumaste, Tarun Suresh, Gagandeep Singh, Sasa Misailovic

专题命中 代码生成 ：code generation(abstract)；分类 cs.SE、cs.LG、cs.PL

Comments Accepted at ICLR 2025

We Have a Package for You! A Comprehensive Analysis of Package Hallucinations by Code Generating LLMs

Joseph Spracklen, Raveen Wijewickrama, A H M Nazmus Sakib, Anindya Maiti, Bimal Viswanath, Murtuza Jadliwala

专题命中 代码生成 ：code generation(abstract)；分类 cs.SE、cs.AI、cs.LG

Comments To appear in the 2025 USENIX Security Symposium. 22 pages, 14 figures, 8 tables. Edited from original version for submission to a different conference. No change to original results or findings

Conversational Planning for Personal Plans

Konstantina Christakopoulou, Iris Qu, John Canny, Andrew Goodridge, Cj Adams, Minmin Chen, Maja Matarić

专题命中 代码生成 ：code generation(abstract)；分类 cs.CL、cs.AI、cs.LG

Mechanistic Understanding of Language Models in Syntactic Code Completion

Samuel Miller, Daking Rai, Ziyu Yao

专题命中 代码生成 ：code generation(abstract)；分类 cs.SE、cs.CL、cs.AI

Comments 10 pages, 4 figures, accepted to the AAAI 2025 Workshop on Towards Knowledgeable Foundation Models

LogoMotion: Visually-Grounded Code Synthesis for Creating and Editing Animation

Vivian Liu, Rubaiat Habib Kazi, Li-Yi Wei, Matthew Fisher, Timothy Langlois, Seth Walker, Lydia Chilton

专题命中 代码生成 ：code generation(abstract)；program repair(abstract)

LeDex: Training LLMs to Better Self-Debug and Explain Code

Nan Jiang, Xiaopeng Li, Shiqi Wang, Qiang Zhou, Soneya Binta Hossain, Baishakhi Ray, Varun Kumar, Xiaofei Ma, Anoop Deoras

专题命中 代码生成 ：code generation(abstract)；分类 cs.SE、cs.CL、cs.AI

Comments This paper is accepted by The Thirty-eighth Annual Conference on Neural Information Processing Systems (NeurIPS 2024)

A Survey on Large Language Models with some Insights on their Capabilities and Limitations

Andrea Matarazzo, Riccardo Torlone

专题命中 代码生成 ：code generation(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 174 pages, to be submitted to a journal in a shorter version. It includes figures taken from papers by other authors. All the sources have been referenced. arXiv admin note: text overlap with arXiv:2303.18223 by other authors

Reusing Embeddings: Reproducible Reward Model Research in Large Language Model Alignment without GPUs

Hao Sun, Yunyi Shen, Jean-Francois Ton, Mihaela van der Schaar

专题命中 代码生成 ：code generation(abstract)；分类 cs.CL、cs.AI、cs.LG

Towards Making Flowchart Images Machine Interpretable

Shreya Shukla, Prajwal Gatti, Yogesh Kumar, Vikash Yadav, Anand Mishra

专题命中 代码生成 ：code generation(abstract)；分类 cs.SE、cs.CL、cs.AI

Comments Published at: ICDAR 2023, Project Page: https://vl2g.github.io/projects/floco/

Deriving Coding-Specific Sub-Models from LLMs using Resource-Efficient Pruning

Laura Puccioni, Alireza Farshin, Mariano Scazzariello, Changjie Wang, Marco Chiesa, Dejan Kostic

专题命中 代码生成 ：code generation(abstract)；分类 cs.SE、cs.AI、cs.LG

Look Before You Leap: An Exploratory Study of Uncertainty Measurement for Large Language Models

Yuheng Huang, Jiayang Song, Zhijie Wang, Shengming Zhao, Huaming Chen, Felix Juefei-Xu, Lei Ma

专题命中 代码生成 ：code generation(abstract)；分类 cs.SE、cs.CL、cs.AI

Comments Update website, code, and experiments on eight new LLMs. To appear in the IEEE Transactions on Software Engineering (2025)

Evaluating the Ability of Large Language Models to Generate Verifiable Specifications in VeriFast

Wen Fan, Marilyn Rego, Xin Hu, Sanya Dod, Zhaorui Ni, Danning Xie, Jenna DiVincenzo, Lin Tan

专题命中 代码生成 ：code generation(abstract)；分类 cs.SE、cs.AI、cs.PL

Enabling New HDLs with Agents

Mark Zakharov, Farzaneh Rabiei Kashanaki, Jose Renau

专题命中 代码生成 ：code generation(abstract)；分类 cs.AI、cs.LG、cs.PL

Channel Merging: Preserving Specialization for Merged Experts

Mingyang Zhang, Jing Liu, Ganggui Ding, Xinyi Yu, Linlin Ou, Bohan Zhuang

专题命中 代码生成 ：code generation(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments accepted by AAAI 2025