代码大模型 / AI 编程

Mark My Words: Analyzing and Evaluating Language Model Watermarks

Julien Piet, Chawin Sitawarin, Vivian Fang, Norman Mu, David Wagner

专题命中 代码评测 ：code generation(abstract)；分类 cs.CL、cs.AI

Comments 22 pages, 18 figures

MOMENT: A Family of Open Time-series Foundation Models

Mononito Goswami, Konrad Szafer, Arjun Choudhry, Yifu Cai, Shuo Li, Artur Dubrawski

专题命中 代码评测 ：repository(abstract)；分类 cs.AI、cs.LG

Comments Accepted at ICML'24. This is a revision. See changelog in the Appendix

GEMS: Generative Expert Metric System through Iterative Prompt Priming

Ti-Chung Cheng, Carmen Badea, Christian Bird, Thomas Zimmermann, Robert DeLine, Nicole Forsgren, Denae Ford

专题命中 代码评测 ：repository(abstract)；分类 cs.SE、cs.AI

Comments 29 pages, 3 figures

BabelBench: An Omni Benchmark for Code-Driven Analysis of Multimodal and Multistructured Data

Xuwu Wang, Qiwen Cui, Yunzhe Tao, Yiran Wang, Ziwei Chai, Xiaotian Han, Boyi Liu, Jianbo Yuan, Jing Su, Guoyin Wang, Tingkai Liu, Liyu Chen, Tianyi Liu, Tao Sun, Yufeng Zhang, Sirui Zheng, Quanzeng You, Yang Yang, Hongxia Yang

专题命中 代码评测 ：code generation(abstract)；分类 cs.CL、cs.AI

CodeInsight: A Curated Dataset of Practical Coding Solutions from Stack Overflow

Nathanaël Beau, Benoît Crabbé

专题命中 代码评测 ：code generation(abstract)；分类 cs.SE、cs.CL

Comments Accepted to ACL 2024 Findings

A Survey on Large Language Models from General Purpose to Medical Applications: Datasets, Methodologies, and Evaluations

Jinqiang Wang, Huansheng Ning, Yi Peng, Qikai Wei, Daniel Tesfai, Wenwei Mao, Tao Zhu, Runhe Huang

专题命中 代码评测 ：repository(abstract)；分类 cs.CL、cs.AI

Comments 25 pages,4 figures

Transformer with Controlled Attention for Synchronous Motion Captioning

Karim Radouane, Sylvie Ranwez, Julien Lagarde, Andon Tchechmedjiev

专题命中 代码评测 ：repository(abstract)；分类 cs.CL、cs.LG

CodeJudge-Eval: Can Large Language Models be Good Judges in Code Understanding?

Yuwei Zhao, Ziyang Luo, Yuchen Tian, Hongzhan Lin, Weixiang Yan, Annan Li, Jing Ma

专题命中 代码评测 ：code generation(abstract)；分类 cs.SE、cs.CL

Comments The first two authors contributed equally

A Survey on Benchmarks of Multimodal Large Language Models

Jian Li, Weiheng Lu, Hao Fei, Meng Luo, Ming Dai, Min Xia, Yizhang Jin, Zhenye Gan, Ding Qi, Chaoyou Fu, Ying Tai, Wankou Yang, Yabiao Wang, Chengjie Wang

专题命中 代码评测 ：repository(abstract)；分类 cs.CL、cs.AI

SALLM: Security Assessment of Generated Code

Mohammed Latif Siddiq, Joanna C. S. Santos, Sajith Devareddy, Anna Muller

专题命中 代码评测 ：code generation(abstract)；分类 cs.SE、cs.AI

Comments Accepted at the 6th International Workshop on Automated and verifiable Software sYstem DEvelopment (ASYDE) with ASE Conference 2024

Journal ref 39th IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW '24), October 27-November 1, 2024, Sacramento, CA, USA, ACM, New York, NY, USA, 12 pages

Evaluating the Energy Consumption of Machine Learning: Systematic Literature Review and Experiments

Charlotte Rodriguez, Laura Degioanni, Laetitia Kameni, Richard Vidal, Giovanni Neglia

专题命中 代码评测 ：repository(abstract)；分类 cs.AI、cs.LG

Comments 52 pages,

Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Era

Sunhao Dai, Chen Xu, Shicheng Xu, Liang Pang, Zhenhua Dong, Jun Xu

专题命中 代码评测 ：repository(abstract)；分类 cs.CL、cs.AI

Comments KDD 2024 Tutorial&Survey; Tutorial Website: https://llm-ir-bias-fairness.github.io/

Which Side Are You On? A Multi-task Dataset for End-to-End Argument Summarisation and Evaluation

Hao Li, Yuping Wu, Viktor Schlegel, Riza Batista-Navarro, Tharindu Madusanka, Iqra Zahid, Jiayan Zeng, Xiaochi Wang, Xinran He, Yizhi Li, Goran Nenadic

专题命中 代码评测 ：repository(abstract)；分类 cs.CL、cs.LG

Comments Published on ACL 2024 Findings

CON-FOLD -- Explainable Machine Learning with Confidence

Lachlan McGinness, Peter Baumgartner

专题命中 代码评测 ：repository(abstract)；分类 cs.AI、cs.LG

rule4ml: An Open-Source Tool for Resource Utilization and Latency Estimation for ML Models on FPGA

Mohammad Mehdi Rahimifar, Hamza Ezzaoui Rahali, Audrey C. Therrien

专题命中 代码评测 ：repository(abstract)；分类 cs.AI、cs.LG

SafeDreamer: Safe Reinforcement Learning with World Models

Weidong Huang, Jiaming Ji, Chunhe Xia, Borong Zhang, Yaodong Yang

专题命中 代码评测 ：repository(abstract)；分类 cs.AI、cs.LG

Comments ICLR 2024

PyBench: Evaluating LLM Agent on various real-world coding tasks

Yaolun Zhang, Yinxu Pan, Yudong Wang, Jie Cai

专题命中 代码评测 ：repository(abstract)；分类 cs.SE、cs.AI

Comments 16 pages

LLMs Plagiarize: Ensuring Responsible Sourcing of Large Language Model Training Data Through Knowledge Graph Comparison

Devam Mondal, Carlo Lipizzi

专题命中 代码评测 ：repository(abstract)；分类 cs.CL、cs.LG

Should we be going MAD? A Look at Multi-Agent Debate Strategies for LLMs

Andries Smit, Paul Duckworth, Nathan Grinsztajn, Thomas D. Barrett, Arnu Pretorius

专题命中 代码评测 ：repository(abstract)；分类 cs.CL、cs.AI

Comments 2 pages, 13 figures

SafePowerGraph: Safety-aware Evaluation of Graph Neural Networks for Transmission Power Grids

Salah Ghamizi, Aleksandar Bojchevski, Aoxiang Ma, Jun Cao

专题命中 代码评测 ：repository(abstract)；分类 cs.AI、cs.LG

Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?

Ruisheng Cao, Fangyu Lei, Haoyuan Wu, Jixuan Chen, Yeqiao Fu, Hongcheng Gao, Xinzhuang Xiong, Hanchong Zhang, Yuchen Mao, Wenjing Hu, Tianbao Xie, Hongshen Xu, Danyang Zhang, Sida Wang, Ruoxi Sun, Pengcheng Yin, Caiming Xiong, Ansong Ni, Qian Liu, Victor Zhong, Lu Chen, Kai Yu, Tao Yu

专题命中 代码评测 ：code generation(abstract)；分类 cs.CL、cs.AI

Comments 34 pages, 14 figures, 10 tables

Reproducible scaling laws for contrastive language-image learning

Mehdi Cherti, Romain Beaumont, Ross Wightman, Mitchell Wortsman, Gabriel Ilharco, Cade Gordon, Christoph Schuhmann, Ludwig Schmidt, Jenia Jitsev

专题命中 代码评测 ：repository(abstract)；分类 cs.AI、cs.LG

Comments CVPR 2023. Version with minor extension. Original: CVPR2023/html/Cherti_Reproducible_Scaling_Laws_for_Contrastive_Language-Image_Learning_CVPR_2023_paper" target="_blank" rel="noopener">https://openaccess.thecvf.com/content/CVPR2023/html/Cherti_Reproducible_Scaling_Laws_for_Contrastive_Language-Image_Learning_CVPR_2023_paper

Journal ref Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, pp. 2818-2829

PythonSaga: Redefining the Benchmark to Evaluate Code Generating LLMs

Ankit Yadav, Himanshu Beniwal, Mayank Singh

专题命中 代码评测 ：code generation(abstract)；分类 cs.CL、cs.AI

MIMOSA: Multi-constraint Molecule Sampling for Molecule Optimization

Tianfan Fu, Cao Xiao, Xinhao Li, Lucas M. Glass, Jimeng Sun

专题命中 代码评测 ：repository(abstract)；分类 cs.AI、cs.LG

Comments Accepted by AAAI 2021

Generation of Asset Administration Shell with Large Language Model Agents: Toward Semantic Interoperability in Digital Twins in the Context of Industry 4.0

Yuchen Xia, Zhewen Xiao, Nasser Jazdi, Michael Weyrich

专题命中 代码评测 ：repository(abstract)；分类 cs.SE、cs.AI

Comments Published in IEEE Access

MASAI: Modular Architecture for Software-engineering AI Agents

Daman Arora, Atharv Sonwane, Nalin Wadhwa, Abhav Mehrotra, Saiteja Utpala, Ramakrishna Bairi, Aditya Kanade, Nagarajan Natarajan

专题命中 代码评测 ：repository(abstract)；分类 cs.SE、cs.AI

Out of style: Misadventures with LLMs and code style transfer

Karl Munson, Chih-Kai Ting, Serenity Wade, Anish Savla, Julian Dolby, Kiran Kate, Kavitha Srinivas

专题命中 代码评测 ：code model(abstract)；分类 cs.SE、cs.AI

FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Models

Gagan Bhatia, El Moatez Billah Nagoudi, Hasan Cavusoglu, Muhammad Abdul-Mageed

专题命中 代码评测 ：repository(abstract)；分类 cs.CL、cs.AI

Mercury: A Code Efficiency Benchmark for Code Large Language Models

Mingzhe Du, Anh Tuan Luu, Bin Ji, Qian Liu, See-Kiong Ng

专题命中 代码评测 ：code generation(abstract)；分类 cs.SE、cs.CL

Evaluation of the Programming Skills of Large Language Models

Luc Bryan Heitz, Joun Chamas, Christopher Scherb

专题命中 代码评测 ：code generation(abstract)；分类 cs.SE、cs.CL