End-user development allows everyday users to tailor service robots or applications to their needs. One user-friendly approach is natural language programming. However, it encounters challenges such as an expansive user expression space and limited support for debugging and editing, which restrict its application in end-user programming. The emergence of large language models (LLMs) offers promising avenues for the translation and interpretation between human language instructions and the code executed by robots, but their application in end-user programming systems requires further study. We introduce Cocobo, a natural language programming system with interactive diagrams powered by LLMs. Cocobo employs LLMs to understand users' authoring intentions, generate and explain robot programs, and facilitate the conversion between executable code and flowchart representations. Our user study shows that Cocobo has a low learning curve, enabling even users with zero coding experience to customize robot programs successfully.
When Do Model Internals Help? Exploring the Role of Representation Engineering in LLM Safety
State Key Laboratory of Multimedia Information Processing, Peking University(北京大学多媒体信息处理国家重点实验室);School of Computer Science, Peking University(北京大学计算机科学学院)
From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future
School of Electrical and Computer Engineering, The University of Sydney(悉尼大学电气与计算机工程学院);University at Buffalo, SUNY(纽约州立大学布法罗分校);University of Chicago(芝加哥大学)
Conversing with Copilot: Exploring Prompt Engineering for Solving CS1 Problems Using Natural Language
University of Auckland(奥克兰大学);Indian Institute of Science(印度科学学院)
GitHub Copilot是一个人工智能模型,用于从自然语言问题描述自动生成源代码。自2022年6月以来,Copilot已正式免费提供给所有学生作为Visual Studio Code等开发环境的插件。之前探索OpenAI Codex(Copilot的底层模型)的工作表明,它在典型的CS1问题上表现良好,因此人们担心它会对入门编程课程的教学产生影响。然而,关于Copilot不能很好地执行的问题类型,或者关于学生在解决错误时可能与Copilot进行的自然语言交互,我们知之甚少。我们通过评估Copilot在166个编程问题的公开数据集上的性能来探索这些问题。我们发现,它成功地解决了大约一半的这些问题的第一次尝试,它解决了60%的剩余问题,只使用自然语言的问题描述的变化。我们认为,这种类型的提示工程,我们相信将成为一个标准的人类和Copilot之间的互动时,它最初失败,是一个潜在的有用的学习活动,促进计算思维技能,并有可能改变代码编写技能的发展的性质。