InstructPipe: Generating Visual Blocks Pipelines with Human Instructions and LLMs
Google Research, USA(谷歌研究, 美国);The University of Tokyo, Japan(东京大学, 日本)
Zhongyi Zhou, Jing Jin, Vrushank Phadnis, Xiuxiu Yuan, Jun Jiang, Xun Qian, Kristen Wright, Mark Sherwood, Jason Mayes, Jingtao Zhou, Yiyi Huang, Zheng Xu, Yind… 展开作者
Zhongyi Zhou, Jing Jin, Vrushank Phadnis, Xiuxiu Yuan, Jun Jiang, Xun Qian, Kristen Wright, Mark Sherwood, Jason Mayes, Jingtao Zhou, Yiyi Huang, Zheng Xu, Yinda Zhang, Johnny Lee, Alex Olwal, David Kim, Ram Iyengar, Na Li, Ruofei Du
Visual programming has the potential of providing novice programmers with a low-code experience to build customized processing pipelines. Existing systems typically require users to build pipelines from scratch, implying that novice users are expected to set up and link appropriate nodes from a blank workspace. In this paper, we introduce InstructPipe, an AI assistant for prototyping machine learning (ML) pipelines with text instructions. We contribute two large language model (LLM) modules and a code interpreter as part of our framework. The LLM modules generate pseudocode for a target pipeline, and the interpreter renders the pipeline in the node-graph editor for further human-AI collaboration. Both technical and user evaluation (N=16) shows that InstructPipe empowers users to streamline their ML pipeline workflow, reduce their learning curve, and leverage open-ended commands to spark innovative ideas.
The Hong Kong University of Science and Technology(香港科技大学);ATH, Alibaba Group(阿里巴巴集团 ATH);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Northwestern Polytechnical University(西北工业大学);Zhejiang University(浙江大学)
Instructional Prompt Optimization for Few-Shot LLM-Based Recommendations on Cold-Start Users
Cullen College of Engineering(卡伦工程学院);McKelvey School of Engineering(麦凯维工程学院);University of Houston(休斯顿大学);Washington University in St. Louis(圣路易斯华盛顿大学);Arizona State University(亚利桑那州立大学);Indiana University Bloomington(印第安纳大学伯明顿分校)
Toward General Instruction-Following Alignment for Retrieval-Augmented Generation
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院)
A Hybrid Supervised-LLM Pipeline for Actionable Suggestion Mining in Unstructured Customer Reviews
Department of Computer Science & Information Systems, Birla Institute of Technology and Science, Pilani, India(印度比拉理工学院计算机科学与信息系统系);Birdeye Inc.(Birdeye公司)
EditCaption: Human-Refined SFT and HAE-DPO for Image Editing Instruction Synthesis
Peking University(北京大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Tsinghua University(清华大学);Beihang University(北京航空航天大学);Xiaohongshu Inc.(小红书公司)
Merging Triggers, Breaking Backdoors: Defensive Poisoning for Instruction-Tuned Language Models
Graduate School of Artificial Intelligence, POSTECH, Republic of Korea(POSTECH人工智能研究生院,韩国);Department of Computer Science and Engineering, POSTECH, Republic of Korea(POSTECH计算机科学与工程系,韩国)
VSLLaVA: a pipeline of large multimodal foundation model for industrial vibration signal analysis
State Key Laboratory of Tribology, Department of Mechanical Engineering, Tsinghua University(摩擦学国家重点实验室,清华大学机械工程系);Department of Statistics and Data Science, Yale University(耶鲁大学统计与数据科学系)
Biology-Instructions: A Dataset and Benchmark for Multi-Omics Sequence Understanding Capability of Large Language Models
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);University of Science and Technology of China(中国科学技术大学);University of Sydney(悉尼大学);University of Toronto(多伦多大学);Chinese University of Hong Kong(香港中文大学);Shanghai Jiao Tong University(上海交通大学);Fudan University(复旦大学);Shanghai Innovation Institute(上海创新研究院)
Agentic AI for Gravitational Wave Data Analysis: A Head-to-Head Comparison of Coding Agents Executing a Matched Filter Pipeline on Einstein Telescope Simulated Data