Although large language models (LLMs) have advanced the state-of-the-art in NLP significantly, deploying them for downstream applications is still challenging due to cost, responsiveness, control, or concerns around privacy and security. As such, trainable models are still the preferred option in some cases. However, these models still require human-labeled data for optimal performance, which is expensive and time-consuming to obtain. In order to address this issue, several techniques to reduce human effort involve labeling or generating data using LLMs. Although these methods are effective for certain applications, in practice they encounter difficulties in real-world scenarios. Labeling data requires careful data selection, while generating data necessitates task-specific prompt engineering. In this paper, we propose a unified data creation pipeline that requires only a single formatting example, and which is applicable to a broad range of tasks, including traditionally problematic ones with semantically devoid label spaces. In our experiments we demonstrate that instruction-following LLMs are highly cost-effective data creators, and that models trained with these data exhibit performance better than those trained with human-labeled data (by up to 17.5%) on out-of-distribution evaluation, while maintaining comparable performance on in-distribution tasks. These results have important implications for the robustness of NLP systems deployed in the real-world.
MSP: Multi-Stage Prompting for Making Pre-trained Language Models Better Translators
Tsinghua University(清华大学);Beijing National Research Center for Information Science and Technology(北京信息科学与技术国家研究中心);Kuaishou Tech, Co.(快手科技有限公司);Institute for AI Industry Research, Tsinghua University(清华大学智能产业研究院);International Innovation Center of Tsinghua University(清华大学上海国际创新中心)
Measuring the practice of shared-decision making (OPTION12): An Investigation into Open-sourced Smaller LLMs (OS-sLLMs) for Better Privacy and Sustainability
Leiden University Medical Centre(莱顿大学医学中心);The Leiden Institute of Advanced Computer Science(莱顿高级计算机科学研究所)
Making Large Language Models Perform Better in Knowledge Graph Completion
Zhejiang University(浙江大学);Zhejiang University-Ant Group Joint Laboratory of Knowledge Graph(浙江大学-蚂蚁集团知识图谱联合实验室);Alibaba-Zhejiang University Joint Institute of Frontier Technology(阿里巴巴-浙江大学前沿技术联合研究院)
Ask more, know better: Reinforce-Learned Prompt Questions for Decision Making with Large Language Models
Institute of Automation, Chinese Academy of Science(中国科学院自动化研究所);Huawei Technologies(华为技术有限公司);Queen Mary University(玛丽女王大学);University College London(伦敦大学学院)
Making Better Use of Bilingual Information for Cross-Lingual AMR Parsing
Wangxuan Institute of Computer Technology, Peking University(北京大学王选计算机研究所);Center for Data Science, Peking University(北京大学数据科学中心);The MOE Key Laboratory of Computational Linguistics, Peking University(北京大学计算语言学教育部重点实验室)