Semantic parsing is a technique aimed at constructing a structured representation of the meaning of a natural-language question. Recent advancements in few-shot language models trained on code have demonstrated superior performance in generating these representations compared to traditional unimodal language models, which are trained on downstream tasks. Despite these advancements, existing fine-tuned neural semantic parsers are susceptible to adversarial attacks on natural-language inputs. While it has been established that the robustness of smaller semantic parsers can be enhanced through adversarial training, this approach is not feasible for large language models in real-world scenarios, as it requires both substantial computational resources and expensive human annotation on in-domain semantic parsing data. This paper presents the first empirical study on the adversarial robustness of a large prompt-based language model of code, \codex. Our results demonstrate that the state-of-the-art (SOTA) code-language models are vulnerable to carefully crafted adversarial examples. To address this challenge, we propose methods for improving robustness without the need for significant amounts of labeled data or heavy computational resources.
kNN-ICL: Compositional Task-Oriented Parsing Generalization with Nearest Neighbor In-Context Learning
University of Illinois Chicago(伊利诺伊大学芝加哥分校);Salesforce Research(赛富时研究院);Huazhong University of Science and Technology(华中科技大学);Columbia University(哥伦比亚大学);The Hong Kong Polytechnic University(香港理工大学);State University of New York at Binghamton(纽约州立大学宾汉姆顿分校)
Rethinking Semantic Parsing for Large Language Models: Enhancing LLM Performance with Semantic Hints
National Key Laboratory for Multimedia Information Processing, Peking University(北京大学多媒体信息处理国家重点实验室);School of Software and Microelectronics, Peking University(北京大学软件与微电子学院);Tsinghua University(清华大学)
Towards a Mathematics Formalisation Assistant using Large Language Models
Microsoft Research(微软研究院);Indian Institute of Science(印度科学学院);London School of Geometry and Number Theory(伦敦几何与数论学院);Indian Institute of Science Education and Research(印度科学教育与研究院)
Knots: A Large-Scale Multi-Agent Enhanced Expert-Annotated Dataset and LLM Prompt Optimization for NOTAM Semantic Parsing
Beijing University of Posts and Telecommunications(北京邮电大学);Beihang University(北航);State Key Laboratory of CNS/ATM(国家空管流量管理技术实验室);Aviation Data Communication Corporation(航空数据通信公司)
Arabic Morphosyntactic Tagging and Dependency Parsing with Large Language Models
Computational Approaches to Modeling Language Lab(语言建模方法计算实验室);New York University Abu Dhabi(纽约大学阿布扎克分校);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
A System for Name and Address Parsing with Large Language Models
Center for Entity Resolution and Information Quality (ERIQ) - University of Arkansas - Little Rock, Arkansas, Little Rock, USA(实体解析与信息质量中心(ERIQ)- 亚拉荷马州立大学-小岩城,阿肯色州,小岩城,美国)
OmniParser V2: Structured-Points-of-Thought for Unified Visual Text Parsing and Its Generality to Multimodal Large Language Models
School of Information Science and Engineering, East China University of Science and Technology(东华大学信息科学与工程学院);School of Artificial Intelligence and Automation, Huazhong University of Science and Technology(华中科技大学人工智能与自动化学院);School of Software Engineering, Huazhong University of Science and Technology(华中科技大学软件工程学院);School of Electronic Information and Communications, Huazhong University of Science and Technology(华中科技大学电子信息与通信学院);Alibaba Group(阿里巴巴集团)
Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLs
The University of Hong Kong(香港大学);DAMO Academy, Alibaba Group(阿里巴巴集团达摩院);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));MIT CSAIL(麻省理工学院计算机科学与人工智能实验室);Tsinghua University(清华大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Shanghai AI Laboratory(上海人工智能实验室)
CienaLLM: Generative Climate-Impact Extraction from News Articles with Autoregressive LLMs
Worcester Polytechnic Institute(沃斯特理工学院);Aragon Institute of Engineering Research(阿拉贡工程研究院);Pyrenean Institute of Ecology (IPE-CSIC)(比利牛斯生态研究院(IPE-CSIC))
llmNER: (Zero|Few)-Shot Named Entity Recognition, Exploiting the Power of Large Language Models
University of Chile(智利大学);Millennium Institute for Foundational Research on Data(数据基础研究千年研究所);Catholic University of Chile(智利天主教大学);Faculty of Physical and Mathematical Sciences, University of Chile(智利大学物理与数学学院)
本文提出 llmNER 库,通过简化提示构建与结果解析,支持基于大型语言模型的零样本和少样本命名实体识别,并在两个 NER 任务上验证其灵活性与有效性。
GesGPT: Speech Gesture Synthesis With Text Parsing from ChatGPT
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Beijing University of Posts and Telecommunications(北京邮电大学);Beijing Engineering Research Center of Mixed Reality and Advanced Display(北京混合现实与先进显示工程研究中心);Institute of Technology, Beijing, China(北京理工大学)
The University of Hong Kong(香港大学);University of Washington(华盛顿大学);University of Waterloo(滑铁卢大学);Salesforce Research(赛富时研究院);Yale University(耶鲁大学);Shanghai Jiao Tong University(上海交通大学);Allen Institute for AI(艾伦人工智能研究所);Meta AI