Graph Databases (Graph DB) find extensive application across diverse domains such as finance, social networks, and medicine. Yet, the translation of Natural Language (NL) into the Graph Query Language (GQL), referred to as NL2GQL, poses significant challenges owing to its intricate and specialized nature. Some approaches have sought to utilize Large Language Models (LLMs) to address analogous tasks like text2SQL. Nonetheless, in the realm of NL2GQL tasks tailored to a particular domain, the absence of domain-specific NL-GQL data pairs adds complexity to aligning LLMs with the graph DB. To tackle this challenge, we present a well-defined pipeline. Initially, we utilize ChatGPT to generate NL-GQL data pairs, leveraging the provided graph DB with self-instruction. Subsequently, we employ the generated data to fine-tune LLMs, ensuring alignment between LLMs and the graph DB. Moreover, we find the importance of relevant schema in efficiently generating accurate GQLs. Thus, we introduce a method to extract relevant schema as the input context. We evaluate our method using two carefully constructed datasets derived from graph DBs in the finance and medicine domains, named FinGQL and MediGQL. Experimental results reveal that our approach significantly outperforms a set of baseline methods, with improvements of 5.90 and 6.36 absolute points on EM, and 6.00 and 7.09 absolute points on EX for FinGQL and MediGQL, respectively.
Large Language Models Meet Harry Potter: A Bilingual Dataset for Aligning Dialogue Agents with Characters
Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Hong Kong University of Science and Technology(香港科技大学);Tencent AI Lab(腾讯人工智能实验室)
Aligning LLM+PDDL Symbolic Plans with Human Objective Specifications through Evolutionary Algorithm Guidance
College of Engineering and Computer Science, University of Central Florida(中央佛罗里达大学工程与计算机科学学院);Robotics Institute, Carnegie Mellon University(卡内基梅隆大学机器人研究所)
Synergistic Weak-Strong Collaboration by Aligning Preferences
Microsoft Research(微软研究院);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);Nanyang Technological University(南洋理工大学)
Aligning Large Language Models from Self-Reference AI Feedback with one General Principle
School of Computer Science, Fudan University(复旦大学计算机科学学院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);The University of Sydney(悉尼大学);Nanyang Technological University(南洋理工大学)
提出自参考 AI 反馈框架,让 Llama2-Chat 依据通用原则、自我批评与自一致性生成高质量偏好数据,显著提升强化学习对齐效果。
X-Instruction: Aligning Language Model in Low-resource Languages with Self-curated Cross-lingual Instructions
State Key Laboratory of Multimodal Artificial Intelligence Systems(多模态人工智能系统国家重点实验室);Institute of Automation, CAS(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Peking University(北京大学)
Uncovering and Aligning Anomalous Attention Heads to Defend Against NLP Backdoor Attacks
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);State Key Laboratory of Cyberspace Security Defense(网络空间安全防御国家重点实验室);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院)
Aligning LLM Uncertainty with Human Disagreement in Subjectivity Analysis
School of Computer Science and Technology, Dalian University of Technology, China(大连理工大学计算机科学与技术学院);Tencent(腾讯);Peking University(北京大学);Tongji University(同济大学)
Aligning LLMs with Graph Neural Solvers for Combinatorial Optimization
National Yang Ming Chiao Tung University(国立阳明交通大学);Eindhoven University of Technology(埃因霍温理工大学);Centre for Frontier AI Research, A*STAR(前沿人工智能研究中心,新加坡科技研究局);Huazhong University of Science and Technology(华中科技大学);National University of Singapore(新加坡国立大学)
Efficiently Aligning Draft Models via Parameter- and Data-Efficient Adaptation
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University(中国教育部多媒体可信感知与高效计算重点实验室,厦门大学);Shanghai Innovation Institute(上海创新研究院);Institute of Artificial Intelligence (TeleAI), China Telecom(中国电信人工智能研究所(TeleAI));University of Science and Technology of China (USTC)(中国科学技术大学)
Aligning Language Model Benchmarks with Pairwise Preferences
School of Data Science, University of Virginia(弗吉尼亚大学数据科学学院);Imperial College London(伦敦帝国理工学院);Thomson Reuters Foundational Research(汤姆森路透基础研究);Department of Electrical Engineering and Computer Science, UC Berkeley and UCSF(伯克利大学电气工程与计算机科学系及旧金山大学)
Aligning Cross-Lingual Entities with Multi-Aspect Information
University of Waterloo(滑铁卢大学);Singapore University of Technology and Design(新加坡科技设计大学);Peking University(北京大学);Beijing Institute of Big Data Research(北京大数据研究院)