Designing high-quality educational questions is a challenging and time-consuming task. In this work, we propose a novel approach that utilizes prompt-based techniques to generate descriptive and reasoning-based questions. However, current question-answering (QA) datasets are inadequate for conducting our experiments on prompt-based question generation (QG) in an educational setting. Therefore, we curate a new QG dataset called EduProbe for school-level subjects, by leveraging the rich content of NCERT textbooks. We carefully annotate this dataset as quadruples of 1) Context: a segment upon which the question is formed; 2) Long Prompt: a long textual cue for the question (i.e., a longer sequence of words or phrases, covering the main theme of the context); 3) Short Prompt: a short textual cue for the question (i.e., a condensed representation of the key information or focus of the context); 4) Question: a deep question that aligns with the context and is coherent with the prompts. We investigate several prompt-based QG methods by fine-tuning pre-trained transformer-based large language models (LLMs), namely PEGASUS, T5, MBART, and BART. Moreover, we explore the performance of two general-purpose pre-trained LLMs such as Text-Davinci-003 and GPT-3.5-Turbo without any further training. By performing automatic evaluation, we show that T5 (with long prompt) outperforms all other models, but still falls short of the human baseline. Under human evaluation criteria, TextDavinci-003 usually shows better results than other models under various prompt settings. Even in the case of human evaluation criteria, QG models mostly fall short of the human baseline. Our code and dataset are available at: https://github.com/my625/PromptQG
StraGo: Harnessing Strategic Guidance for Prompt Optimization
Institute of Software, CAS(中国科学院软件研究所);University of Chinese Academy of Sciences(中国科学院大学);Microsoft(微软公司);Institute of Computing Technology, CAS(中国科学院计算技术研究所)
An Evaluation of the Pedagogical Soundness and Usability of AI-Generated Lesson Plans Across Different Models and Prompt Frameworks in High-School Physics
Harnessing non-adversarial robustness in large language models
Applied AI Institute, Moscow, Russia(莫斯科应用人工智能研究所);King's College London, London, UK(伦敦国王学院);International Joint Laboratory of AI for Industry, QUST, Qingdao, China(工业人工智能联合实验室)
Proactive Adversarial Defense: Harnessing Prompt Tuning in Vision-Language Models to Detect Unseen Backdoored Images
University of West Florida(西佛罗里达大学);Florida Institute For Human and Machine Cognition (IHMC)(佛罗里达人机认知研究所);Center for Cybersecurity, University of West Florida(西佛罗里达大学网络安全中心)
Steering Language Generation: Harnessing Contrastive Expert Guidance and Negative Prompting for Coherent and Diverse Synthetic Data Generation
Mathematical Sciences Institute, Australian National University(澳大利亚国立大学数学科学研究所);Research School of Astronomy & Astrophysics, Australian National University(澳大利亚国立大学天文与天体物理研究学院);School of Computing, Australian National University(澳大利亚国立大学计算学院);Department of Astronomy, The Ohio State University(俄亥俄州立大学天文学系)
Review-LLM: Harnessing Large Language Models for Personalized Review Generation
School of New Media Communication, Tianjin University(天津大学新媒体与传播学院);Du Xiaoman Financial(度小满金融);College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部)
Harnessing Multi-Role Capabilities of Large Language Models for Open-Domain Question Answering
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Nankai University(南开大学);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Moqi, Inc.(墨奇科技);King Abdullah University of Science and Technology(阿卜杜拉国王科技大学);University of Electronic Science and Technology of China(电子科技大学)
Harnessing LLMs for Automated Video Content Analysis: An Exploratory Workflow of Short Videos on Depression
The University of Texas at Austin(德克萨斯大学奥斯汀分校);Institute of High Performance Computing (IHPC), A*STAR(高性能计算研究所(A*STAR));Pennsylvania State University(宾夕法尼亚州立大学);Clark University(克拉克大学);Columbia University(哥伦比亚大学)
Self-Prompting Large Language Models for Zero-Shot Open-Domain QA
Shanghai Jiao Tong University(上海交通大学);SJTU-Paris Elite Institute of Technology, Shanghai Jiao Tong University(上海交通大学巴黎卓越工程师学院);School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院)
Harnessing Large Language Models for Knowledge Graph Question Answering via Adaptive Multi-Aspect Retrieval-Augmentation
University of Science and Technology of China(中国科学技术大学);City University of Hong Kong(香港城市大学);Jarvis Research Center(贾维斯研究中心);Tencent YouTu Lab(腾讯优图实验室);Peking University(北京大学)
Harnessing Multimodal Large Language Models for Multimodal Sequential Recommendation
Rutgers University(罗格斯大学);University of Science and Technology of China(中国科学技术大学);University of Pennsylvania(宾夕法尼亚大学);Bytedance Inc.(字节跳动公司);Georgia Institute of Technology(佐治亚理工学院);University of Pittsburgh(匹兹堡大学);The Hong Kong University of Science and Technology(香港科技大学)
Universal Abstraction: Harnessing Frontier Models to Structure Real-World Data at Scale
Microsoft Research(微软研究院);Johns Hopkins University School of Medicine(约翰霍普金斯大学医学院);Providence Portland Medical Center(普罗维德波特医疗中心);Earle A. Chiles Research Institute(埃勒·A·奇尔斯研究所);Providence Research Network(普罗维德研究网络);Providence Genomics(普罗维德基因组学);The Oregon Clinic(俄勒冈诊所)
Prompt engineering paradigms for medical applications: scoping review and recommendations for better practices
Geneva University Hospitals(日内瓦大学医院);University of Geneva(日内瓦大学);Université Paris-Saclay(巴黎萨克雷大学);CNRS(法国国家科学研究中心);Sorbonne Université(索邦大学);INSERM(法国国家健康与医学研究院);Université Sorbonne Paris-Nord(索邦巴黎北大学)
L-TUNING: Synchronized Label Tuning for Prompt and Prefix in LLMs
Stevens Institute of Technology(史蒂文斯理工学院);Hajee Mohammad Danesh Science & Technology University(哈吉·穆罕默德·达内什科学技术大学);Noakhali Science & Technology University(诺阿卡利科学技术大学);Amazon(亚马逊)