As Large Language Models (LLMs) advance in natural language processing, there is growing interest in leveraging their capabilities to simplify software interactions. In this paper, we propose a novel system that integrates LLMs for both classifying natural language inputs into corresponding API calls and automating the creation of sample datasets tailored to specific API functions. By classifying natural language commands, our system allows users to invoke complex software functionalities through simple inputs, improving interaction efficiency and lowering the barrier to software utilization. Our dataset generation approach also enables the efficient and systematic evaluation of different LLMs in classifying API calls, offering a practical tool for developers or business owners to assess the suitability of LLMs for customized API management. We conduct experiments on several prominent LLMs using generated sample datasets for various API functions. The results show that GPT-4 achieves a high classification accuracy of 0.996, while LLaMA-3-8B performs much worse at 0.759. These findings highlight the potential of LLMs to transform API management and validate the effectiveness of our system in guiding model testing and selection across diverse applications.
Steering Language Generation: Harnessing Contrastive Expert Guidance and Negative Prompting for Coherent and Diverse Synthetic Data Generation
Mathematical Sciences Institute, Australian National University(澳大利亚国立大学数学科学研究所);Research School of Astronomy & Astrophysics, Australian National University(澳大利亚国立大学天文与天体物理研究学院);School of Computing, Australian National University(澳大利亚国立大学计算学院);Department of Astronomy, The Ohio State University(俄亥俄州立大学天文学系)
Named Entity Recognition for Address Extraction in Speech-to-Text Transcriptions Using Synthetic Data
Slovak National Supercomputing Centre(斯洛伐克国家超级计算中心);nettle, s.r.o.(nettle有限责任公司);Institute of Information Engineering, Automation, and Mathematics, Slovak University of Technology in Bratislava(布拉迪斯拉发斯洛伐克理工大学信息工程、自动化与数学研究所)
NEFMind: Parameter-Efficient Fine-Tuning of Open-Source LLMs for Telecom APIs Automation
Alto University, School of Science, Espoo, Finland(阿尔托大学科学学院,芬兰);Networked Systems Security (NSS) Group -- KTH Royal Institute of Technology, Stockholm, Sweden(网络系统安全(NSS)小组——皇家理工学院,瑞典);Ericsson, Finland(爱立信,芬兰)