In recent years, the rapid advancement of large-scale pre-trained language models based on transformer architectures has revolutionized natural language processing tasks. Among these, ChatGPT has gained widespread popularity, demonstrating human-level conversational abilities and attracting over 100 million monthly users by late 2022. Concurrently, Baidu's commercial deployment of the Ernie Wenxin model has significantly enhanced marketing effectiveness through AI-driven technologies. This paper focuses on optimizing high-performance inference for Ernie models, emphasizing GPU acceleration and leveraging the Paddle inference framework. We employ techniques such as Faster Transformer for efficient model processing, embedding layer pruning to reduce computational overhead, and FP16 half-precision inference for enhanced computational efficiency. Additionally, our approach integrates efficient data handling strategies using multi-process parallel processing to minimize latency. Experimental results demonstrate that our optimized solution achieves up to an 8.96x improvement in inference speed compared to standard methods, while maintaining competitive performance.
Cooperation, Competition, and Maliciousness: LLM-Stakeholders Interactive Negotiation
Microsoft(微软);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心(DFKI));CISPA Helmholtz Center for Information Security(CISPA亥姆霍兹信息安全中心)
Intelligent Mobile AI-Generated Content Services via Interactive Prompt Engineering and Dynamic Service Provisioning
College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院);Western University(西安大略大学);College of Information and Communication Engineering, Sungkyunkwan University(成均馆大学信息与通信工程学院);University of Hong Kong(香港大学)
Can LLMs Generate Reliable Test Case Generators? A Study on Competition-Level Programming Problems
Shanghai Qi Zhi Institute(上海启智研究院);ShanghaiTech University(上海科技大学);Wuhan University(武汉大学);Fuzhou University(福州大学);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);Tsinghua University(清华大学);Huazhong University of Science and Technology(华中科技大学);Nanjing University(南京大学);Beijing University of Posts and Telecommunications(北京邮电大学);Peking University(北京大学)