Large language models (LLMs) have achieved remarkable performance in language understanding and generation tasks by leveraging vast amounts of online texts. Unlike conventional models, LLMs can adapt to new domains through prompt engineering without the need for retraining, making them suitable for various business functions, such as strategic planning, project implementation, and data-driven decision-making. However, their limitations in terms of bias, contextual understanding, and sensitivity to prompts raise concerns about their readiness for real-world applications. This paper thoroughly examines the usefulness and readiness of LLMs for business processes. The limitations and capacities of LLMs are evaluated through experiments conducted on four accessible LLMs using real-world data. The findings have significant implications for organizations seeking to leverage generative AI and provide valuable insights into future research directions. To the best of our knowledge, this represents the first quantified study of LLMs applied to core business operations and challenges.
The Bitter Lesson of Diffusion Language Models for Agentic Workflows: A Comprehensive Reality Check
Southeast University(东南大学);Alibaba(阿里巴巴);Southeast University Shenzhen Research Institute(东南大学深圳研究院);College of Computing and Data Science at Nanyang Technological University(南洋理工大学计算机与数据科学学院)
Sentiment Analysis in the Era of Large Language Models: A Reality Check
DAMO Academy, Alibaba Group(阿里巴巴集团达摩院);Nanyang Technological University(南洋理工大学);University of Illinois at Chicago(伊利诺伊大学芝加哥分校);The Chinese University of Hong Kong(香港中文大学)