arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.12003cs.HC
收藏

企业AI助手的评估与持续改进

Evaluation and Continual Improvement for an Enterprise AI Assistant

Akash V. Maharaj, Kun Qian, Uttaran Bhattacharya, Sally Fang, Horia Galatanu, Manas Garg, Rachel Hanessian, Nishant Kapoor, Ken Russell, Shivakumar Vaithyanathan, Yunyao Li

AI总结:

本文针对企业生成式AI助手开发中评估与持续改进的复杂多面问题,介绍其面临的挑战及应对方法,并分享初步结果与经验教训,助力该类系统迭代优化。

摘要:

对话式AI助手的开发是一个涉及多个组件的迭代过程。因此,这些助手的评估和持续改进是一个复杂且多方面的问题。本文介绍了在评估和改进一款正在积极开发的企业生成式AI助手时所面临的挑战,以及我们如何应对这些挑战。我们还分享了初步结果并讨论了经验教训。

英文摘要:

The development of conversational AI assistants is an iterative process with multiple components. As such, the evaluation and continual improvement of these assistants is a complex and multifaceted problem. This paper introduces the challenges in evaluating and improving a generative AI assistant for enterprises, which is under active development, and how we address these challenges. We also share preliminary results and discuss lessons learned.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑