Integrated into websites, LLM-powered chatbots offer alternative means of navigation and information retrieval, leading to a shift in how users access information on the web. Yet, predominantly closed-sourced solutions limit proliferation among web hosts and suffer from a lack of transparency with regard to implementation details and energy efficiency. In this work, we propose our openly available agent Talk2X leveraging an adapted retrieval-augmented generation approach (RAG) combined with an automatically generated vector database, benefiting energy efficiency. Talk2X's architecture is generalizable to arbitrary websites offering developers a ready to use tool for integration. Using a mixed-methods approach, we evaluated Talk2X's usability by tasking users to acquire specific assets from an open science repository. Talk2X significantly improved task completion time, correctness, and user experience supporting users in quickly pinpointing specific information as compared to standard user-website interaction. Our findings contribute technical advancements to an ongoing paradigm shift of how we access information on the web.
A Statistical Framework for Ranking LLM-Based Chatbots
ICSI and Department of Statistics, University of California, Berkeley(ICSI和统计学系,加州大学伯克利分校);Department of Computer Science, University of California, Berkeley(计算机科学系,加州大学伯克利分校);ICSI, LBNL, and Department of Statistics, University of California, Berkeley(ICSI、劳伦斯伯克利国家实验室和统计学系,加州大学伯克利分校)
Building Trust in Mental Health Chatbots: Safety Metrics and LLM-Based Evaluation Tools
Sue & Bill Gross School of Nursing, University of California, Irvine(加州大学欧文分校苏与比尔·格罗斯护理学院);Department of Computer Sciences, University of California, Irvine(加州大学欧文分校计算机科学系);School of Medicine, University of California, Irvine(加州大学欧文分校医学院);Department of Psychological Science, University of California, Irvine(加州大学欧文分校心理科学系);Chicago School of Professional Psychology(芝加哥专业心理学院);HealthUnity
PsychAdapter: Adapting LLM Transformers to Reflect Traits, Personality and Mental Health
Stony Brook University(石溪大学);New York University(纽约大学);University of Melbourne(墨尔本大学);University of Texas at Dallas(德克萨斯大学达拉斯分校);University of Pennsylvania(宾夕法尼亚大学);Stanford University(斯坦福大学)
AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents
Tsinghua University(清华大学);Shanghai Jiao Tong University(上海交通大学);Westlake University(西湖大学);The University of Hong Kong(香港大学);HKUST(香港科技大学);Zhejiang University(浙江大学)
WildVis: Open Source Visualizer for Million-Scale Chat Logs in the Wild
Cornell University(康奈尔大学);Samaya AI(萨马亚人工智能公司);University of Southern California(南加利福尼亚大学);University of Washington(华盛顿大学);University of Waterloo(滑铁卢大学);Nvidia(英伟达公司)