An Interdisciplinary Perspective on Evaluation and Experimental Design for Visual Text Analytics: Position Paper
Linköping University(林雪平大学);Linnaeus University(林奈大学);University of Toronto(多伦多大学);Vrije Universiteit Amsterdam(阿姆斯特丹自由大学);Lund University(隆德大学);Uppsala University(乌普萨拉大学);LMU Munich(慕尼黑大学)
Kostiantyn Kucher, Nicole Sultanum, Angel Daza, Vasiliki Simaki, Maria Skeppstedt, Barbara Plank, Jean-Daniel Fekete, Narges Mahyar
备注:
Published in Proceedings of the 2022 IEEE Workshop on Evaluation and Beyond - Methodological Approaches to Visualization (BELIV '22). ACM 2012 CCS: Human-centered computing, Visualization, Visualization design and evaluation methods
Appropriate evaluation and experimental design are fundamental for empirical sciences, particularly in data-driven fields. Due to the successes in computational modeling of languages, for instance, research outcomes are having an increasingly immediate impact on end users. As the gap in adoption by end users decreases, the need increases to ensure that tools and models developed by the research communities and practitioners are reliable, trustworthy, and supportive of the users in their goals. In this position paper, we focus on the issues of evaluating visual text analytics approaches. We take an interdisciplinary perspective from the visualization and natural language processing communities, as we argue that the design and validation of visual text analytics include concerns beyond computational or visual/interactive methods on their own. We identify four key groups of challenges for evaluating visual text analytics approaches (data ambiguity, experimental design, user trust, and "big picture" concerns) and provide suggestions for research opportunities from an interdisciplinary perspective.
Sign Language Recognition, Generation, and Translation: An Interdisciplinary Perspective
Microsoft Research(微软研究院);Microsoft(微软公司);Rochester Institute of Technology(罗切斯特理工学院);Gallaudet University(加劳德特大学);LIMSI(LIMSI实验室);CNRS(法国国家科学研究中心);Paris-Saclay University(巴黎萨克雷大学);Boston University(波士顿大学);University of Maryland(马里兰大学);Leiden University(莱顿大学)
What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Research
Saarland University(萨尔大学);Technical University Dortmund(多特蒙德工业大学);Institute of Intelligent Software(智能软件研究所)
Mapping the Scholarship of Dark Pattern Regulation: A Systematic Review of Concepts, Regulatory Paradigms, and Solutions from an Interdisciplinary Perspective
University of Glasgow(格拉斯哥大学);Stanford University(斯坦福大学)
FAIR for AI: An interdisciplinary and international community building perspective
Argonne National Laboratory(阿贡国家实验室);University of Chicago(芝加哥大学);Duke University(杜克大学);Lawrence Berkeley National Laboratory(劳伦斯伯克利国家实验室);University of California Berkeley(加州大学伯克利分校);University of California San Diego(加州大学圣地亚哥分校);Lund University(隆德大学);The University of Manchester(曼彻斯特大学)
"We'll have to see how it works": An interview study to understand collaborative practices in interdisciplinary artificial intelligence and healthcare research
William Harvey Research Institute(威廉·哈维研究所);Queen Mary University of London(伦敦玛丽女王大学);Wolfson Institute of Population Health(沃尔夫森人口健康研究所)
Aïra: Rethinking AI Research Assistants for Interdisciplinary Science
Pratt School of Engineering, Duke University(杜克大学普雷特工程学院);Nicholas School of the Environment, Duke University(杜克大学尼古拉斯环境学院);Information Sciences School, University of Maryland, Baltimore(马里兰大学巴尔的摩分校信息科学学院);Department of Sociology, Duke University(杜克大学社会学系);Department of Philosophy and Kenan Institute for Ethics, Duke University(杜克大学哲学系和凯南伦理学研究所)
Small Data and Process in Data Visualization: The Radical Translations Case Study
本文使用合作项目激进的翻译作为案例研究,检查一些理论的角度,通知采用和批评的数据可视化在数字人文与应用的例子在上下文中。它展示了如何在King's Digital Lab项目生命周期中使用数据可视化来促进项目跨学科团队内的协作数据探索-支持数据整理和清理和/或指导设计过程-以及团队外部用户的数据分析。围绕弥合小规模和/或大规模数据集所采用的方法之间的差距的理论问题,从功能的角度来解决,参考不断发展的数据建模和软件开发生命周期的方法和工作流程。虽然锚定的具体背景下的项目正在审查,一些确定的权衡有认识论的价值超出了具体的案例研究迭代及其设计解决方案。