Contextual Reasoning for Scene Generation (Technical Report)
Fondazione Bruno Kessler(布鲁诺·凯斯勒基金会);Technische Universität Wien(维也纳工业大学);Bosch Center for Artificial Intelligence(博世人工智能中心)
Loris Bozzato, Thomas Eiter, Rafael Kiesel, Daria Stepanova
备注:
Technical Report for Humane-AI micro-project "Multi-Relational Contextual Reasoning for Complex Scene Generation for Autonomous Vehicle Data". 23 pages, 6 figures
We present a continuation to our previous work, in which we developed the MR-CKR framework to reason with knowledge overriding across contexts organized in multi-relational hierarchies. Reasoning is realized via ASP with algebraic measures, allowing for flexible definitions of preferences. In this paper, we show how to apply our theoretical work to real autonomous-vehicle scene data. Goal of this work is to apply MR-CKR to the problem of generating challenging scenes for autonomous vehicle learning. In practice, most of the scene data for AV learning models common situations, thus it might be difficult to capture cases where a particular situation occurs (e.g. partial occlusions of a crossing pedestrian). The MR-CKR model allows for data organization exploiting the multi-dimensionality of such data (e.g., temporal and spatial). Reasoning over multiple contexts enables the verification and configuration of scenes, using the combination of different scene ontologies. We describe a framework for semantically guided data generation, based on a combination of MR-CKR and Algebraic Measures. The framework is implemented in a proof-of-concept prototype exemplifying some cases of scene generation.
Contextual Scene Augmentation and Synthesis via GSACNet
FHL Vive Center for Enhanced Reality, University of California, Berkeley(加州大学伯克利分校FHL Vive增强现实中心);XR Lab, Department of Architecture, University of California, Berkeley(加州大学伯克利分校建筑系XR实验室)
GuardianBench: A Same-Scene Instruction-Contrastive Benchmark for Latent Contextual Risk in Embodied AI
Shandong University(山东大学);National University of Singapore(新加坡国立大学);Nanjing University of Aeronautics and Astronautics(南京航空航天大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Xiaomi Corporation(小米公司)
When Pigs Fly: Contextual Reasoning in Synthetic and Natural Scenes
ETH Zürich(苏黎世联邦理工学院);Children’s Hospital, Harvard Medical School(哈佛医学院儿童医院);Center for Brains, Minds and Machines(脑、心智与机器中心);Harvard College, Harvard University(哈佛大学哈佛学院);School of Engineering and Applied Sciences, Harvard University(哈佛大学工程与应用科学学院)
Beyond the Parameters: A Technical Survey of Contextual Enrichment in Large Language Models: From In-Context Prompting to Causal Retrieval-Augmented Generation
Learning to See the Elephant in the Room: Self-Supervised Context Reasoning in Humans and AI
College of Computing and Data Science, Nanyang Technological University(计算与数据科学学院,南洋理工大学);CFAR and I2R, Agency for Science, Technology and Research(CFAR和I2R,科技研究局);Boston Children’s Hospital, Harvard Medical School(哈佛医学院儿童医院)
MTMCS-Bench: Evaluating Contextual Safety of Multimodal Large Language Models in Multi-Turn Dialogues
University of Notre Dame(诺丁汉大学);University of California, Los Angeles(加州大学洛杉矶分校);Georgia Institute of Technology(佐治亚理工学院);University of Montreal(蒙特利尔大学)
Two-Stream Interactive Joint Learning of Scene Parsing and Geometric Vision Tasks
College of Electronic and Information Engineering, Tongji University(同济大学电子信息学院);Shanghai Research Institute for Intelligent Autonomous Systems, Tongji University(同济大学智能自主系统研究所);College of Computer Science and Technology, Tongji University(同济大学计算机科学与技术学院);Department of Vehicle Control System and Software Development, NIO(蔚来汽车车辆控制系统与软件开发部门);Department of Automotive Engineering, Jilin University(吉林大学汽车工程学院);Key Laboratory of Embedded System and Service Computing (Ministry of Education), Tongji University(同济大学嵌入式系统与服务计算重点实验室);College of Electronic and Information Engineering, Shanghai Institute of Intelligent Science and Technology(上海智能科学与技术研究院电子信息学院);Shanghai Key Laboratory of Intelligent Autonomous Systems(上海智能自主系统重点实验室)
What Does Evaluation of Explainable Artificial Intelligence Actually Tell Us? A Case for Compositional and Contextual Validation of XAI Building Blocks
The University of Texas at Austin(德克萨斯大学奥斯汀分校);University of Tennessee, Knoxville(田纳西大学基洛纳分校);University of South Carolina(南卡罗来纳大学);Arizona State University(亚利桑那州立大学);University of Canterbury(坎特伯雷大学);Texas A&M University(德克萨斯A&M大学);University of Wisconsin-Madison(威斯康星大学麦迪逊分校)