Dominic Kao, Christos Mousas, Alejandra J. Magana, D. Fox Harrell, Rabindra Ratan, Edward F. Melcer, Brett Sherrick, Paul Parsons, Dmitri A. Gusev
In this article we describe Hack.VR, an object-oriented programming game in virtual reality. Hack.VR uses a VR programming language in which nodes represent functions and node connections represent data flow. Using this programming framework, players reprogram VR objects such as elevators, robots, and switches. Hack.VR has been designed to be highly interactable both physically and semantically.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
继续探索
We use an immersive virtual reality environment to explore the intricate social cues that underlie non-verbal communication involved in a pedestrian's crossing decision. We "hack" non-verbal communication between pedestrian and vehicle by engineering a set of 15 vehicle trajectories, some of which follow social conventions and some that break them. By subverting social expectations of vehicle behavior we show that pedestrians may use vehicle kinematics to infer social intentions and not merely as the state of a moving object. We investigate human behavior in this virtual world by conducting a …
In this paper, we review the background of physical reality, virtual reality, and some traditional mixed forms of them. Based on the current knowledge, we propose a new unified concept called symmetrical reality to describe the physical and virtual world in a unified perspective. Under the framework of symmetrical reality, the traditional virtual reality, augmented reality, inverse virtual reality, and inverse augmented reality can be interpreted using a unified presentation. We analyze the characteristics of symmetrical reality from two different observation locations (i.e., from the physical…
We propose a framework called inverse augmented reality (IAR) which describes the scenario that a virtual agent living in the virtual world can observe both virtual objects and real objects. This is different from the traditional augmented reality. The traditional virtual reality, mixed reality and augmented reality are all generated for humans, i.e., they are human-centered frameworks. On the contrary, the proposed inverse augmented reality is a virtual agent-centered framework, which represents and analyzes the reality from a virtual agent's perspective. In this paper, we elaborate the frame…
When establishing a visual connection between a virtual reality user and an augmented reality user, it is important to consider whether the augmented reality user faces a surplus of information. Augmented reality, compared to virtual reality, involves two, not one, planes of information: the physical and the virtual. We propose SelectVisAR, a selective visualisation system of virtual environments in augmented reality. Our system enables an augmented reality spectator to perceive a co-located virtual reality user in the context of four distinct visualisation conditions: Interactive, Proximity, …
This essay, written in 1998 by an active participant in both virtual reality development and the virtual reality definition debate, discusses the definition of the phrase "Virtual Reality" (VR). I start with history from a personal perspective, concentrating on the debate between the "Virtual Reality" and "Virtual Environment" labels in the late 1980's and early 1990's. Definitions of VR based on specific technologies are shown to be unsatisfactory. I propose the following definition of VR, based on the striking effects of a good VR system: "Virtual Reality is the use of computer technology to…
The Virtual Reality Koinos Method: Analysis of Symmetrical Dyadic Collaboration in Virtual Reality from the perspective of communication models
本文提出Koinos方法，通过交流模型分析虚拟现实中的对称双人协作，提出方程预测和管理共在感。
Virtualization of Classical Reality: Limits and Possibilities in Physical Simulation
本研究围绕经典现实虚拟化展开，通过构建含方法、结果、讨论的理论框架，解答感官能否感知另类现实、能否模拟非物理定律现实的问题，为VR的边界认知与多领域应用提供支撑。
RealityDrop: A Multimodal Mixed Reality Framework to Manipulate Virtual Content between Cross-system Displays
提出RealityDrop多模态混合现实框架，以MR为控制中心，通过凝视和手势交互及定制解释器，实现跨系统显示设备间虚拟内容的操控、传输与展示。
This paper proposes the concept of "live-action virtual reality games" as a new genre of digital games based on an innovative combination of live-action, mixed-reality, context-awareness, and interaction paradigms that comprise tangible objects, context-aware input devices, and embedded/embodied interactions. Live-action virtual reality games are "live-action games" because a player physically acts out (using his/her real body and senses) his/her "avatar" (his/her virtual representation) in the game stage, which is the mixed-reality environment where the game happens. The game stage is a kind …
The contributions of this paper are: (1) a taxonomy of the "Realities" (Virtual, Augmented, Mixed, Mediated, etc.), and (2) some new kinds of "reality" that come from nature itself, i.e. that expand our notion beyond synthetic realities to include also phenomenological realities. VR (Virtual Reality) replaces the real world with a simulated experience (virtual world). AR (Augmented Reality) allows a virtual world to be experienced while also experiencing the real world at the same time. Mixed Reality provides blends that interpolate between real and virtual worlds in various proportions, along…
A driving simulator was created using commercially available 3 degree of freedom motion platform (DOFreality H3) and a virtual reality head-mounted display (Oculus CV1). Using virtual reality headset as the visual simulation system with low-cost moving base platform allowed us to create a high-fidelity driving simulator with minimal cost and space. A custom motion cueing algorithm was used to minimize visuo-vestibular conflict, and simulator sickness questionnaire (SSQ) was used to measure progression of simulator sickness over time while driving on a highway environment.
Navigating spaces is an embodied experience. Examples can vary from rescue workers trying to save people from natural disasters; a tourist finding their way to the nearest coffee shop, or a gamer solving a maze. Virtual reality allows these experiences to be simulated in a controlled virtual environment. However, virtual reality users remain anchored in the real world and the conventions by which the virtual environment is deployed influence user performance. There is currently a need to evaluate the degree of influence imposed by extrinsic factors and virtual reality hardware on its users. Tr…
Near distances are overestimated in virtual reality, and far distances are underestimated, but an explanation for these distortions remains elusive. One potential concern is that whilst the eye rotates to look at the virtual scene, the virtual cameras remain static. Could using eye-tracking to change the perspective of the virtual cameras as the eye rotates improve depth perception in virtual reality? This paper identifies 14 distinct perspective distortions that could in theory occur from keeping the virtual cameras fixed whilst the eye rotates in the context of near-eye displays. However, th…
Interactive fiction is a literary genre that is rapidly gaining popularity. In this genre, readers are able to explicitly take actions in order to guide the course of the story. With the recent popularity of narrative focused games, we propose to design and develop an interactive narrative tool for content creators. In this extended abstract, we show how we leverage this interactive medium to present a tool for interactive storytelling in virtual reality. Using a simple markup language, content creators and researchers are now able to create interactive narratives in a virtual reality environm…
Results of the 2023 Census of Beat Saber Users: Virtual Reality Gaming Population Insights and Factors Affecting Virtual Reality E-Sports Performance
该研究基于1006名Beat Saber用户的大规模调查，分析VR游戏人群的背景、健康、行为及设备特征，并探讨影响VR电子竞技表现的相关因素。
Virtual Reality enables the exploration of large information spaces. In physically constrained spaces such as airplanes or buses, controller-based or mid-air interaction in mobile Virtual Reality can be challenging. Instead, the input space on and above touch-screen enabled devices such as smartphones or tablets could be employed for Virtual Reality interaction in those spaces. In this context, we compared an above surface interaction technique with traditional 2D on-surface input for navigating large planar information spaces such as maps in a controlled user study (n = 20). We find that our …
We propose a new approach for interaction in Virtual Reality (VR) using mobile robots as proxies for haptic feedback. This approach allows VR users to have the experience of sharing and manipulating tangible physical objects with remote collaborators. Because participants do not directly observe the robotic proxies, the mapping between them and the virtual objects is not required to be direct. In this paper, we describe our implementation, various scenarios for interaction, and a preliminary user study.
This is the preprint version of our paper on ICWL2015. A virtual reality based enhanced technology for learning primary geography is proposed, which synthesizes several latest information technologies including virtual reality(VR), 3D geographical information system(GIS), 3D visualization and multimodal human-computer-interaction (HCI). The main functions of the proposed system are introduced, i.e. Buffer analysis, Overlay analysis, Space convex hull calculation, Space convex decomposition, 3D topology analysis and 3D space intersection detection. The multimodal technologies are employed in th…
Environmental citizen science frequently relies on experience-based assessment, however volunteers are not trained to make qualitative judgments. Embodied learning in virtual reality (VR) has been explored as a way to train behavior, but has not fully been considered as a way to train judgment. This preliminary research explores embodied learning in VR through the design, evaluation, and redesign of StreamBED, a water quality monitoring training environment that teaches volunteers to make qualitative assessments by exploring, assessing and comparing virtual watersheds.
Effects of Virtual Controller Representation and Virtuality on Selection Performance in Extended Reality
本研究通过实验探究MR和VR场景中控制器虚拟表示对目标获取性能的影响，发现模拟现实的控制器表示提升性能，VR与MR性能相当但用户感知有差异，需针对MR进行独特设计考量。
This workshop paper presents two proxy objects for high fidelity interaction in virtual reality (VR): a paper map and a smartphone. We showcase how our virtual paper map can increase interactivity and orientation, while our virtual smartphone extends the use of a proxy object, as it allows for actual touch input on a real phone leading to an almost infinite set of possible (inter-)actions (e.g. snapping pictures in the virtual world). Observations showed that participants were very precise in holding and interacting with both the paper map and the smartphone even though they did not see their …
Oculus rift: Virtual reality (VR) is a burgeoning field that has the inherent potential of manipulating peoples mind with a superlative 3D experience. Oculus rift is one such application that assists in achieving the same. With the fleeting enhancements in VR it now seems very feasible to provide the user with experiences that were earlier thought to be merely a dream or a nightmare.
Virtual reality offers the unique possibility to experience a virtual representation as our own body. In contrast to previous research that predominantly studied this phenomenon for humanoid avatars, our work focuses on virtual animals. In this paper, we discuss different body tracking approaches to control creatures such as spiders or bats and the respective virtual body ownership effects. Our empirical results demonstrate that virtual body ownership is also applicable for nonhumanoids and can even outperform human-like avatars in certain cases. An additional survey confirms the general inter…
Outpace Reality: A Novel Augmented-Walking Technique for Virtual Reality Games
本文提出一种基于虚拟隧道的增强行走技术，通过压缩隧道内部距离使用户以真实行走覆盖大范围虚拟场景，在避免晕屏症的同时增强身体活动并保持临场感。
Prism XR -- A Curated Exhibition Experience in Virtual Reality with Peer Annotation Features and Virtual Guides for Art and Archaeology Classes
Prism XR项目为艺术与考古教育打造VR精选展览体验，整合同伴标注与虚拟导览功能，以促进多方对话、解决虚拟空间孤立感，提升学习动机与效果及展览交互性。
This paper presents I-nteract, a cyber-physical system that enables real-time interaction with real and virtual objects in a mixed augmented reality environment to design 3D models for additive manufacturing. The system has been developed using mixed reality technologies such as HoloLens, for augmenting visual feedback, and haptic gloves, for augmenting haptic force feedback. The efficacy of the system has been demonstrated by generating 3D model using a novel scanning method to 3D print a customized orthopedic cast for human arm, by estimating spring rates of compression springs, and by simul…
We created a hand texture resource (with different skin tone versions as well as non-human hands) for use in virtual reality studies. This makes it easier to run lab and remote studies where the hand representation is matched to the participant's own skin tone. We validate that the virtual hands with our textures align with participants view of their own real hands and allow to create VR applications where participants have an increased sense of body ownership. These properties are critical for a range of VR studies, such as of immersion.
Facing the severe global dementia problem, an exploration was conducted adopting the technology of virtual reality (VR). This report lays a technical foundation for further research project "Early Detection of Dementia Using Testing Tools in VR Environment", which illustrates the process of developing a VR application using Unity 3D software on Oculus Go. This preliminary exploration is composed of three steps, including 3D virtual scene construction, VR interaction design and monitoring. The exploration was recorded to provide basic technical guidance and detailed method for subsequent resear…
Thanks to the eye-tracking sensors that are embedded in emerging consumer devices like the Vive Pro Eye, we demonstrate that it is feasible to deliver user authentication via eye movement biometrics.
Beyond the Screen: Reshaping the Workplace with Virtual and Augmented Reality
本文通过文献综述考察虚拟现实、增强现实和混合现实技术在工作场所的有效整合现状，分析已进入实际工作流程的应用，并界定决定其适用性的技术特征。
Brown Ring Experiment is a very popular test to detect the presence of Nitrate in salts commonly performed in chemical laboratories with supplies of required chemicals. Our work clears out the need for a chemical laboratory and chemicals in order to understand the experiment practically. We have used the technology of Virtual Reality to fulfill this requirement. Our research work can be extensively utilized to create virtual environments for conducting other chemical processes in a virtual environment hence, eliminating the need for a chemical laboratory. This can help students in remote areas…
We present PhyShare, a new haptic user interface based on actuated robots. Virtual reality has recently been gaining wide adoption, and an effective haptic feedback in these scenarios can strongly support user's sensory in bridging virtual and physical world. Since participants do not directly observe these robotic proxies, we investigate the multiple mappings between physical robots and virtual proxies that can utilize the resources needed to provide a well rounded VR experience. PhyShare bots can act either as directly touchable objects or invisible carriers of physical objects, depending on…
The ImmersaDesk3 -- Experiences With A Flat Panel Display for Virtual Reality
本文探讨了用于宽视野桌面VR环境的等离子显示器的设计与实现，分析了其在立体图像和跟踪方面的挑战，指出系统局限性使其暂不适用于实际应用。
In this position paper, we outline our research challenges in Affective Interactive Systems, and present recent work on visualizing avatar biosignals for social VR entertainment. We highlight considerations for how biosignals animations in social VR spaces can (falsely) indicate users' availability status.
This paper presents and analyses existing taxonomies of virtual and augmented reality and demonstrates knowledge gaps and mixed terminology which may cause confusion among educators, researchers, and developers. Several such occasions of confusion are presented. A methodology is then presented to construct a taxonomy of virtual reality and augmented reality applications based on a combination of: a faceted analysis approach for the overall design of the taxonomy; an existing taxonomy of educational objectives to derive the educational purpose; an information systems analysis to establish impor…
Application of Artificial Intelligence in Hand Gesture Recognition with Virtual Reality: Survey and Analysis of Hand Gesture Hardware Selection
本文综述了虚拟现实中手势识别硬件（控制器与头戴显示器）的优缺点及数据集，并指出未来研究方向，如噪声过滤、轻量网络、触觉反馈和眼手数据融合。
We present an IoT home network visualizer that utilizes virtual reality (VR). This prototype demonstrates the potential that VR has to aid in the understanding of home IoT networks. This is particularly important due the increased number of household devices now connected to the Internet. This prototype is able to function in a standard display or a VR headset. A prototype was developed to aid in the understanding of home IoT networks for homeowners.
Fingernail-Based Tangential Force Simulation for Enhanced Dexterous Manipulation in Virtual Reality
本研究提出一种轻量级触觉设备，通过刺激指甲两侧机械感受器模拟切向力，增强虚拟现实中的灵巧操作；初步实验显示用户微调更频繁，精度提升，有望推动VR触觉反馈发展。
GulliVR: A Walking-Oriented Technique for Navigation in Virtual Reality Games Based on Virtual Body Resizing
提出GulliVR导航技术，通过按需将玩家虚拟身体放大为巨人并按比例调整眼距，在防止晕动症的同时增强存在感并增加物理行走距离。
Virtual Reality (VR) provides immersive experiences in the virtual world, but it may reduce users' awareness of physical surroundings and cause safety concerns and psychological discomfort. Hence, there is a need of an ambient information design to increase users' situational awareness (SA) of physical elements when they are immersed in VR environment. This is challenging, since there is a tradeoff between the awareness in reality and the interference with users' experience in virtuality. In this paper, we design five representations (indexical, symbolic, and iconic with three emotions) based …
Objectives: This paper presents an up-to-date overview of research performed in the Virtual Reality (VR) environment ranging from definitions, its presence in the various fields, and existing market players and their projects in the VR technology. Further an attempt is made to gain an insight on the psychological mechanism underlying experience in using VR device. Methods: Our literature survey is based on the research articles, analysis of the projects of various companies and their findings for different areas of interest. Findings: In our literature survey we observed that the recent advanc…
Meditation, or mindfulness, is widely used to improve mental health. With the emergence of Virtual Reality technology, many studies have provided evidence that meditation with VR can bring health benefits. However, to our knowledge, there are no guidelines and comprehensive reviews in the literature on how to conduct such research in virtual reality. In order to understand the role of VR technology in meditation and future research opportunities, we conducted a systematic literature review in the IEEE and ACM databases. Our process yielded 19 eligible papers and we conducted a structured analy…
In this paper, we describe the development and operating principles of an immersive virtual reality (VR) visualisation environment that is designed around the use of consumer VR headsets in an existing wide area motion capture suite. We present two case studies in the application areas of visualisation of scientific and engineering data. Each of these case studies utilise a different render engine, namely a custom engine for one case and a commercial game engine for the other. The advantages and appropriateness of each approach are discussed along with suggestions for future work.
In recent years there has been a strong development of the concept of virtual reality (VR) which from the first video games developed in the 60s has reached the current immersive systems. VR and the consequent deception of perception pose an interesting question: is it possible to deceive the mind to the point of not being able to recognize whether the perceived reality is real or simulated? In addition to this question, another question arises spontaneously: is it possible to simulate a non-reality in which the physical laws do not apply? The answer to the first question is that it would theo…
In this paper we introduce novel Virtual Reality (VR) and Augmented Reality (AR) treatments to improve the psychological well being of patients in palliative care, based on interviews with a clinical psychologist who has successfully implemented VR assisted interventions on palliative care patients in the Hong Kong hospital system. Our VR and AR assisted interventions are adaptations of traditional palliative care therapies which simultaneously facilitate patients communication with family and friends while isolated in hospital due to physical weakness and COVID-19 related restrictions. The fi…
Vsens Reality: Blending the Virtual Sensors into XR
本文提出 Vsens Reality，利用 XR 的情境感知与直观性，将虚拟传感器作为交互式系统设计的增强工具，以提升其易用性和数据理解效能。
Bionic vision is a rapidly advancing field aimed at developing visual neuroprostheses ('bionic eyes') to restore useful vision to people who are blind. However, a major outstanding challenge is predicting what people 'see' when they use their devices. The limited field of view of current devices necessitates head movements to scan the scene, which is difficult to simulate on a computer screen. In addition, many computational models of bionic vision lack biological realism. To address these challenges, we propose to embed biologically realistic models of simulated prosthetic vision (SPV) in imm…
Situated Brushing and Linking in Virtual and Augmented Reality
本文研究了在实际物理空间中使用增强现实进行刷选和链接的技术，发现其在时间和准确性上优于虚拟现实，但效果因条件而异。
Virtual reality technology is biased. It excludes approximately 95% the world's population by being primarily designed for male, western, educated, industrial, rich, and democratic populations. This bias may be due to the lack of diversity in virtual reality researchers, research participants, developers, and end users, fueling a noninclusive research, development, and usability cycle. The objective of this paper is to highlight the minimal virtual reality research involving understudied populations with respect to dimensions of diversity, such as gender, race, culture, ethnicity, age, disabil…
Rapidly growing virtual reality (VR) technologies and techniques have gained importance over the past few years, and academics and practitioners have been searching for efficient visualizations in VR. To date, emphasis has been on the employment of game technologies. Despite the growing interest and discussion, visualization studies have lacked a common baseline in the transition period of 2D visualizations to immersive ones. To this end, the presented study aims to provide a systematic literature review that explains the state-of-the-art research and future trends on visualization in virtual …
Whole-body movements enhance the presence and enjoyment of Virtual Reality (VR) experiences. However, using large gestures is often uncomfortable and impossible in confined spaces (e.g., public transport). We introduce FingerMapper, mapping small-scale finger motions onto virtual arms and hands to enable whole-body virtual movements in VR. In a first target selection study (n=13) comparing FingerMapper to hand tracking and ray-casting, we found that FingerMapper can significantly reduce physical motions and fatigue while having a similar degree of precision. In a consecutive study (n=13), we c…
The aim of this project is the development of Virtual Reality Application in order to document one kind of Balinese cultural heritages which are Temples. The Bali Temple VR application will allow users to do the virtual tour and experience the landscape of the temples and all objects inside the temples. The application gives on-site tour guide using virtual reality that allow users experience the visualization of the Balinese culture heritages in this case are temples. The users can walk through the temples and can see the 3D objects of temples and also there is narration of every object insid…
CreepyCoCreator? Investigating AI Representation Modes for 3D Object Co-Creation in Virtual Reality
针对虚拟现实中生成式AI行为不透明导致用户协作困难的问题，通过绿野仙踪研究探究三种AI呈现模式对用户交互、满意度及所有权感的影响，为人机协同创作系统提供设计参考。
Cross-Reality Lifestyle: Integrating Physical and Virtual Lives through Multi-Platform Metaverse
本研究提出“跨现实生活方式”概念，识别放大、互补、涌现三种整合模式，并构建ACE立方体框架，为多平台元宇宙中的平台选择与应用开发提供实用指南。
Artificial Intelligence (AI), especially Neural Networks (NNs), has become increasingly popular. However, people usually treat AI as a tool, focusing on improving outcome, accuracy, and performance while paying less attention to the representation of AI itself. We present AIive, an interactive visualization of AI in Virtual Reality (VR) that brings AI "alive". AIive enables users to manipulate the parameters of NNs with virtual hands and provides auditory feedback for the real-time values of loss, accuracy, and hyperparameters. Thus, AIive contributes an artistic and intuitive way to represent…
Virtual Reality in Social Media: A New Era of Immersive Social Interactions
本研究考察VR技术与社交媒体应用的融合，指出VR可提供3D沉浸式互动体验，有望打造更具吸引力的数字社交空间，推动社交互动方式革新。
Haptic feedback in virtual reality (VR) allows users to perceive the physical properties of virtual objects (e.g., their weight and motion patterns). However, the lack of haptic sensations deteriorates users' immersion and overall experience. In this work, we designed and implemented a low-cost hardware prototype with liquid metal, VibroWeight, which can work in complementarity with commercial VR handheld controllers. VibroWeight is characterized by bimodal feedback cues in VR, driven by adaptive absolute mass (weights) and gravity shift. To our knowledge, liquid metal is used in a VR haptic d…
The CellxGene project has enabled access to single-cell data in the scientific community, providing tools for browsed-based no-code analysis of more than 500 annotated datasets. However, single-cell data requires dimensional reduction to visualize, and 2D embedding does not take full advantage of three-dimensional human spatial understanding and cognition. Compared to a 2D visualization that could potentially hide gene expression patterns, 3D Virtual Reality may enable researchers to make better use of the information contained within the datasets. For this purpose, we present \emph{Corvo}, a …
Editing and manipulating graph-based models within immersive environments is largely unexplored and certain design activities could benefit from using those technologies. For example, in the case study of architectural modelling, the 3D context of Virtual Reality naturally matches the intended output product, i.e. a 3D architectural geometry. Since both the state of the art and the state of the practice are lacking, we explore the field of VR-based interactive modelling, and provide insights as to how to implement proper interactions in that context, with broadly available devices. We conseque…
Virtual Steps: The Experience of Walking for a Lifelong Wheelchair User in Virtual Reality
本研究与一位终身使用轮椅的脊髓性肌萎缩症患者共同设计了VR行走体验，通过9天日记研究分析了所需设计元素，发现该体验提供了积极的高视角观察并伴随情感与能动感的演变，为设计更具包容性的VR体验提供了启示。
扫码添加微信好友，提出您的宝贵建议 👇
💡 备注请填写：网站反馈
发表机构由 AI 从论文文本抽取，如发现错误，欢迎反馈修正建议。