Thinking Differently for Mixed Reality ↗
Microsoft case study on sketching, prototyping and adapting the mixed reality design process.
Paper library
Explore papers by life-cycle stage, research theme, year and venue.
| Year | Venue | Title | Key insight | Links |
|---|---|---|---|---|
| 2026 | NDSS | From Perception to Protection: A Developer-Centered Study of Security and Privacy Threats in Extended Reality (XR) | Studies XR developers' threat awareness and mitigation practices to guide developer-centered security support. | |
| 2026 | Automated Software Engineering | Harnessing large language models for virtual reality exploration testing: a case study | Evaluates LLM entity detection, feature descriptions and spatial reasoning for black-box VR exploration testing. | |
| 2026 | IEEE Transactions on Networking | Vetting Privacy Policies in Virtual Reality Platforms With Longitudinal Analysis | Tracks VR platform privacy policies over time to analyze policy quality and longitudinal changes. | |
| 2026 | ICSE | XRFix: Exploring Performance Bug Repair of Extended Reality Applications with Large Language Models | Introduces XRFix to generate and validate performance-bug repairs for XR applications with LLMs. | |
| 2025 | ASE Workshops | A Test Automation Framework for User Interaction in Extended Reality Applications | Introduces INTENXION APIs to simulate compositional XR interactions and assert expected outcomes. | |
| 2025 | IEEE TSE | An Empirical Study on Meta Virtual Reality Applications: Security and Privacy Perspectives | Combines static, third-party-library, privacy-policy and user-review analysis to audit Meta VR applications. | |
| 2025 | USENIX Security | AUTOVR: Automated UI Exploration for Detecting Sensitive Data Flow Exposures in Virtual Reality Apps | Introduces AUTOVR to explore Unity VR interfaces and expose sensitive data flows through hidden events. | |
| 2025 | IDE @ ICSE | Code Refactoring in Virtual Reality | Explores code refactoring inside VR through spatial program visualization and controller interactions. | |
| 2025 | CHI | CreepyCoCreator? Investigating AI Representation Modes for 3D Object Co-Creation in Virtual Reality | Studies how embodied AI representation shapes engagement, ownership and partnership in VR object co-creation. | |
| 2025 | CHI | Dreamcrafter: Immersive Editing of 3D Radiance Fields Through Flexible, Generative Inputs and Outputs | Unifies direct manipulation and generative inputs for iterative editing of immersive 3D radiance fields. | |
| 2025 | CHI | Exploring the Design Space of Privacy-Driven Adaptation Techniques for Future Augmented Reality Interfaces | Explores interface adaptation techniques that respond to privacy needs in AR. | |
| 2025 | ISSTA | Extended Reality Cybersickness Assessment via User Review Analysis | Introduces XRCare to assess cybersickness through LLM-driven analysis of XR app reviews. | |
| 2025 | UIST | GaussianShopVR: Facilitating Immersive 3D Authoring Using Gaussian Splatting in VR | Supports immersive editing and authoring of 3D Gaussian splatting content in VR. | |
| 2025 | UIST | ImaginateAR: AI-Assisted In-Situ Authoring in Augmented Reality | Combines scene understanding, generated 3D assets and speech interaction for in-situ AR authoring. | |
| 2025 | CCS | PipID: Light-Pupillary Response Based User Authentication for Virtual Reality | Uses light-induced pupillary responses to authenticate users within VR headsets. | |
| 2025 | USENIX Security | Principled and Automated Approach for Investigating AR/VR Attacks | Builds AR/VR-aware provenance graphs to investigate attacks and reconstruct their causes and impacts. | |
| 2025 | UIST Adjunct | RealityCrafter: User-guided Editable 3D Scene Generation from a Single Image in Mixed Reality | Generates editable mixed reality scenes from one image with user guidance. | |
| 2025 | CHI | RemapVR: An Immersive Authoring Tool for Rapid Prototyping of Remapped Interaction in VR | Provides an immersive authoring tool for prototyping and inspecting remapped VR interactions. | |
| 2025 | EASE | SecCityVR: Visualization and Collaborative Exploration of Software Vulnerabilities in Virtual Reality | Uses a collaborative VR city visualization to explore software vulnerabilities and their relationships. | |
| 2025 | USENIX Security | Shadowed Realities: An Investigation of UI Attacks in WebXR | Analyzes WebXR UI attacks and measures how dark designs influence immersive user behavior. | |
| 2025 | USENIX Security | SoK: Come Together – Unifying Security, Information Theory, and Cognition for a Mixed Reality Deception Attack Ontology & Analysis Framework | Unifies security, information theory and cognition in an ontology and analysis framework for MR deception attacks. | |
| 2025 | CCS | Virtual Reality, Real Problems: A Longitudinal Security Analysis of VR Firmware | Tracks VR firmware evolution to identify security weaknesses and the persistence of vulnerable components. | |
| 2025 | ICSE Companion | VReqST: A Requirement Specification Tool for Virtual Reality Software Products | Provides a requirements specification tool tailored to VR software products. | |
| 2025 | ASE | VRExplorer: A Model-based Approach for Semi-Automated Testing of Virtual Reality Scenes | Models entities, actions and tasks to guide navigation and diverse interactions during VR testing. | |
| 2025 | ASE | VRTestSniffer: Test Smell Detector for Virtual Reality (VR) Software Projects | Detects VR-specific test smells using syntax, control-flow and data-flow analysis of Unity tests. | |
| 2024 | INTETAIN | A Novel Approach to 3D Storyboarding | Creates storyboards from 3D scenes, actor actions, camera settings and generated scene descriptions. | |
| 2024 | ICSE | An Empirical Study on Oculus Virtual Reality Applications: Security and Privacy Perspectives | Combines application analysis and privacy-policy inspection to assess security and privacy in Oculus VR apps. | |
| 2024 | Multimedia Tools and Applications | Content format and quality of experience in virtual reality | Examines how VR content formats influence the quality of immersive viewing experiences. | |
| 2024 | ACM IMWUT | EStatiG: Wearable Haptic Feedback with Multi-Phalanx Electrostatic Brake for Enhanced Object Perception in VR | Uses a multi-phalanx electrostatic brake to provide wearable haptic feedback for perceiving virtual objects. | |
| 2024 | ACM IMWUT | Examining Psychological Conflict-Handling Strategies for Highly Automated Vehicles to Resolve Legal User-Vehicle Conflicts | Studies persuasive conflict-handling strategies in a VR driving simulator for highly automated vehicles. | |
| 2024 | Heritage Science | Gamification of virtual museum curation: a case study of Chinese bronze wares | Combines scanned bronze artifacts, immersive museum scenes and games to support cultural learning. | |
| 2024 | arXiv | Grounded GUI Understanding for Vision Based Spatial Intelligent Agent: Exemplified by Virtual Reality Apps | Introduces Orienter to ground context-sensitive interactable GUI elements in VR scenes with multimodal models. | |
| 2024 | ACM IMWUT | HapticPilot: Authoring In-situ Hand Posture-Adaptive Vibrotactile Feedback for Virtual Reality | Supports authoring hand-posture-adaptive vibrotactile feedback for VR interactions. | |
| 2024 | Applied Sciences | Impact of Latency on QoE, Performance, and Collaboration in Interactive Multi-User Virtual Reality | Studies how network latency affects experience, task performance and collaboration in multi-user VR. | |
| 2024 | arXiv | Inception Attacks: Immersive Hijacking in Virtual Reality Systems | Demonstrates immersive hijacking by trapping users inside an application that impersonates the VR system interface. | |
| 2024 | FSE | Less Cybersickness, Please: Demystifying and Detecting Stereoscopic Visual Inconsistencies in Virtual Reality Apps | Introduces StereoID to detect stereoscopic visual inconsistencies from rendered left- and right-eye images. | |
| 2024 | MODELS | M2AR: A Web-based Modeling Environment for the Augmented Reality Workflow Modeling Language | Provides a web modeling environment for specifying AR application workflows. | |
| 2024 | ACM TOSEM | RE Methods for Virtual Reality Software Product Development: A Mapping Study | Maps requirements engineering methods used in VR software product development. | |
| 2024 | USENIX Security | That doesn’t go there: attacks on shared state in Multi-User augmented reality applications | Shows how manipulated shared state compromises multi-user AR interactions and virtual content. | |
| 2024 | CCS | The Big Brother’s New Playground: Unmasking the Illusion of Privacy in Web Metaverses from a Malicious User’s Perspective | Exploits browser-side metaverse objects to study surveillance, tracking and privacy leakage by malicious users. | |
| 2024 | ISSTA | Towards Automatic Oracle Prediction for AR Testing: Assessing Virtual Object Placement Quality under Real-World Scenes | Combines scene metadata and learned image analysis to detect imprecise AR object placements. | |
| 2024 | IEEE Security & Privacy | Understanding Privacy in Virtual Reality Classrooms: A Contextual Integrity Perspective | Analyzes information flows in VR classrooms through contextual integrity and context-dependent privacy expectations. | |
| 2024 | ASE Workshops | Utilizing Generative AI for VR Exploration Testing: A Case Study | Studies generative AI for identifying test entities and spatial features from VR field-of-view images. | |
| 2024 | CCS | VPVet: Vetting Privacy Policies of Virtual Reality Apps | Introduces VPVet to analyze VR privacy policies for collection granularity, minimization and statement consistency. | |
| 2024 | USENIX Security | When the User Is Inside the User Interface: An Empirical Study of UI Security Properties in Augmented Reality | Examines AR UI security properties through platform measurements and proof-of-concept interface attacks. | |
| 2023 | USENIX Security | A peek into the metaverse: detecting 3D model clones in mobile games | Detects static and animated 3D model clones in Unity mobile games through normalized asset comparison. | |
| 2023 | IEEE Communications Surveys & Tutorials | A Survey on Metaverse: Fundamentals, Security, and Privacy | Surveys metaverse foundations alongside security and privacy threats, protections and research challenges. | |
| 2023 | Social Sciences & Humanities Open | Analyzing augmented reality (AR) and virtual reality (VR) recent development in education | Reviews recent AR and VR developments and their educational applications. | |
| 2023 | The Web Conference | Demystifying Mobile Extended Reality in Web Browsers: How Far Can We Go? | Benchmarks mobile web XR frameworks to connect loading and frame-rate bottlenecks with implementation choices. | |
| 2023 | USENIX Security | Erebus: Access Control for Augmented Reality Systems | Introduces Erebus for fine-grained, context-aware access control over AR sensing data. | |
| 2023 | PoPETs | Exploring the Privacy Risks of Adversarial VR Game Design | Uses adversarial VR game design to investigate sensitive information exposed through gameplay and movement. | |
| 2023 | USENIX Security | It’s all in your head(set): side-channel attacks on AR/VR systems | Demonstrates malware-driven side channels that infer AR/VR gestures, voice commands and virtual keystrokes. | |
| 2023 | ISEC | Requirements Elicitation for Virtual Reality Products - A Mapping Study | Maps techniques and practices for eliciting requirements of VR products. | |
| 2023 | ISSTA | Virtual Reality (VR) Automated Testing in the Wild: A Case Study on Unity-Based VR Applications | Characterizes automated testing practices and test categories across open-source Unity VR applications. | |
| 2023 | ASE | VRGuide: Efficient Testing of Virtual Reality Scenes via Dynamic Cut Coverage | Uses dynamic cut coverage to guide camera movement and improve exploration of VR scenes. | |
| 2022 | IEEE VR | A Keylogging Inference Attack on Air-Tapping Keyboards in Virtual Environments | Reconstructs air-tapped keyboard input from observable hand-motion patterns in virtual environments. | |
| 2022 | ASE | A Role Based Model Template for Specifying Virtual Reality Software | Introduces a role-based metamodel for specifying the core elements of VR software systems. | |
| 2022 | ASE | A Study of User Privacy in Android Mobile AR Apps | Examines user privacy practices and data handling in Android mobile AR applications. | |
| 2022 | ICECAA | Analysis of Virtual Reality and Augmented Reality SDK’s and Game Engines: A Comparison | Compares VR and AR SDKs and game engines for application development. | |
| 2022 | arXiv | Analyzing Performance Issues of Virtual Reality Applications | Derives Unreal Engine performance bug patterns and detects performance bugs in configuration files and C++ code. | |
| 2022 | IEEE Transactions on Games | Beyond Genre: Classifying Virtual Reality Experiences | Classifies VR experiences beyond conventional game genres to support platform discovery and comparison. | |
| 2022 | ASE | DyTRec: A Dynamic Testing Recommendation tool for Unity-based Virtual Reality Software | Recommends dynamic test types by analyzing Unity APIs and their use in VR source code. | |
| 2022 | Frontiers in Virtual Reality | Effects of simulated augmented reality cueing in a virtual navigation task | Evaluates AR-style navigation cues through spatial learning, cognitive load and situational awareness in VR. | |
| 2022 | CHI | Elements of XR Prototyping: Characterizing the Role and Use of Prototypes in Augmented and Virtual Reality Design | Characterizes how prototypes support design work across AR and VR projects. | |
| 2022 | ACM TOPS | Hidden in Plain Sight: Exploring Privacy Risks of Mobile Augmented Reality Applications | Examines hidden operations in mobile AR and develops defenses against privacy-invasive interactions. | |
| 2022 | IEEE VR | HoloLogger: Keystroke Inference on Mixed Reality Head Mounted Displays | Introduces HoloLogger to infer virtual keystrokes on mixed-reality head-mounted displays. | |
| 2022 | IEEE TDSC | Modeling and Defense of Social Virtual Reality Attacks Inducing Cybersickness | Models attacks that induce cybersickness in social VR and evaluates defenses with attack-fault trees. | |
| 2022 | USENIX Security | OVRseen: Auditing Network Traffic and Privacy Policies in Oculus VR | Audits Oculus VR network traffic against privacy policies to examine data collection and disclosure. | |
| 2022 | USENIX Security | Playing Without Paying: Detecting Vulnerable Payment Verification in Native Binaries of Unity Mobile Games | Analyzes native Unity game binaries to detect vulnerable in-app payment verification. | |
| 2022 | ASE | PredART: Towards automatic oracle prediction of object placements in augmented reality testing | Predicts human judgments of virtual object placement to automate AR usability oracles. | |
| 2022 | IEEE VR Workshops | Reality Check of Metaverse: A First Look at Commercial Social Virtual Reality Platforms | Measures commercial social VR networking to characterize multimedia delivery, protocol use and bandwidth demands. | |
| 2022 | IEEE MetroXRAINE | Security and privacy evaluation of popular augmented and virtual reality technologies | Evaluates authentication, user profiling and access control in popular AR/VR technologies. | |
| 2022 | arXiv | Security of Virtual Reality Authentication Methods in Metaverse: An Overview | Compares knowledge-based, biometric and multimodal authentication methods for VR environments and metaverse access. | |
| 2022 | ACM PACMHCI (EICS) | Software Engineering for Augmented Reality - A Research Agenda | Reviews software engineering for AR and develops a research agenda for its methods and tools. | |
| 2022 | Emerging Advancements for Virtual and Augmented Reality in Healthcare | Virtual Reality in Healthcare: A Survey | Surveys VR applications in therapy, rehabilitation and medical education. | |
| 2022 | ISMAR Adjunct | VR4HcRE: Virtual Reality Platform for Human-centric Requirements Elicitation | Provides a VR platform for human-centered requirements elicitation. | |
| 2022 | ICSE Companion | VRTest: An extensible framework for automatic testing of virtual reality scenes | Automates VR scene exploration through camera control and random or greedy interaction strategies. | |
| 2022 | IEEE Network | Will Metaverse Be NextG Internet? Vision, Hype, and Reality | Compares commercial metaverse platforms to connect network performance with deployment requirements and future infrastructure. | |
| 2021 | IEEE Communications Surveys & Tutorials | A Survey on Mobile Augmented Reality With 5G Mobile Edge Computing: Architectures, Applications, and Technical Aspects | Surveys mobile AR architectures, applications and technical challenges enabled by 5G mobile edge computing. | |
| 2021 | USENIX Security | AdCube: WebVR Ad Fraud and Practical Confinement of Third-Party Ads | Exposes WebVR advertising fraud and designs confinement mechanisms for third-party immersive advertisements. | |
| 2021 | ICPC | Automatic Extraction of Code Dependency in Virtual Reality Software | Extracts code dependencies from VR software to support program understanding. | |
| 2021 | CHI | Current practices, challenges, and design implications for collaborative AR/VR application development | Interviews AR/VR professionals to identify development roles, collaboration challenges and tool needs. | |
| 2021 | Advances in Engineering Software | Distributed Microscopic Traffic Simulation with Human-in-the-Loop Enabled by Virtual Reality Technologies | Integrates VR human participation with distributed microscopic traffic simulation. | |
| 2021 | ICSE | How Developers Optimize Virtual Reality Applications: A Study of Optimization Commits in Open Source Unity Projects | Classifies real-world Unity VR optimizations across graphics, rendering and memory management. | |
| 2021 | Mindtrek | Immersive Video Sketching: Low-Fidelity Extended Reality Prototyping for Everyone | Uses immersive video sketching to create accessible, low-fidelity XR experience prototypes. | |
| 2021 | CCS Poster | POSTER: ReAvatar: Virtual Reality De-anonymization Attack Through Correlating Movement Signatures | Correlates movement signatures across VR sessions to study user de-anonymization. | |
| 2021 | VRST | Research and Practice Recommendations for Mixed Reality Design – Different Perspectives from the Community | Collects community perspectives to derive mixed reality design and research recommendations. | |
| 2021 | IEEE VR | VR-Spy: A Side-Channel Attack on Virtual Key-Logging in VR Headsets | Demonstrates a side-channel attack that recovers virtual keyboard input from VR headsets. | |
| 2020 | CVPR | 3D Photography Using Context-Aware Layered Depth Inpainting | Converts RGB-D images into layered 3D photos through context-aware color and depth inpainting. | |
| 2020 | ICST | Agent-based testing of extended reality systems | Combines autonomous cognitive test agents with emotion modeling to assess XR behavior and user experience. | |
| 2020 | ProQuest Dissertations and Theses | An Empirical Analysis of Unity Performance Bugs | Analyzes Unity performance fixes to connect source-code changes with prefab and asset modifications. | |
| 2020 | ISSRE | An Exploratory Study of Bugs in Extended Reality Applications on the Web | Builds a WebXR bug taxonomy covering device incompatibility, interaction handling and application failures. | |
| 2020 | IEEE VR | ARCHIE: A user-focused framework for testing augmented reality applications in the wild | Connects user feedback with runtime telemetry to diagnose AR performance and usability problems. | |
| 2020 | ISCV | ARKit and ARCore in serve to augmented reality | Examines ARKit and ARCore as platforms for building augmented reality applications. | |
| 2020 | MSR | Detecting Video Game-Specific Bad Smells in Unity Projects | Introduces UnityLinter to detect game-specific performance, maintainability and behavioral smells. | |
| 2020 | Virtual Reality | Effects of steering locomotion and teleporting on cybersickness and presence in HMD-based virtual reality | Compares steering and teleportation locomotion through cybersickness and presence measurements. | |
| 2020 | HORA | Modern Virtual Reality Headsets | Reviews modern VR headsets and their characteristics for immersive interaction. | |
| 2020 | NDSS | OcuLock: Exploring human visual system for authentication in virtual reality head-mounted display | Uses human visual-system responses for biometric authentication in VR head-mounted displays. | |
| 2020 | CHI | VRSketchIn: Exploring the Design Space of Pen and Tablet Interaction for 3D Sketching in Virtual Reality | Explores pen-and-tablet interaction techniques for 3D sketching in VR. | |
| 2020 | CHI | WalkingVibe: Reducing Virtual Reality Sickness and Improving Realism while Walking in VR using Unobtrusive Head-mounted Vibrotactile Feedback | Studies head-mounted vibrotactile feedback for reducing sickness and improving walking realism in VR. | |
| 2019 | CHI | 360proto: Making Interactive Virtual Reality & Augmented Reality Prototypes from Paper | Turns paper sketches into interactive VR and AR prototypes for rapid experience validation. | |
| 2019 | International Journal of Emerging Technologies in Learning | Augmented Reality and Virtual Reality in Education. Myth or Reality? | Discusses AR and VR adoption in education and the opportunities for immersive learning. | |
| 2019 | USENIX Security | Secure Multi-User Content Sharing for Augmented Reality Applications | Defines secure multi-user AR content sharing with permissions grounded in physical and virtual context. | |
| 2019 | CHI EA | What You Sketch Is What You Get: Quick and Easy Augmented Reality Prototyping with PintAR | Lets designers sketch with a digital pen and interact with the resulting AR prototypes. | |
| 2018 | IEEE CIG | A virtual agent toolkit for serious games developers | Provides the FAtiMA toolkit for authoring virtual agents with emotional and social behavior. | |
| 2018 | Software Testing, Verification and Reliability | An automated functional testing approach for virtual reality applications | Generates functional test requirements and data from semiformal specifications of VR behavior. | |
| 2018 | IEEE Security and Privacy Workshops | Forensic Analysis of Immersive Virtual Reality Social Applications: A Primary Account | Examines forensic artifacts of immersive social VR applications to reconstruct user activity. | |
| 2018 | QRS | The State of Practice on Virtual Reality (VR) Applications: An Exploratory Study on Github and Stack Overflow | Studies VR application development practices through GitHub projects and Stack Overflow discussions. | |
| 2018 | ACM PACMHCI (CSCW) | UMI3D: A Unity3D Toolbox to Support CSCW Systems Properties in Generic 3D User Interfaces | Offers a Unity toolbox for generic 3D interfaces that support collaborative work. | |
| 2017 | Experimental Brain Research | The virtual reality head-mounted display Oculus Rift induces motion sickness and is sexist in its effects | Measures motion sickness and postural responses during Oculus Rift gameplay. | |
| 2017 | AVR | Virtual reality system for training in automotive mechanics | Builds a VR automotive mechanics training system around practical maintenance tasks. | |
| 2016 | Virtual Reality | Review on cybersickness in applications and visual displays | Reviews cybersickness factors, measurement approaches and mitigation across immersive applications and visual displays. | |
| 2012 | Personal and Ubiquitous Computing | Sketching up the World: In Situ Authoring for Mobile Augmented Reality | Enables smartphone users to sketch and create mobile AR content in its physical context. | |
| 2010 | IEEE VR | In-Place Sketching for Content Authoring in Augmented Reality Games | Explores in-place sketching as a visual language for authoring AR game content. | |
| 2002 | Applied Ergonomics | Health and safety implications of virtual reality: a review of empirical evidence | Reviews empirical evidence on health and safety effects associated with VR use. | |
| 2000 | ACM SIGCHI Bulletin | A discussion of cybersickness in virtual environments | Discusses causes, symptoms and mitigation approaches for cybersickness in virtual environments. | |
| 1995 | CHI | Virtual reality on a WIM: interactive worlds in miniature | Introduces worlds-in-miniature for viewing and manipulating a virtual environment through a small-scale representation. |
No papers match these filters.
Tools, platforms and design references discussed in the survey.
Microsoft case study on sketching, prototyping and adapting the mixed reality design process.
Meta guidance on VR design patterns for movement, interaction and comfort.
Developer documentation for vibration feedback through VR controllers.
An AI assistant integrated with Unity projects for debugging, coding and game creation.
Unity tools for AI-assisted creation and running AI models in applications.
Engine-integrated AI assistance for Unity development.
AI-assisted guidance for Unreal Engine development.
Integrates AI asset generation into Unity editing workflows.
Standard interfaces for accessing XR devices from web applications.
Reusable components and interaction building blocks for mixed-reality applications.
A foundational reference on 3D interaction, navigation, user-interface design and evaluation.