Responsible Immersive Support for Firefighter Retreat under Unreliable Spatial and Communication Information
Firefighters retreating from a building operate under extreme time pressure, poor visibility and high mental strain - precisely when positioning and communication can become unreliable. The University of Twente is researching how immersive systems can make this uncertainty visible and understandable, so that digital cues support decision-making without creating false confidence or adding to the user's mental load.
Involved organisations
More projects from CIIIC Start
Discover other projects within this funding scheme
ImmersiveValidMovement: Validatie van consumenten-XR voor verantwoorde fysiotherapie oefeningen
In physiotherapy, there is growing interest in using immersive experiences (IX), such as XR serious games, to motivate patients and help them perform exercises correctly. To this end, VerseUS Games has developed XR exercise formats that use the built-in sensors of consumer XR headsets (such as Meta Quest and Pico) to track patients' movements. However, it remains unclear how reliable and valid this data is for assessing clinically relevant joint angles, particularly in patients with complex shoulder complaints. ImmersiveValidMovement therefore focuses primarily on "new methodological approaches to measuring usability and effectiveness of IX". We are developing and validating methods to derive head, neck, shoulder and elbow movements from XR sensor data (headset and hand controllers) and to assess their reliability. We are not developing new IX software or hardware, but working with existing VerseUS games and consumer XR headsets. The focus is on measurement methods, analysis techniques and responsible use. In work package 1 (the first three months), we carry out the preparatory work. Together with physiotherapists (FlevoFysiotherapie), we specify which joint angles and variables are relevant for correctly performing the prescribed exercise (position, velocity, acceleration; within a global coordinate system and/or relative to body segments). VerseUS Games provides the XR environment and handles the technical work of exporting time-synchronised data collected from the headset. UMCG oversees the research protocol, arranges ethical approval, and provides the research labs needed to carry out the study. In work package 2, we then carry out the validation study, comparing the XR measurements against the gold standard (such as Vicon or Optotrak) available at UMCG. Reliability and validity are determined using methods including ICC, Bland–Altman plots, correlations and RMSE. Based on this research, UMCG will deliver a report on the validity and reliability of the VerseUS XR exercises, as measured by the sensors in commercial headsets. This report will form the basis for further development.
Van ethische dilemma’s naar toekomstdenken: immersieve technologie als katalysator voor inclusieve besluitvorming
Technological innovations bring urgent ethical questions with them. These questions call not only for judgements about what is desirable, but also for anticipating possible futures and the values at the heart of them. A key barrier to inclusive decision-making is the lack of future consciousness and ethical capacity. Many people struggle to imagine the implications of technology. Non-users in particular experience a knowledge gap and don't feel entitled to a voice in the conversation, even though they are the ones who bear the impact of that technology. This problem is compounded by the fact that the future of a technology is often shaped by a handful of companies with business models that fuel polarisation and digital dependency, while environmental impact and social costs are externalised. This increases the risk of one-sided decision-making. The project applies ethics-by-design by actively and inclusively involving city residents in exploring the ethical dilemmas raised by emerging technology. We treat social friction as a source of innovation and link technology development to values such as safety, power and inclusion. The research focuses on expanding people's capacity for imagination through two 'Moral Labs': 1 - A traditional presentation (image and text), followed by a discussion; 2 - An immersive presentation in Virtual Reality (VR), followed by a discussion. In both scenarios, multiple participants will discuss their positions and the moral dilemmas together. The VR intervention uses multiplayer functionality to create social presence. By running a moderated split test across these two scenarios, this research measures the effectiveness of an immersive experience against a traditional presentation. The richness of both conversations is analysed using Ahvenharju's (2018) five dimensions of future consciousness and the LIWC tool (Boyd, 2022). The results offer insight into how immersive technology can contribute to inclusive ethical dialogue and democratic decision-making.
Staging collective VR experiences
Scalable — and therefore affordable — IX onboarding and social IX, as part of an optimal user experience, remain key challenges for the IX community. How can museums onboard visitors more effectively so that more of them can experience a functional IX? And how can they create a shared VR experience in the process? That's what the Amsterdam University of Applied Sciences will be researching, together with a museum and an IX developer.
Enhancing Authentic Learning in Primary Care: Real-Time Immersive Experiences in Family Medicine Clerkships
Medical education also has high expectations of IX applications, especially given the staff shortages in healthcare. Students need IX to deliver a suitable and effective learning experience. That's why Maastricht University, together with two GP practices, is researching how IX can let students experience real patient consultations digitally and live.
Gedeelde inzichten in interactionele en impactvolle XR
XR learning environments - such as VR simulations and interactive training scenarios - are increasingly used in health care, communication, safety and public services. They help professionals practise difficult conversations, analyse complex situations and experiment safely with new behaviour. Despite this growth, it is not yet sufficiently clear which didactic and design choices make these environments effective, inclusive and responsible. The project Gedeelde inzichten in interactionele en impactvolle XR investigates how immersive learning environments can be designed to support learning, reflection and meaningful professional practice. The focus is not on the technology, but on the experience of users: how they navigate, interpret, process feedback and gain insight into digital decision-making processes. Together with XR creators and partners from the health care and public sectors, we analyse existing applications - such as VR-Gedeelde Smart and the BEP environments - and gather experiences from designers, health care professionals, communication advisers and environmental analysts. We build on existing, long-used XR learning environments and a proven collaboration, so that we do not need to develop new technology and can devote resources fully to research, analysis and validation. By linking their practical knowledge to insights from conversation analysis, user experience design, adoption theories and smart education, we develop and validate a set of generic design and didactic principles for effective and responsible XR learning environments. These principles address, among other things, clarity, interaction, reflection, accessibility and value-conscious design. The results yield scalable knowledge for the broad XR sector: from design studios and public organisations to educators working with immersive technology. In doing so, the project contributes to a more responsible and inclusive use of XR in society and offers concrete tools for digital decision-making and complex communication.
GausScape: Evaluating 3D Gaussian Splatting for Spatial Understanding in Greenhouse Environments
In greenhouse horticulture, operators need to monitor optimal growing conditions for crops. Wageningen University & Research (WUR), together with 2 SMEs, is investigating the following question: what desired and undesired effects does a specific 3D technique (Gaussian Splatting) have on operators' work processes, perception and decision-making, compared to the current technique? The insights from this research may also prove relevant to other sectors.