May I ask you a question? A large-scale experiment examining the effectiveness of a multimodal, conversational digital dietitian on nutritional knowledge in virtual reality
Dietitians play a key role in healthcare, but a shortage of well-trained professionals is looming. Wageningen University & Research is therefore investigating an immersive digital dietitian: in VR, patients learn about portion sizes, energy density and food preparation by preparing virtual meals themselves. The central question is whether the virtual dietitian's conversational abilities and non-verbal communication - asking questions, gestures, facial expressions - further strengthen the learning effect.
Involved organisations
More projects from CIIIC Start
Discover other projects within this funding scheme
Responsible Immersive Support for Firefighter Retreat under Unreliable Spatial and Communication Information
Firefighters retreating from a building operate under extreme time pressure, poor visibility and high mental strain - precisely when positioning and communication can become unreliable. The University of Twente is researching how immersive systems can make this uncertainty visible and understandable, so that digital cues support decision-making without creating false confidence or adding to the user's mental load.
To what degree do interactive agents enhance the willingness-to-adopt IX?
IX environments have the potential to transform how people train physical, interactive skills - from surgery to team sports. Vrije Universiteit Amsterdam, working with movement scientists, IX developers and a user-experience designer, is investigating whether interactive avatars that physically respond to a user's movements can make XR training more engaging and effective. The test case is a football training exercise in which participants learn to make themselves available for a pass - with and without virtual defenders that move in response.
ImmersiveValidMovement: Validatie van consumenten-XR voor verantwoorde fysiotherapie oefeningen
In physiotherapy, there is growing interest in using immersive experiences (IX), such as XR serious games, to motivate patients and help them perform exercises correctly. To this end, VerseUS Games has developed XR exercise formats that use the built-in sensors of consumer XR headsets (such as Meta Quest and Pico) to track patients' movements. However, it remains unclear how reliable and valid this data is for assessing clinically relevant joint angles, particularly in patients with complex shoulder complaints. ImmersiveValidMovement therefore focuses primarily on "new methodological approaches to measuring usability and effectiveness of IX". We are developing and validating methods to derive head, neck, shoulder and elbow movements from XR sensor data (headset and hand controllers) and to assess their reliability. We are not developing new IX software or hardware, but working with existing VerseUS games and consumer XR headsets. The focus is on measurement methods, analysis techniques and responsible use. In work package 1 (the first three months), we carry out the preparatory work. Together with physiotherapists (FlevoFysiotherapie), we specify which joint angles and variables are relevant for correctly performing the prescribed exercise (position, velocity, acceleration; within a global coordinate system and/or relative to body segments). VerseUS Games provides the XR environment and handles the technical work of exporting time-synchronised data collected from the headset. UMCG oversees the research protocol, arranges ethical approval, and provides the research labs needed to carry out the study. In work package 2, we then carry out the validation study, comparing the XR measurements against the gold standard (such as Vicon or Optotrak) available at UMCG. Reliability and validity are determined using methods including ICC, Bland–Altman plots, correlations and RMSE. Based on this research, UMCG will deliver a report on the validity and reliability of the VerseUS XR exercises, as measured by the sensors in commercial headsets. This report will form the basis for further development.
Experience the future, embrace the change: The potential of IX to create and leverage teachable moments and improve lifestyle behaviors in osteoarthritis patients
A healthy lifestyle is crucial for many patients, but medical advice alone rarely leads to lasting behavioural change. Tilburg University is investigating whether immersive experiences can create and reinforce so-called teachable moments in osteoarthritis patients: moments in which a patient becomes acutely aware of the consequences of an unhealthy lifestyle. Through IX, patients experience the long-term effects of their behaviour in an emotionally compelling way, sparking the motivation to live more healthily.
Van ethische dilemma’s naar toekomstdenken: immersieve technologie als katalysator voor inclusieve besluitvorming
Technological innovations bring urgent ethical questions with them. These questions call not only for judgements about what is desirable, but also for anticipating possible futures and the values at the heart of them. A key barrier to inclusive decision-making is the lack of future consciousness and ethical capacity. Many people struggle to imagine the implications of technology. Non-users in particular experience a knowledge gap and don't feel entitled to a voice in the conversation, even though they are the ones who bear the impact of that technology. This problem is compounded by the fact that the future of a technology is often shaped by a handful of companies with business models that fuel polarisation and digital dependency, while environmental impact and social costs are externalised. This increases the risk of one-sided decision-making. The project applies ethics-by-design by actively and inclusively involving city residents in exploring the ethical dilemmas raised by emerging technology. We treat social friction as a source of innovation and link technology development to values such as safety, power and inclusion. The research focuses on expanding people's capacity for imagination through two 'Moral Labs': 1 - A traditional presentation (image and text), followed by a discussion; 2 - An immersive presentation in Virtual Reality (VR), followed by a discussion. In both scenarios, multiple participants will discuss their positions and the moral dilemmas together. The VR intervention uses multiplayer functionality to create social presence. By running a moderated split test across these two scenarios, this research measures the effectiveness of an immersive experience against a traditional presentation. The richness of both conversations is analysed using Ahvenharju's (2018) five dimensions of future consciousness and the LIWC tool (Boyd, 2022). The results offer insight into how immersive technology can contribute to inclusive ethical dialogue and democratic decision-making.
Gedeelde inzichten in interactionele en impactvolle XR
XR learning environments - such as VR simulations and interactive training scenarios - are increasingly used in health care, communication, safety and public services. They help professionals practise difficult conversations, analyse complex situations and experiment safely with new behaviour. Despite this growth, it is not yet sufficiently clear which didactic and design choices make these environments effective, inclusive and responsible. The project Gedeelde inzichten in interactionele en impactvolle XR investigates how immersive learning environments can be designed to support learning, reflection and meaningful professional practice. The focus is not on the technology, but on the experience of users: how they navigate, interpret, process feedback and gain insight into digital decision-making processes. Together with XR creators and partners from the health care and public sectors, we analyse existing applications - such as VR-Gedeelde Smart and the BEP environments - and gather experiences from designers, health care professionals, communication advisers and environmental analysts. We build on existing, long-used XR learning environments and a proven collaboration, so that we do not need to develop new technology and can devote resources fully to research, analysis and validation. By linking their practical knowledge to insights from conversation analysis, user experience design, adoption theories and smart education, we develop and validate a set of generic design and didactic principles for effective and responsible XR learning environments. These principles address, among other things, clarity, interaction, reflection, accessibility and value-conscious design. The results yield scalable knowledge for the broad XR sector: from design studios and public organisations to educators working with immersive technology. In doing so, the project contributes to a more responsible and inclusive use of XR in society and offers concrete tools for digital decision-making and complex communication.