The Use of Scent to Enhance Immersion in Virtual Reality, Streaming, and Broadcasting

Introduction

The integration of olfactory cues, or scents, into virtual reality (VR), streaming, and broadcasting environments represents a burgeoning field of research aimed at enhancing user immersion and engagement. While visual and auditory stimuli have long been the dominant forces in these media, the potential of olfaction to create more realistic and emotionally resonant experiences is increasingly recognized (Silva, 2024), (Flavin, 2020), (Brengman, 2022). This exploration delves into the current state of research, examining the methods employed, the findings obtained, and the remaining challenges in leveraging scent to deepen the immersive qualities of these technologies.

The Science of Scent and Immersion

The human sense of smell, unlike other senses, has a direct connection to the limbic system, the brain region responsible for emotions and memory (Silva, 2024). This unique neurological pathway suggests that olfactory stimuli can powerfully influence emotional responses and memory recall, making them potentially valuable tools for enhancing immersion in virtual environments. Studies have shown that olfactory stimulation can indeed increase immersion and the sense of reality in VR (, NaN), (Cowan, 2023), leading to more positive brand responses, particularly in retail settings (Cowan, 2023). However, the effectiveness of scent is not solely dependent on its presence; the congruency between the scent and the virtual environment is also crucial (Flavin, 2020). Using ill-matched scents can actually reduce the immersive experience (, NaN), highlighting the importance of careful scent selection and integration.

The impact of scent on immersion is not merely a matter of adding a pleasant aroma; it’s about creating a cohesive and believable sensory experience. This involves carefully synchronizing olfactory cues with visual and auditory stimuli to create a more holistic and believable experience (Silva, 2024), (Garca-Ruiz, 2021). For instance, in a virtual forest, the scent of pine needles might be released to complement the visual and auditory elements, enhancing the user’s sense of being present in that environment (Flavin, 2020). This concept extends beyond simple realism; the use of scent can also be strategically employed to evoke specific emotions or enhance the narrative arc of a virtual experience (Brengman, 2022).

Several studies have explored the effectiveness of incorporating scent into VR experiences. Cowan, Ketron, Kostyk, and Kristofferson (Cowan, 2023) conducted four studies using both ambient (actual scents) and imagined scents (prompted through descriptions) in various settings, including field testing and laboratory experiments. Their findings demonstrated that the presence of actual scents significantly enhanced immersion compared to their absence (Cowan, 2023). Similarly, Edwards and Sessoms (Edwards, 2013) integrated a scent delivery system into the Computer Assisted Rehabilitation Environment (CAREN), a virtual reality system used for rehabilitation. They found that the addition of olfactory stimulation significantly increased immersion and improved rehabilitation outcomes (Edwards, 2013).

However, the research is not without its inconsistencies. Svenson, Kass, and Blalock (Svenson, 2024) conducted a study examining the impact of scents on immersion, anxiety, and mood in VR. Interestingly, while the VR experience itself significantly reduced anxiety and improved mood, the addition of scents did not significantly affect memory performance or immersion levels (Svenson, 2024). This suggests that the effectiveness of scent in enhancing immersion may be context-dependent and requires further investigation.

Technological Advancements in Olfactory Delivery

The successful implementation of olfactory cues in immersive environments relies heavily on the technological capabilities of scent delivery systems. Early attempts to integrate scents into cinema, such as AromaRama and Smell-O-Vision (Spence, 2020), were hampered by technological limitations. However, recent advancements have led to the development of more sophisticated and compact olfactory displays (Javerliat, 2022), (Yang, 2022), (Niedenthal, 2022). These devices offer improvements in scent diffusion rates, control over scent intensity and blending, and compatibility with various VR headsets (Javerliat, 2022), (Yang, 2022), (Niedenthal, 2022). Some systems even utilize AI to synchronize olfactory cues with visual and auditory stimuli (Silva, 2024), allowing for more dynamic and contextually relevant scent experiences.

Nebula, an open-source olfactory display for VR headsets (Javerliat, 2022), is a prime example of this progress. Its ability to diffuse scents at different rates, combined with its affordability and open-source nature, facilitates further research and development in the field (Javerliat, 2022). Similarly, the self-powered virtual olfactory generation system developed by Yang et al. (Yang, 2022) utilizes a bionic fibrous membrane and electrostatic field accelerated evaporation for rapid and controlled scent release, enabling wireless control via mobile devices (Yang, 2022). These advancements are crucial for creating seamless and engaging olfactory experiences in VR. Another example is the graspable olfactory display developed by Niedenthal et al. (Niedenthal, 2022), which allows for control over scent magnitude and blending, and has proven to be intuitive for users (Niedenthal, 2022).

Despite these advancements, challenges remain. The limited range of available scents, the size and cost of some devices, and the potential for latency issues (Silva, 2024) continue to hinder widespread adoption. Furthermore, the lack of standardized methods for scent representation and playback (Washburn, 2004) presents a significant obstacle to the reproducibility and comparability of research findings across different studies.

Scent Integration in Different Media Contexts

The application of olfactory cues extends beyond VR, finding potential in streaming and broadcasting contexts as well. Marfil et al. (Marfil, 2022), (Marfil, NaN) explored the integration of multisensory effects, including olfactory stimuli, to enhance immersion in hybrid TV scenarios. Their findings indicated that multisensory approaches improved the perceived quality of experience (QoE) and synchronization between multimedia content and user perceptions (Marfil, 2022), (Marfil, NaN). This suggests that incorporating scent into streaming platforms could significantly enhance viewer engagement and immersion, particularly in scenarios where visual and auditory elements alone may not be sufficient to create a compelling experience.

The potential benefits of multisensory media are particularly relevant for various user groups, including those with sensory deficiencies or attention span problems (Marfil, 2022), (Marfil, NaN). By engaging multiple senses, multisensory media can foster greater social integration and provide more engaging educational programs (Marfil, 2022), (Marfil, NaN). In educational settings, the integration of olfactory stimuli has shown promise in improving memorization and information recall (Garca-Ruiz, 2021), further highlighting the potential of scent in enhancing learning experiences across different media platforms.

However, the successful implementation of scent in streaming and broadcasting requires careful consideration of technical and logistical challenges. The delivery of scents to a large audience requires scalable and reliable technology, which may pose significant engineering hurdles. Furthermore, the variability in individual olfactory perception (Persky, 2020) necessitates careful consideration of scent selection and intensity to ensure a positive and effective experience for the majority of viewers.

The Role of User Engagement and Experience

The ultimate success of scent integration in immersive media hinges on its ability to enhance user engagement and overall satisfaction. Hammami’s (Hammami, 2024) research on VR gaming highlighted the mediating role of user engagement between immersive experiences and user satisfaction. Higher levels of immersion, facilitated by interactive elements and sensory richness, lead to greater emotional connection and satisfaction (Hammami, 2024). This underscores the importance of designing VR and streaming experiences that seamlessly integrate olfactory cues with other sensory inputs to foster a holistic and engaging experience.

Several studies have examined the impact of scent on specific aspects of user experience. Brengman, Willems, and De Gauquier (Brengman, 2022) investigated the effect of sound and scent congruence in VR advertising. They found that product-scent congruence, when paired with sound, significantly enhanced customer engagement and immersion (Brengman, 2022). Conversely, incongruent scents had a negative impact, emphasizing the need for careful sensory alignment in VR environments. Andonova et al. (Andonova, 2023) explored the impact of multisensory stimulation (including scent) on learning in VR. While they found that VR combined with olfactory stimuli enhanced creativity, recall scores were highest with traditional video alone, suggesting that the effectiveness of multisensory experiences might be context-dependent (Andonova, 2023).

Xia et al. (Xia, 2024) investigated the impact of thermal and scent feedback on emotional responses in a VR evacuation experiment. While thermal feedback significantly enhanced negative emotional states and immersion, the effect of scent feedback was less pronounced (Xia, 2024). This study highlights the complexity of multisensory integration and the need for further research to understand the nuanced interplay between different sensory modalities.

Future Directions and Research Gaps

Despite the growing interest and technological advancements, several research gaps remain. The inconsistent findings regarding the impact of scent on immersion underscore the need for more rigorous and controlled studies to identify the optimal conditions for scent integration (Svenson, 2024), (Andonova, 2023). Further research is needed to explore the interplay between different sensory modalities and to develop standardized methods for scent representation and playback (Washburn, 2004). The development of more affordable, compact, and versatile olfactory displays is also crucial for wider adoption of scent technology in immersive environments (Silva, 2024).

The exploration of scent’s influence on specific user groups, such as those with sensory impairments or cognitive differences (Marfil, 2022), (Marfil, NaN), (Flynn, 2024), is another important avenue for future research. Understanding how scent interacts with other psychological and physiological factors can further optimize the design of immersive experiences (Sanchez, 2024). Finally, the ethical implications of using scent in immersive media require careful consideration (Wang, 2021). For example, the potential for scent to manipulate emotions or evoke unwanted responses needs to be addressed.

The integration of AI in scent generation and delivery systems offers promising opportunities for creating more dynamic and contextually relevant olfactory experiences (Silva, 2024). AI-powered systems could adapt scent profiles based on user preferences, emotional states, and the content being displayed (Luhaybi, 2019). This could lead to more personalized and engaging immersive experiences across various media platforms.

Furthermore, exploring the potential of scent in specific applications, such as therapeutic interventions (Silva, 2024), (Niedenthal, 2022) and educational settings (Garca-Ruiz, 2021), (Andonova, 2023), can further highlight the benefits of scent integration. The development of novel interaction paradigms, such as mid-air gestural interactions for scent release (Li, 2023), can enhance user control and engagement, leading to more immersive and interactive experiences. The use of scent in combination with other haptic and tactile feedback methods (Gougeh, 2023), (Saleme, 2019) warrants further investigation, as this combination could significantly enhance the realism and emotional impact of immersive environments.

Finally, the impact of scent on collaboration performance in virtual environments (Suh, 2024) is an area that requires more attention. Understanding how scent can influence team dynamics and communication could lead to the development of more effective collaborative VR and streaming platforms.

The use of scent to enhance immersion in virtual reality, streaming, and broadcasting environments shows considerable promise. While technological advancements have made more sophisticated scent delivery systems possible, further research is needed to fully understand the complex interplay between olfactory stimuli, other sensory inputs, and user experience. Careful consideration of scent selection, congruency, intensity, and synchronization with other media elements is crucial for creating positive and effective immersive experiences. By addressing the existing research gaps and technological challenges, the integration of scent could transform how we interact with and experience immersive media in the future. The potential for creating more realistic, emotionally resonant, and engaging experiences across various media platforms is substantial, promising a richer and more immersive future for VR, streaming, and broadcasting.

References

1. Silva, M., Sanches, I. H., Borba, J. V. B., Barros, A. C. D. A., Feitosa, F. L., Carvalho, R. M. D., Filho, A. R. G., & Andrade, C. (2024). Elevating virtual reality experiences with olfactory integration: a preliminary review. Journal of the Brazilian Computer Society. https://doi.org/10.5753/jbcs.2024.4632
2. Flavin, C., IbezSnchez, S., & Ors, C. (2020). The influence of scent on virtual reality experiences: the role of aroma-content congruence. Elsevier BV. https://doi.org/10.1016/j.jbusres.2020.09.036
3. Brengman, M., Willems, K., & Gauquier, L. D. (2022). Customer engagement in multi-sensory virtual reality advertising: the effect of sound and scent congruence. Frontiers Media. https://doi.org/10.3389/fpsyg.2022.747456
5. Cowan, K., Ketron, S., Kostyk, A., & Kristofferson, K. (2023). Can you smell the (virtual) roses? the influence of olfactory cues in virtual reality on immersion and positive brand responses. Elsevier BV. https://doi.org/10.1016/j.jretai.2023.07.004
6. Garca-Ruiz, M. .., Kapralos, B., & RebolledoMendez, G. (2021). An overview of olfactory displays in education and training. Multidisciplinary Digital Publishing Institute. https://doi.org/10.3390/mti5100064
7. Edwards, H. & Sessoms, P. (2013). Design and integration of a scent delivery system in the computer assisted rehabilitation environment (caren). None. https://doi.org/10.21236/ada618141
8. Svenson, K. A., Kass, S. J., & Blalock, L. D. (2024). Smelling what you see in virtual reality: impacts on mood, memory, and anxiety. Proceedings of the Human Factors and Ergonomics Society Annual Meeting. https://doi.org/10.1177/107118132412606669.
9. Spence, C. (2020). Scent and the cinema. SAGE Publishing. https://doi.org/10.1177/2041669520969710
10. Javerliat, C., Elst, P., Saive, A., Baert, P., & Lavou, G. (2022). Nebula: an affordable open-source and autonomous olfactory display for vr headsets. None. https://doi.org/10.1145/3562939.3565617
11. Yang, P., Shi, Y., Tao, X., Liu, Z., Li, S., Chen, X., & Wang, Z. L. (2022). Selfpowered virtual olfactory generation system based on bionic fibrous membrane and electrostatic field accelerated evaporation. Wiley. https://doi.org/10.1002/eom2.12298
12. Niedenthal, S., Fredborg, W., Lundn, P., Ehrndal, M., & Olofsson, J. (2022). A graspable olfactory display for virtual reality. Elsevier BV. https://doi.org/10.1016/j.ijhcs.2022.102928
13. Washburn, D. & Jones, L. (2004). Could olfactory displays improve data visualization?. None. https://doi.org/10.1109/MCSE.2004.66
14. Marfil, D., Boronat, F., Gonzlez, J., & Sapena, A. (2022). Integration of multisensorial effects in synchronised immersive hybrid tv scenarios. Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/access.2022.3194170
15. Marfil, D., Boronat, F., Gonzlez, J., & Sapena, A. (NaN). Integration of multisensorial effects in synchronised immersive hybrid tv scenarios. IEEE Access. https://doi.org/10.1109/access.2022.3194170
16. Persky, S. & Dolwick, A. P. (2020). Olfactory perception and presence in a virtual reality food environment. Frontiers Media. https://doi.org/10.3389/frvir.2020.571812
17. Hammami, H. (2024). Exploring the mediating role of user engagement in the relationship between immersive experiences and user satisfaction in virtual reality gaming. International Review of Management and Marketing. https://doi.org/10.32479/irmm.17343
18. Andonova, V., Reinoso-Carvalho, F., Ramirez, M. A. J., & Carrasquilla, D. (2023). Does multisensory stimulation with virtual reality (vr) and smell improve learning? an educational experience in recall and creativity. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2023.1176697
19. Xia, X., Li, N., & Zhang, J. (2024). The influence of an immersive multisensory virtual reality system with integrated thermal and scent devices on individuals emotional responses in an evacuation experiment. None. https://doi.org/10.22260/isarc2024/0071
20. Flynn, A., Brennan, A., Barry, M., Redfern, S., & Casey, D. (2024). Social connectedness and the role of virtual reality: experiences and perceptions of people living with dementia and their caregivers.. None. https://doi.org/10.1080/17483107.2024.2310262
21. Sanchez, D. R., Mcveigh-Schultz, J., Isbister, K., Tran, M., Martinez, K., Dost, M., Osborne, A., Diaz, D., Farillas, P., Lang, T., Leeds, A., Butler, G., & Ferronatto, M. (2024). Virtual reality pursuit: using individual predispositions towards vr to understand perceptions of a virtualized workplace team experience. Virtual Worlds. https://doi.org/10.3390/virtualworlds3040023
22. Wang, Q. J., Escobar, F. B., Mota, P. A. D., & Velasco, C. (2021). Getting started with virtual reality for sensory and consumer science: current practices and future perspectives. Elsevier BV. https://doi.org/10.1016/j.foodres.2021.110410
23. Luhaybi, A. A., Alqurashi, F., Tsaramirsis, G., & Buhari, S. M. (2019). Automatic association of scents based on visual content. Multidisciplinary Digital Publishing Institute. https://doi.org/10.3390/app9081697
24. Li, J., Wang, Y., Gong, H., & Cui, Z. (2023). Awakenflora: exploring proactive smell experience in virtual reality through mid-air gestures. ACM Symposium on User Interface Software and Technology. https://doi.org/10.1145/3586182.3616667
25. Gougeh, R. A. & Falk, T. (2023). Enhancing motor imagery detection efficacy using multisensory virtual reality priming. Frontiers in Neuroergonomics. https://doi.org/10.3389/fnrgo.2023.1080200
26. Saleme, E. B., Covaci, A., Mesfin, G., Santos, C. A. S., & Ghinea, G. (2019). Mulsemedia diy: a survey of devices and a tutorial for building your own mulsemedia environment. Association for Computing Machinery. https://doi.org/10.1145/3319853
27. Suh, A. (2024). How virtual reality influences collaboration performance: ateam-level analysis. None. https://doi.org/10.1108/itp-10-2023-1040