Abstract
In recent years, the quality of real-time rendering has reached new heights—realistic reflections, physically based materials, and photometric lighting are all becoming commonplace in modern game engines and even interactive virtual environments, such as virtual reality (VR). As the strive for realism continues, there is a need to investigate the effect of photorealism on users’ perception, particularly for interactive, emotional scenarios in VR. In this article, we explored three main topics, where we predicted photorealism will make a difference: the illusion of being present with the virtual person and in an environment, altered emotional response toward the character, and a subtler response—comfort of being in close proximity to the character. We present a perceptual experiment, with an interactive expressive virtual character in VR, which was designed to induce particular social responses in people. Our participant pool was large (N = 797) and diverse in terms of demographics. We designed a between-group experiment, where each group saw either the realistic rendering or one of our stylized conditions (simple and sketch style), expressing one of three attitudes: Friendly, Unfriendly, or Sad. While the render style did not particularly effect the level of comfort with the character or increase the illusion of presence with it, our main finding shows that the photorealistic character changed the emotional responses of participants, compared to the stylized versions. We also found a preference for realism in VR, reflected in the affinity and higher place illusion in the scenario, rendered in the realistic render style.
Supplemental Material
Available for Download
Supplemental movie and image files for, Is Photorealism Important for Perception of Expressive Virtual Humans in Virtual Reality?
- 3DScanstore. 2018. Retrieved from https://www.3dscanstore.com/.Google Scholar
- Jeremy N. Bailenson, Jim Blascovich, Andrew C. Beall, and Jack M. Loomis. 2001. Equilibrium theory revisited: Mutual gaze and personal space in virtual environments. Presence 10, 6 (2001), 583--598. Google ScholarDigital Library
- Jeremy N. Bailenson, Jim Blascovich, Andrew C. Beall, and Jack M. Loomis. 2003. Interpersonal distance in immersive virtual environments. Personal. Soc. Psychol. Bull. 29, 7 (2003), 819--833.Google ScholarCross Ref
- Jeremy N. Bailenson, Kimberly R. Swinth, Crystal L. Hoyt, Susan Persky, Alex Dimov, and Jim Blascovich. 2005. The independent and interactive effects of embodied-agent appearance and behavior on self-report, cognitive, and behavioral markers of copresence in immersive virtual environments. Presence 14, 4 (2005), 379--393. Google ScholarDigital Library
- Jeremy N. Bailenson, Nick Yee, Dan Merget, and Ralph Schroeder. 2006. The effect of behavioral realism and form realism of real-time avatar faces on verbal disclosure, nonverbal disclosure, emotion recognition, and copresence in dyadic interaction. Presence: Teleoper. Virt. Environ. 15, 4 (2006), 359--372. Google ScholarDigital Library
- Jim Blascovich. 2002. Social influence within immersive virtual environments. In The Social Life of Avatars. Springer, 127--145. Google ScholarDigital Library
- Andrea Bönsch, Sina Radke, Heiko Overath, Laura M. Asché, Jonathan Wendt, Tom Vierjahn, Ute Habel, and Torsten W. Kuhlen. 2018. Social VR: How personal space is affected by virtual agents’ emotions. In Proceedings of the IEEE Conference on Virtual Reality and 3D User Interfaces (VR’18). IEEE, 199--206.Google Scholar
- Elizabeth J. Carter, Moshe Mahler, and Jessica K. Hodgins. 2013. Unpleasantness of animated characters increases viewer attention to faces. In Proceedings of the ACM Symposium in Applied Perception. 35--40. Google ScholarDigital Library
- Thierry Chaminade, Jessica Hodgins, and Mitsuo Kawato. 2007. Anthropomorphism influences perception of computer-animated characters’ actions. Soc. Cogn. Affect. Neurosci. 2, 3 (2007), 206--216.Google ScholarCross Ref
- Mark H. Davis. 1983. Measuring individual differences in empathy: Evidence for a multidimensional approach. J. Personal. Soc. Psychol. 44, 1 (1983), 113.Google ScholarCross Ref
- James A. Ferwerda. 2003. Three varieties of realism in computer graphics. In Human Vision and Electronic Imaging VIII, Vol. 5007. International Society for Optics and Photonics, 290--298.Google ScholarCross Ref
- Philip W. Fink, Patrick S. Foo, and William H. Warren. 2007. Obstacle avoidance during walking in real and virtual environments. ACM Trans. Appl. Percept. 4, 1 (2007), 2. Google ScholarDigital Library
- Maia Garau. 2003. The Impact of Avatar Fidelity on Social Interaction in Virtual Environments. Ph.D. Dissertation, University College London.Google Scholar
- Maia Garau, Mel Slater, Simon Bee, and Martina Angela Sasse. 2001. The impact of eye gaze on communication using humanoid avatars. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 309--316. Google ScholarDigital Library
- Maia Garau, Mel Slater, Vinoba Vinayagamoorthy, Andrea Brogni, Anthony Steed, and M. Angela Sasse. 2003. The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 529--536. Google ScholarDigital Library
- Simon Baron-Cohen, Ofer Golan, and Jacqueline Hill. 2006. The cambridge mindreading (CAM) face-voice battery: Testing complex emotion recognition in adults with and without Asperger syndrome. J. Autism Dev. Disorders 36, 2 (2006), 169--183.Google ScholarCross Ref
- Jennifer Hyde, Elizabeth J. Carter, Jessica K. Hodgins, and Sara Kiesler. 2013. Perceptual effects of damped and exaggerated facial motion in animated characters. In Proceedings of the 10th IEEE International Conference on Automatic Face and Gesture Recognition. 1--6.Google ScholarCross Ref
- Sungchul Jung, Christian Sandor, Pamela J. Wisniewski, and Charles E. Hughes. 2017. Realme: The influence of body and hand representations on body ownership and presence. In Proceedings of the 5th Symposium on Spatial User Interaction. ACM, 3--11. Google ScholarDigital Library
- Kristi J. K. Klein and Sara D. Hodges. 2001. Gender differences, motivation, and empathic accuracy: When it pays to understand. Personal. Soc. Psychol. Bull. 27, 6 (2001), 720--730.Google ScholarCross Ref
- Marc Erich Latoschik, Daniel Roth, Dominik Gall, Jascha Achenbach, Thomas Waltemate, and Mario Botsch. 2017. The effect of avatar realism in immersive social virtual realities. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology. ACM, 39. Google ScholarDigital Library
- R. Michael Latta. 1978. Relation of status incongruence to personal space. Personal. Soc. Psychol. Bull. 4, 1 (1978), 143--146.Google ScholarCross Ref
- Myungho Lee, Gerd Bruder, Tobias Höllerer, and Greg Welch. 2018. Effects of unaugmented periphery and vibrotactile feedback on proxemics with virtual humans in AR. IEEE Trans. Visual. Comput. Graph. 24, 4 (2018), 1525--1534. Google ScholarDigital Library
- Lorraine Lin and Sophie Jörg. 2016. Need a hand?: How appearance affects the virtual hand illusion. In Proceedings of the ACM Symposium on Applied Perception. ACM, 69--76. Google ScholarDigital Library
- Karl F. MacDorman, Robert D. Green, Chin-Chang Ho, and Clinton T. Koch. 2009. Too real for comfort? Uncanny responses to computer generated faces. Comput. Hum. Behav. 25, 3 (2009), 695--710. Google ScholarDigital Library
- Rachel McDonnell, Martin Breidt, and Heinrich Buelthoff. 2012. Render me real Investigating the effect of render style on the perception of animated virtual humans. ACM Trans. Graph. 31, 4 (2012), 91:1--91:11. Google ScholarDigital Library
- Wade J. Mitchell, Kevin A. Szerszen Sr., Amy Shirong Lu, Paul W. Schermerhorn, Matthias Scheutz, and Karl F. MacDorman. 2011. A mismatch in the human realism of face and voice produces an uncanny valley. i-Perception 2, 1 (2011), 10--12.Google Scholar
- Masahiro Mori. 1970. The uncanny valley. Energy 7, 4 (1970), 33--35.Google Scholar
- Kristin Nowak. 2001. The influence of anthropomorphism on social judgment in social virtual environments. In Proceedings of the Annual Convention of the International Communication Association.Google Scholar
- Otoy. 2018. Retrieved from https://home.otoy.com/.Google Scholar
- Lazlo Ring, Dina Utami, and Timothy Bickmore. 2014. The right agent for the job? In Proceedings of the International Conference on Intelligent Virtual Agents. Springer, 374--384.Google ScholarCross Ref
- Ulrike Schultze. 2010. Embodiment and presence in virtual worlds: A review. J. Info. Technol. 25, 4 (2010), 434--449.Google ScholarCross Ref
- Richard Skarbez, Solene Neyret, Frederick P. Brooks, Mel Slater, and Mary C. Whitton. 2017. A psychophysical experiment regarding components of the plausibility illusion. IEEE Trans. Visual. Comput. Graph. 23, 4 (2017), 1369--1378. Google ScholarDigital Library
- Mel Slater. 2009. Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philos. Trans. Roy. Soc. London B: Biol. Sci. 364, 1535 (2009), 3549--3557.Google ScholarCross Ref
- Mel Slater and Anthony Steed. 2002. Meeting people virtually: Experiments in shared virtual environments. In The Social Life of Avatars. Springer, 146--171. Google ScholarDigital Library
- UE4. 2018. Paragon Phase. Unreal Engine 4, Paragon Phase. Retrieved from https://www.unrealengine.com/marketplace/paragon-phase.Google Scholar
- UE4. 2018. Unreal Engine 4, Realistic Rendering. Retrieved from https://docs.unrealengine.com/en-us/Resources/Showcases/RealisticRendering.Google Scholar
- Matias Volante, Sabarish V. Babu, Himanshu Chaturvedi, Nathan Newsome, Elham Ebrahimi, Tania Roy, Shaundra B. Daily, and Tracy Fasolino. 2016. Effects of virtual human appearance fidelity on emotion contagion in affective inter-personal simulations. IEEE Trans. Visual. Comput. Graph. 22, 4 (2016), 1326--1335. Google ScholarDigital Library
- David Watson, Lee A. Clark, and Auke Tellegen. 1988. Development and validation of brief measures of positive and negative affect: The PANAS scales.J. Personal. Soc. Psychol. 54, 6 (1988), 1063.Google ScholarCross Ref
- Yuki Yamada, Takahiro Kawabe, and Keiko Ihaya. 2013. Categorization difficulty is associated with negative evaluation in the “uncanny valley” phenomenon. Japan. Psychol. Res. 55, 1 (2013), 20--32.Google ScholarCross Ref
- Nick Yee and Jeremy Bailenson. 2007. The proteus effect: The effect of transformed self-representation on behavior. Hum. Commun. Res. 33, 3 (2007), 271--290.Google ScholarCross Ref
- Eduard Zell, Carlos Aliaga, Adrian Jarabo, Katja Zibrek, Diego Gutierrez, Rachel McDonnell, and Mario Botsch. 2015. To stylize or not to stylize?: The effect of shape and material stylization on the perception of computer-generated faces. ACM Trans. Graph. 34, 6 (2015), 184:1--184:12. Google ScholarDigital Library
- Katja Zibrek, Elena Kokkinara, and Rachel McDonnell. 2017. Don’t stand so close to me: Investigating the effect of control on the appeal of virtual humans using immersion and a proximity-based behavioral task. In Proceedings of the ACM Symposium on Applied Perception. ACM, 3. Google ScholarDigital Library
- Katja Zibrek, Elena Kokkinara, and Rachel McDonnell. 2018. The effect of realistic appearance of virtual characters in immersive environments—Does the character’s personality play a role? IEEE Trans. Visual. Comput. Graph. 24, 4 (2018), 1681--1690. Google ScholarDigital Library
Index Terms
Is Photorealism Important for Perception of Expressive Virtual Humans in Virtual Reality?
Recommendations
Social presence and place illusion are affected by photorealism in embodied VR
MIG '19: Proceedings of the 12th ACM SIGGRAPH Conference on Motion, Interaction and GamesPhotorealism of virtual characters and environments is becoming more achievable in Virtual Reality (VR). With this development comes the need for further investigation into the role it plays on people’s responses to characters. Whether or not these ...
Virtual Reality Software and Technology
This special issue contains an introductory survey on 3D user interfaces by leading VR authorities and significantly expanded versions of the four best short papers from the proceedings of the 14th ACM Symposium on Virtual Reality Software and ...
Extending Virtual Reality Display Wall Environments Using Augmented Reality
SUI '19: Symposium on Spatial User InteractionTwo major form factors for virtual reality are head-mounted displays and large display environments such as CAVE®and the LCD-based successor CAVE2®. Each of these has distinct advantages and limitations based on how they’re used. This work explores ...
Comments