Esen K. Tütüncü
Sensorimotor contingencies (SC) refer to the rules by which we use our body to perceive. It has been argued that to the extent that a virtual reality (VR) application affords natural SC so the greater likelihood that participants will experience Place Illusion (PI), the illusion of ‘being there’ (a component of presence) in the virtual environment. However, notwithstanding numerous studies this only has anecdotal support.
Here we used a reinforcement learning (RL) paradigm where 26 participants experienced a VR scenario where the RL agent could sequentially propose changes to 5 binary factors: mono or stereo vision, 3 or 6 degrees of freedom head tracking, mono or spatialised sound, low or high display resolution, or one of two color schemes. The first 4 are SC, whereas the last is not. Participants could reject or accept each change proposed by the RL, until convergence.
Participants were more likely to accept changes from low to high SC than changes to the color. Additionally, theory suggests that increased PI should be associated with lower eye scanpath entropy. Our results show that mean entropy did decrease over time and the final level of entropy was negatively correlated with a post exposure questionnaire-based assessment of PI.
Download the preprint here
Figure - The string quartet scenario. (A) The learning phase where participants were in a room showing some loudspeakers and practiced changing the settings, in the case shown the resolution. (B) An overview of the scenario – this image has been slightly vertically stretched for alignment purposes. (C) The participant chooses whether or not to make a change to the audio. (D) The scene is shown in the alternate scheme and the participant chooses whether or not to accept this change.