Aurally and visually guided visual search in a virtual environment

We investigated the time participants took to perform a visual search task for targets outside the visual held of view using a helmet-mounted display We also measured the effectiveness of visual and auditory cues to target lo cation. The auditory stimuli used to cue location were noise bursts previou sly recorded from the ear canals of the participants and were either presen ted briefly at the beginning of a trial or continually updated to compensat e for head movements. The visual cue was a dynamic arrow that indicated the direction and angular distance from the instantaneous head position to the target. Both visual and auditory spatial cues reduced search time dramatic ally, compared with unaided search. The updating audio cue was more effecti ve than the transient audio cue and was as effective as the visual cue in r educing search time. These data show that both spatial auditory and visual cues can markedly improve visual search performance. potential applications for this research include highly visual environments, such as aviation, wh ere there is risk of overloading the visual modality with information.