Soundtrack loudness as a depth cue in stereoscopic 3D media
- Submitting institution
-
Ravensbourne University London
- Unit of assessment
- 32 - Art and Design: History, Practice and Theory
- Output identifier
- CM02
- Type
- D - Journal article
- DOI
-
10.1177/1354856520968016
- Title of journal
- Convergence: The International Journal of Research into New Media Technologies
- Article number
- -
- First page
- 1
- Volume
- 0
- Issue
- -
- ISSN
- 1354-8565
- Open access status
- Compliant
- Month of publication
- -
- Year of publication
- 2020
- URL
-
-
- Supplementary information
-
-
- Request cross-referral to
- -
- Output has been delayed by COVID-19
- No
- COVID-19 affected output statement
- -
- Forensic science
- No
- Criminology
- No
- Interdisciplinary
- No
- Number of additional authors
-
2
- Research group(s)
-
-
- Proposed double-weighted
- No
- Reserve for an output with double weighting
- No
- Additional information
- This study is part of an ongoing research project that explores and evaluates possible ways of using auditory cues to influence the perception of depth in 3D/immersive audiovisual presentations.
Considering the role of cross-modal integration in depth perception, it was expected that manipulating auditory parameters related with depth perception would result in the viewer/listener being forced to perceive the depth of the visual objects as being altered, even though the visual depth and the scene remained unchanged.
In terms of the variable studied, the overall volume level of the soundtrack was used to influence the sense of depth of the displayed stereoscopic 3D animation sequences. Previous work indicated that an attenuation of the amplitude may not have the desired effects, as described on ‘Volume Attenuation and High Frequency Loss as Auditory Depth Cues in Stereoscopic 3D Cinema’, another paper submitted under REF 21. Thus, the purpose of this study was to explore the possibility that an inverted effect may be in place, where increased soundtrack volume levels cause an increased sense of visual depth. The hypothesis tested was:
H1: The perceived level of visual depth of a short stereoscopic 3D animation sequence can be increased by an amplitude increase of the accompanying soundtrack.
The study utilised a repeated-measures design and quantitative analysis, and provided statistically significant results. Results suggested that amplitude increase was effective in influencing depth perception in a number of occasions.
Based on these results, an additional study was designed and is currently in progress. It investigates the effect of altering various auditory parameters, such as volume, positioning or pitch in order to influence the sense of depth and immersion in VR/AR presentations. This study is presented as a separate submission - 'Auditory Cues as a Means to Alter the Sense of Depth and Immersion in VR/AR Presentations’.
- Author contribution statement
- -
- Non-English
- No
- English abstract
- -