Exploring Pitch and Timbre through 3D Spaces: Embodied Models in Virtual Reality as a Basis for Performance Systems Design
- Submitting institution
-
University of Ulster
- Unit of assessment
- 33 - Music, Drama, Dance, Performing Arts, Film and Screen Studies
- Output identifier
- 76472769
- Type
- E - Conference contribution
- DOI
-
10.5281/zenodo.1176207
- Title of conference / published proceedings
- Proceedings of the International Conference on New Interfaces for Musical Expression : n/a
- First page
- 157
- Volume
- -
- Issue
- -
- ISSN
- 2220-4806
- Open access status
- Compliant
- Month of publication
- May
- Year of publication
- 2017
- URL
-
https://ulster.sharepoint.com/:b:/s/REF2021/EcRWcZUd-IhHuy0siuaBGXsBbDcDp43n33SuPtWNT_LA5Q?e=v1EtOa
- Supplementary information
-
-
- Request cross-referral to
- -
- Output has been delayed by COVID-19
- No
- COVID-19 affected output statement
- -
- Forensic science
- No
- Criminology
- No
- Interdisciplinary
- No
- Number of additional authors
-
3
- Research group(s)
-
C - Creative industries and technologies
- Proposed double-weighted
- No
- Reserve for an output with double weighting
- No
- Additional information
- Context:
This output applies models from embodied cognition to spatial/immersive media, parsing note and audioevent data via an integrating mapping which facilitates connections between formal and embodied
domains.
Original Abstract:
This paper builds on an ongoing collaboration between theorists and practitioners within the computer
music community, with a specific focus on three-dimensional environments as an incubator for
performance systems design… We are concerned with how to provide accessible means of controlling
spatialization and timbral shaping in an integrated manner through the collection of performance data
from… an electric guitar with a multichannel audio output. This paper will focus … on the combination of
pitch data treated within tonal models and the detection of physical performance gestures using timbral
feature extraction algorithms. We discuss how these tracked gestures may be connected to concepts and
dynamic relationships from embodied cognition, expanding on performative models for pitch and timbre
spaces. Finally, we explore how these ideas support connections between sonic, formal and performative
dimensions. This includes instrumental technique detection and mapping strategies aimed at bridging
music performance gestures across physical and conceptual planes.
Methodology and Findings:
The present paper (Graham et al., 2017) marks the culmination of previous work by Graham and Bridges
(2014; 2015; 2016), which sees note-event data being applied to the control of spatial audio and creative
signal processing (Graham and Bridges, 2014; 2015), and VR (Graham and Bridges, 2016; 2017).Varied
performance data is considered via gestural models informed by Johnson (2007) and Smalley (1997),
with spatial movement facilitated by the boids flocking algorithm (Reynolds, 1987). The result is an
integrating typology which provides solutions for the treatment of localised gestures via macrostructural
models, including tonal (Lerdahl, 2001), timbral (Grey et al, 1977) and performative uses of space, via
Emmerson (2007), informed by Lakoff and Johnson’s (1999) image schema.
- Author contribution statement
- -
- Non-English
- No
- English abstract
- -
