The fungible audio-visual mapping and its experience
Autor(a) principal: | |
---|---|
Data de Publicação: | 2014 |
Outros Autores: | , |
Tipo de documento: | Artigo |
Idioma: | eng |
Título da fonte: | Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
Texto Completo: | http://hdl.handle.net/10437/13960 |
Resumo: | This article draws a perceptual approach to audio-visual mapping. Clearly perceivable cause and effect relationships can be problematic if one desires the audience to experience the music. Indeed perception would bias those sonic qualities that fit previous concepts of causation, subordinating other sonic qualities, which may form the relations between the sounds themselves. The question is, how can an audio-visual mapping produce a sense of causation, and simultaneously confound the actual cause-effect relationships. We call this a fungible audio-visual mapping. Our aim here is to glean its constitution and aspect. We will report a study, which draws upon methods from experimental psychology to inform audio-visual instrument design and composition. The participants are shown several audio-visual mapping prototypes, after which we pose quantitative and qualitative questions regarding their sense of causation, and their sense of understanding the cause-effect relationships. The study shows that a fungible mapping requires both synchronized and seemingly non-related components – sufficient complexity to be confusing. As the specific cause-effect concepts remain inconclusive, the sense of causation embraces the whole. KEYWORDS: Audio-visual Mapping; Perception; Causation; Multisensory Integration; User Studies. |
id |
RCAP_7c612296e231d887c117c53e3764a719 |
---|---|
oai_identifier_str |
oai:recil.ensinolusofona.pt:10437/13960 |
network_acronym_str |
RCAP |
network_name_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository_id_str |
7160 |
spelling |
The fungible audio-visual mapping and its experienceAUDIOVISUALPERCEÇÃO MUSICALEXPRESSÃO MUSICALEXPERIÊNCIA DO UTILIZADORAUDIOVISUALMUSIC PERCEPTIONMUSICAL EXPRESSIONUSER EXPERIENCEThis article draws a perceptual approach to audio-visual mapping. Clearly perceivable cause and effect relationships can be problematic if one desires the audience to experience the music. Indeed perception would bias those sonic qualities that fit previous concepts of causation, subordinating other sonic qualities, which may form the relations between the sounds themselves. The question is, how can an audio-visual mapping produce a sense of causation, and simultaneously confound the actual cause-effect relationships. We call this a fungible audio-visual mapping. Our aim here is to glean its constitution and aspect. We will report a study, which draws upon methods from experimental psychology to inform audio-visual instrument design and composition. The participants are shown several audio-visual mapping prototypes, after which we pose quantitative and qualitative questions regarding their sense of causation, and their sense of understanding the cause-effect relationships. The study shows that a fungible mapping requires both synchronized and seemingly non-related components – sufficient complexity to be confusing. As the specific cause-effect concepts remain inconclusive, the sense of causation embraces the whole. KEYWORDS: Audio-visual Mapping; Perception; Causation; Multisensory Integration; User Studies.2023-06-19T14:05:02Z2014-01-01T00:00:00Z2014info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10437/13960eng1646-9798Sá, AdrianaCaramiaux, BaptisteTanaka, Atauinfo:eu-repo/semantics/openAccessreponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos)instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãoinstacron:RCAAP2023-06-30T01:30:46Zoai:recil.ensinolusofona.pt:10437/13960Portal AgregadorONGhttps://www.rcaap.pt/oai/openaireopendoar:71602024-03-19T18:01:18.175451Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informaçãofalse |
dc.title.none.fl_str_mv |
The fungible audio-visual mapping and its experience |
title |
The fungible audio-visual mapping and its experience |
spellingShingle |
The fungible audio-visual mapping and its experience Sá, Adriana AUDIOVISUAL PERCEÇÃO MUSICAL EXPRESSÃO MUSICAL EXPERIÊNCIA DO UTILIZADOR AUDIOVISUAL MUSIC PERCEPTION MUSICAL EXPRESSION USER EXPERIENCE |
title_short |
The fungible audio-visual mapping and its experience |
title_full |
The fungible audio-visual mapping and its experience |
title_fullStr |
The fungible audio-visual mapping and its experience |
title_full_unstemmed |
The fungible audio-visual mapping and its experience |
title_sort |
The fungible audio-visual mapping and its experience |
author |
Sá, Adriana |
author_facet |
Sá, Adriana Caramiaux, Baptiste Tanaka, Atau |
author_role |
author |
author2 |
Caramiaux, Baptiste Tanaka, Atau |
author2_role |
author author |
dc.contributor.author.fl_str_mv |
Sá, Adriana Caramiaux, Baptiste Tanaka, Atau |
dc.subject.por.fl_str_mv |
AUDIOVISUAL PERCEÇÃO MUSICAL EXPRESSÃO MUSICAL EXPERIÊNCIA DO UTILIZADOR AUDIOVISUAL MUSIC PERCEPTION MUSICAL EXPRESSION USER EXPERIENCE |
topic |
AUDIOVISUAL PERCEÇÃO MUSICAL EXPRESSÃO MUSICAL EXPERIÊNCIA DO UTILIZADOR AUDIOVISUAL MUSIC PERCEPTION MUSICAL EXPRESSION USER EXPERIENCE |
description |
This article draws a perceptual approach to audio-visual mapping. Clearly perceivable cause and effect relationships can be problematic if one desires the audience to experience the music. Indeed perception would bias those sonic qualities that fit previous concepts of causation, subordinating other sonic qualities, which may form the relations between the sounds themselves. The question is, how can an audio-visual mapping produce a sense of causation, and simultaneously confound the actual cause-effect relationships. We call this a fungible audio-visual mapping. Our aim here is to glean its constitution and aspect. We will report a study, which draws upon methods from experimental psychology to inform audio-visual instrument design and composition. The participants are shown several audio-visual mapping prototypes, after which we pose quantitative and qualitative questions regarding their sense of causation, and their sense of understanding the cause-effect relationships. The study shows that a fungible mapping requires both synchronized and seemingly non-related components – sufficient complexity to be confusing. As the specific cause-effect concepts remain inconclusive, the sense of causation embraces the whole. KEYWORDS: Audio-visual Mapping; Perception; Causation; Multisensory Integration; User Studies. |
publishDate |
2014 |
dc.date.none.fl_str_mv |
2014-01-01T00:00:00Z 2014 2023-06-19T14:05:02Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/article |
format |
article |
status_str |
publishedVersion |
dc.identifier.uri.fl_str_mv |
http://hdl.handle.net/10437/13960 |
url |
http://hdl.handle.net/10437/13960 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.relation.none.fl_str_mv |
1646-9798 |
dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
eu_rights_str_mv |
openAccess |
dc.format.none.fl_str_mv |
application/pdf |
dc.source.none.fl_str_mv |
reponame:Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) instname:Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação instacron:RCAAP |
instname_str |
Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
instacron_str |
RCAAP |
institution |
RCAAP |
reponame_str |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
collection |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) |
repository.name.fl_str_mv |
Repositório Científico de Acesso Aberto de Portugal (Repositórios Cientìficos) - Agência para a Sociedade do Conhecimento (UMIC) - FCT - Sociedade da Informação |
repository.mail.fl_str_mv |
|
_version_ |
1799131681027784704 |