Audiovisual interactive artwork via web-deployed software: Motus composes Homino-idea

Autores

  • Augusto Piato Amstalden Universidade Estadual de Campinas
  • Tiago Fernandes Tavares Universidade Estadual de Campinas
  • Anésio Azevedo Costa Neto Instituto Federal de São Paulo
  • Giovana Cardi Camarini Instituto Federal de São Paulo

DOI:

https://doi.org/10.33871/23179937.2022.10.1.6

Palavras-chave:

audiovisual interactive installation, ubiquitous hardware, Processing, atlantic forest, soundscapes

Resumo

Many art installations rely on camera-based audiovisual interactions, and this commonly requires specialized hardware and software. Consequently, audiovisual installations are usually restricted to wealthier areas, in which the specialized equipment can be afforded and properly hosted. In countries with an evident income unbalance linked to location, the geographic restriction leads to an audience restriction. In this work, we present the development of a web-deployed composition tool for audiovisual interactions that runs on the client side and does not require installing any additional software. Simultaneously, it provides visual feedback that can aid the audience to understand the experience. Consequently, the tool can be used to compose audiovisual interactions that reach a large audience via web. We further explore the tool by composing the audiovisual installation Homino-idea. The installation is inspired by the interactions between humans and the environment, and can be either shown in art venues or used online.

Downloads

Não há dados estatísticos.

Biografia do Autor

Augusto Piato Amstalden, Universidade Estadual de Campinas

Augusto Piato Amstalden is both a Computer Engineering and Sound Engineering student at University of Campinas (UNICAMP). Although his work in audiovisual interactions is fairly new, he is determined to learn new skills and improve existing ones to maximize his knowledge about this work area. Fascinated by music for a long time, he has found a friendly face in applying his programming skills in a vast range of musically-related software developments. ORCID: https://orcid.org/0000-0002-2248-5673

Tiago Fernandes Tavares, Universidade Estadual de Campinas

Tiago Fernandes Tavares has a BsC in Computer Engineering, a MsC and a PhD in Electrical Engineering, all issued by Unicamp. His research comprised digital signal processing, machine learning and models for human-computer interaction. ORCID: https://orcid.org/0000-0002-9104-613X

Anésio Azevedo Costa Neto, Instituto Federal de São Paulo

Anésio Azevedo Costa Neto was born in Ituiutaba, Minas Gerais, Brazil. He holds a Bachelor's degree in Philosophy from the Universidade Federal de Uberlândia (UFU), a Master's degree in Fine Arts in Contemporary Art and a Ph.D. in Extended Perceptual Fields at the Universidade de Brasí­lia (UnB). His research interests include sound art, audiovisual media and technology, and the transformation of organic sounds recorded in the Brazilian Cerrado. ORCID: https://orcid.org/0000-0003-4616-2243

Giovana Cardi Camarini, Instituto Federal de São Paulo

Giovana Cardi Camarini was born in Votuporanga, São Paulo, Brazil. She is currently graduating in information systems at Instituto Federal de São Paulo - Campus Votuporanga. ORCID: https://orcid.org/0000-0003-1516-6903

Referências

ARAÚJO, João; DE PAULO, Avner; JUNIOR, Igino Silva; SCHIAVONI, Flávio; CANITO, César; COSTA, Rômulo. A technical approach of the audience participation in the performance 'O Chaos das 5'. In: Anais do XVII Simpósio Brasileiro de Computação Musical. São João del-Rei: SBC, 2019. 28-34.

CALEGARIO, Filipe; TRAGTENBERG, João; CABRAL, Giordano; RAMALHO, Geber. Batebit controller: Popularizing digital musical instruments"™ technical development process. In Anais do XVII Simpósio Brasileiro de Computação Musical. Porto Alegre, RS, SBC, pages 217–218, 2019.

FIGUEIRÓ, Cristiano Severo. Desobediência sonora: selos de música experimental e suas tecnologias de sustentabilidade. EDUFBA, 2019.

FIGUEIRÓ, Cristiano; SOARES, Guilherme; ROHDE, Bruno. Esmeril - an interactive audio player and composition system for collaborative experimental music netlabels. In NIME 2019, 2019.

FOOTE, Brian. Model-view-controller. Available at: <http://www.laputan.org/pub/papers/POSA-MVC>. Accessed on: 1 mar. 2022.

HOLANDA, Thiago; BARBOZA, Paulo José Mote; MEJIA, Dayana Priscila Maia. Tratamento fisioterapêutico em pacientes acometidos por Alzheimer. Referência bibliográfica. 2012.

MAMEDES, Clayton Rosa; GARCIA, Denise H. L.; FORNARI, José; MANZOLLI, Jônatas. Abstrações: An audiovisual installation based on motion recognizing. In 2011 4th International Congress on Image and Signal Processing. Volume 2, pages 586–589, 2011.

MAMEDES, Clayton. Participação em instalações interativas (in portuguese). Revista Interdisciplinar Internacional de Artes Visuais, 5(1): UNESPAR, 2018.

MOREIRA, Shirlene Vianna; JUSTI, Francis Ricardo dos Reis; MOREIRA, Marcos. Intervenção musical pode melhorar a memória em pacientes com doença de Alzheimer ? Uma revisão sistemática. 2018.

MUTEK. "Mutek virtual". Available at: <https://virtual.mutek.org/en/mutek>. Accessed on: 15 jul. 2021.

NIME 2020. "Installations". Available at: <https://nime2020.bcu.ac.uk/installations/>. Accessed on: 15 jul. 2021.

PAIVA, Raul; TAVARES, Tiago Fernandes. Impact of Algorithmic Composition on Player Immersion in Computer Games: A Case Study Using Markov Chains. Revista Música Hodie, 18, 1, 61-73, 2018.

SHIPMAN, Heather. Smart art for smart cities. In Miroslav Mateev and Panikkos Poutziouris, editors, Creative Business and Social Innovations for a Sustainable Future. Springer International Publishing, pages 251–253, 2019.

STOESSEL, Alexander; DAVID, Romain; GUNZ, Philipp; OBERHOFFNER, Tobias; SPOOR, Fred; HUBLIN, Jean-Jacques. Morphology and function of neanderthal and modern human ear ossicles. Proceedings of the National Academy of Sciences: 113:201605881, 09, 2016.

TAVARES, Tiago Fernandes. An interactive audio-visual installation using ubiquitous hardware and web-based software deployment. PeerJ Computer Science, 1:e5, 5, 2015.

TAVARES, Tiago Fernandes; RIMOLDI, Gabriel; PONTES, Vânia Eger; MANZOLI, Jônatas. Cooperative Musical Creation Using Kinect, WiiMote, Epoc and Microphones: a case study with MinDSounDS. In: Sound and Music Computing 2015, 2015.

TRAIL, Shawn; DEAN, Michael; TAVARES, Tiago Fernandes; ODOWICHUK, Gabrielle; DRIESSEN, Peter; SCHLOSS, W. Andrew; TZANETAKIS, George. Non-invasive sensing and gesture control for pitched percussion hyper-instruments using the Kinect. In: New Interfaces for Musical Expression - NIME 2012. Ann Arbour, Michigan, U.S.A., 2012.

TURNER, Ash. "How many smartphones are in the world?". Available at: <https://www.bankmycell.com/blog/how-many-phones-are-in-the-world>. Accessed on: 23 jun. 2021.

VIEIRA, Rômulo; SCHIAVONI, Flávio. Fliperama: An affordable arduino based midi controller. In Proceedings of NIME 2020, 2020.

WINKLER, Todd. Motion-sensing Music: Artistic and Technical Challenges In Two Works For Dance. In: Proceedings of the International Computer Music Conference, 1998/01.

WYZOWL. "Why video is exploding on social media in 2021". Available at: <https://www.wyzowl.com/video-social-media-2020/>. Accessed on: 14 jul. 2021.

ZUGARA. "Webcam penetration rates adoption". Available at: <http://zugara.com/webcam-penetration-rates-adoption>. Accessed on: 23 jun. 2021.

Downloads

Publicado

30.04.2022

Como Citar

Amstalden, A. P., Tavares, T. F., Costa Neto, A. A., & Camarini, G. C. (2022). Audiovisual interactive artwork via web-deployed software: Motus composes Homino-idea. Revista Vórtex, 10(1). https://doi.org/10.33871/23179937.2022.10.1.6

Edição

v. 10 n. 1 (2022): Revista Vórtex

Seção

Dossier "18th Brazilian Symposium on Computer Music"

Licença

Copyright (c) 2022 Augusto Piato Amstalden, Tiago Fernandes Tavares, Anésio Azevedo Costa Neto, Giovana Cardi Camarini

Creative Commons License
Este trabalho está licenciado sob uma licença Creative Commons Attribution 4.0 International License.

Autores mantêm os direitos autorais e concedem à revista o direito de primeira publicação, com o trabalho simultaneamente licenciado sob a Licença Creative Commons Attribution que permite o compartilhamento do trabalho com reconhecimento da autoria e publicação inicial nesta revista.