A Networked Hybrid Interface for Audience Sonification and Machine Learning

Visualizações: 272

Autores

  • Konstantinos Vasilakos Istanbul Technical University, Center for Advanced Studies in Music

DOI:

https://doi.org/10.33871/23179937.2022.10.1.4695

Palavras-chave:

Sonifications, Live Coding, Networked Music System, Improvisation, Web Application

Resumo

Lick the Toad is an ongoing project developed as a web based interface that runs in modern browsers. It provides a custom made platform to collect user data accessed from mobile devices, such as smartphones, tablets etc. The system offers a tool for interactive collective sonification supporting networked music performance. It can be used in various contexts, such as an onsite installation, or for the distribution of raw data for live coding performances making it a versatile component for an array of creative practices. Of these, live coding which is one of the author's artistic approach to create live performances is demonstrated in this article highlighting and elaborating on technical and musical aspects of this approach. Final sections outline the system as a tool for live coding performances and cover a series of potential interactions integrating audience and/or using it independently alike.

Downloads

Não há dados estatísticos.

Biografia do Autor

Konstantinos Vasilakos, Istanbul Technical University, Center for Advanced Studies in Music

Konstantinos Vasilakos creates electro-acoustic music using hitherto available computer music systems within the milieu of interactive music and digital arts. He studied in Greece, UK and The Netherlands. His music interests include performance with hardware interfaces, live coding, sonification, and networked music environments for real time improvisation. ORCID: https://orcid.org/0000-0002-3058-0048

Referências

AMERSHI, S.; CAKMAK, M.; KNOX, W.B.; KULESZA, T. Power to the People: The Role of Humans in Interactive Machine Learning. AI Magazine, [online] 35(4), pp.105–120, 2014. https://doi.org/10.1609/aimag.v35i4.2513 DOI: https://doi.org/10.1609/aimag.v35i4.2513

BAALMAN, M. the machine is learning. [Personal Website] Marije Baalman. 2020. Available at: <https://marijebaalman.eu/projects/the-machine-is-learning.html> [Accessed 16 April 2021].

CHAFE, C. Ping. 2001.

COLLINS, N.; MCLEAN, A.; ROHRHUBER, J.; WARD, A. Live coding in laptop performance. Organised Sound, [online] 8(3), pp.321–330, 2003. https://doi.org/10.1017/S135577180300030X DOI: https://doi.org/10.1017/S135577180300030X

CRAB, S. The "˜Telharmonium"™ or "˜Dynamophone"™ Thaddeus Cahill, USA 1897. 120 Years of Electronic Music. 2013. Available at: <https://120years.net/wordpress/the-telharmonium-thaddeus-cahill-usa-1897/> [Accessed 5 April 2022].

FIEBRINK, R.; SONAMI, L. Reflections on Eight Years of Instrument Creation with Machine Learning. In: R. Michon and F. Schroeder, eds. Proceedings of the International Conference on New Interfaces for Musical Expression. [online] Birmingham, UK: Birmingham City University. pp.282–288, 2020. Available at:

GRESHAM-LANCASTER, S. The Aesthetics and History of the Hub: The Effects of Changing Technology on Network Computer Music. Leonardo Music Journal 8 (1998): 39. https://doi.org/10.2307/1513398 DOI: https://doi.org/10.2307/1513398

HERMANN, T.; HUNT, A.; NEUHOFF, J. G. (eds). The Sonification Handbook. Berlin: Logos Verlag, 2011.

L. STURM, B.; BEN-TAL, O. Taking the Models back to Music Practice: Evaluating Generative Transcription Models built using Deep Learning. Journal of Creative Music Systems, [online] 2(1), 2017. https://doi.org/10.5920/JCMS.2017.09 DOI: https://doi.org/10.5920/JCMS.2017.09

LUKA, 2019. Live Coding and Algorave. [online] Medium. Available at: <https://lukabaramishvili.medium.com/live-coding-and-algorave-9eee0ca0217f> [Accessed 14 April 2021].

MANNING, P. Electronic and computer music. Rev. and expanded ed ed. Oxford ; New York: Oxford University Press, 2004.

NILSON, C. Live coding practice. In: Proceedings of the 7th international conference on New interfaces for musical expression - NIME "™07. [online] the 7th international conference. New York, New York: ACM Press. p.112, 2007. https://doi.org/10.1145/1279740.1279760 DOI: https://doi.org/10.1145/1279740.1279760

SMITH, O.; TACCHINI, F. Network Ensemble Selected Network Studies. Number SF0010 in The Strong of the Future. Rizosfera, Via Guido de Ruggiero, 6 – 42123, Reggio Emilia – Italia, 2017.

VASILAKOS, K. Exploring Live Coding as Performance Practice. 2021, [online] 21(Guz 2021), pp. 21–38, 2021. Available at: <https://dergipark.org.tr/tr/pub/porteakademik/issue/66105/1033868> [Accessed 7 February 2022].

VASILAKOS, K.; WILSON, S.; MCCAULEY, T.; YEUNG, T.W.; MARGETSON, E; KHOSRAVI MARDAKHEH, M. Sonification of High Energy Physics Data Using Live Coding and Web Based Interfaces. In: R. Michon and F. Schroeder, eds. Proceedings of the International Conference on New Interfaces for Musical Expression. [online] Birmingham, UK: Birmingham City University. pp. 464–470, 2020. Available at:

WORRALL, D. Sonification Design: From Data to Intelligible Soundfields. Springer Publishing Company, Incorporated, 1st edition, 2019. DOI: https://doi.org/10.1007/978-3-030-01497-1

ZMÖLNIG, Io.; ECKEL, G. Live coding: An overview. International Computer Music Conference, ICMC 2007, pp. 295–298, 2007.

Downloads

Publicado

30.04.2022

Como Citar

Vasilakos, K. (2022). A Networked Hybrid Interface for Audience Sonification and Machine Learning. Revista Vórtex, 10(1). https://doi.org/10.33871/23179937.2022.10.1.4695

Edição

v. 10 n. 1 (2022): Revista Vórtex

Seção

Dossier "18th Brazilian Symposium on Computer Music"

Licença

Copyright (c) 2022 Konstantinos Vasilakos

Creative Commons License
Este trabalho está licenciado sob uma licença Creative Commons Attribution 4.0 International License.

Autores mantêm os direitos autorais e concedem à revista o direito de primeira publicação, com o trabalho simultaneamente licenciado sob a Licença Creative Commons Attribution que permite o compartilhamento do trabalho com reconhecimento da autoria e publicação inicial nesta revista.

Métricas