Brian K. Smith: Affect, Cognition, and Musical Artificial Intelligence

Authors

DOI:

https://doi.org/10.33871/vortex.2026.14.12179

Keywords:

Brian K. Smith, Musical Artificial Intelligence;, Music Cognition, Affective Computing, Systematic Musicology

Abstract

This article examines Brian K. Smith’s intellectual trajectory in the field of Artificial Intelligence applied to music, using his publications as a framework for analyzing the development of rule-based models and the progressive incorporation and refinement of Case-Based Reasoning (CBR). The study begins with “Affect and Musical Composition from Natural Environment Representations,” presented at SBIA 1991, and follows the later development of the MILES and SCORE! systems at the MIT Media Lab. The analysis considers how these models articulate affective representation, memory, narrative, and human-computer mediation, while also discussing their conceptual and historical limitations. Finally, Smith’s contribution is situated in dialogue with contemporary debates on interpretability, affective computing, hybrid architectures, and human participation in generative music systems.

Downloads

Download data is not yet available.

Author Biography

Anselmo Guerra, Universidade Federal de Goiás (UFG) | Goiânia, Goiás, Brasil

Anselmo Guerra is a Full Professor at the Federal University of Goiás (UFG), where he teaches and conducts research in composition, music technology, artificial intelligence applied to music, and related fields. He is Editor-in-Chief of Música Hodie, the journal of the Graduate Program in Music at UFG.

References

ARCOS, Josep Lluís; LÓPEZ DE MÁNTARAS, Ramon; SERRA, Xavier. SaxEx: a case-based reasoning system for generating expressive musical performances. Journal of New Music Research, v. 27, n. 3, p. 194–210, 1998. DOI: 10.1080/09298219808570746.

BODEN, Margaret. The Creative Mind: Myths and Mechanisms. London: Routledge, 2004.

DALY, Ian et al. Affective Brain–Computer Music Interfacing: A Longitudinal Study on Modulating User Affect Concurrently with Music Generation. IEEE Transactions on Affective Computing, v. 7, n. 4, p. 320-333, 2016.

DUAN, Wei; YU, Yi; BRIOT, Jean-Pierre. Recent advances in music generation: methods, evaluation, and challenges. Artificial Intelligence Review, v. 59, art. 195, 2026. DOI: 10.1007/s10462-026-11582-x.

HEVNER, Kate. Experimental studies of the elements of expression in music. The American Journal of Psychology, v. 48, n. 2, p. 246–268, 1936. DOI: 10.2307/1415746.

HONG, Yu; HORNER, Andrew; SMITH, Julius. Emotional Equalizer: An Emotion-Based Real-Time Music Arrangement System. In: INTERNATIONAL COMPUTER MUSIC CONFERENCE (ICMC), 2019, New York. Proceedings [...]. New York: International Computer Music Association, 2019. p. 412-415.

HURON, David. Sweet Anticipation: Music and the Psychology of Expectation. Cambridge: MIT Press, 2006.

JUSLIN, Patrik N.; SLOBODA, John A. Handbook of Music and Emotion. Oxford: Oxford University Press, 2010.

MARCUS, Gary; DAVIS, Ernest. Rebooting AI. New York: Pantheon Books, 2019.

MEYER, Leonard B. Emotion and Meaning in Music. Chicago: Univ. of Chicago Press, 1956.

PADOVANI, José Henrique; OLIVEIRA, Vinícius César de. Seizing the means of machine listening/learning and agentic AI: creative practices with conTorchionist and vibe composing. Música Hodie, Goiânia, v. 26, 2026. DOI: 10.5216/mh.v26.85224. Disponível em: https://revistas.ufg.br/musica/article/view/85224. Acesso em: 31 ago. 2026.

PICARD, Rosalind W. Affective Computing. Cambridge: MIT Press, 1997.

RUDIN, Cynthia. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, v. 1, p. 206–215, 2019.

SEARLE, John R. Minds, brains, and programs. Behavioral and Brain Sciences, v. 3, n. 3, p. 417-424, 1980.

SIMONDON, Gilbert. Du mode d’existence des objets techniques. Paris: Aubier, 1958.

SMITH, Brian K. Affect and Musical Composition from Natural Environment Representations. In: SIMPÓSIO BRASILEIRO DE INTELIGÊNCIA ARTIFICIAL (SBIA), 8., 1991, Brasília. Anais [...]. Brasília: Sociedade Brasileira de Computação (SBC), 1991.

SMITH, Brian K. You Can Learn a Lot From Film Scoring. In: INTERNATIONAL CONFERENCE ON COMPUTER MUSIC (ICMC), 1999, Beijing. Proceedings [...]. Beijing: International Computer Music Association, 1999. Disponível em: https://www.researchgate.net/publication/369538638_You_Can_Learn_a_Lot_From_Film_Scoring#fullTextFileContent. Acesso em: 16 mai. 2026.

SMITH, Brian K.; REISER, Brian J. MILES: A Case-Based Reasoning System for Music Composition. Working Notes of the AAAI Workshop on AI and Music. Madison: AAAI Press, 1998. Disponível em: https://aaai.org/proceeding/ws98-15/. Acesso em: 16 mai. 2026.

TSURUOKA, Toshihisa; MUNIZ, Ashley Erika. Soundwriter: Real-Time Music Generation for Oral Storytelling through Emotion Mapping. In: INTERNATIONAL COMPUTER MUSIC CONFERENCE (ICMC), 2019, New York. Proceedings [...]. New York: International Computer Music Association, 2019. p. 118-121.

Published

2026-10-30

How to Cite

Guerra, A. (2026). Brian K. Smith: Affect, Cognition, and Musical Artificial Intelligence. Vortex Music Journal, 14, 1–27. https://doi.org/10.33871/vortex.2026.14.12179

Issue

Section

Original Article