Emojis and visual literacy: a semiotic analysis of non-verbal language and emotional expression
DOI:
https://doi.org/10.33871/22386084.2026.16.11657Keywords:
Visual literacy, Emojis, Situated cognition, Non-verbal languageAbstract
This study explores the potential of emojis as non-verbal symbols for communicating and measuring emotional responses in decision-making. The research framework involved testing 100 consumers (55% female; 64% aged 18-25) using the Rate-All-That-Apply (RATA) method with 41 pictograms to assess perceptions of kefir stimuli at different levels of information about its functional properties. Data analysis was conducted using Factorial Correspondence Analysis (FCA) and Principal Component Analysis (PCA). The findings show that emojis capture subjective nuances of valence and emotional arousal that go beyond traditional hedonic scales. It was demonstrated that the use of pictograms is sensitive to situated cognition, enabling the mapping of emotional valence shifts induced by health information. In the fields of Education and Languages, the study indicates that emojis serve as semiotic levelers, promoting emotional expression and the development of socio-emotional skills, thereby providing inclusive pedagogical support for learners with varying levels of verbal literacy. It is concluded that these signs can serve as potential predictors of choicepreference, bridging communication gaps in interfaces where verbal language may be limited.
Downloads
References
ARSHAD, Mahzan; CHEN, Wu Hsueh. Vygotsky's socio-cultural theory of literacy: Scaffolding children to read and write at an early age. Wacana, Jakarta, v. 11, n. 2, p. 319-334, out. 2009. Disponível em: https://doi.org/10.17510/wacana.v11i2.158. Acesso em: 22 jan. 2026.
ANDRADE JR, Edson de Oliveira; ANDRADE, Edson de Oliveira. Lexical analysis of the Code of Medical Ethics of the Federal Council of Medicine. Revista da Associação Médica Brasileira, v. 62, n. 2, p. 123-130, 2016. Disponível em: https://doi.org/10.1590/1806-9282.62.02.123. Acesso em: 14 jan. 2026.
CAMARA, Gabriele Silveira; CAMBOIM, Silvana Philippi; BRAVO, João Vitor Meza. Semantic correlation between emojis and feelings’ descriptions for Mapping Emotions into the Urban Mobility context. Abstracts of the ICA, v. 3, p. 1-3, 2021. Disponível em: https://www.scielo.br/j/ep/a/ZLkQp5sWqTz8yJjKkGcRvLt/. Acesso em: 10 dez. 2025.
CAMPBELL, Cary; OLTEANU, Alin; KULL, Kalevi. Learning and knowing as semiosis: Extending the conceptual apparatus of semiotics. Sign systems studies., v. 47, n. 3-4, p. 352-381, 2019. Disponível em: https://doi.org/10.12697/SSS.2019.47.3-4.01. Acesso em: 10 dez. 2025.
ERLE, Thorsten M. et al. Emojis as social information in digital communication. Emotion, v. 22, n. 7, p. 1529, 2022. Disponível em: https://doi.org/10.1037/emo0000992. Acesso em: 14 dez. 2025.
FATIMA, Naeem; EJAZ, Sehar Jabeen; MIRAN, Ghulam. Exploring the Role of Visual Semiotics Analysis in Digital Communication for Ideological Purposes; A Study of Memes and Emojis. Liberal Journal of Language & Literature Review, v. 3, n. 1, p. 345-364, 2025. Disponível em: https://llrjournal.com/index.php/11/article/view/98. Acesso em: 05 jan. 2026.
FERRÉ, Pilar et al. Emoji-Dis: A dataset of emojis characterised in 13 discrete emotions. Scientific Data, v. 12, n. 1, p. 1313, 2025. Disponível em: https://doi.org/10.1038/s41597-025-05682-6. Acesso em: 21 jan. 2026.
GIBSON, Will; HUANG, Pingping; YU, Qianyun. Emoji and communicative action: The semiotics, sequence and gestural actions of ‘face covering hand’. Discourse, context & media, v. 26, p. 91-99, 2018. Disponível em: https://doi.org/10.1016/j.dcm.2018.05.005. Acesso em: 21 jan. 2026.
GODARD, Rebecca; HOLTZMAN, Susan. The multidimensional lexicon of emojis: A new tool to assess the emotional content of emojis. Frontiers in psychology, v. 13, p. 921388, 2022. Disponível em: https://doi.org/10.3389/fpsyg.2022.921388. Acesso em: 14 dez. 2025.
GUNDAWAR, Prashant et al. Analyzing the Impact of Semiotic Strategies in Brand Development on Consumer Psychology Using Machine Learning and AI. In: 2024 Second International Conference Computational and Characterization Techniques in Engineering & Sciences (IC3TES). IEEE, 2024. p. 1-5. Disponível em: https://doi.org/10.1109/IC3TES62412.2024.10877444. Acesso em: 21 jan. 2026.
HOLTGRAVES, Thomas. The role of emoji in the communication of specific emotions. Acta Psychologica, v. 260, p. 105678, 2025. Disponível em: https://doi.org/10.1016/j.actpsy.2025.105678. Acesso em: 14 dez. 2025.
HUNG, David WL; CHEN, Der-Thanq. Situated cognition, Vygotskian thought and learning from the communities of practice perspective: Implications for the design of web-based e-learning. Educational Media International, v. 38, n. 1, p. 3-12, 2001. Disponível em: https://doi.org/10.1080/09523980121818. Acesso em: 14 dez. 2025.
JAEGER, Sara R.; ROIGARD, Christina M.; ARES, Gastón. Measuring consumers' product associations with emoji and emotion word questionnaires: case studies with tasted foods and written stimuli. Food Research International, v. 111, p. 732-747, 2018. Disponível em: https://doi.org/10.1016/j.foodres.2018.04.010. Acesso em: 14 dez. 2025.
KERSLAKE, Laura; WEGERIF, Rupert. The semiotics of emoji: the rise of visual language in the age of the internet (book review). Media and Communication, v. 5, n. 4, p. 75-78, 2017. Disponível em: https://doi.org/10.17645/mac.v5i4.1041. Acesso em: 22 jan. 2026.
KULL, Kalevi. Choosing and learning: Semiosis means choice. Σημειωτκή-Sign Systems Studies, v. 46, n. 4, p. 452-466, 2018. Disponível em: https://doi.org/10.12697/SSS.2018.46.4.03. Acesso em: 22 jan. 2026.
KUMAR, Sunita; THANKACHAN, Jimmy. Aesthetic of Consumption: A Review of Sensory Branding and Visual Semiotics in Consumer Experience. Advances in Consumer Research, v. 2, p. 1068-1083, 2025. Disponível em: https://acr-journal.com/article/aesthetic-of-consumption-a-review-of-sensory-branding-and-visual-semiotics-in-consumer-experience-1787/. Acesso em: 21 jan. 2026.
LU, Wanhong et al. The lexicalization of emojis: the influence of frequency and functions of emojis in sentences on this process—a study based on eye movement tracking. Frontiers in Psychology, v. 16, p. 1631967, 2025. Disponível em: https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2025.1631967/full. Acesso em: 13 jan. 2026.
MESSARIS, Paul. Visual “literacy” in the digital age. Review of Communication, v. 12, n. 2, p. 101-117, 2012. Disponível em: https://doi.org/10.1080/15358593.2011.653508. Acesso em: 13 jan. 2026.
NUTTAVUTHISIT, Krittinee. How consumers as aesthetic subjects co-create the aesthetic experience of the retail environment. Journal of Retailing and Consumer Services, v. 21, n. 4, p. 432-437, 2014. Disponível em: https://doi.org/10.1016/j.jretconser.2014.03.003. Acesso em: 21 jan. 2026.
OLTEANU, Alin; STABLES, Andrew. Learning and adaptation from a semiotic perspective. Sign Systems Studies, v. 46, n. 4, p. 409-434, 2018. Disponível em: https://doi.org/10.12697/SSS.2018.46.4.01. Acesso em: 14 jan. 2026.
POHL, Henning; DOMIN, Christian; ROHS, Michael. Beyond just text: semantic emoji similarity modeling to support expressive communication. ACM Transactions on Computer-Human Interaction (TOCHI), v. 24, n. 1, p. 1-42, 2017. Disponível em: https://henningpohl.net/papers/Pohl2017TOCHI.pdf. Acesso em: 14 dez. 2025.
STRAND, Torill. A semiotic model of learning. Chinese Semiotic Studies, v. 17, n. 1, p. 153-162, 2021. Disponível em: https://doi.org/10.1515/css-2021-0008. Acesso em: 21 jan. 2026.
STRUBE, Gerhard. Cognitive science: overview. 2001. Disponível em: https://doi.org/10.1016/B0-08-043076-7/01441-8. Acesso em: 21 jan. 2026.
TIEU, Lyn et al. Experimental evidence for a semantic typology of emoji: Inferences of co-, pro-, and post-text emoji. Quarterly Journal of Experimental Psychology, v. 78, n. 4, p. 808-826, 2025. Disponível em: https://doi.org/10.1177/17470218241255786. Acesso em: 21 jan. 2026.
UDRIS-BORODAVKO, Natalia et al. Aesthetics and semiotics in 21st century visual communications: Pedagogical and sociocultural aspects. Research Journal in Advanced Humanities, v. 4, n. 4, p. 22-40, 2023. Disponível em: https://doi.org/10.58256/rjah.v4i4.1144. Acesso em: 21 jan. 2026.
VENKATESH, Alladi; MEAMBER, Laurie A. The aesthetics of consumption and the consumer as an aesthetic subject. Consumption, Markets and culture, v. 11, n. 1, p. 45-70, 2008. Disponível em: https://doi.org/10.1080/10253860701799983. Acesso em: 21 jan. 2026.
WANG, Rongbin. The semiotics of emoji: the rise of visual language in the age of the internet: by Marcel Danesi, London, Oxford, New York, New Delhi, Sydney, Bloomsbury, 2017. Disponível em: https://doi.org/10.1080/10350330.2018.1472864. Acesso em: 14 jan. 2026.
WENINGER, Csilla; HUIMIN, Xu. AI, representation, and critical digital literacy: Navigating visual bias in the digital age. System, p. 103896, 2025. Disponível em: https://doi.org/10.1016/j.system.2025.103896. Acesso em: 22 jan. 2026
ZAQHID, Ahmad Aqsal. Visual Semiotics and Learner Engagement in Technology Mediated Language Education. LIER: Language Inquiry & Exploration Review, v. 2, n. 2, p. 71-81, 2025. Disponível em: https://pppii.org/index.php/lier/article/view/163. Acesso em: 13 jan. 2026
AUTOR et al. [Omitido para anonimização].
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Vinícius Rodrigues Arruda Pinto, Marco Antônio Silva Alvarenga

This work is licensed under a Creative Commons Attribution 4.0 International License.
Autores mantêm os direitos autorais e concedem à revista o direito de primeira publicação, com o trabalho simultaneamente licenciado sob a Licença Creative Commons Attribution que permite o compartilhamento do trabalho com reconhecimento da autoria e publicação inicial nesta revista.



