A prosodic analysis of emotional expressions in Langkat Malay speech

Emmy Erwina

Abstract


Emotional prosody is the paralinguistic elements of language that interact with verbal content to express emotion. It also demonstrates the complex relationship between voice expression and emotional experience, highlighting the depth to which humans can express complex emotions beyond words. This qualitative study investigated the prosodic features associated with the emotional expression of anger in Langkat Malay speech. It focused on variations in pitch, loudness, and tempo among speakers from different socio-economic backgrounds. The aims are to explain how emotions are encoded in speech; and to highlight the influence of cultural and social contexts on emotional expression through prosody. This study employed a qualitative method. The data were collected from 40 native Langkat Malay speakers, divided evenly between individuals from the nobility and the general populace, encompassing a range of ages from 20 to 50 years. The samples were collected, processed, and analyzed using Praat software. The study then looked at the prosodic aspects of emotional speech in terms of its acoustic characteristics. The results showed that louder, faster tempos, and higher pitches are used to indicate anger. The study also found differences between the socioeconomic classes, with the nobles exhibiting more intense and intricate pitch contours in their angry reactions than the ordinary public. It can be concluded that within the Langkat Malay group, cultural and socioeconomic influences modulate prosodic aspects of emotional manifestation. This study is expected to disclose implications for speech therapy, language instruction, and the creation of emotionally intelligent artificial intelligence systems. It will also likely highlight the significance of taking cultural differences into account when studying emotional prosody.


Keywords


Cultural Linguistics; emotional expression; Langkat Malay; Prosody; Speech Analysis; Socio-economic Factors

Full Text:

PDF

References


Abdel-Hamid, L., Shaker, N. H., & Emara, I. (2020). Analysis of linguistic and prosodic features of bilingual Arabic–English speakers for speech emotion recognition. Ieee Access, 8, 72957-72970. https://doi.org/10.1109/ACCESS.2020.2987864

Al-Dujaili, M. J., & Ebrahimi-Moghadam, A. (2023). Speech emotion recognition: a comprehensive survey. Wireless Personal Communications, 129(4), 2525-2561. https://doi.org/10.1007/s11277-023-10244-3

Alsmadi, K. A., Yunus, K., & Almadani, Y. (2020). The importance of intonation in the performance of different speech acts. English Education: Jurnal Tadris Bahasa Inggris, 13(2), 65-79. https://ejournal.radenintan.ac.id/index.php/ENGEDU/article/view/7415

Anikin, A. (2020). The link between auditory salience and emotion intensity. Cognition and Emotion, 34(6), 1246-1259. https://doi.org/10.1080/02699931.2020.1736992

Anikin, A., Pisanski, K., Massenet, M., & Reby, D. (2021). Harsh is large: nonlinear vocal phenomena lower voice pitch and exaggerate body size. Proceedings of the Royal Society B, 288(1954), 20210872.

Banse, R., & Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of personality and social psychology, 70(3), 614-636. https://doi.org/10.1037/0022-3514.70.3.614

Bharadwaj, S., & Acharjee, P. B. (2020, November). Analysis of Prosodic features for the degree of emotions of an Assamese Emotional Speech. In 2020 4th International Conference on Electronics, Communication and Aerospace Technology (ICECA) (pp. 1441-1452). IEEE.

Cohn, M., Predeck, K., Sarian, M., & Zellou, G. (2021). Prosodic alignment toward emotionally expressive speech: Comparing human and Alexa model talkers. Speech Communication, 135, 66-75. https://doi.org/10.1016/j.specom.2021.10.003

D'Onofrio, A., & Eckert, P. (2021). Affect and iconicity in phonological variation. Language in Society, 50(1), 29-51. https://doi.org/10.1017/S0047404520000871

Durmuş, H. E., & Okyayuz, Ş. (2023). An appraisal approach to emotion, culture and discourse in audio description. In M. Deckert, R. Zago, & P. Pezik (Eds.), Language, expressivity and cognition (p. 209). Bloomsbury Publishing.

Elfenbein, H. A., Laukka, P., Althoff, J., Chui, W., Iraki, F. K., Rockstuhl, T., & Thingujam, N. S. (2022). What do we hear in the voice? An open-ended judgment study of emotional speech prosody. Personality and Social Psychology Bulletin, 48(7), 1087-1104. https://doi.org/10.1177/01461672211029786

Erdemir, A., Liu, Y. Y., & Campos, M. J. (2023, June). Emotion explorers & zen: AI system and voice assistant for exploring emotions and cultivating compassion. In Proceedings of the 22nd Annual ACM Interaction Design and Children Conference (pp. 444-448). ACM Digital Library.

Ertürk, A., Gürses, E., & Kulak Kayıkcı, M. E. (2024). Sex related differences in the perception and production of emotional prosody in adults. Psychological Research, 88(2), 449-457. https://doi.org/10.1007/s00426-023-01865-1

Esposito, L., & Gratton, C. (2022). Prosody and ideologies of embodiment: Variation in the use of pitch and articulation rate among fitness instructors. Language in Society, 51(2), 211-236. https://doi.org/10.1017/S0047404520000809

Gandhioke, S., & Singh, C. (2023). Learner awareness of the “music” of spoken english—focus on intonation—and its impact on communicative competence. is intonation teachable and learnable? Creative Education, 14(3), 454-468. https://doi.org/10.4236/ce.2023.143031

Gao, F. (2023). Getting the message in ‘Sound’across at conference interpreting: a case study on rendering prosodic emphasis. Perspectives, 31(6), 1033-1048. https://doi.org/10.1080/0907676X.2022.2117636

Gasteiger, N., Lim, J., Hellou, M., MacDonald, B. A., & Ahn, H. S. (2024). A scoping review of the literature on prosodic elements related to emotional speech in human-robot interaction. International Journal of Social Robotics, 16(4), 659-670. https://doi.org/10.1007/s12369-022-00913-x

Hashem, A., Arif, M., & Alghamdi, M. (2023). Speech emotion recognition approaches: A systematic review. Speech Communication, 154, 102974. https://doi.org/10.1016/j.specom.2023.102974

Hirst, D. J., & de Looze, C. (2021). Measuring Speech. Fundamental frequency and pitch. In R. Knight & J. Setter (Eds.), Cambridge handbook of Phonetics (pp. 336-361). Cambridge University Press.

Huttenlauch, C., Hansen, M., de Beer, C., Hanne, S., & Wartenburger, I. (2023). Age effects on linguistic prosody in coordinates produced to varying interlocutors: Comparison of younger and older speakers. In F. Schubö, S. Zerbian, & S. Sandra (Eds.), Prosodic boundary phenomena (pp. 157-192). Language Science Press.

Ivanova, Y. E., & Mikhaleva, E. I. (2022). The role of prosody in expressing culture-specific speech behaviour of language teachers in English. TLC Journal, 6(1), 49-59. https://doi.org/10.22363/2521-442X-2022-6-1-49-59

Kanwal, S., Asghar, S., Hussain, A., & Rafique, A. (2022). Identifying the evidence of speech emotional dialects using artificial intelligence: A cross-cultural study. Plos one, 17(3), e0265199. https://doi.org/10.1371/journal.pone.0265199

Karimi-Boroujeni, M., Dajani, H. R., & Giguère, C. (2023). Perception of prosody in hearing-impaired individuals and users of hearing assistive devices: An overview of recent advances. Journal of Speech, Language, and Hearing Research, 66(2), 775-789. https://doi.org/10.1044/2022_JSLHR-22-00125

Kolekar, S. S., Richter, D. J., & Bappi, M. I. (2024). Advancing AI voice synthesis: Integrating emotional expression in multi-speaker voice generation. In 2024 International Conference on Artificial Intelligence in Information and Communication (ICAIIC). IEEE.

Ladd, D. R., & Arvaniti, A. (2023). Prosodic prominence across languages. Annual Review of Linguistics, 9(1), 171-193. https://doi.org/10.1146/annurev-linguistics-031120-101954

Larrouy-Maestri, P., Poeppel, D., & Pell, M. D. (2024). The sound of emotional prosody: Nearly 3 decades of research and future directions. Perspectives on Psychological Science, 17456916231217722. https://doi.org/10.1177/17456916231217722

Lau, J. C., Patel, S., Kang, X., Nayar, K., Martin, G. E., Choy, J., ... & Losh, M. (2022). Cross-linguistic patterns of speech prosodic differences in autism: A machine learning study. PloS one, 17(6), e0269637. https://doi.org/10.1371/journal.pone.0269637

Laukka, P., & Elfenbein, H. A. (2021). Cross-cultural emotion recognition and in-group advantage in vocal expression: A meta-analysis. Emotion Review, 13(1), 3-11. https://doi.org/10.1177/1754073919897295

Li, J., & Huang, C. R. (2023). Investigating acoustic cues of emotional valence in Mandarin speech prosody-A Corpus approach. In Workshop on Chinese Lexical Semantics (pp. 316-330). Springer Nature Singapore.

Ma, W., Zhou, P., & Thompson, W. F. (2022). Children’s decoding of emotional prosody in four languages. Emotion, 22(1), 198-212. https://doi.org/10.1037/emo0001054

Maharani, M. H. (2023). Volitive interjections in Langkat Malay. IJOTL-TL: Indonesian Journal of Language Teaching and Linguistics, 8(3), 202-211. https://ijotl-tl.soloclcs.org/index.php/ijoltl/article/view/758

Mauchand, M., & Pell, M. D. (2021). Emotivity in the voice: prosodic, lexical, and cultural appraisal of complaining speech. Frontiers in Psychology, 11, 619222. https://doi.org/10.3389/fpsyg.2020.619222

Mauchand, M., & Pell, M. D. (2023). Complain like you mean it! How prosody conveys suffering even about innocuous events. Brain and Language, 244, 105305. https://doi.org/10.1016/j.bandl.2023.105305

Melnik-Leroy, G. A., Bernatavičienė, J., Korvel, G., Navickas, G., Tamulevičius, G., & Treigys, P. (2022). An overview of Lithuanian intonation: a linguistic and modelling perspective. Informatica, 33(4), 795-832. https://doi.org/10.15388/22-INFOR502

Mujahiddin, M., Triadi, R., & Chairunnisa, C. (2020, November). The existence of Malay language in the flow of modernization in Medan city. In Proceeding International Conference on Language and Literature (IC2LC) (pp. 229-234). Universitas Muhammadiyah Sumatera Utara.

Nault, D. R., Bonar, R. J., Ilyaz, E., Dirks, M. A., & Morningstar, M. (2024). Fast and friendly: The role of vocal cues in adolescents' responses to and perceptions of peer provocation. Journal of Research on Adolescence, 00, 1-15. https://doi.org/10.1111/jora.12992

Patnaik, S. (2023). Speech emotion recognition by using complex MFCC and deep sequential model. Multimedia Tools and Applications, 82, 11897-11922. https://doi.org/10.1007/s11042-022-13725-y

Pennebaker, J. W., Mehl, M. R., & Niederhoffer, K. G. (2003). Psychological aspects of natural language use: Our words, our selves. Annual review of psychology, 54(1), 547-577. https://doi.org/10.1146/annurev.psych.54.101601.145041

Ponsonnet, M. (2022). 49 Emotional linguistic relativity and cross-cultural research. In G. L. Schiewer, J. Altarriba, & B. C. Ng (Eds.), Language and emotion volume 2 (pp. 1031-1061). De Gruyter Mouton.

Rodero, E., Larrea, O., Rodríguez-de-Dios, I., & Lucas, I. (2022). The expressive balance effect: perception and physiological responses of prosody and gestures. Journal of language and social psychology, 41(6), 659-684. https://doi.org/10.1177/0261927X221078317

Rokhsaritalemi, S., Sadeghi-Niaraki, A., & Choi, S. M. (2023). Exploring emotion analysis using artificial intelligence, geospatial information systems, and extended reality for urban services. IEEE Access, 11, 92478-92495. https://doi.org/10.1109/ACCESS.2023.3307639

Rosenberg, A., & Hirschberg, J. (2021). Prosodic aspects of the attractive voice. In B. Weiss, J. Trouvain, M. Barkat-Defradas, & J. J. Ohala (Eds.), Voice attractiveness. Prosody, phonology and phonetics (pp. 17–40). Springer. https://doi.org/10.1007/978-981-15-6627-1_2

Ross, E. D. (2023). Affective prosody and its impact on the neurology of language, depression, memory and emotions. Brain Sciences, 13(11), 1572. https://doi.org/10.3390/brainsci13111572

Scherer, K. R. (2022). Theory convergence in emotion science is timely and realistic. Cognition and Emotion, 36(2), 154-170. https://doi.org/10.1080/02699931.2021.1973378

Sun, J., Schwartz, H. A., Son, Y., Kern, M. L., & Vazire, S. (2020). The language of well-being: Tracking fluctuations in emotion experience through everyday speech. Journal of Personality and Social Psychology, 118(2), 364-387. https://doi.org/10.1037/pspp0000244

Tomasello, R., Grisoni, L., Boux, I., Sammler, D., & Pulvermüller, F. (2022). Instantaneous neural processing of communicative functions conveyed by speech prosody. Cerebral cortex, 32(21), 4885-4901. https://doi.org/10.1093/cercor/bhab522

Truba, H., Khrapatyi, S., Harashchuk, K., Shvets, D., & Proskurnia, A. (2024). Psycholinguistic underpinnings of image formation: Suggestion and manipulation in the educational network discourse. Thinking Skills and Creativity, 52, 101496. https://doi.org/10.1016/j.tsc.2024.101496

Vogel, A. P., & Morgan, A. T. (2009). Factors affecting the quality of sound recording for speech and voice analysis. International journal of speech-language pathology, 11(6), 431-437. https://doi.org/10.3109/17549500902822189

Wade-Woolley, L., Wood, C., Chan, J., & Weidman, S. (2022). Prosodic competence as the missing component of reading processes across languages: Theory, evidence and future research. Scientific Studies of Reading, 26(2), 165-181. https://doi.org/10.1080/10888438.2021.1995390

Wang, H., Peng, A., & Patterson, M. M. (2021). The roles of class social climate, language mindset, and emotions in predicting willingness to communicate in a foreign language. System, 99, 102529. https://doi.org/10.1016/j.system.2021.102529

Zhang, M., Xu, S., Chen, Y., Lin, Y., Ding, H., & Zhang, Y. (2022). Recognition of affective prosody in autism spectrum conditions: A systematic review and meta-analysis. Autism, 26(4), 798-813. https://doi.org/10.1177/1362361321995725




DOI: https://doi.org/10.17509/ijal.v14i1.70392

Refbacks

  • There are currently no refbacks.


View My Stats

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.