Multisensory effects of mask wearing on speech intelligibility and the benefit of multilingualism
Efeitos multissensoriais do uso de máscara na inteligibilidade da fala e o benefício do multilinguismo
Filipa Ponte, Filipa Melo, Inês Duarte, Catarina Mendonça
Abstract
Purpose: Due to the pandemic of the Covid-19 disease, it became common to wear masks on some public spaces. By covering mouth and nose, visual-related speech cues are greatly reduced, while the auditory signal is both distorted and attenuated. The present study aimed to analyze the multisensory effects of mask wearing on speech intelligibility and the differences in these effects between participants who spoke 1, 2 and 3 languages. Methods: The study consisted of the presentation of sentences from the SPIN test to 40 participants. Participants were asked to report the perceived sentences. There were four conditions: auditory with mask; audiovisual with mask; auditory without mask; audiovisual without mask. Two sessions were conducted, one week apart, each with the same stimuli but with a different signal-to-noise ratio. Results: Results demonstrated that the use of the mask decreased speech intelligibility, both due to a decrease in the quality of auditory stimuli and due to the loss of visual information. Signal-to-noise ratio largely affects speech intelligibility and higher ratios are needed in mask-wearing conditions to obtain any degree of intelligibility. Those who speak more than one language are less affected by mask wearing, as are younger listeners. Conclusion: Wearing a facial mask reduces speech intelligibility, both due to visual and auditory factors. Older people and people who only speak one language are affected the most.
Keywords
Resumo
Objetivo: Devido à pandemia da doença Covid-19, o uso de máscaras em espaços públicos tornou-se comum. Ao cobrir a boca e o nariz, reduzem-se amplamente as pistas visuais associadas à fala, assim como se distorce e atenua o sinal auditivo. Este estudo teve como objetivo analisar os efeitos multissensoriais do uso da máscara na percepção da fala e a diferença entre participantes falantes de uma, duas ou três línguas. Método: Este estudo consistiu na apresentação de frases do SPIN teste a 40 participantes. Os participantes tinham como tarefa reportar as frases percebidas em quatro condições: Auditiva com máscara, audiovisual com máscara, auditiva sem máscara, audiovisual sem máscara. Conduziram-se duas sessões, com uma semana de intervalo, cada uma com os mesmos estímulos mas com diferente relação sinal-ruído. Resultados: Os resultados demonstraram que o uso de máscara reduz a inteligibilidade da fala, tanto devido à diminuição da qualidade do estímulo auditivo, como devido à perda de informação visual. A relação sinal-ruído afeta a inteligibilidade e com o uso de máscara são necessárias relações mais altas para obter qualquer identificação correta. Aqueles que falam mais do que uma língua, assim como os mais novos, são menos afetados na percepção de fala com uso de máscara. Conclusão: O uso de máscara facial reduz a inteligibilidade da fala, tanto devido a fatores visuais como auditivos. Indivíduos monolíngues, assim como os mais velhos, são os mais afetados nesta tarefa.
Palavras-chave
Referencias
-
Yang L, Liu S, Liu J, Zhang Z, Wan X, Huang B, et al. COVID-19: immunopathogenesis and Immunotherapeutics. Signal Transduct Target Ther. 2020;5(1):128. PMid:32712629.
- 2
Bandaru SV, Augustine AM, Lepcha A, Sebastian S, Gowri M, Philip A, et al. The effects of N95 mask and face shield on speech perception among healthcare workers in the coronavirus disease 2019 pandemic scenario. J Laryngol Otol. 2020;134(10):895-8. http://dx.doi.org/10.1017/S0022215120002108 PMid:32981539.
» http://dx.doi.org/10.1017/S0022215120002108 - 3
Magee M, Lewis C, Noffs G, Reece H, Chan JC, Zaga CJ, et al. Effects of face masks on acoustic analysis and speech perception: implications for peri-pandemic protocols. J Acoust Soc Am. 2020;148(6):3562-8. http://dx.doi.org/10.1121/10.0002873 PMid:33379897.
» http://dx.doi.org/10.1121/10.0002873 - 4
Tiippana K, Andersen TS, Sams M. Visual attention modulates audiovisual speech perception. Eur J Cogn Psychol. 2004;16(3):457-72. http://dx.doi.org/10.1080/09541440340000268
» http://dx.doi.org/10.1080/09541440340000268 - 5
Brown VA, Van Engen KJ, Peelle JE. Face mask type affects audiovisual speech intelligibility and subjective listening effort in young and older adults. Cogn Res Princ Implic. 2021;6(1):49. http://dx.doi.org/10.1186/s41235-021-00314-0 PMid:34275022.
» http://dx.doi.org/10.1186/s41235-021-00314-0 - 6
Andersen TS, Tiippana K, Laarni J, Kojo I, Sams M. The role of visual spatial attention in audiovisual speech perception. Speech Commun. 2009;51(2):184-93. http://dx.doi.org/10.1016/j.specom.2008.07.004
» http://dx.doi.org/10.1016/j.specom.2008.07.004 - 7
Skipper JI, Van Wassenhove V, Nusbaum HC, Small SL. Hearing lips and seeing voices: how cortical areas supporting speech production mediate audiovisual speech perception. Cereb Cortex. 2007;17(10):2387-99. http://dx.doi.org/10.1093/cercor/bhl147 PMid:17218482.
» http://dx.doi.org/10.1093/cercor/bhl147 - 8
McGurk H, MacDonald J. Hearing lips and seeing voices. Nature. 1976;264(5588):746-8. http://dx.doi.org/10.1038/264746a0 PMid:1012311.
» http://dx.doi.org/10.1038/264746a0 - 9
Marian V, Hayakawa S, Lam TQ, Schroeder SR. Language experience changes audiovisual perception. Brain Sci. 2018;8(5):85. http://dx.doi.org/10.3390/brainsci8050085 PMid:29751619.
» http://dx.doi.org/10.3390/brainsci8050085 - 10
Navarra J, Soto-Faraco S. Hearing lips in a second language: visual articulatory information enables the perception of second language sounds. Psychol Res. 2007;71(1):4-12. http://dx.doi.org/10.1007/s00426-005-0031-5 PMid:16362332.
» http://dx.doi.org/10.1007/s00426-005-0031-5 - 11
Ferreira, G.C., Torres, E.M., Garcia, M.V., Santos, S.N., & Costa, M.J., 2019. Bilingualism and speech recognition in silence and noise in adults. CoDAS 31(5), e20180217. PMid:31644717. http://dx.doi.org/10.1590/2317-1782/20192018217
» http://dx.doi.org/10.1590/2317-1782/20192018217 - 12
Smiljanic R, Keerstock S, Meemann K, Ransom SM. Face masks and speaking style affect audio-visual word recognition and memory of native and non-native speech. J Acoust Soc Am. 2021;149(6):4013-23. http://dx.doi.org/10.1121/10.0005191 PMid:34241444.
» http://dx.doi.org/10.1121/10.0005191 - 13
Toscano JC, Toscano CM. Effects of face masks on speech recognition in multi-talker babble noise. PLoS One. 2021;16(2):e0246842. http://dx.doi.org/10.1371/journal.pone.0246842 PMid:33626073.
» http://dx.doi.org/10.1371/journal.pone.0246842 - 14
Truong TL, Beck SD, Weber A. The impact of face masks on the recall of spoken sentences. J Acoust Soc Am. 2021;149(1):142-4. http://dx.doi.org/10.1121/10.0002951 PMid:33514131.
» http://dx.doi.org/10.1121/10.0002951 - 15
Truong TL, Weber A. Intelligibility and recall of sentences spoken by adult and child talkers wearing face masks. J Acoust Soc Am. 2021;150(3):1674-81. http://dx.doi.org/10.1121/10.0006098 PMid:34598631.
» http://dx.doi.org/10.1121/10.0006098 - 16
Yi H, Pingsterhaus A, Song W. Effects of wearing face masks while using different speaking styles in noise on speech intelligibility during the COVID-19 pandemic. Front Psychol. 2021;12:682677. http://dx.doi.org/10.3389/fpsyg.2021.682677 PMid:34295288.
» http://dx.doi.org/10.3389/fpsyg.2021.682677 - 17
Sönnichsen R, Llorach Tó G, Hochmuth S, Hohmann V, Radeloff A. How face masks interfere with speech understanding of normal-hearing individuals: vision makes the difference. Otol Neurotol. 2022;43(3):282-8. http://dx.doi.org/10.1097/MAO.0000000000003458 PMid:34999618.
» http://dx.doi.org/10.1097/MAO.0000000000003458 - 18
Fernandes A, Lucas AF, Rodrigues C, Silva D, Pinho J, Santos V, et al. Teste de SPIN em Português Europeu. Revista Portuguesa de Otorrinolaringologia e Cirurgia de Cabeça e Pescoço. 2015;53(4):209-13.
- 19
Baraldi GDS, Almeida LCD, Borges ACDC. Evolução da perda auditiva no decorrer do envelhecimento. Rev Bras Otorrinolaringol. 2007;73(1):64-70. http://dx.doi.org/10.1590/S0034-72992007000100010
» http://dx.doi.org/10.1590/S0034-72992007000100010 - 20
Goh JO, Park DC. Neuroplasticity and cognitive aging: the scaffolding theory of aging and cognition. Restor Neurol Neurosci. 2009;27(5):391-403. http://dx.doi.org/10.3233/RNN-2009-0493 PMid:19847066.
» http://dx.doi.org/10.3233/RNN-2009-0493
Submitted date:
02/02/2023
Accepted date:
19/04/2023
Facebook
Google+
Twitter
LinkedIn
Mendeley
StumbleUpon
CiteULike
Reddit
Email