The influence of listener experience, measurement scale and speech task on the reliability of auditory-perceptual evaluation of vocal quality
Jônatas do Nascimento Alves; Anna Alice Figueiredo de Almeida; Rosiane Yamasaki; Leonardo Wanderley Lopes
Abstract
Keywords
References
1 Eadie TL, Baylor CR. The effect of perceptual training on inexperienced listeners’ judgments of dysphonic voice. J Voice. 2006;20(4):527-44.
2 Barsties B, De Bodt M. Assessment of voice quality: current state-of-the-art. Auris Nasus Larynx. 2015;42(3):183-8.
3 Childers DG, Lee CK. Vocal quality factors: analysis, synthesis, and perception. J Acoust Soc Am. 1991;90(5):2394-410.
4 Ri Z, Wendel K, Smith-Olinde L. The effect of speaking task on perceptual judgment of the severity of dysphonic voice. J Voice. 2005;19(4):574-81.
5 Kreiman J, Vanlancker-Sidtis D, Geratt B. Defining and measuring voice quality. From Sound to Sense. 2004;163-68.
6 Martins PC, Couto TE, Gama AC. Auditory-perceptual evaluation of the degree of vocal deviation: correlation between the visual analogue scale and numerical scale. CoDAS. 2015;27(3):279-84.
7 Godino-Llorente JI, Osma-Ruiz V, Sáenz-Lechón N, Gómez-Vilda P, Blanco-Velasco M, Cruz-Roldán F. The effectiveness of the glottal to noise excitation ratio for the screening of voice disorders. J Voice. 2010;24(1):47-56.
8 Orozco-Arroyave JR, Belalcazar-Bolaños EA, Arias-Londoño JD, Vargas-Bonilla JF, Skodda S, Rusz J, et al. Characterization methods for the detection of multiple voice disorders: neurological, functional, and laryngeal diseases. IEEE J Biomed Health Inform. 2015;19(6):1820-8.
9 Ugulino AC, Oliveira G, Behlau M. Disfonia na percepção do clínico e do paciente. J Soc Bras Fonoaudiol. 2012;24(2):113-8.
10 Lopes LW. Preferências e atitudes dos ouvintes em relação à variação linguística regional no telejornalismo [tese]. João Pessoa: Universidade Federal da Paraíba; 2012.
11 Oates J. Auditory-perceptual evaluation of disordered voice quality: proscons and future directions. Folia Phoniatr Logop. 2009;61(1):49-56.
12 Lima Silva MFB, Madureira S, Rusilo LC, Camargo Z. Vocal quality assessment: methodological approach for a perceptive data analysis. Rev CEFAC. 2017;19(6):831-41.
13 Barsties B, Maryn Y. The influence of voice sample length in the auditory-perceptual judgment of overall voice quality. J Voice. 2016;31(2):202-10.
14 Roy N, Barkmeier-Kraemer J, Eadie T, Sivasankar MP, Mehta D, Paul D, et al. Evidence-based clinical voice assessment: a systematic review. Am J Speech Lang Pathol. 2013;22(2):212-26.
15 Kraus N, McGee T, Carrell T, King C, Tremblay K, Nicol T. Central auditory system plasticity associated with speech discrimination training. J Cogn Neurosci. 1995;7(1):25-32.
16 Eadie TL, Kapsner M, Rosenzweig J, Waugh P, Hillel A, Merati A. The role of experience on judgments of dysphonia. J Voice. 2010;24(5):564-73.
17 Silva RS, Simões-Zenari M, Nemr NK. Impact of auditory training for perceptual assessment of voice executed by undergraduate students in speech-language pathology. J Soc Bras Fonoaudiol. 2012;24(1):19-25.
18 Lu FL, Matteson S. Speech tasks and interrater reliability in perceptual voice evaluation. J Voice. 2014;28(6):725-32.
19 Maryn Y, Roy N. Sustained vowels and continuous speech in the auditory perceptual evaluation of dysphonia severity. J Soc Bras Fonoaudiol. 2012;24(2):107-12.
20 Bele IV. Reability in perceptual analysis of voice quality. J Voice. 2005;19(4):555-73.
21 Yamasaki R, Madazio G, Leão SHS, Padovani M, Azevedo R, Behlau M. Auditory-perceptual evaluation of normal and dysphonic voices using the voice deviation scale. J Voice. 2017;31(1):67-71.
22 Laczi E, Sussman JE, Stathopoulos ET, Huber J. Perceptual evaluation of hypernasality compared to HONC measures: the role of experience. Cleft Palate Craniofac J. 2005;42(2):202-11.
23 Eadie TL, Nicolici C, Baylor C, Almand K, Waugh P, Maronian N. Effect of experience on judgments of adductor spasmodic dysphonia. Ann Otol Rhinol Laryngol. 2007;116(9):695-701.
24 Kreiman J, Gerratt BR. The perceptual structure of pathologic voice quality. J Acoust Soc Am. 1996;100(3):1787-95.
25 Kempster GB, Gerratt BR, Verdolini Abbott K, Barkmeier-Kraemer J, Hillman RE. Consensus auditory perceptual evaluation of voice: development of a standardized clinical protocol. Am J Speech Lang Pathol. 2009;18(2):124-32.
26 Law T, Kim JH, Lee KY, Tang EC, Lam JH, van Hasselt AC, et al. Comparison of rater’s reliability on perceptual evaluation of different types of voice sample. J Voice. 2012;26(5):666.e13-21.
27 Patel RR, Awan SN, Barkmeier-Kraemer J, Courey M, Deliyski D, Eadie T, et al. Recommended Protocols for Instrumental Assessment of Voice: American Speech-Language-Hearing Association Expert Panel to Develop a Protocol for Instrumental Assessment of Vocal Function. Am J Speech Lang Pathol. 2018;27(3):887-905.
28 Muñoz J, Mendoza E, Fresneda MD, Carballo G, Ramirez I. Perceptual analysis in different voice samples: agreement and reliability. Percept Mot Skills. 2002;94(3 Pt 2):1187-95.
29 Krom G. Consistency and reliability of voice quality ratings for different types of speech fragments. J Speech Hear Res. 1994;37(5):985-1000.
30 Revis J, Giovanni A, Wuyts F, Triglia JM. Comparison of different voice samples for perceptual analysis. Folia Phoniatr Logop. 1999;51(3):108-16.
31 Kreiman J, Gerratt BR, Ito M. When and why listeners disagree in voice quality assessment tasks. J Acoust Soc Am. 2007;122(4):2354-64.
32 Yamasaki R, Leão SHS, Madazio G, Padovani M, Azevedo R. Auditory-perceptual analysis of normal and disorder voices: visual analog scale. In: XV Congresso Brasileiro de Fonoaudiologia e VII Congresso Internacional de Fonoaudiologia. Gramado: CBFa; 2007. p. 16-20.
33 Baravieira PB, Brasolotto AG, Montagnoli NA, Silvério KCA, Yamasaki R, Behlau M. Auditory-perceptual analysis de vozes rugosas e soprosas: correspondência entre a escala visual analógica e a escala numérica. CoDAS. 2016;28(2):163-7.
34 Karnell MP, Melton SD, Childes JM, Coleman TC, Dailey SA, Hoffman HT. Reliability of clinician-based (GRBAS and CAPE-V) and patientbased (V-RQOL and IPVI) documentation of voice disorders. J Voice. 2007;21(5):576-90.
35 Nemr K, Simões-Zenari M, Cordeiro GF, Tsuji D, Ogawa AI, Ubrig MT, et al. GRBAS and Cape-V Scales: high reliability and consensus when applied at different times. J Voice. 2012;26(6):812e17-22.
36 Isshiki N, Olamura M, Tanabe M, Morimoto M. Differential diagnosis ofhoarseness. Folia Phoniatr (Basel). 1969;21(1):9-19.
37 Hirano M. Clinical examination of voice. New York, NY: Springer-Verlag; 1981
38 Hill AE, Bronwyn JD, McAllister S, Wright J, Theodoros DG. Assessment of student competency in a simulated speech-language pathology clinical placement. Int J Speech Lang Pathol. 2013;16(5):464-75.
39 Parsa V, Jamieson DG. Acoustic discrimination of pathological voice: sustained vowels versus continuous speech. J Speech Lang Hear Res. 2001;44(2):327-39.
40 Gonçalves MIR, Pontes PAL, Vieira VP, Pontes AAL, Curcio D, Biase NG. Função de transferência das vogais orais do Português brasileiro: análise acústica comparativa. Rev Bras Otorrinolaringol (Engl Ed). 2009;75(5):680-4.
41 Watts CR, Awan SN. Use of spectral/cepstral analyses for differentiating normal from hypofunctional voices in sustained vowel and continuous speech contexts. J Speech Hear Res. 2011;54(6):1525-37.
42 Parsa V, Jamieson DG. Acoustic discrimination of pathological voice: sustained vowels versus continuous speech. J Speech Lang Hear Res. 2001;44(2):327-39.
43 Moers C, Mobius B, Rosanowski F, Noth E, Eysholdt U, Haderlein T. Vowel- and text-based cepstral analysis of chronic hoarseness. J Voice. 2012;26(4):416-24.
44 Shrivastav R. Evaluating voice quality. In: Ma EPM, Yiu EML, editors. Handbook of voice assessments. San Diego, CA: Singular Publishing Group; 2011. p. 305-18.
45 Kent RD. Hearing and believing: some limits to the auditory-perceptual assessment of speech and voice disorders. Am J Speech Lang Pathol. 1996;5(3):7-23.
46 Lu L, Shara N. Reliability Analysis: Calculate and Compare Intra-Class Correlation Coefficients (Icc) in Sas. Hyattsville: Northeast SAS Users Group 14; 2007.
47 Miot HA. Análise de concordância em estudos clínicos e experimentais. J Vasc Bras. 2016;15(2):89-92.
48 Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155-63.
49 Landis JR, Koch GG. The measurement of observer agreement for categorical data.
50 Shoukri MM. Measures of interobserver agreement. USA: Chapman & Hall Taylor & Francis; 2004.
51 Patel S, Shrivastav R. Perception of dysphonic vocal quality: some thoughts and research update. Perspectives on Voice and Voice Disorders. 2007;17(2):3-7.
52 Kent RD, Read C. Análise acústica da fala. São Paulo: Cortez; 2015.
53 Chan KMK, Yiu EML. The effect of anchors and training on the reliability of perceptual voice evaluation. J Speech Lang Hear Res. 2002;45(1):111-26.
54 Oliveira SB, Gama ACC, Chaves CR. Interferência do tempo de experiência na concordância da auditory-perceptual analysis de vozes neutras e disfônicas. Distúrb Comun. 2016;28(3):415-22.
55 Iwarsson J, Petersen NR. Effects of consensus training on the reliability of auditory perceptual ratings of voice quality. J Voice. 2012;26(3):304-12.
56 Gerratt BR, Kreiman J. Measuring vocal quality with speech synthesis. J Acoust Soc Am. 2001;110(5 Pt 1):2560-6.
57 Kreiman J, Gerratt B, Kempster G, Erman A, Berke G. Perceptual evaluation of voice quality: review, tutorial, and a framework for future research. J Speech Hear Res. 1993;36(1):21-40.
58 Mozzanica F, Ginocchio D, Borghi E, Bachmann C, Schindler A. Reliability and validity of the Italian version of the Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V). Folia Phoniatr Logop. 2013;65(5):257-65.
59 Almeida S, Mendes AP, Kempster GB. The Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V) Psychometric Characteristics: II European Portuguese Version (II EP CAPE-V). J Voice. 2018;33(4):582.e5-13. PMid:29936062.
60 Laver J. Phonetic evaluation of voice quality. In: Kent RD, Ball MJ. Voice quality measurement. San Diego: Singular Publishing Group Inc; 2000. p. 37-48
61 Rouve S, Didier A, Demoly P, Jankowsky R, Klossek JM, Annesi-Maesano I, et al. Numeric score and visual analog scale in assessing seasonal allergic rhinitis severity. Rhinology. 2010;48(3):285-91.
Submitted date:
07/18/2023
Accepted date:
09/24/2023
Facebook
Google+
Twitter
LinkedIn
Mendeley
StumbleUpon
CiteULike
Reddit
Email