Interrater reliability in the temporal quantitative analysis of oropharyngeal swallowing using a specific software
Confiabilidade entre avaliadores na análise quantitativa temporal da deglutição orofaríngea por meio de software específico
Paula Cristina Cola; Thaís Coelho Alves; Ana Rita Gatto; Claudio José Rubira; André Augusto Spadotto; Roberta Gonçalves da Silva
Abstract
Purpose: This study aims to analyze inter-judge reliability by measuring a few temporal parameters of swallowing using a specific software. Methods: Six databases that include the results of reliability tests performed in prior studies by the present research group were employed. The datasets were obtained using the same measurement method and include data obtained based on puree (level 3) consistency and liquid (level 0) consistency according to the International Dysphagia Diet Standardization Initiative. In this study, the reliabilities corresponding to the total oral transit time (TOTT), initiation of the pharyngeal response time (PRT), and the pharyngeal transit time (PTT) were measured using the same software; the evaluations performed by a single rater for all datasets were used as the benchmark, and evaluations performed by new raters for each dataset were also included. The intra-class correlation coefficient (ICC) with a 95% confidence interval was employed. Results: A total of 244 videofluoroscopic swallowing study images were analyzed. In all analyses, the ICCs were >0,75 and showed excellent agreement between the senior and junior raters. The TOTT for level 3 showed ICCs from 0.936 to 1.000 and that for level 0 showed ICCs from 0.997 to 1.000. Further, the PRT showed ICCs from 0.916 to 1.000 for level 3 and from 0.978 to 1.000 for level 0. The PTT showed ICCs from 0.848 to 1.000 for level 3 and from 0.984 to 1.000 for level 0. Conclusion: The reliabilities obtained using this specific software for the TOTT, PRT, and PTT showed excellent agreement.
Keywords
Resumo
Objetivo: analisar a confiabilidade inter-juízes por meio da mensuração de alguns parâmetros temporais da deglutição por meio de um software específico. Método: Foram utilizados seis bancos de dados que incluem os resultados dos testes de confiabilidade realizados em estudos anteriores do presente grupo de pesquisa. Os bancos de dados foram obtidos usando o mesmo método de medição e incluem dados obtidos na consistência purê (nível 3) e líquida (nível 0). Neste estudo, as confiabilidades correspondentes ao tempo de trânsito oral total (TTOT), tempo de início de resposta faríngea (IRF) e tempo de trânsito faríngeo (TTF) mensuradas no mesmo software; as avaliações realizadas por um único avaliador para todos os bancos de dados foram usadas como referência, e as avaliações realizadas por novos avaliadores para cada banco de dados também foram incluídas. Foi utilizado o coeficiente de correlação intraclasse (ICC) com intervalo de confiança de 95%. Resultados: Foram analisadas 244 imagens de estudos videofluoroscópicos da deglutição. Em todas as análises, os ICCs foram >0,75, mostrando excelente concordância entre avaliadores. O TTOT do nível 3 apresentou ICCs de 0,936 a 1.000 e o do nível 0 apresentou ICCs de 0,997 a 1,000. Além disso, o IRF mostrou ICCs de 0,916 a 1,000 para o nível 3 e de 0,978 a 1,000 para o nível 0. O TTF mostrou ICCs de 0,848 a 1,000 para o nível 3 e de 0,984 a 1,000 para o nível 0. Conclusão: As confiabilidades obtidas com este software específico para o TTOT, IRF e TTF mostraram excelente concordância.
Palavras-chave
Referências
1) Wilcox F, Liss JM, Siegel GM. Interjudge agreement in videofluoroscopic studies of swallowing. J Speech Hear Res. 1996;39(1):144-52. http://dx.doi.org/10.1044/jshr.3901.144 PMid:8820706.
» http://dx.doi.org/10.1044/jshr.3901.144
2) Zarkada A, Regan J. Inter-rater reliability of the Dysphagia Outcome and Severity Scale (DOSS): effects of clinical experience, audio-recording and training. Dysphagia. 2018;33(3):329-36. http://dx.doi.org/10.1007/s00455-017-9857-4 PMid:29052050.
» http://dx.doi.org/10.1007/s00455-017-9857-4
3) Bryant KN, Finnegan E, Berbaum K. VFS interjudge reliability using a free and directed search. Dysphagia. 2012;27(1):53-63. http://dx.doi.org/10.1007/s00455-011-9337-1 PMid:21484603.
» http://dx.doi.org/10.1007/s00455-011-9337-1
4) Stoeckli SJ, Huisman TAGM, Seifert B, Martin–Harris BJW. Interrater Reliability of Videofluoroscopic Swallow Evaluation. Dysphagia. 2003;18(1):53-7. http://dx.doi.org/10.1007/s00455-002-0085-0 PMid:12497197.
» http://dx.doi.org/10.1007/s00455-002-0085-0
5) Scott A, Perry A, Bench J. A study of interrater reliability when using videofluoroscopy as an assessment of swallowing. Dysphagia. 1998;13(4):223-7. http://dx.doi.org/10.1007/PL00009576 PMid:9716754.
» http://dx.doi.org/10.1007/PL00009576
6) Spadotto AA, Gatto AR, Cola PC, Montagnoli AN, Schelp AO, Silva RG, et al. Software para análise quantitativa da deglutição. Radiol Bras. 2008;41(1):25-8. http://dx.doi.org/10.1590/S0100-39842008000100008
» http://dx.doi.org/10.1590/S0100-39842008000100008
7) Molfenter SM, Steele CM. Temporal variability in the deglutition literature. Dysphagia. 2012;27(2):162-77. http://dx.doi.org/10.1007/s00455-012-9397-x PMid:22366761.
» http://dx.doi.org/10.1007/s00455-012-9397-x
8) Furkim AM, da Silva RG, Vanin G, Martino R. The association between temporal measures of swallowing with penetration and aspiration in patients with dysphagia: A meta-analysis. NeuroRehabilitation. 2019;44(1):111-29. http://dx.doi.org/10.3233/NRE-182553 PMid:30776021.
» http://dx.doi.org/10.3233/NRE-182553
9) Power ML, Hamdy S, Goulermas JY, Tyrrell PJ, Turnbull I, Thompson DG. predicting aspiration after hemispheric stroke from timing measures of oropharyngeal bolus flow and laryngeal closure. Dysphagia. 2009;24(3):257-64. http://dx.doi.org/10.1007/s00455-008-9198-4 PMid:19252944.
» http://dx.doi.org/10.1007/s00455-008-9198-4
10) Nagy A, Leigh C, Hori SF, Molfenter SM, Shariff T, Steele CM. Timing differences between cued and noncued swallows in healthy young adults. Dysphagia. 2013;28(3):428-34. http://dx.doi.org/10.1007/s00455-013-9456-y PMid:23456325.
» http://dx.doi.org/10.1007/s00455-013-9456-y
11) Kim DH, Choi KH, Kim HM, Koo JH, Kim BR, Kim TW, et al. Inter-rater reliability of videofluoroscopic dysphagia scale. Ann Rehabil Med. 2012;36(6):791-6. http://dx.doi.org/10.5535/arm.2012.36.6.791 PMid:23342311.
» http://dx.doi.org/10.5535/arm.2012.36.6.791
12) Molfenter SM, Steele CM. Kinematic and temporal factors associated with penetration aspiration in swallowing liquids. Dysphagia. 2014;29(2):269-76. http://dx.doi.org/10.1007/s00455-013-9506-5 PMid:24445381.
» http://dx.doi.org/10.1007/s00455-013-9506-5
13) Mozzanica F, Lorusso R, Robotti C, Zambon T, Corti P, Pizzorni N, et al. Effect of age, sex, bolus volume, and bolus consistency on whiteout duration in healthy subjects during FEES. Dysphagia. 2019;34(2):192-200. http://dx.doi.org/10.1007/s00455-018-9961-0 PMid:30456424.
» http://dx.doi.org/10.1007/s00455-018-9961-0
14) Santos RRD, Cola PC, Jorge AG, Peres FM, Lauris JRP, Silva RG. Correlação entre tempo de trânsito oral e faríngeo no Acidente Vascular Cerebral. Audiol Commun Res. 2015;20(3):198-202. http://dx.doi.org/10.1590/S2317-64312015000300001567
» http://dx.doi.org/10.1590/S2317-64312015000300001567
15) Gatto AR, Cola PC, da Silva RG, Ribeiro PW, Spadotto AA, Henry MAAC. Influence of thermal and gustatory stimulus in the initiation of the pharyngeal swallow and bolus location in stroke. J Stroke Cerebrovasc Dis. 2021;30(4):105349. http://dx.doi.org/10.1016/j.jstrokecerebrovasdis.2020.105349 PMid:33549862.
» http://dx.doi.org/10.1016/j.jstrokecerebrovasdis.2020.105349
16) Alves TC, Cola PC, Jorge AG, Gatto AR, Da Silva RG. Relationship between pharyngeal response time and lateralized brain lesion in stroke. Top Stroke Rehabil. 2019;26(6):435-9. http://dx.doi.org/10.1080/10749357.2019.1623519 PMid:31154954.
» http://dx.doi.org/10.1080/10749357.2019.1623519
17) Cola PC, Gatto AR, Silva RG, Spadotto AA, Schelp AO, Henry MACA. The influence of sour taste and cold temperature in pharyngeal transit duration in patients with stroke. Arq Gastroenterol. 2010;47(1):18-21. http://dx.doi.org/10.1590/S0004-28032010000100004 PMid:20520970.
» http://dx.doi.org/10.1590/S0004-28032010000100004
18) Cola PC, Gatto AR, da Silva RG, Spadotto AA, Ribeiro PW, Schelp AO, et al. Taste and temperature in swallowing transit time after stroke. Cerebrovasc Dis Extra. 2012;2(1):45-51. http://dx.doi.org/10.1159/000339888 PMid:23139681.
» http://dx.doi.org/10.1159/000339888
19) Cichero JAY, Lam P, Steele CM, Hanson B, Chen J, Dantas RO, et al. Development of international terminology and definitions for texture-modified foods and thickened fluids used in dysphagia management: the IDDSI framework. Dysphagia. 2017;32(2):293-314. http://dx.doi.org/10.1007/s00455-016-9758-y PMid:27913916.
» http://dx.doi.org/10.1007/s00455-016-9758-y
20) Logemann JA. Evaluation and treatment of swallowing disorders. San Diego: College-Hill; 1983.
21) Logemann JA, Pauloski BR, Colangelo L, Lazarus C, Fujiu M, Kahrilas PJ. Effects of a sour bolus on oropharyngeal swallowing measures in patients with neurogenic dysphagia. J Speech Hear Res. 1995;38(3):556-63. http://dx.doi.org/10.1044/jshr.3803.556 PMid:7674647.
» http://dx.doi.org/10.1044/jshr.3803.556
22) Gatto AR, Cola PC, Silva RG, Spadotto AA, Ribeiro PW, Schelp AO, et al. Sour taste and cold temperature in the oral phase of swallowing in patients after stroke. CoDAS. 2013;25(2):164-8. http://dx.doi.org/10.1590/S2317-17822013000200012 PMid:24408246.
» http://dx.doi.org/10.1590/S2317-17822013000200012
23) Kendall KA, Leonard RJ. Bolus transit and airway protection coordination in older dysphagic patients. Laryngoscope. 2001;111(11 Pt 1):2017-21. http://dx.doi.org/10.1097/00005537-200111000-00028 PMid:11801989.
» http://dx.doi.org/10.1097/00005537-200111000-00028
24) Kendall KA, Mckenzie S, Leonard RJ, Gonçalves MI, Walker A. Timing of events in normal swallowing: a videofluoroscopic study. Dysphagia. 2000;15(2):74-83. http://dx.doi.org/10.1007/s004550010004 PMid:10758189.
» http://dx.doi.org/10.1007/s004550010004
25) Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;6(4):284-90. http://dx.doi.org/10.1037/1040-3590.6.4.284
» http://dx.doi.org/10.1037/1040-3590.6.4.284
26) Swan K, Cordier R, Brown T, Speyer R. Psychometric properties of visuoperceptual measures of videofluoroscopic and fibre-endoscopic evaluations of swallowing: a systematic review. Dysphagia. 2019;34(1):2-33. http://dx.doi.org/10.1007/s00455-018-9918-3 PMid:30019178.
» http://dx.doi.org/10.1007/s00455-018-9918-3
27) Baijens L, Barikroo A, Pilz W. Intrarater and interrater reliability for measurements in videofluoroscopy of swallowing. Eur J Radiol. 2013;82(10):1683-95. http://dx.doi.org/10.1016/j.ejrad.2013.05.009 PMid:23773554.
» http://dx.doi.org/10.1016/j.ejrad.2013.05.009
28) Pauloski BR, Rademaker AW, Kern M, Shaker R, Logemann JA. The feasibility of establishing agreement between laboratories for measures of oropharyngeal structural movements. J Med Speech-Lang Pathol. 2009;17(1):9-19. PMid:21512610.
29) Kahrilas PJ, Lin S, Chen J, Logemann JA. Oropharyngeal accommodation to swallow volume. Gastroenterology. 1996;111(2):297-306. http://dx.doi.org/10.1053/gast.1996.v111.pm8690194 PMid:8690194.
» http://dx.doi.org/10.1053/gast.1996.v111.pm8690194
30) Vilardell N, Rofes L, Arreola V, Martin A, Muriana D, Palomeras E, et al. Videofluoroscopic assessment of the pathophysiology of chronic poststroke oropharyngeal dysphagia. Neurogastroenterol Motil. 2017;29(10):1-8. http://dx.doi.org/10.1111/nmo.13111 PMid:28547922.
» http://dx.doi.org/10.1111/nmo.13111
Submetido em:
07/12/2020
Aceito em:
21/02/2021
Facebook
Google+
Twitter
LinkedIn
Mendeley
StumbleUpon
CiteULike
Reddit
Email