CoDAS
https://codas.org.br/article/doi/10.1590/2317-1782/20242024041en
CoDAS
Artigo Original

Activity ordering task: conceptualization and development of a novel context-based working memory task with a metacognitive facet

Nidhi Lalu Jacob; Gagan Bajaj; Aysha Rooha; Vinitha Mary George; Jayashree S. Bhat

Downloads: 0
Views: 81

Abstract

ABSTRACT: Purpose: The aim of the present study was to conceptualize and develop a novel context-based working memory (WM) task which would possess the potential to assess the context-based WM in an Indian scenario and incorporate a task-linked metacognitive facet to understand an individual's self-perception of performance.

Methods: Employing the ADDIE instructional design model, comprising Analysis, Design, Development, Implementation and Evaluation phases, the present study focused on the initial four phases. In the Analysis-phase, the needs and objectives for creating a context-based WM task were identified. Design-phase included task conceptualization and content validation of the conceptualized context-based WM task. In the Develop-phase, the designed context-based WM task was developed in an animated video format. Five content experts and fifteen lay experts were involved in the content validation process. In the Implementation-phase, a pilot study was done on ten adults to assess the feasibility of the novel context-based WM task.

Results: The task obtained good content validation index and understandability scores on the Patient Education Materials Assessment Tool. Preliminary data trends from the implementation-phase revealed the task's potential to detect age-related WM differences. Significantly correlated with established WM tasks, the novel Activity Ordering Task (AOT) effectively measured WM-spans. Observed discrepancies between performance and prediction/postdiction spans during metacognitive facet administration highlighted the AOT's utility in evaluating metacognition.

Conclusion: Addressing the limitations of context in traditional tasks, the AOT appears to be a promising tool that not only measures WM but also assesses metacognition, thereby enhancing its utility beyond an everyday WM assessment.

Keywords

Everyday Working Memory, Activity Ordering Task, Metacognition, Indian Adults, Context-based Task

Referências

1 Namratha HG, George VM, Bajaj G, Mridula J, Bhat JS. Effect of yoga and working memory training on cognitive communicative abilities among middle aged adults. Complement Ther Clin Pract. 2017;28:92-100. http://doi.org/10.1016/j.ctcp.2017.05.007. PMid:28779944.

2 Baddeley A. Working memory: theories, models, and controversies. Annu Rev Psychol. 2012;63(1):1-29. http://doi.org/10.1146/annurev-psych-120710-100422. PMid:21961947.

3 Cansino S, Hernández-Ramos E, Estrada-Manilla C, Torres-Trejo F, Martínez-Galindo JG, Ayala-Hernández M, et al. The decline of verbal and visuospatial working memory across the adult life span. Age (Dordr). 2013;35(6):2283-302. http://doi.org/10.1007/s11357-013-9531-1. PMid:23558670.

4 Ecker UK, Lewandowsky S, Oberauer K, Chee AE. The components of working memory updating: an experimental decomposition and individual differences. J Exp Psychol Learn Mem Cogn. 2010;36(1):170-89. http://doi.org/10.1037/a0017891. PMid:20053053.

5 de Paula JJ, Malloy-Diniz LF, Romano-Silva MA. Reliability of working memory assessment in neurocognitive disorders: A study of the digit span and Corsi block-tapping tasks. Rev Bras Psiquiatr. 2016;38(3):262-3. http://doi.org/10.1590/1516-4446-2015-1879. PMid:27579598.

6 George VM, Bajaj G, Bhat JS. Efficacy of working memory training in middle-aged adults. Communication Sciences &. Commun Sci Disord. 2020;25(4):830-56. http://doi.org/10.12963/csd.20768.

7 Redick TS, Broadway JM, Meier ME, Kuriakose PS, Unsworth N, Kane MJ, et al. Measuring working memory capacity with automated complex span tasks. Eur J Psychol Assess. 2012;28(3):164-71. http://doi.org/10.1027/1015-5759/a000123.

8 Schmiedek F, Lovden M, Lindenberger U. A task is a task is a task: putting complex span, N-back, and other working memory indicators in psychometric context. Front Psychol. 2014;5:1475. http://doi.org/10.3389/fpsyg.2014.01475. PMid:25566149.

9 Brown KD, Schmitter-Edgecombe M. A clinic-based measure of everyday planning ability: the overnight trip task. Arch Clin Neuropsychol. 2024;39(1):51-64. http://doi.org/10.1093/arclin/acad052. PMid:37489707.

10 Rumpf U, Menze I, Müller NG, Schmicker M. Investigating the potential role of ecological validity on change-detection memory tasks and distractor processing in younger and older adults. Front Psychol. 2019;10:1046. http://doi.org/10.3389/fpsyg.2019.01046. PMid:31178777.

11 Jessup C. A guide to the Multiple Errands Test [Internet]. 2018 [cited 2024 Feb 19]. Available from: https://scholar.utc.edu/honors-theses/130.

12 Dawson DR, Marcotte TD. Special issue on ecological validity and Cognitive Assessment. Neuropsychol Rehabil. 2017;27(5):599-602. http://doi.org/10.1080/09602011.2017.1313379. PMid:28480821.

13 Mazurek A, Bhoopathy RM, Read JC, Gallagher P, Smulders TV. Effects of age on a real-world what-where-when memory task. Front Aging Neurosci. 2015;7:74. http://doi.org/10.3389/fnagi.2015.00074. PMid:26042030.

14 Okahashi S, Seki K, Nagano A, Luo Z, Kojima M, Futaki T. A virtual shopping test for realistic assessment of cognitive function. J Neuroeng Rehabil. 2013;10(1):59. http://doi.org/10.1186/1743-0003-10-59. PMid:23777412.

15 Sanz Simon S, Ben-Eliezer D, Pondikos M, Stern Y, Gopher D. Feasibility and acceptability of a new web-based cognitive training platform for cognitively healthy older adults: the breakfast task. Pilot Feasibility Stud. 2023;9(1):136. http://doi.org/10.1186/s40814-023-01359-2. PMid:37542331.

16 Park DC, Huang C-M. Culture wires the brain. Perspect Psychol Sci. 2010;5(4):391-400. http://doi.org/10.1177/1745691610374591. PMid:22866061.

17 Merkley TL, Esopenko C, Zizak VS, Bilder RM, Strutt AM, Tate DF, et al. Challenges and opportunities for harmonization of cross-cultural neuropsychological data. Neuropsychology. 2023;37(3):237-46. http://doi.org/10.1037/neu0000818. PMid:35549387.

18 Porrselvi A, Shankar V. Status of cognitive testing of adults in India. Ann Indian Acad Neurol. 2017;20(4):334-40. http://doi.org/10.4103/aian.AIAN_107_17. PMid:29184333.

19 Dawson TL. Metacognition and learning in adulthood. Developmental Testing Service, LLC; 2008 [cited 2024 May 26]. Available from: https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=3f8c7e40fe183de233433be5899ec7a801b5ae61

20 Woelfer SW, Tomitch LM, Procailo L. Working memory, metacognition and Foreign Language Reading Comprehension: a bibliographical review. Let Hoje. 2019;54(2):263. http://doi.org/10.15448/1984-7726.2019.2.32314.

21 Weakley A, Weakley AT, Schmitter-Edgecombe M. Compensatory strategy use improves real-world functional performance in community dwelling older adults. Neuropsychology. 2019;33(8):1121-35. http://doi.org/10.1037/neu0000591. PMid:31448941.

22 Arora C, Frantz C, Toglia J. Awareness of performance on a functional cognitive performance-based assessment across the adult lifespan. Front Psychol. 2021;12:753016. http://doi.org/10.3389/fpsyg.2021.753016. PMid:34803834.

23 Chi SY, Chua EF, Kieschnick DW, Rabin LA. Retrospective metamemory monitoring of Semantic Memory in community-dwelling older adults with subjective cognitive decline and mild cognitive impairment. Neuropsychol Rehabil. 2022;32(3):429-63. http://doi.org/10.1080/09602011.2020.1831552. PMid:33106082.

24 Chudoba LA, Schmitter-Edgecombe M. Insight into memory and functional abilities in individuals with amnestic mild cognitive impairment. J Clin Exp Neuropsychol. 2020;42(8):822-33. http://doi.org/10.1080/13803395.2020.1817338. PMid:32957853.

25 Ozturk N. Assessing metacognition: theory and practices. IJATE. 2017:4(2);134-48. http://doi.org/10.21449/ijate.298299

26 Chen P, Toglia J. Online and offline awareness deficits: anosognosia for spatial neglect. Rehabil Psychol. 2019;64(1):50-64. http://doi.org/10.1037/rep0000207. PMid:29648845.

27 Mohapatra B, Laures-Gore J. Moving toward accurate assessment of working memory in adults with neurogenically based communication disorders. Am J Speech Lang Pathol. 2021;30(3):1292-300. http://doi.org/10.1044/2021_AJSLP-20-00305. PMid:33970679.

28 Sopian S, Inderawati R, Petrus I. Developing e-learning based local-folklores for eighth graders. English Review. J Eng Educ. 2019;8(1):101. http://doi.org/10.25134/erjee.v8i1.1813.

29 Folstein MF, Folstein SE, McHugh PR. Mini-mental state: a practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12(3):189-98. http://doi.org/10.1016/0022-3956(75)90026-6. PMid:1202204.

30 Radhakrishnan M, Nagaraja SB. Modified kuppuswamy socioeconomic scale 2023: stratification and updates. Int J Community Med Public Health. 2023;10(11):4415-8. http://doi.org/10.18203/2394-6040.ijcmph20233487.

31 Marian V, Blumenfeld HK, Kaushanskaya M. The language experience and proficiency questionnaire (LEAP-Q): assessing language profiles in Bilinguals and multilinguals. J Speech Lang Hear Res. 2007;50(4):940-67. http://doi.org/10.1044/1092-4388(2007/067). PMid:17675598.

32 McMillan SS, King M, Tully MP. How to use the nominal group and Delphi Techniques. Int J Clin Pharm. 2016;38(3):655-62. http://doi.org/10.1007/s11096-016-0257-x. PMid:26846316.

33 Yusoff MS. ABC of content validation and content validity index calculation. Education in Medicine Journal. 2019;11(2):49-54. http://doi.org/10.21315/eimj2019.11.2.6.

34 Shoemaker SJ, Wolf MS, Brach C. Development of the patient education materials assessment tool (PEMAT): a new measure of understandability and actionability for print and audiovisual patient information. Patient Educ Couns. 2014;96(3):395-403. http://doi.org/10.1016/j.pec.2014.05.027. PMid:24973195.

35 Bajaj G, D’Souza D, George V, Karuppali S, Bhat J. “I think I can remember” age-related changes in self-efficacy for short-term memory. J Nat Sci Biol Med. 2021;12(1):97. http://doi.org/10.4103/jnsbm.JNSBM_32_20.

36 Oliveira CR, Lopes Filho BJ, Sugarman MA, Esteves CS, Lima MM, Moret-Tatay C, et al. Development and feasibility of a virtual reality task for the Cognitive Assessment of older adults: the ECO-VR. Span J Psychol. 2016;19:E95. http://doi.org/10.1017/sjp.2016.96. PMid:27955716.

37 Drljača D, Latinović B, Stanković Ž, Cvetković D. Addie Model for development of E-courses. In: Proceedings of the International Scientific Conference - Sinteza 2017. Serbia: Singidunum University; 2017. p. 242-7. http://doi.org/10.15308/Sinteza-2017-242-247

38 Nur Kholifah L, Supriyana S, Bahiyatun B, Widyawati MN. Using addie model to design early detection system of child growth and development in the Community Health Center of Bendosari, Semarang Indonesia. Belitung Nursing Journal. 2017;3(3):205-12. http://doi.org/10.33546/bnj.105.

39 Vakili MM, Jahangiri N. Content validity and reliability of the measurement tools in educational, behavioral, and Health Sciences Research. Journal of Medical Education Development. 2018;10(28):106-18. http://doi.org/10.29252/edcj.10.28.106.

40 Lipari M, Berlie H, Saleh Y, Hang P, Moser L. Understandability, actionability, and readability of online patient education materials about diabetes mellitus. Am J Health Syst Pharm. 2019;76(3):182-6. http://doi.org/10.1093/ajhp/zxy021. PMid:31408087.

41 Chan JYC, Kwong JSW, Wong A, Kwok TCY, Tsoi KKF. Comparison of computerized and paper-and-pencil memory tests in detection of mild cognitive impairment and dementia: A systematic review and meta-analysis of Diagnostic Studies. J Am Med Dir Assoc. 2018;19(9):748-756.e5. http://doi.org/10.1016/j.jamda.2018.05.010. PMid:29921507.

42 Ahmad FN, Tan P, Hockley WE. Directed forgetting for Categorised Pictures: recognition memory for perceptual details versus Gist. Memory. 2019;27(7):894-903. http://doi.org/10.1080/09658211.2019.1591456. PMid:30849286.
 


Submetido em:
19/02/2024

Aceito em:
23/04/2024

6769f5aca953950e9e669f02 codas Articles

CoDAS

Share this page
Page Sections