The Reliability and Clinical Validation of Automatically-Derived Verbal Memory Features of the Verbal Learning Test in Early Diagnostics of Cognitive Impairment

Nina Possemis, Daphne Ter Huurne, Leonie Banning, Angelique Gruters, Stephanie Van Asbroeck, Alexandra König, Nicklas Linz, Johannes Tröger, Kai Langel, Arjan Blokland, Jos Prickaerts, Marjolein de Vugt, Frans Verhey, Inez Ramakers*

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

BACKGROUND: Previous research has shown that verbal memory accurately measures cognitive decline in the early phases of neurocognitive impairment. Automatic speech recognition from the verbal learning task (VLT) can potentially be used to differentiate between people with and without cognitive impairment. OBJECTIVE: Investigate whether automatic speech recognition (ASR) of the VLT is reliable and able to differentiate between subjective cognitive decline (SCD) and mild cognitive impairment (MCI). METHODS: The VLT was recorded and processed via a mobile application. Following, verbal memory features were automatically extracted. The diagnostic performance of the automatically derived features was investigated by training machine learning classifiers to distinguish between participants with SCD versus MCI/dementia. RESULTS: The ICC for inter-rater reliability between the clinical and automatically derived features was 0.87 for the total immediate recall and 0.94 for the delayed recall. The full model including the total immediate recall, delayed recall, recognition count, and the novel verbal memory features had an AUC of 0.79 for distinguishing between participants with SCD versus MCI/dementia. The ten best differentiating VLT features correlated low to moderate with other cognitive tests such as logical memory tasks, semantic verbal fluency, and executive functioning. CONCLUSIONS: The VLT with automatically derived verbal memory features showed in general high agreement with the clinical scoring and distinguished well between SCD and MCI/dementia participants. This might be of added value in screening for cognitive impairment.
Original languageEnglish
Pages (from-to)179-191
Number of pages13
JournalJournal of Alzheimer's Disease
Volume97
Issue number1
DOIs
Publication statusPublished - 2 Jan 2024

Keywords

  • Alzheimer’s disease
  • cognitive dysfunction
  • memory
  • speech

Fingerprint

Dive into the research topics of 'The Reliability and Clinical Validation of Automatically-Derived Verbal Memory Features of the Verbal Learning Test in Early Diagnostics of Cognitive Impairment'. Together they form a unique fingerprint.

Cite this