Header

UZH-Logo

Maintenance Infos

Digitalisation of the Brief Visuospatial Memory Test-Revised and Evaluation with a Machine Learning Algorithm


Birchmeier, Martin Eduard; Studer, Tobias; Lutterotti, Andreas; Penner, Iris-Katharina; Bignens, Serge (2020). Digitalisation of the Brief Visuospatial Memory Test-Revised and Evaluation with a Machine Learning Algorithm. Studies in Health Technology and Informatics, 270:168-172.

Abstract

The disease multiple sclerosis (MS) is characterized by various neurological symptoms. This paper deals with a novel tool to assess cognitive dysfunction. The Brief Visuospatial Memory Test-Revised (BVMT-R) is a recognized method to measure optical recognition deficits and their progression. Typically, the test is carried out on paper. We present a way to make this process more efficient, without losing quality by having the patients using a tablet App and having the drawings rated with the use of a machine learning (ML) algorithm. A dataset of 1'525 drawings were digitalized and then randomly split in a training dataset and in a test dataset. In addition to the training dataset the already trained drawings from a preliminary paper were added to the training dataset. The ratings done by two neuropsychologists matched for 81% of the test dataset. The ratings done automatically with the ML algorithm matched 72% with the ones of the first neuropsychologist and 79% of the ones of the second neuropsychologist. For a semi-automated rating we defined a threshold value for the reliability of the rating of 78.8%, under which the drawing is routed for manual rating. With this threshold value the ML algorithm matched 80.3% and 86.6% of the ratings of the first and second neuropsychologists. The neuropsychologists have in that case to manually check 17.4% of the drawings. With our results is it possible to execute the BVMT-R Test in a digital way. We found out, that our ML algorithms have with the semi-automated method the similar matching as the two professional raters.

Abstract

The disease multiple sclerosis (MS) is characterized by various neurological symptoms. This paper deals with a novel tool to assess cognitive dysfunction. The Brief Visuospatial Memory Test-Revised (BVMT-R) is a recognized method to measure optical recognition deficits and their progression. Typically, the test is carried out on paper. We present a way to make this process more efficient, without losing quality by having the patients using a tablet App and having the drawings rated with the use of a machine learning (ML) algorithm. A dataset of 1'525 drawings were digitalized and then randomly split in a training dataset and in a test dataset. In addition to the training dataset the already trained drawings from a preliminary paper were added to the training dataset. The ratings done by two neuropsychologists matched for 81% of the test dataset. The ratings done automatically with the ML algorithm matched 72% with the ones of the first neuropsychologist and 79% of the ones of the second neuropsychologist. For a semi-automated rating we defined a threshold value for the reliability of the rating of 78.8%, under which the drawing is routed for manual rating. With this threshold value the ML algorithm matched 80.3% and 86.6% of the ratings of the first and second neuropsychologists. The neuropsychologists have in that case to manually check 17.4% of the drawings. With our results is it possible to execute the BVMT-R Test in a digital way. We found out, that our ML algorithms have with the semi-automated method the similar matching as the two professional raters.

Statistics

Citations

Dimensions.ai Metrics

Altmetrics

Downloads

50 downloads since deposited on 11 Jan 2021
35 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:04 Faculty of Medicine > University Hospital Zurich > Clinic for Neurology
Dewey Decimal Classification:610 Medicine & health
Scopus Subject Areas:Physical Sciences > Biomedical Engineering
Health Sciences > Health Informatics
Health Sciences > Health Information Management
Language:English
Date:16 June 2020
Deposited On:11 Jan 2021 06:42
Last Modified:12 Jan 2021 21:00
Publisher:I O S Press
ISSN:0926-9630
OA Status:Green
Free access at:Publisher DOI. An embargo period may apply.
Publisher DOI:https://doi.org/10.3233/SHTI200144
PubMed ID:32570368

Download

Green Open Access

Download PDF  'Digitalisation of the Brief Visuospatial Memory Test-Revised and Evaluation with a Machine Learning Algorithm'.
Preview
Content: Published Version
Filetype: PDF
Size: 239kB
View at publisher
Licence: Creative Commons: Attribution-NonCommercial 4.0 International (CC BY-NC 4.0)