Header

UZH-Logo

Maintenance Infos

Digitalisation of the Brief Visuospatial Memory Test-Revised and Evaluation with a Machine Learning Algorithm


Birchmeier, Martin Eduard; Studer, Tobias; Lutterotti, Andreas; Penner, Iris-Katharina; Bignens, Serge (2020). Digitalisation of the Brief Visuospatial Memory Test-Revised and Evaluation with a Machine Learning Algorithm. Studies in Health Technology and Informatics, 270:168-172.

Abstract

The disease multiple sclerosis (MS) is characterized by various neurological symptoms. This paper deals with a novel tool to assess cognitive dysfunction. The Brief Visuospatial Memory Test-Revised (BVMT-R) is a recognized method to measure optical recognition deficits and their progression. Typically, the test is carried out on paper. We present a way to make this process more efficient, without losing quality by having the patients using a tablet App and having the drawings rated with the use of a machine learning (ML) algorithm. A dataset of 1'525 drawings were digitalized and then randomly split in a training dataset and in a test dataset. In addition to the training dataset the already trained drawings from a preliminary paper were added to the training dataset. The ratings done by two neuropsychologists matched for 81% of the test dataset. The ratings done automatically with the ML algorithm matched 72% with the ones of the first neuropsychologist and 79% of the ones of the second neuropsychologist. For a semi-automated rating we defined a threshold value for the reliability of the rating of 78.8%, under which the drawing is routed for manual rating. With this threshold value the ML algorithm matched 80.3% and 86.6% of the ratings of the first and second neuropsychologists. The neuropsychologists have in that case to manually check 17.4% of the drawings. With our results is it possible to execute the BVMT-R Test in a digital way. We found out, that our ML algorithms have with the semi-automated method the similar matching as the two professional raters.

Abstract

The disease multiple sclerosis (MS) is characterized by various neurological symptoms. This paper deals with a novel tool to assess cognitive dysfunction. The Brief Visuospatial Memory Test-Revised (BVMT-R) is a recognized method to measure optical recognition deficits and their progression. Typically, the test is carried out on paper. We present a way to make this process more efficient, without losing quality by having the patients using a tablet App and having the drawings rated with the use of a machine learning (ML) algorithm. A dataset of 1'525 drawings were digitalized and then randomly split in a training dataset and in a test dataset. In addition to the training dataset the already trained drawings from a preliminary paper were added to the training dataset. The ratings done by two neuropsychologists matched for 81% of the test dataset. The ratings done automatically with the ML algorithm matched 72% with the ones of the first neuropsychologist and 79% of the ones of the second neuropsychologist. For a semi-automated rating we defined a threshold value for the reliability of the rating of 78.8%, under which the drawing is routed for manual rating. With this threshold value the ML algorithm matched 80.3% and 86.6% of the ratings of the first and second neuropsychologists. The neuropsychologists have in that case to manually check 17.4% of the drawings. With our results is it possible to execute the BVMT-R Test in a digital way. We found out, that our ML algorithms have with the semi-automated method the similar matching as the two professional raters.

Statistics

Citations

Dimensions.ai Metrics

Altmetrics

Downloads

5 downloads since deposited on 11 Jan 2021
5 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:04 Faculty of Medicine > University Hospital Zurich > Clinic for Neurology
Dewey Decimal Classification:610 Medicine & health
Scopus Subject Areas:Physical Sciences > Biomedical Engineering
Health Sciences > Health Informatics
Health Sciences > Health Information Management
Language:English
Date:16 June 2020
Deposited On:11 Jan 2021 06:42
Last Modified:12 Jan 2021 21:00
Publisher:I O S Press
ISSN:0926-9630
OA Status:Green
Free access at:Publisher DOI. An embargo period may apply.
Publisher DOI:https://doi.org/10.3233/SHTI200144
PubMed ID:32570368

Download

Green Open Access

Download PDF  'Digitalisation of the Brief Visuospatial Memory Test-Revised and Evaluation with a Machine Learning Algorithm'.
Preview
Content: Published Version
Filetype: PDF
Size: 239kB
View at publisher
Licence: Creative Commons: Attribution-NonCommercial 4.0 International (CC BY-NC 4.0)