Header

UZH-Logo

Maintenance Infos

Benchmarks for models of short-term and working memory


Abstract

Any mature field of research in psychology-such as short-term/working memory-is characterized by a wealth of empirical findings. It is currently unrealistic to expect a theory to explain them all; theorists must satisfice with explaining a subset of findings. The aim of the present article is to make the choice of that subset less arbitrary and idiosyncratic than is current practice. We propose criteria for identifying benchmark findings that every theory in a field should be able to explain: Benchmarks should be reproducible, generalize across materials and methodological variations, and be theoretically informative. We propose a set of benchmarks for theories and computational models of short-term and working memory. The benchmarks are described in as theory-neutral a way as possible, so that they can serve as empirical common ground for competing theoretical approaches. Benchmarks are rated on three levels according to their priority for explanation. Selection and ratings of the benchmarks is based on consensus among the authors, who jointly represent a broad range of theoretical perspectives on working memory, and they are supported by a survey among other experts on working memory. The article is accompanied by a web page providing an open forum for discussion and for submitting proposals for new benchmarks; and a repository for reference data sets for each benchmark. (PsycINFO Database Record

Abstract

Any mature field of research in psychology-such as short-term/working memory-is characterized by a wealth of empirical findings. It is currently unrealistic to expect a theory to explain them all; theorists must satisfice with explaining a subset of findings. The aim of the present article is to make the choice of that subset less arbitrary and idiosyncratic than is current practice. We propose criteria for identifying benchmark findings that every theory in a field should be able to explain: Benchmarks should be reproducible, generalize across materials and methodological variations, and be theoretically informative. We propose a set of benchmarks for theories and computational models of short-term and working memory. The benchmarks are described in as theory-neutral a way as possible, so that they can serve as empirical common ground for competing theoretical approaches. Benchmarks are rated on three levels according to their priority for explanation. Selection and ratings of the benchmarks is based on consensus among the authors, who jointly represent a broad range of theoretical perspectives on working memory, and they are supported by a survey among other experts on working memory. The article is accompanied by a web page providing an open forum for discussion and for submitting proposals for new benchmarks; and a repository for reference data sets for each benchmark. (PsycINFO Database Record

Statistics

Citations

Dimensions.ai Metrics
21 citations in Web of Science®
22 citations in Scopus®
Google Scholar™

Altmetrics

Downloads

25 downloads since deposited on 12 Sep 2018
25 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, refereed, further contribution
Communities & Collections:06 Faculty of Arts > Institute of Psychology
Dewey Decimal Classification:150 Psychology
Scopus Subject Areas:Social Sciences & Humanities > General Psychology
Language:English
Date:September 2018
Deposited On:12 Sep 2018 11:39
Last Modified:08 Apr 2020 23:58
Publisher:American Psychological Association
ISSN:0033-2909
Additional Information:This article may not exactly replicate the final version published in the APA journal. It is not the copy of record.
OA Status:Green
Publisher DOI:https://doi.org/10.1037/bul0000153
PubMed ID:30148379
Project Information:
  • : FunderSNSF
  • : Grant IDIZ32Z0_150896
  • : Project TitleWorkshop: Benchmarks for Models of Working Memory
  • : FunderSNSF
  • : Grant IDIZ32Z0_160296
  • : Project TitleWorkshop: Benchmarks for Models of Working Memory, II

Download

Green Open Access

Download PDF  'Benchmarks for models of short-term and working memory'.
Preview
Content: Accepted Version
Filetype: PDF
Size: 743kB
View at publisher