Navigation auf zora.uzh.ch

Search ZORA

ZORA (Zurich Open Repository and Archive)

Evaluation of Algorithms for Interaction-Sparse Recommendations: Neural Networks don’t Always Win

Klingler, Yasamin; Lehmann, Claude; Monteiro, João Pedro; Saladin, Carlo; Bernstein, Abraham; Stockinger, Kurt (2022). Evaluation of Algorithms for Interaction-Sparse Recommendations: Neural Networks don’t Always Win. In: 25th International Conference on Extending Database Technology, Edinburgh, UK, 29 March 2022 - 1 April 2022. OpenProceedings, 475-486.

Abstract

In recent years, top-K recommender systems with implicit feed-back data gained interest in many real-world business scenarios. In particular, neural networks have shown promising results on these tasks. However, while traditional recommender systems are built on datasets with frequent user interactions, insurance recommenders often have access to a very limited amount of user interactions, as people only buy a few insurance products.

In this paper, we shed new light on the problem of top-K recommendations for interaction-sparse recommender problems. In particular, we analyze six different recommender algorithms, namely a popularity-based baseline and compare it against two matrix factorization methods (SVD++, ALS), one neural network approach (JCA) and two combinations of neural network and factorization machine approaches (DeepFM, NeuFM). We evaluate these algorithms on six different interaction-sparse datasets and one dataset with a less sparse interaction pattern to elucidate the unique behavior of interaction-sparse datasets.

In our experimental evaluation based on real-world insurance data, we demonstrate that DeepFM shows the best performance followed by JCA and SVD++, which indicates that neural network approaches are the dominant technologies. However, for the remaining five datasets we observe a different pattern. Overall, the matrix factorization method SVD++ is the winner. Surprisingly, the simple popularity-based approach comes out second followed by the neural network approach JCA. In summary, our experimental evaluation for interaction-sparse datasets demonstrates that in general matrix factorization methods outperform neural network approaches. As a consequence, traditional well- established methods should be part of the portfolio of algorithms to solve real-world interaction-sparse recommender problems.

Additional indexing

Item Type:Conference or Workshop Item (Paper), not_refereed, original work
Communities & Collections:03 Faculty of Economics > Department of Informatics
Dewey Decimal Classification:000 Computer science, knowledge & systems
Scopus Subject Areas:Physical Sciences > Information Systems
Physical Sciences > Software
Physical Sciences > Computer Science Applications
Scope:Discipline-based scholarship (basic research)
Language:English
Event End Date:1 April 2022
Deposited On:05 Apr 2023 07:42
Last Modified:06 Mar 2024 14:37
Publisher:OpenProceedings
Series Name:Advances in Database Technology
Number:25
ISSN:2367-2005
ISBN:978-3-89318-085-7
OA Status:Gold
Free access at:Publisher DOI. An embargo period may apply.
Publisher DOI:https://doi.org/10.48786/edbt.2022.42
Other Identification Number:merlin-id:22302
Download PDF  'Evaluation of Algorithms for Interaction-Sparse Recommendations: Neural Networks don’t Always Win'.
Preview
  • Content: Published Version
  • Language: English
  • Licence: Creative Commons: Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0)

Metadata Export

Statistics

Citations

Dimensions.ai Metrics

Altmetrics

Downloads

89 downloads since deposited on 05 Apr 2023
38 downloads since 12 months
Detailed statistics

Authors, Affiliations, Collaborations

Similar Publications