Publication: What’s the Meaning of Superhuman Performance in Today’s NLU?
What’s the Meaning of Superhuman Performance in Today’s NLU?
Date
Date
Date
Citations
Tedeschi, S., Bos, J., Declerck, T., Hajič, J., Hershcovich, D., Hovy, E., Koller, A., Krek, S., Schockaert, S., Sennrich, R., Shutova, E., & Navigli, R. (2023). What’s the Meaning of Superhuman Performance in Today’s NLU? 12471–12491. https://doi.org/10.18653/v1/2023.acl-long.697
Abstract
Abstract
Abstract
In the last five years, there has been a significant focus in Natural Language Processing (NLP) on developing larger Pretrained Language Models (PLMs) and introducing benchmarks such as SuperGLUE and SQuAD to measure their abilities in language understanding, reasoning, and reading comprehension. These PLMs have achieved impressive results on these benchmarks, even surpassing human performance in some cases. This has led to claims of superhuman capabilities and the provocative idea that certain tasks have been solved. In this position
Metrics
Downloads
Views
Additional indexing
Creators (Authors)
Event Title
Event Title
Event Title
Event Location
Event Location
Event Location
Event Country
Event Country
Event Country
Event Start Date
Event Start Date
Event Start Date
Event End Date
Event End Date
Event End Date
Page range/Item number
Page range/Item number
Page range/Item number
Page end
Page end
Page end
Item Type
Item Type
Item Type
Dewey Decimal Classifikation
Dewey Decimal Classifikation
Dewey Decimal Classifikation
Language
Language
Language
Date available
Date available
Date available
OA Status
OA Status
OA Status
Publisher DOI
Metrics
Downloads
Views
Citations
Tedeschi, S., Bos, J., Declerck, T., Hajič, J., Hershcovich, D., Hovy, E., Koller, A., Krek, S., Schockaert, S., Sennrich, R., Shutova, E., & Navigli, R. (2023). What’s the Meaning of Superhuman Performance in Today’s NLU? 12471–12491. https://doi.org/10.18653/v1/2023.acl-long.697
