Publication:

SignCLIP: Connecting Text and Sign Language by Contrastive Learning

Date

Date

Date
2024
Conference or Workshop Item
Published version

Citations

Citation copied

Jiang, Z., Sant Muniesa, G., Moryossef, A., Müller, M., Sennrich, R., & Ebling, S. (2024). SignCLIP: Connecting Text and Sign Language by Contrastive Learning. 9171–9193. https://aclanthology.org/2024.emnlp-main.518

Abstract

Abstract

Abstract

We present SignCLIP, which re-purposes CLIP (Contrastive Language-Image Pretraining) to project spoken language text and sign language videos, two classes of natural languages of distinct modalities, into the same space. SignCLIP is an efficient method of learning useful visual representations for sign language processing from large-scale, multilingual video-text pairs, without directly optimizing for a specific task or sign language which is often of limited size.We pretrain SignCLIP on Spreadthesign, a prominent sign language dictio

Metrics

Downloads

7 since deposited on 2025-01-05
Acq. date: 2025-11-13

Views

5 since deposited on 2025-01-05
3last week
Acq. date: 2025-11-13

Citations

Additional indexing

Creators (Authors)

Event Title

Event Title

Event Title
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing

Event Location

Event Location

Event Location
Miami

Event Start Date

Event Start Date

Event Start Date
2024-11-12

Event End Date

Event End Date

Event End Date
2024-11-16

Page range/Item number

Page range/Item number

Page range/Item number
9171

Page end

Page end

Page end
9193

Item Type

Item Type

Item Type
Conference or Workshop Item

Dewey Decimal Classifikation

Dewey Decimal Classifikation

Dewey Decimal Classifikation

Language

Language

Language
English

Date available

Date available

Date available
2025-01-05

OA Status

OA Status

OA Status
Green

Official URL

Official URL

Official URL

Metrics

Downloads

7 since deposited on 2025-01-05
Acq. date: 2025-11-13

Views

5 since deposited on 2025-01-05
3last week
Acq. date: 2025-11-13

Citations

Citations

Citation copied

Jiang, Z., Sant Muniesa, G., Moryossef, A., Müller, M., Sennrich, R., & Ebling, S. (2024). SignCLIP: Connecting Text and Sign Language by Contrastive Learning. 9171–9193. https://aclanthology.org/2024.emnlp-main.518

Green Open Access
Loading...
Thumbnail Image

Files

Files

Files
Files available to download:2

Files

Files

Files
Files available to download:2
Loading...
Thumbnail Image