Top Research Papers on Sign Language Recognition
Explore the top research papers on Sign Language Recognition, featuring groundbreaking studies and key developments in the field. Whether you're a researcher, student, or enthusiast, this collection provides valuable insights and knowledge to stay ahead in the domain of sign language recognition technology.
Looking for research-backed answers?Try AI Search
Natural Language-Assisted Sign Language Recognition
108 Citations 2023Ronglai Zuo, Fangyun Wei, Brian Kan-Wing Mak
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
The Natural Language-Assisted Sign Language Recognition (NLA-SLR) framework is proposed, which exploits semantic information contained in glosses (sign labels) and introduces a novel backbone, video-keypoint network, which not only models both RGB videos and human body keypoints but also derives knowledge from sign videos of different temporal receptive fields.
Sign Language Recognition: A Deep Survey
575 Citations 2020Razieh Rastgoo, Kourosh Kiani, Sérgio Escalera
Expert Systems with Applications
A taxonomy to categorize the proposed models for isolated and continuous sign language recognition is presented, discussing applications, datasets, hybrid models, complexity, and future lines of research in the field.
Sign Language Transformers: Joint End-to-End Sign Language Recognition and Translation
114 Citations 2020Necati Cihan Camgöz, Oscar Koller, Simon Hadfield + 1 more
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
A novel transformer based architecture that jointly learns Continuous Sign Language Recognition and Translation while being trainable in an end-to-end manner is introduced by using a Connectionist Temporal Classification (CTC) loss to bind the recognition and translation problems into a single unified architecture.
Hear Sign Language: A Real-time End-to-End Sign Language Recognition System
109 Citations 2020Zhibo Wang, Tengda Zhao, Jinxin Ma + 5 more
IEEE Transactions on Mobile Computing
A novel real-time end-to-end SLR system to translate sign language into voices to help people “hear” sign language using an attention-based encoder-decoder model with a multi-channel convolutional neural network (CNN).
ML Based Sign Language Recognition System
121 Citations 2021K Amrutha, P. Prabu
International Conference on Innovative Trends in Information Technology (ICITIIT)
Assessment of ML-based SLR model was conducted with the help of 4 candidates under a controlled environment, and the model yielded 65% accuracy.
SIGNFORMER: DeepVision Transformer for Sign Language Recognition
130 Citations 2023Deep Kothadiya, Chintan Bhatt, Tanzila Saba + 2 more
IEEE Access
The Transformer Encoder is proposed as a useful tool for sign language recognition and shows noticeable performance over other state-of-the-art convolution architecture.
Continuous Sign Language Recognition with Correlation Network
151 Citations 2023Lianyu Hu, Liqing Gao, Zekang Liu + 1 more
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
CorrNet is proposed to explicitly capture and leverage body trajectories across frames to identify signs in continuous sign language recognition and achieves new state-of-the-art accuracy on four largescale datasets, i.e., PHOenIX14, PHOENIX14-T, CSL-Daily, and CSL.
Sign Pose-based Transformer for Word-level Sign Language Recognition
191 Citations 2022Matyáš Boháček, Marek Hrúz
IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW)
This paper introduces a robust pose normalization scheme which takes the signing space in consideration and processes the hand poses in a separate local coordinate system, independent on the body pose, and demonstrates the significant impact of this normalization on the accuracy of the proposed system.
Deep learning-based sign language recognition system for static signs
324 Citations 2020Ankita Wadhawan, Parteek Kumar
Neural Computing and Applications
Robust modeling of static signs in the context of sign language recognition using deep learning-based convolutional neural networks (CNN) and demonstrates its effectiveness over the earlier works in which only a few hand signs are considered for recognition.
Skeleton Aware Multi-modal Sign Language Recognition
290 Citations 2021Songyao Jiang, Bin Sun, Lichen Wang + 3 more
IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
A novel skeleton Aware Multimodal SLR framework (SAM-SLR) is proposed and a Sign Language Graph Convolution Network (SL-GCN) to model the embedded dynamics and a novel Separable SpatialTemporal Convolution network (SSTCN) to exploit skeleton features to improve the recognition rate.
Understanding vision-based continuous sign language recognition
121 Citations 2020Neena Aloysius, M. Kalaiselvi Geetha
Multimedia Tools and Applications
A detailed review of all the works in vision-based CSLR is presented, based on the methods they have followed, followed by a brief on sensor-based systems and benchmark databases.
Hand Gesture Recognition for Sign Language Using 3DCNN
232 Citations 2020Muneer H. Al-Hammadi, Ghulam Muhammad, Wadood Abdul + 3 more
IEEE Access
This study proposed an efficient deep convolutional neural networks approach for hand gesture recognition that employed transfer learning to beat the scarcity of a large labeled hand gesture dataset.
Fully Convolutional Networks for Continuous Sign Language Recognition
161 Citations 2020Ka Leong Cheng, Zhaoyang Yang, Qifeng Chen + 1 more
Lecture notes in computer science
A fully convolutional network (FCN) is proposed for online SLR to concurrently learn spatial and temporal features from weakly annotated video sequences with only sentence-level annotations given to enforce better sequence alignment learning.
Visual Alignment Constraint for Continuous Sign Language Recognition
210 Citations 2021Yuecong Min, Aiming Hao, Xiujuan Chai + 1 more
IEEE/CVF International Conference on Computer Vision (ICCV)
This work revisits the overfitting problem in recent CTC-based CSLR works and proposes a Visual Alignment Constraint (VAC) to enhance the feature extractor with more alignment supervision and proposes two metrics to evaluate the contributions of the feature Extractor and the alignment model, which provide evidence for the over fitting problem.
Transferring Cross-Domain Knowledge for Video Sign Language Recognition
158 Citations 2020Dongxu Li, Xin Feng Yu, Chenchen Xu + 2 more
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
A novel method is proposed that learns domain-invariant visual concepts and fertilizes WSLR models by transferring knowledge of subtitled news sign to them, and outperforms previous state-of-the-art methods significantly.
Wearable Sensor-Based Sign Language Recognition: A Comprehensive Review
146 Citations 2020Karly Kudrinko, Emile Flavin, Xiaodan Zhu + 1 more
IEEE Reviews in Biomedical Engineering
Analysis of studies that use wearable sensor-based systems to classify sign language gestures finds trends, best practices, and common challenges could aid in the development of user-centred and robust wearable sensors for sign language recognition.
Self-Mutual Distillation Learning for Continuous Sign Language Recognition
150 Citations 2021Aiming Hao, Yuecong Min, Xilin Chen
IEEE/CVF International Conference on Computer Vision (ICCV)
A Self-Mutual Knowledge Distillation (SMKD) method is proposed, which enforces the visual and contextual modules to focus on short-term and long-term information and enhances the discriminative power of both modules simultaneously.
Pose-based Sign Language Recognition using GCN and BERT
116 Citations 2021Anirudh Tunga, Sai Vidyaranya Nuthalapati, Juan Pablo Wachs
journal unavailable
This work tackles the problem of WSLR using a novel pose-based approach, which captures spatial and temporal information separately and performs late fusion, and explicitly captures the spatial interactions in the video using a Graph Convolutional Network (GCN) and a Bidirectional Encoder Representations from Transformers (BERT).
Hand sign language recognition using multi-view hand skeleton
192 Citations 2020Razieh Rastgoo, Kourosh Kiani, Sérgio Escalera
Expert Systems with Applications
Evaluation results of the proposed model indicate that the model outperforms state-of-the-art models in hand sign language recognition, hand pose estimation, and hand action recognition.
Spatial-Temporal Multi-Cue Network for Continuous Sign Language Recognition
222 Citations 2020Hao Zhou, Wengang Zhou, Yun Zhou + 1 more
Proceedings of the AAAI Conference on Artificial Intelligence
This work proposes a spatial-temporal multi-cue (STMC) network, which aims to solve the vision-based sequence learning problem in continuous sign language recognition and designs a joint optimization strategy to achieve the end-to-end sequence learning of the STMC network.
