Skip to content

Latest commit

 

History

History
177 lines (136 loc) · 24.1 KB

README.md

File metadata and controls

177 lines (136 loc) · 24.1 KB
Raw

SLRPapers

papers on sign language recognition and related fields

Table of Content

Papers

HMM

  1. Online Early-Late Fusion Based on Adaptive HMM for Sign Language Recognition TOMM2017 paper code
  2. Chinese sign language recognition with adaptive HMM ICME2016 paper code
  3. Sign language recognition based on adaptive HMMS with data augmentation ICIP2016 paper code
  4. Continuous sign language recognition using level building based on fast hidden Markov model Pattern Recognit.Lett.2016 paper code
  5. Sign Transition Modeling and a Scalable Solution to Continuous Sign Language Recognition for Real-World Applications TACCESS2016 paper code
  6. A Threshold-based HMM-DTW Approach for Continuous Sign Language Recognition ICIMCS2014 paper code
  7. Improving Continuous Sign Language Recognition: Speech Recognition Techniques and System Design SLPAT2013 paper code
  8. Using Viseme Recognition to Improve a Sign Language Translation System IWSLT2013 paper code
  9. Advances in phonetics-based sub-unit modeling for transcription alignment and sign language recognition CVPRW2011 paper code
  10. Speech Recognition Techniques for a Sign Language Recognition System INTERSPEECH2007 paper code
  11. Large-Vocabulary Continuous Sign Language Recognition Based on Transition-Movement Models TSMC2007 paper code
  12. Real-time American sign language recognition using desk and wearable computer based video TPAMI1998 paper code

CNN+RNN

CNN includes 2D CNN and 3D CNN, and RNN includes LSTM and BLSTM.

  1. SF-Net: Structured Feature Network for Continuous Sign Language Recognition ArXiv2019 paper code
  2. Iterative Alignment Network for Continuous Sign Language CVPR2019 paper code
  3. Fingerspelling recognition in the wild with iterative visual attention ICCV2019 paper code
  4. Zero-Shot Sign Language Recognition: Can Textual Data Uncover Sign Languages? BMVC2019 paper code
  5. Sign Language Recognition Analysis using Multimodal Data DSAA2019 paper code
  6. Dynamic Sign Language Recognition Based on Video Sequence With BLSTM-3D Residual Networks ACCESS2019 paper code
  7. Attention in Convolutional LSTM for Gesture Recognition NIPS2018 paper code
  8. Hierarchical LSTM for Sign Language Translation AAAI2018 paper code
  9. Neural Sign Language Translation CVPR2018 paper code
  10. SubUNets: End-to-End Hand Shape and Continuous Sign Language Recognition ICCV2017 paper code
  11. Recurrent Convolutional Neural Networks for Continuous Sign Language Recognition by Staged Optimization CVPR2017 paper code
  12. Learning Spatiotemporal Features Using 3DCNN and Convolutional LSTM for Gesture Recognition ICCV2017 paper code
  13. Online Detection and Classification of Dynamic Hand Gestures with Recurrent 3D Convolutional Neural Networks CVPR2016 paper code

3D CNN

  1. Dense Temporal Convolution Network for Sign Language Translation IJCAI2019 paper code
  2. Thai Sign Language Recognition Using 3D Convolutional Neural Networks ICCCM2019 paper code
  3. Video-based sign language recognition without temporal segmentation AAAI2018 paper code
  4. Using Convolutional 3D Neural Networks for User-independent continuous gesture recognition ICPR2016 paper code
  5. Hand Gesture Recognition with 3D Convolutional Neural Networks CVPRW2015 paper code
  6. Sign Language Recognition using 3D convolutional neural networks ICME2015 paper code

GCN

  1. Spatial-Temporal Graph Convolutional Networks for Sign Language Recognition ICANN2019 paper code

Others

  1. Sign Language Translation with Transformers ArXiv2020 paper code
  2. Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translation ArXiv2020 paper code
  3. Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparison WACV2020 paper code
  4. Human-like sign-language learning method using deep learning ETRI2018 paper code
  5. Re-Sign: Re-Aligned End-to-End Sequence Modelling with Deep Recurrent CNN-HMMs CVPR2017 paper code
  6. Deep Hand: How to Train a CNN on 1 Million Hand Images When Your Data is Continuous and Weakly Labelled CVPR2016 paper code
  7. Deep Sign: Hybrid CNN-HMM for Continuous Sign Language Recognition BMVC2016 paper code
  8. SIGN LANGUAGE RECOGNITION WITH LONG SHORT-TERM MEMORY ICIP2016 paper code
  9. Iterative Reference Driven Metric Learning for Signer Independent Isolated Sign Language Recognition. ECCV2016 paper code
  10. Automatic Alignment of HamNoSys Subunits for Continuous Sign Language Recognition LREC2016 paper code
  11. Curve Matching from the View of Manifold for Sign Language Recognition ACCV2014 paper code
  12. Sign Language Recognition and Translation with Kinect AFGR2013 paper code
  13. Large-scale Learning of Sign Language by Watching TV (Using Cooccurrences). BMVC2013 paper code
  14. Sign Language Recognition using Sequential Pattern Trees CVPR2012 paper code
  15. Sign language recognition using sub-units JMLR2012 paper code
  16. American Sign Language word recognition with a sensory glove using artificial neural networks Eng.Appl.Artif.Intell.2011 paper code
  17. Learning sign language by watching TV (using weakly aligned subtitles) CVPR2009 paper code

Datasets

Dataset Language Classes Samples Data Type Language Level
CSL Dataset I Chinese 500 125,000 Videos&Depth from Kinect isolated
CSL Dataset II Chinese 100 25,000 Videos&Depth from Kinect continuous
RWTH-PHOENIX-Weather 2014 German 1,081 6,841 Videos continuous
RWTH-PHOENIX-Weather 2014 T German 1,066 8,257 Videos continuous
ASLLVD American 3,300 9,800 Videos(multiple angles) isolated
ASLLVD-Skeleton American 3,300 9,800 Skeleton isolated
SIGNUM German 450 33,210 Videos continuous
DGS Kinect 40 German 40 3,000 Videos(multiple angles) isolated
DEVISIGN-G Chinese 36 432 Videos isolated
DEVISIGN-D Chinese 500 6,000 Videos isolated
DEVISIGN-L Chinese 2000 24,000 Videos isolated
LSA64 Argentinian 64 3,200 Videos isolated
GSL isol. Greek 310 40,785 Videos&Depth from RealSense isolated
GSL SD Greek 310 10,290 Videos&Depth from RealSense continuous
GSL SI Greek 310 10,290 Videos&Depth from RealSense continuous
IIITA -ROBITA Indian 23 605 Videos isolated
PSL Kinect Polish 30 300 Videos&Depth from Kinect isolated
PSL ToF Polish 84 1,680 Videos&Depth from ToF camera isolated
BUHMAP-DB Turkish 8 440 Videos isolated
LSE-Sign Spanish 2,400 2,400 Videos isolated
Purdue RVL-SLLL American 39 546 Videos isolated
RWTH-BOSTON-50 American 50 483 Videos(multiple angles) isolated
RWTH-BOSTON-104 American 104 201 Videos(multiple angles) continuous
RWTH-BOSTON-400 American 400 843 Videos continuous
WLASL American 2,000 21,083 Videos isolated

Related Fields

Action Recognition

  1. DistInit: Learning Video Representations Without a Single Labeled Video ICCV2019 paper code
  2. SCSampler: Sampling Salient Clips from Video for Efficient Action Recognition ICCV2019 paper code
  3. Reasoning About Human-Object Interactions Through Dual Attention Networks ICCV2019 paper code
  4. SlowFast Networks for Video Recognition ICCV2019 paper code
  5. Video Classification with Channel-Separated Convolutional Networks ICCV2019 paper code
  6. BMN: Boundary-Matching Network for Temporal Action Proposal Generation ICCV2019 paper code
  7. DynamoNet: Dynamic Action and Motion Network ICCV2019 paper code
  8. Graph Convolutional Networks for Temporal Action Localization ICCV2019 paper code
  9. Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet? CVPR2018 paper code
  10. A Closer Look at Spatiotemporal Convolutions for Action Recognition CVPR2018 paper code
  11. Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition AAAI2018 paper code
  12. Co-occurrence Feature Learning from Skeleton Data for Action Recognition and Detection with Hierarchical Aggregation IJCAI2018 paper code
  13. Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset CVPR2017 paper code
  14. Action Recognition using Visual Attention ICLR2016 paper code
  15. Action Recognition with Trajectory-Pooled Deep-Convolutional Descriptors CVPR2015 paper code
  16. Two-Stream Convolutional Networks for Action Recognition in Videos NIPS2014 paper code

Speech Recognition

  1. State-of-the-art Speech Recognition With Sequence-to-Sequence Models ICASSP2018 paper code
  2. Lip Reading Sentences in the Wild CVPR2017 paper code
  3. Listen, Attend and Spell ICASSP2016 paper code
  4. Deep speech 2: End-to-end speech recognition in english and mandarin ICML2016 paper code
  5. Attention-Based Models for Speech Recognition NIPS2015 paper code
  6. Convolutional Neural Networks for Speech Recognition TASLP2014 paper code
  7. Hybrid speech recognition with Deep Bidirectional LSTM ASRU2013 paper code
  8. New types of deep neural network learning for speech recognition and related applications: an overview ICASSP2013 paper code
  9. Speech Recognition with Deep Recurrent Neural Networks ICASSP2013 paper code

Video Captioning

  1. Video Description A Survey of Methods, Datasets and Evaluation Metrics ACM Computing Surveys2019 paper code
  2. Spatio-Temporal Dynamics and Semantic Attribute Enriched Visual Encoding for Video Captioning CVPR2019 paper code
  3. Reconstruction Network for Video Captioning CVPR2018 paper code
  4. Multimodal Memory Modelling for Video Captioning CVPR2018 paper code
  5. Interpretable Video Captioning via Trajectory Structured Localization CVPR2018 paper code
  6. Video Captioning with Transferred Semantic Attributes CVPR2017 paper code
  7. Video Paragraph Captioning Using Hierarchical Recurrent Neural Networks CVPR2016 paper code
  8. Jointly Modeling Embedding and Translation to Bridge Video and Language CVPR2016 paper code
  9. Describing Videos by Exploiting Temporal Structure ICCV2015 paper code