关键词: 手语语句识别,关键帧,手语轨迹,体感设备

Abstract: At present,most of the dynamic sign language recognition is only for sign language words.The continuous sign language sentence recognition research and the corresponding results are less,because the segmentation of such sentence is very difficult.In this paper,a sign language sentence recognition algorithm was proposed based on weighted key frames.Key frames can be regarded as the basic unit of sign word,therefore,according to the key frames,we can get related vocabularies,and thus we can further organize these vocabularies into meaningful sentence.Such work can avoid the hard point of dividing sign language sentence directly.With the help of Kinect,i.e.motion-control device,a kind of self-adaptive algorithm of key frame extraction based on the trajectory of sign language was brought out in the paper.After that,the key frame was given to weight according to its semantic contribution.Finally,the recognition algorithm was designed based on these weighted key frames and thus got the continuous sign language sentence.Experiments show that the algorithm designed in this paper can realize real-time recognition of continuous sign language sentences.

Key words: Sign language sentence recognition,Key frame,Gesture trace,Kinect motion-control device