Assistive technology for relieving communication lumber between hearing/speech impaired and hearing people

The Journal of Engineering

Donald Bailey¹  Rini Akmeliawati¹  Sara Bilal¹  Gourab Sen Gupta²  Serge Demidenko²  Shujjat Khan²  Ye Chow Kuang³  Melanie Ooi³  Nuwan Gamage³ 

[1] Faculty (Kulliyyah) of Engineering, International Islamic University Malaysia, Jl, Gombak 53100, Kuala Lumpur, Malaysia;School of Engineering and Advanced Technology, Massey University, New Zealand, Private Bag 11222, Palmerston North 4442, New Zealand;School of Engineering, Monash University Malaysia, Jl Lagoon Selatan, 46150, Selangor Darul Ehsan, Malaysia

关键词: speech impaired people;    feature recognition;    automatic sign language translator;    dynamic signs;    Malaysian sign language;    hearing impaired people;    LINUX Fedora 16 operating systems;    static signs;    feature extraction;    Windows7 operating systems;    assistive technology;    hearing impaired communities;    system architecture;    speech impaired communities;    segmentation signature;    VMware workstation;    hidden Markov model;   

DOI  :  10.1049/joe.2014.0039

学科分类：工程和技术（综合）

来源: IET

【 摘 要 】

This study proposes an automatic sign language translator, which is developed as assistive technology to help the hearing/speech impaired communities to communicate with the rest of the world. The system architecture, which includes feature extraction and recognition stages is described in detail. The signs are classified into two types: static and dynamic. Various types of sign features are presented and analysed. Recognition stage considers the hidden Markov model and segmentation signature. Real-time implementation of the system with the use of Windows7 and LINUX Fedora 16 operating systems with VMware workstation is presented in detail. The system has been successfully tested on Malaysian sign language.

【 授权许可】

CC BY