Deep learning scheme for character prediction with position-free touch screen-based Braille input method

Human-centric Computing and Information Sciences

Adeel Ahmed Abbasi¹  Sana Shokat¹  Abdul Majid Abbasi¹  Rabia Riaz¹  Se Jin Kwon²  Sanam Shahla Rizvi³ 

[1] Department of Computer Science and Information Technology, University of Azad Jammu and Kashmir, 13100, Muzaffarabad, Pakistan;Dept. of Computer Engineering, Kangwon National University, 346 Joongang-ro, 25913, Samcheok, Gangwon-do, South Korea;Reptor Interactive (Pty) Ltd, Eco Boulvard. Witch Hazel Ave, 0157, Centurion, South Africa;

关键词: Braille;    Machine learning;    Natural language processing;    Deep learning;    Touch screen;    Convolutional neural network;    Transfer learning;    GoogLe net;    Visually impaired;   

DOI  :  10.1186/s13673-020-00246-6

来源: Springer

【 摘 要 】

Smart devices are effective in helping people with impairments, overcome their disabilities, and improve their living standards. Braille is a popular method used for communication by visually impaired people. Touch screen smart devices can be used to take Braille input and instantaneously convert it into a natural language. Most of these schemes require location-specific input that is difficult for visually impaired users. In this study, a position-free accessible touchscreen-based Braille input algorithm is designed and implemented for visually impaired people. It aims to place the least burden on the user, who is only required to tap those dots that are needed for a specific character. The user has input English Braille Grade 1 data (a–z) using a newly designed application. A total dataset comprised of 1258 images was collected. The classification was performed using deep learning techniques, out of which 70%–30% was used for training and validation purposes. The proposed method was thoroughly evaluated on a dataset collected from visually impaired people using Deep Learning (DL) techniques. The results obtained from deep learning techniques are compared with classical machine learning techniques like Naïve Bayes (NB), Decision Trees (DT), SVM, and KNN. We divided the multi-class into two categories, i.e., Category-A (a–m) and Category-B (n–z). The performance was evaluated using Sensitivity, Specificity, Positive Predicted Value (PPV), Negative Predicted Value (NPV), False Positive Rate (FPV), Total Accuracy (TA), and Area under the Curve (AUC). GoogLeNet Model, followed by the Sequential model, SVM, DT, KNN, and NB achieved the highest performance. The results prove that the proposed Braille input method for touch screen devices is more effective and that the deep learning method can predict the user's input with high accuracy.

【 授权许可】

CC BY