Applying Artificial Neural Network Based on Backpropagation Method for Indonesian Sign Language Recognition

Abstract

Sign-language is a nonverbal language utilized by hearing loss and speech disorder people to interact and speak with each other. Sometimes people call it a visual-language utilizing hand gestures and changes in hand shape to express intentions and thoughts. In Indonesia, people use two sign language types commonly. They are Indonesian Signal System (ISS) and Indonesian Sign Language (ISL). In this paper, we investigated research on the recognition of ISL alphabets by proposing an application using the Artificial Neural Network algorithm with the principle of the Backpropagation method for dealing with this research. Firstly, we performed preprocessing the image data sequentially by splitting the dataset, labeling the dataset based on the alphabet types, scaling the images into a size of 150x150 pixels, and segmentizing the datasets to eliminate noise in the image to yield color, grayscale, binary segmentations, and image edge detection. Later on, we split the dataset and distributed them into training and testing sets with two different proportions, 70:30 and 80:20 percent. After applying the algorithm, we obtained the highest accuracy at 80:20 data proportions using an epoch of 700, a learning rate of 0.001, a batch size of 25, and some hidden nodes of 100 was 98.41 percent.