Implementation of Deep Learning on Number Recognition in Sign Language

Fini Keni Celsia, Green Arther Sandag

Abstract


Measuring the wound area in diabetics is still using a manual way with a wound ruler. Whereas the ruler affixed to the wound will become a contaminated agent that can transmit the infection to other recipients. Digital measurement methods are needed to solve the problem. However, clarifying the boundaries between the wound and the skin requires carefulness and high accuracy. For this reason, it has needed an imaging method that can do segmentation between the wound and the skin boundary for diabetic patients based on digital, called digital planimetry. This study uses a masking contour image processing algorithm from the Hue, Saturation, Value (HSV), Then doing iteration five times and gamma filter. So the result of segmentation is formed. This study concludes that the segmentation with this method has not been able to perform the segment properly, and it requires more masking values, but the results of the 5th iteration got a minor error, which is 0.002%. The digital imaging carried out in this study could be developed to be a digital-based diabetic patient wound measurement tool.


Keywords


Digital planimetry; Image processing; HSV; Diabetic wound; Contour image;

Full Text:

PDF (Indonesian)

References


Zheng, L., Liang, B., & Jiang, A. (2017, November). Recent advances of deep learning for sign language recognition. In 2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA) (pp. 1-7). IEEE.

Das, A., Gawde, S., Suratwala, K., & Kalbande, D. (2018, January). Sign language recognition using deep learning on custom processed static gesture images. In 2018 International Conference on Smart City and Emerging Technology (ICSCET) (pp. 1-6). IEEE.

Tang, A., Lu, K., Wang, Y., Huang, J., & Li, H. (2015). A real-time hand posture recognition system using deep neural networks. ACM Transactions on Intelligent Systems and Technology (TIST), 6(2), 1-23.

World Health Organization. (2018). Addressing the rising prevalence of hearing loss.

Islam, M. R., Mitu, U. K., Bhuiyan, R. A., & Shin, J. (2018, September). Hand gesture feature extraction using deep convolutional neural network for recognizing American sign language. In 2018 4th International Conference on Frontiers of Signal Processing (ICFSP) (pp. 115-119). IEEE.

Rao, G. A., Syamala, K., Kishore, P. V. V., & Sastry, A. S. C. S. (2018, January). Deep convolutional neural networks for sign language recognition. In 2018 Conference on Signal Processing And Communication Engineering Systems (SPACES) (pp. 194-197). IEEE.

Gattupalli, S., Ghaderi, A., & Athitsos, V. (2016, June). Evaluation of Deep Learning Based pose estimation for sign language recognition. In Proceedings of the 9th ACM International Conference On Pervasive Technologies Related To Assistive Environments (pp. 1-7).

Kembuan, O., Rorimpandey, G. C., & Tengker, S. M. T. (2020, October). Convolutional Neural Network (CNN) for Image Classification of Indonesia Sign Language Using Tensorflow. In 2020 2nd International Conference on Cybernetics and Intelligent System (ICORIS) (pp. 1-5). IEEE.

Shahriar, S., Siddiquee, A., Islam, T., Ghosh, A., Chakraborty, R., Khan, A. I., ... & Fattah, S. A. (2018, October). Real-time American Sign Language Recognition using skin segmentation and image category classification with convolutional neural network and deep learning. In TENCON 2018-2018 IEEE Region 10 Conference (pp. 1168-1171). IEEE.

Bheda, V. and Radpour, N. D., “Using Deep Convolutional Networks for Gesture Recognition in American Sign Language,” 2017.

Taskiran, M., Killioglu, M., & Kahraman, N. (2018, July). A real-time system for recognition of American sign language by using deep learning. In 2018 41st International Conference on Telecommunications and Signal Processing (TSP) (pp. 1-5). IEEE.

Putro, E. C., Awangga, R. M., and Andarsyah, R., Tutorial Object Detection People with Faster region-Based Convolutional Neural Network (Faster R-CNN). Kreatif, 2020.

Goodfellow, I., Bengio, Y., Courville, A., & Bengio, Y. (2016). Deep learning (Vol. 1, No. 2). Cambridge: MIT press.

Oz, C., & Leu, M. C. (2011). American sign language word recognition with a sensory glove using artificial neural networks. Engineering Applications of Artificial Intelligence, 24(7), 1204-1213.

Kumar, A., "Activation Functions, Loss Functions, and Optimizer:", Medium, 2020. [Online]. Available: https://medium.com/@amitbalharakr93/activation-functions-loss-functions-and-optimizer-a5da4571e401. [Accessed: 18- Aug- 2020].

Das, A., Gawde, S., Suratwala, K., and Kalbande, D., “Sign Language Recognition Using Deep Learning on Custom Processed Static Gesture Images,” in 2018 International Conference on Smart City and Emerging Technology (ICSCET), Mumbai, Jan. 2018, pp. 1–6, doi: 10.1109/ICSCET.2018.8537248.

Bantupalli, K., & Xie, Y. (2018, December). American sign language recognition using deep learning and computer vision. In 2018 IEEE International Conference on Big Data (Big Data) (pp. 4896-4899). IEEE.

Pigou, L., Dieleman, S., Kindermans, P. J., & Schrauwen, B. (2014, September). Sign language recognition using convolutional neural networks. In European Conference on Computer Vision (pp. 572-578). Springer, Cham.

Ruder, S. (2016). An overview of gradient descent optimization algorithms. arXiv preprint arXiv:1609.04747.

M, R. (2019). The Ascent of Gradient Descent. Medium. Retrieved 11 June 2020, from https://blog.clairvoyantsoft.com/the-ascent-of-gradient-descent-23356390836f.

Krasula, L., Fliegel, K., Le Callet, P., & Klíma, M. (2016, June). On the accuracy of objective image and video quality models: New methodology for performance evaluation. In 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX) (pp. 1-6). IEEE.

Carneiro, T., Da Nóbrega, R. V. M., Nepomuceno, T., Bian, G. B., De Albuquerque, V. H. C., & Reboucas Filho, P. P. (2018). Performance analysis of google colaboratory as a tool for accelerating deep learning applications. IEEE Access, 6, 61677-61685.




DOI: http://dx.doi.org/10.30700/jst.v11i2.1117

Article Metrics

Abstract view : 562 times
PDF (Indonesian) - 649 times

Refbacks

  • There are currently no refbacks.


Copyright (c) 2021 SISFOTENIKA

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Badan Pengelola Jurnal Ilmiah Sistem Informasi dan Teknik Informatika (SISFOTENIKA) STMIK Pontianak.

 

Jurnal Ilmiah SISFOTENIKA terindex di :


   

   

  

    

    

    

   

 

 

 

ISSN Printed : 2087-7897

ISSN Online : 2460-5344


SERTIFIKAT PENGHARGAAN :

Jurnal Ilmiah SISFOTENIKA Terakreditasi Peringkat Empat

 

Partners & Co-Organizers:




Lisensi Creative Commons

Jurnal Ilmiah SISFOTENIKA: STMIK Pontianak Online Journal ISSN Printed (2087-7897) - ISSN Online (2460-5344) licensed under a Lisensi Creative Commons Atribusi 4.0 Internasional. Flag Counter

View My Stats>