Moment Invariant Features Extraction for Hand Gesture Recognition of Sign Language based on SIBI

  • Angga Rahagiyanto Politeknik Elektronika Negeri Surabaya
  • Achmad Basuki Politeknik Elektronika Negeri Surabaya
  • Riyanto Sigit Politeknik Elektronika Negeri Surabaya

Abstract

Myo Armband became an immersive technology to help deaf people for communication each other. The problem on Myo sensor is unstable clock rate. It causes the different length data for the same period even on the same gesture. This research proposes Moment Invariant Method to extract the feature of sensor data from Myo. This method reduces the amount of data and makes the same length of data. This research is user-dependent, according to the characteristics of Myo Armband. The testing process was performed by using alphabet A to Z on SIBI, Indonesian Sign Language, with static and dynamic finger movements. There are 26 class of alphabets and 10 variants in each class. We use min-max normalization for guarantying the range of data. We use K-Nearest Neighbor method to classify dataset. Performance analysis with leave-one-out-validation method produced an accuracy of 82.31%. It requires a more advanced method of classification to improve the performance on the detection results.

Downloads

Download data is not yet available.

References

Sulfayanti, Dewiani, and Armin Lawi, “A real time alphabets sign language recognition system using hands tracking,†2016 Int. Conf. Comput. Intell. Cybern., pp. 69–72, 2016.

F. Ramirez-Garibay, C. M. Olivarria, A. F. E. Aguilera, and J. C. Huegel, “MyVox—Device for the communication between people: blind, deaf, deaf-blind and unimpaired,†IEEE Glob. Humanit. Technol. Conf. (GHTC 2014), pp. 506–509, 2014.

M. T. Wolf et al., “Decoding static and dynamic arm and hand gestures from the JPL BioSleeve,†IEEE Aerosp. Conf. Proc., pp. 1–9, 2013.

S. Mitra, S. Member, T. Acharya, and S. Member, “Gesture Recognition : A Survey,†IEEE, vol. 37, no. 3, pp. 311–324, 2007.

L. Chen, F. Wang, H. Deng, and K. Ji, “A Survey on Hand Gesture Recognition,†2013 Int. Conf. Comput. Sci. Appl., pp. 313–316, 2013.

Z. Yang and S. Narayanan, “Modeling Dynamics of Expressive Body Gestures In Dyadic Interactions,†IEEE Trans. Affect. Comput., vol. XX, no. XX, pp. 1–1, 2016.

S. Ongkittikul, S. Worrall, and A. Kondoz, “Two hand tracking using colour statistical model with the K-means embedded particle filter for hand gesture recognition,†7th Comput. Inf. Syst. Ind. Manag. Appl. CISIM 2008, pp. 201–206, 2008.

V. Bhame, R. Sreemathy, and H. Dhumal, “Vision based hand gesture recognition using eccentric approach for human computer interaction,†2014 Int. Conf. Adv. Comput. Commun. Informatics, pp. 949–953, 2014.

S. S. Ge, Y. Yang, and T. H. Lee, “Hand Gesture Recognition and Tracking based on Distributed Locally Linear Embedding,†IEEE, no. ii, 2006.

S. Khare, “Finger gesture and pattern recognition based device security system,†2015 Int. Conf. Signal Process. Commun. ICSC 2015, pp. 443–447, 2015.

“Multi-feature criteria with fuzzy logic pattern recognition for hand gesture classification,†in Midwest Symposium on Circuits and Systems, 2015, vol. 2015–Septe, pp. 1–4.

M. Vanco, I. Minarik, and G. Rozinaj, “Evaluation of static hand gesture algorithms,†21st Int. Conf. Syst. Signals Image Process., no. May, pp. 83–86, 2014.

Y. Liu et al., “Image processing and recognition of multiple static hand gestures for human-computer interaction,†Proc. - 2013 7th Int. Conf. Image Graph. ICIG 2013, pp. 465–470, 2013.

V. et al Elamaran, “Image Processing Algorithms for Gesture Recognition using MATLAB,†2014 IEEE Int. Conf. Adv. Commun. Control Comput. Technol., no. 978, pp. 0–1, 2014.

E. H. El-shazly, M. M. Abdelwahab, A. Shimada, and R. Taniguchi, “Real Time Algorithm for Efficient HCI Employing Features Obtained From MYO Sensor,†IEEE 59th Int. Midwest Symp. Circuits Syst., no. October, pp. 16–19, 2016.

A. A. Hidayat, Z. Arief, and D. C. Happyanto, “LOVETT Scaling with Flex Sensor and MYO Armband for Monitoring Finger Muscles Therapy of Post-Stroke People,†EMITTER International Journal of Engineering Technology, Vol. 3, No. 2, pp. 60–76, 2015.

A. F. Ruiz-olaya, M. Callejas-cuervo, and A. M. Perez, “EMG-based Pattern Recognition with Kinematics Information for Hand Gesture Recognition,†Signal Process. Images Comput. Vis. (STSIVA), 2015 20th Symp., pp. 1–4, 2015.

Z. Arief, I. A. Sulistijono, and R. A. Ardiansyah, “Comparison of five time series EMG features extractions using Myo Armband,†2015 Int. Electron. Symp., pp. 11–14, 2015.

J. G. Abreu, J. M. Teixeira, L. S. Figueiredo, and V. Teichrieb, “Evaluating Sign Language Recognition Using the Myo Armband,†Proc. - 18th Symp. Virtual Augment. Reality, SVR 2016, pp. 64–70, 2016.

A. L. P. Madushanka, R. G. D. C. Senevirathne, L. M. H. Wijesekara, S. M. K. D. Arunatilake, and K. D. Sandaruwan, “Framework for Sinhala Sign Language Recognition and Translation Using a Wearable Armband,†pp. 49–57, 2016.

S. Rawat, S. Vats, and P. Kumar, “Evaluating and Exploring the MYO ARMBAND,†pp. 4–9, 2016.

Wahyudi, A. Susanto, W. Widada, and S. P. Hadi, “Inertial Measurement Unit using multigain accelerometer sensor and gyroscope sensor,†Proc. 2011 Int. Conf. Electr. Eng. Informatics, ICEEI 2011, no. July, pp. 4–8, 2011.

T. Harada, H. Uchino, T. Mori, and T. Sato, “Portable orientation estimation device based on accelerometers, magnetometers and gyroscope sensors for sensor network,†IEEE Int. Conf. Multisens. Fusion Integr. Intell. Syst., vol. 2003–Janua, pp. 191–196, 2003.

E. Fresk and G. Nikolakopoulos, “Full Quaternion Based Attitude Control for a Quadrotor,†Eur. Control Conf., pp. 3864–3869, 2013.

W. Djojonegoro, Kamus Sistem Bahasa Isyarat Bahasa Indonesia, Ketiga. Jakarta: Departemen Pendidikan Nasional, 2001.

J. Flusser, B. Zitova, and T. Suk, Moments and Moment Invariants in Pattern Recognition; Kapitel 6, First Edit. Prague, Cezh Republic: WILEY, 2010.

Published
2017-07-23
How to Cite
Rahagiyanto, A., Basuki, A., & Sigit, R. (2017). Moment Invariant Features Extraction for Hand Gesture Recognition of Sign Language based on SIBI. EMITTER International Journal of Engineering Technology, 5(1), 119-138. https://doi.org/10.24003/emitter.v5i1.173
Section
Articles