Abstract
Integration of information from different systems support enhanced functionality however it requires a rigorous pre-determined results for the fusion. This paper proposes a novel approach for determining the integration criteria using Particle filter for the fusion of hand gesture and posture recognition system at decision level. For decision level fusion, integration framework requires the classification of hand gesture and posture symbols in which HMM is used to classify the alphabets and numbers from hand gesture recognition system whereas ASL finger spelling signs (alphabets and numbers) are classified by posture recognition system using SVM. These classification results are input to integration framework to compute the contribution-weights. For this purpose, Condensation algorithm approximates the optimal a-posterior probability using a-prior probability and Gaussian based likelihood function thus making the weights independent of classification ambiguities. Considering the recognition as a problem of regular grammar, we have developed our production rules based on context free grammar (CFG) for the restaurant scenario. On the basis of contribution-weights, we mapped the recognized outcome over CFG rules and infer meaningful expressions. Experiments are conducted on 500 different combinations of restaurant orders with the overall 98.3% inference accuracy which proves the significance of proposed approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Jaimes, A., Sebe, N.: Multimodal human-computer interaction: A survey. In: Computer Vision and Image Understanding, pp. 116–134 (2007)
Yoon, H., Soh, J., Bae, Y., Yang, H.: Hand gesture recognition using combined features of location, angle and velocity. Pattern Recognition 34, 1491–1501 (2001)
Liu, N., Lovel, B., Kootsookos, P.: Evaluation of hmm training algorithms for letter hand gesture recognition. In: IEEE Int. Sym. on SPIT, pp. 648–651 (2003)
Hunter, E., Schlenzig, J., Jain, R.: Posture estimation in reduced-model gesture input systems. In: International Workshop on Automatic Face-and Gesture-Recognition, pp. 290–295 (1995)
Hussain, M.: Automatic recognition of sign language gestures. Master thesis, Jordan University of Science and Technology (1999)
Malassiotis, S., Strintzis, M.: Real-time hand posture recognition using range data. Image and Vision Computing 26, 1027–1037 (2008)
Licsar, A., Sziranyi, T.: Supervised training based hand gesture recognition system. In: International Conference on Pattern Recognition, pp. 999–1002 (2002)
Handouyahia, M., Ziou, D., Wang, S.: Sign language recognition using moment-based size functions. In: Int. Conference of Vision Interface, pp. 210–216 (1999)
Freeman, W., Roth, M.: Orientation histograms for hand gesture recognition. In: Int. Workshop on Automatic Face and Gesture Recognition, pp. 296–301 (1994)
Brunelli, R., Falavigna, D.: Person identification using multiple cues. IEEE Trans. on PAMI 17, 955–966 (1995)
Ross, A., Jain, A.: Multimodal biometrics: An overview. In: 12th Signal Processing Conference, pp. 1221–1224 (2004)
Chang, K., Bowyer, K.W., Flynn, P.J.: Face recognition using 2d and 3d facial data. In: ACM Workshop on Multimodal User Authentication, pp. 25–32 (2003)
Kumar, A., Wong, D., Shen, H., Jain, A.: Personal verification using palmprint and hand geometry biometric. In: 4th Int. Conf. on Audio and Video-based Biometric Person Authentication, pp. 668–678 (2003)
Wu, Q., Wang, L., Geng, X., Li, M., He, X.: Dynamic biometrics fusion at feature level for video-based human recognition, pp. 152–157 (2007)
Rashid, O., Hamadi, A., Michaelis, B.: A framework for integration of gesture and posture recognition using hmm and svm. In: IEEE ICIS, pp. 572–577 (2009)
Hu, M.: Visual pattern recognition by moment invariants. IRE Transaction on Information Theory 8, 179–187 (1962)
Isard, M., Blake, A.: Condensation - conditional density propagation for visual tracking. Int. Jour. of Computer Vision 29, 5–28 (1998)
Monwar, M., Gavrilova, M.: A robust authentication system using multiple biometrics. In: Computer and Information Science, pp. 189–201 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ahmed, O.R., Al-Hamadi, A., Michaelis, B. (2011). Interpreting Dynamic Meanings by Integrating Gesture and Posture Recognition System. In: Koch, R., Huang, F. (eds) Computer Vision – ACCV 2010 Workshops. ACCV 2010. Lecture Notes in Computer Science, vol 6468. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22822-3_31
Download citation
DOI: https://doi.org/10.1007/978-3-642-22822-3_31
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-22821-6
Online ISBN: 978-3-642-22822-3
eBook Packages: Computer ScienceComputer Science (R0)