Authors:
K Ruben Raju,Yogesh Kumar Sharma,Birru Devender,DOI NO:
https://doi.org/10.26782/jmcms.2020.06.00022Keywords:
Human action recognition,Gaussian,Gradient,Gabor,Kernel ,Discriminant Analysis,Support vector Machine,Recognition Accuracy,Abstract
Aimed at the problems of Intensity, Contour and orientation information, a Human Action Recognition (HAR) method based on Fused Feature Vector (FFV) is proposed in this paper. The FFV is constructed based on three different features such as Intensity features, Gradient features, and Orientation features. These three set of features are obtained through three different feature extraction methods based on Gaussian Filter, Gradient Filter and Gabor filter. Further to ensure optimal discriminant subspace, Kernel Discriminant Analysis is employed as a dimensionality reduction technique. Given the FFV of each action image, Support Vector Machine (SVM) is employed for classification. The proposed recognition model is evaluated systematically on the three public datasets such as KTH dataset, Weizmann dataset and the challenging UCF YouTube action dataset. Experimental results prove that our method outperforms the conventional approaches in terms of recognition accuracy.Refference:
I. A. Bobick and J. Davis, “The recognition of human movement using temporal templates,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 3, pp. 257–267, 2001.
II. A. Klaser and M. Marszalek, “A Spatio-temporal descriptor based on 3dgradients,” in Proc. Eur. Conf. Comput. Vision, 2008.
III. B. Mandal, How-Lung Eng, “Regularized Discriminant Analysis for Holistic Human Activity Recognition”, IEEE intelligent systems, 2012
IV. Bo Lin and Bin Fang, “A new spatial-temporal histograms of gradients descriptor and HOD-VLAD encoding for human action recognition”, International Journal of Wavelets, Multi-resolution and Information Processing, Vol. 17, No. 02, 2019.
V. B. Sch¨olkopf and A. J. Smola, Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond, MIT press, 2002.
VI. Chakraborty, B.; Holte, M.B.; Moeslund, T.B.; Gonzalez, J. Selective Spatio-temporal interest points. Comput. Vis. Image Underst. 2012, 116, 396–4100
VII. C Schuldt, I. Laptev, and B. Caputo, “Recognizing human actions: a local SVM approach,” in Proc. Int. Conf. Pattern Recognit., vol. 3, 2004, pp. 32–36.
VIII. C.Yang, M. Schmalz, W. Hu, and G. Ritter, “Center-surround filters for the detection of small targets in cluttered multispectral imagery: Background and filter design,” in Proc. SPIE, 1995, vol. 2496, pp. 637–648
IX. D.K. Vishwakarma and C. Dhiman, “A unified model for human activity recognition using spatial distribution of gradient and difference of Gaussian kernel”, Vis Comput. 35, 1595-1613, 2019.
X. D.K. Vishwakarma, PrachiRawat, and RajivKapoor, “Human Activity Recognition Using Gabor Wavelet Transform and Ridgelet Transform”, Procedia Computer Science,Volume 57, 2015, Pages 630-636.
XI. D. Song and D. Tao, “Biologically inspired feature manifold for scene classification,” IEEE Trans. Image Process., vol. 19, no. 1, pp. 174–184, Jan. 2010.
XII. Duta. I. C, Uijlings, J. R, Ionescu B, et al. Efficient Human Action recognition using Histograms of motion gradients and VLAD with descriptor shape information. Multimed Tools Appl. 76, 22445-22475, 2017.
XIII. D. Weinland and E. Boyer, “Action recognition using exemplar-based embedding,” in Proc. IEEE Conf. Comput. Vision Pattern Recognit., 2008, pp. 1–7.
XIV. G.Cheng, Y. Wan, A. N. Saudagar, K. Namuduri, and B. P. Buckles, “Advances in human action recognition: A survey,” New J. Phys., vol. 17, no. 8, pp. 1_30, 2015.
XV. G.Willems, T. Tuytelaars, and L. Van Gool, “An efficient dense and scale-invariant Spatio-temporal interest point detector,” in Proc. Eur. Conf. Comput. Vision, 2008, pp. 650–663.
XVI. I Laptev and T. Lindeberg, “Space-time interest points,” in Proc. IEEE Int. Conf. Comput. Vision, 2003, pp. 432–439.
XVII. J. Arunnehru1 and M. KalaiselviGeetha, “Motion Intensity Code for Action Recognition in Video Using PCA and SVM”, In: prasath R., Kathirvalavakumar T. (eds) Mining Intelligence and knowledge Exploration Lecture notes in computer science, Vol.8284, Spriger, Cham.
XVIII. Jin Wang et al. “Human action recognition based on Pyramid Histogram of Oriented Gradients”, IEEE International Conference on Systems, Man, and Cybernetics, AK, USA, 2011.
XIX. J. Liu, J. Luo and M. Shah, Recognizing realistic actions from videos “in the wild”, CVPR 2009, Miami, FL.
XX. Kishore K. Reddy, NareshCuntoor, AmithaPerera, Anthony Hoogs, “Human Action Recognition in Large-Scale Datasets Using Histogram of Spatiotemporal Gradients”, IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance, Bejing China, 2012.
XXI. K. Ruben Raju, Yogesh Kumar Sharma, BirruDevender, “Composite Feature Vector Assisted Human Action Recognition through Supervised Learning”, International Journal of Recent Technology and Engineering (IJRTE), Volume-8 Issue-6, March 2020.
XXII. K. Soomro and A. R. Zamir, “Action recognition in realistic sports videos,” in Advances in Computer Vision and Pattern Recognition, vol. 71. Cham, Switzerland: Springer, 2014, pp. 181_208.
XXIII. M. B. Abidine, B. Fergani, “Evaluating a new classification method using PCA to human activity recognition”, ICCMA 2013: IEEEInternational Conference on Computer Medical Applications, At Sousse, Tunisia.
XXIV. M. Blank, L. Gorelick, E. Shechtman, M. Irani, and R. Basri, “Actions as space-time shapes,” in Proc. IEEE Int. Conf. Comput. Vision, vol. 2, 2005, pp. 1395–1402.
XXV. M. Bregonzio, S. Gong, and T. Xiang, Recognizing action as clouds of space-time interest points, in CVPR, 2009.
XXVI. Md. Zia Uddin, J.J. Lee, and T.-S. Kim, “Shape-Based Human Activity Recognition Using Independent Component Analysis and Hidden Markov Model”, In: Nguyen N. T., Borzemski L., Grzech A., Ali M. (eds) New frontiers in applied artificial intelligence. IEA/AIE 2008. Lecture notes I computer science, vol. 5027, Springer, Berlin, Heidelberg.
XXVII. M. Guo and Z. Wang, “A feature extraction method for human action recognition using body-worn inertial sensors”, IEEE 19th International Conference on Computer Supported Cooperative Work in Design (CSCWD), itlay, 2015.
XXVIII. Michael W. Davidson, Mortimer Abramowitz, “Molecular Expressions Microscopy Primer: Digital Image Processing – Difference of Gaussians Edge Enhancement Algorithm”, Olympus America Inc., and Florida State University.
XXIX. Ning Ii, De Xu, “2D Log-Gabor wavelet based action recognition”, IEICE Trans.Inf& Sys. Vol.E92-D, No.11, 2009.
XXX. P A. Dhulekar, S. T. Gandhe, “Action recognition based on Histogram of Oriented gradients and Spatio-temporal interest points, IJET, 7(4), 2018, 2153-2160.
XXXI. ParulArora, SmritiSrivastava, KunalArora, ShreyaBareja, “Improved Gait Recognition using Gradient Histogram Gaussian Image”, Procedia Computer Science 58 ( 2015 ) 408 – 413.
XXXII. P. Doll´ar, V. Rabaud, G. Cottrell, and S. Belongie, “Behavior recognition via sparse spatio-temporal features,” in Proc. Joint IEEE Int. Workshop Visual Surveillance Perform. Eval. Tracking Surveillance, 2005, pp. 65–72.
XXXIII. R. Gonzalez and R. Woods, Digital image processing. Pearson/Prentice Hall, 2008.
XXXIV. R. Poppe, “A survey on vision-based human action recognition”, Image and Vision Computing 28 (2010) 976–990
XXXV. S Kanagamalliga, and S. Vasuki “Contour-based object tracking in video scenes through optical flow and Gabor features”, Optik, Volume 157, March 2018, Pages 787-797.
XXXVI. S. Maheswari and P. ArockiaJansi Rani, “RVM-based human action classification through Gabor and Haar feature extraction”, Int. J. Computational Vision and Robotics, Vol. 6, Nos. 1/2, 2016.
XXXVII. Su, Y., Li, Y. & Liu, A., “open-view human action recognition based on Linear Discriminant Analysis”, Multimedia tools Appl, 78, 767-782, 2019
XXXVIII. T. B. Moeslund, A. Hilton, and V. Kr¨uger, “A survey of advances in vision-based human motion capture and analysis,” Computer Vision and Image Understanding, vol. 104, no.2-3, pp. 90–126, 2006.
XXXIX. T. Ko, “A survey on behavior analysis in video surveillance for homeland security applications,” in Proc. 37th IEEE Appl. Imagery Pattern Recog. Workshop, Washington, DC, 2008, pp. 1–8.
XL. Uddin M, Lee JJ, Kim T.S., “Independent component feature-based human activity recognition via Linear Discriminant Analysis and Hidden Markov Model. ”, In: ConfProc of IEEE Eng Med Biol Soc. 2008;2008:5168-71.
XLI. VikasTripathi, DurgaprasadGangodkar, AnkushMittal, VishnuKanth, “Robust Action Recognition framework using Segmented Block and Distance Mean Histogram of Gradients Approach”, Procedia Computer Science, Volume 115, 2017, Pages 493-500
XLII. V. Thanikachalam and K.K. Thyagarajan, “Human Action Recognition using Accumulated motion and gradient of motion from video”, ICCCNT 2012.
XLIII. Y. Ke, R. Sukthankar, and M. Hebert, “Event detection in crowded videos,” in Proc. IEEE Int. Conf. Comput. Vision, 2007, pp. 1–8.
XLIV. Yuan Shen, Zhenjiang Miao, “Oriented Gradients for Human Action Recognition”, ICIMCS’10, December 30–31, 2010, Harbin, China.
View Download