Research PaperNo Access

Timber–Prairie Wolf Optimization-Dependent Deep Learning Classifier for Anomaly Detection in Surveillance Videos

Department of Electronics & Telecommunication Engineering, RMD Sinhgad School of Engineering, Pune 411058, Maharashtra, India

E-mail Address: ram.gayal@gmail.com

Corresponding author.

Search for more papers by this author

and

Sandip Raosaheb Patil

Department of Electronics & Telecommunication Engineering, Bharati Vidyapeeth’s College of Engineering for Women, Dhankawadi, Pune 411043, Maharashtra, India

Search for more papers by this author

https://doi.org/10.1142/S0219691323500121Cited by:1 (Source: Crossref)

Abstract

Anomaly detection in public places using the video surveillance gains significance due to the real-time monitoring and security that ensures the personal assets and public security. Accordingly, in this research, a deep CNN model with Timber–Prairie wolf optimization algorithm (TPWO) optimization is proposed for surveillance-based anomaly detection. To support the TPWO-based deep CNN anomaly detection model, tracking model named OptSpatio tracking model tracks the location and movement of the anomalous objects in any locality. The OptSpatio tracking model uses both visual and spatial tracking models to monitor any anomalous activity. On the other hand, TPWO is designed to tune the deep classifier for acquiring better detection performance. The TPWO-based model surpasses the competent methods in terms of accuracy by 97.214%, sensitivity by 97.831% and specificity by 96.668% with minimal EER of 2.786%. The MOTP values are also obtained at a rate of 0.7325; moreover, the effectiveness of the TPWO method is justified at the object-, frame-, and pixel-level analysis.

Keywords:

References

1. J. Anguera, C. Borja and C. Puente , Microstrip fractal-shaped antennas: A review, in The Second European Conference on Antennas and Propagation, EuCAP 2007 (IET, Edinburgh, 2007), pp. 1–7. Crossref, Google Scholar
2. M. Asad, J. Yang, E. Tu, L. Chen and X. He , Anomaly3D: Video anomaly detection based on 3D-normality clusters, J. Vis. Commun. Image Represent. 75 (2021). Crossref, Web of Science, Google Scholar
3. M. V. Berry and Z. V. Lewis , On the Weierstrass–Mandelbrot fractal function, Proc. R. Soc. Lond. Ser. A 370 (1980) 459–484. Crossref, Web of Science, Google Scholar
4. S. R. Best , Operating band comparison of the perturbated Sierpinski and modified Parany gasket antennas, IEEE Antennas Wirel. Propag. Lett. 1 (2002) 35–38. Crossref, Web of Science, Google Scholar
5. Y. Chang, Z. Tu, W. Xie, B. Luo, S. Zhang, H. Sui and J. Yuan , Video anomaly detection with spatio-temporal dissociation, Pattern Recognit. 122 (2022). Crossref, Web of Science, Google Scholar
6. Y. S. Chong and Y. H. Tay , Abnormal event detection in videos using spatiotemporal autoencoder, in Proc. Int. Symp. Neural Network (Springer, Sapporo, Hakodate, and Muroran, Hokkaido, Japan, 2017), pp. 189–196. Crossref, Google Scholar
7. W. Chu, H. Xue, C. Yao and D. Cai , Sparse coding guided spatiotemporal feature learning for abnormal event detection in large videos, IEEE Trans. Multimedia 21 (2019) 246–255. Crossref, Web of Science, Google Scholar
8. Y. Fan, G. Wen, D. Li, S. Qiu, M. D. Levine and F. Xiao , Video anomaly detection and localization via Gaussian mixture fully convolutional variational autoencoder, Comput. Vis. Image Underst. 195 (2020). Crossref, Web of Science, Google Scholar
9. R. Girshick, J. Donahue, T. Darrell and J. Malik , Rich feature hierarchies for accurate object detection and semantic segmentation, in Proc. IEEE Conf. Computer Vision and Pattern Recognition (IEEE, 2014), pp. 580–587. Crossref, Google Scholar
10. E. Guariglia , Entropy and fractal antennas, Entropy 18 (2016) 84. Crossref, Web of Science, Google Scholar
11. E. Guariglia , Spectral analysis of the Weierstrass–Mandelbrot function, in Proc. 2nd Int. Multidisciplinary Conf. Computer and Energy Science (Split, Croatia, 2017). Google Scholar
12. E. Guariglia , Harmonic Sierpinski gasket and applications, Entropy 20 (2018) 714. Crossref, Web of Science, Google Scholar
13. E. Guariglia and S. Silvestrov , Fractional-wavelet analysis of positive definite distributions and wavelets on $D$ ’( $C$ ), in Engineering Mathematics II: Algebraic, Stochastic and Analysis Structures for Networks, Data Classification and Optimization, eds. S. Silvestrov and M. Rančić (Springer, 2016), pp. 337–353. Crossref, Google Scholar
14. M. Hasan, J. Choi, J. Neumann, A. K. Roy-Chowdhury and L. S. Davis , Learning temporal regularity in video sequences, in Proc. IEEE Conf. Computer Vision and Pattern Recognition (IEEE, 2016), pp. 733–742. Crossref, Google Scholar
15. R. G. Hohlfeld and N. Cohen , Self-similarity and the geometric requirements for frequency independence in antennae, Fractals 7 (1999) 79–84. Link, Web of Science, Google Scholar
16. http://www.cse.cuhk.edu.hk/leojia/projects/detectabnormal/dataset.html. Google Scholar
17. http://www.svcl.ucsd.edu/projects/anomaly/dataset.html. Google Scholar
18. https://svip-lab.github.io/dataset/campus_dataset.html. Google Scholar
19. P. Juliano and L. D. S. Coelho , Coyote optimization algorithm: A new metaheuristic for global optimization problems, in 2018 IEEE Congr. Evolutionary Computation (CEC) (IEEE, 2018), pp. 1–8. Google Scholar
20. A. Krizhevsky, I. Sutskever and G. E. Hinton , ImageNet classification with deep convolutional neural networks, in Advances in Neural Information Processing Systems (Lake Tahoe, Nevada, USA, 2012), pp. 1097–1105. Google Scholar
21. W. J. Krzysztofik , Fractal geometry in electromagnetics applications — From antenna to metamaterials, Microw. Rev. 19 (2013) 3–14. Google Scholar
22. W. Liu, W. Luo, D. Lian and S. Gao , Future frame prediction for anomaly detection — A new baseline, in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition (CVPR) (IEEE, 2018), pp. 6536–6545. Google Scholar
23. W. Luo, W. Liu and S. Gao , A revisit of sparse coding based anomaly detection in stacked RNN framework, in Proc. IEEE Int. Conf. Computer Vision (ICCV) (IEEE, 2017), pp. 341–349. Crossref, Google Scholar
24. W. Luo, W. Liu, D. Lian, J. Tang, L. Duan, X. Peng and S. Gao , Video anomaly detection with sparse coding inspired deep neural networks, IEEE Trans. Pattern Anal. Mach. Intell. 43 (2019) 1070–1084. Crossref, Web of Science, Google Scholar
25. H. Lv, C. Zhou, Z. Cui, C. Xu, Y. Li and J. Yang , Localizing anomalies from weakly labeled videos, IEEE Trans. Image Process. 30 (2021) 4505–4515. Crossref, Web of Science, Google Scholar
26. R. F. Mansour, J. Escorcia-Gutierrez, M. Gamarra, J. A. Villanueva and N. Leal , Intelligent video anomaly detection and classification using faster RCNN with deep reinforcement learning model, Image Vis. Comput. 112 (2021). Crossref, Web of Science, Google Scholar
27. R. Nawaratne, D. Alahakoon, D. De Silva and X. Yu , Spatiotemporal anomaly detection using deep learning for real-time video surveillance, IEEE Trans. Ind. Inform. 16 (2020) 393–402. Crossref, Web of Science, Google Scholar
28. R. Nawaratne, T. Bandaragoda, A. Adikari, D. Alahakoon, D. De Silva and X. Yu , Incremental knowledge acquisition and self-learning for autonomous video surveillance, in IECON 2017 — 43rd Annual Conf. IEEE Industrial Electronics Society (IEEE, 2017), pp. 4790–4795. Crossref, Google Scholar
29. K. Neelu, P. Devan, C. L. Chowdhary, S. Bhattacharya, G. Singh, S. Singh and B. Yoon , SMO-DNN: Spider monkey optimization and deep neural network hybrid classifier model for intrusion detection, Electronics 9 (2020). Web of Science, Google Scholar
30. C. Puente-Baliarda, J. Romeu, R. Pous and A. Cardama , On the behavior of the Sierpinski multiband fractal antenna, IEEE Trans. Antennas Propag. 46 (1998) 517–524. Crossref, Web of Science, Google Scholar
31. K. Seongchan, S. Hong, M. Joh and S.-k. Song, DeepRain: ConvLSTM network for precipitation prediction using multichannel radar data, preprint (2017), arXiv:1711.02316. Google Scholar
32. M. Seyedali, S. M. Mirjalili and A. Lewis , Grey wolf optimizer, Adv. Eng. Softw. 69 (2014) 46–61. Crossref, Web of Science, Google Scholar
33. K. Simonyan and A. Zisserman , Two-stream convolutional networks for action recognition in videos, in Advances in Neural Information Processing Systems (Montreal, Canada, 2014), pp. 568–576. Google Scholar
34. N. Srivastava, E. Mansimov and R. Salakhudinov , Unsupervised learning of video representations using LSTMs, in Int. Conf. Machine Learning (Lille, France, 2015), pp. 843–852. Google Scholar
35. W. Sultani, C. Chen and M. Shah , Real-world anomaly detection in surveillance videos, in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition(CVPR) (IEEE, 2018), pp. 6479–6488. Crossref, Google Scholar
36. L. Taiyong, Z. Qian and T. He , Short-term load forecasting with improved CEEMDAN and GWO-based multiple kernel ELM, Complexity (2020). Web of Science, Google Scholar
37. W. Tian, D. Zhao, S. Cai, W. Jia and A. Liu , Bidirectional prediction-based underwater data collection protocol for end-edge-cloud orchestrated system, IEEE Trans. Ind. Inform. 16 (2019) 4791–4799. Web of Science, Google Scholar
38. D. Tran, L. Bourdev, R. Fergus, L. Torresani and M. Paluri , Learning spatiotemporal features with 3d convolutional networks, in Proc. IEEE Int. Conf. Computer Vision (IEEE, 2015), pp. 4489–4497. Crossref, Google Scholar
39. F. Tung, J. S. Zelek and D. A. Clausi , Goal-based trajectory analysis for unusual behaviour detection in intelligent surveillance, Image Vis. Comput. 29 (2011) 230–240. Crossref, Web of Science, Google Scholar
40. N. Wang and D.-Y. Yeung , Learning a deep compact image representation for visual tracking, in Advances in Neural Information Processing Systems (Lake Tahoe, Nevada, USA, 2013), pp. 809–817. Google Scholar
41. P. Wu, J. Liu, M. Li, Y. Sun and F. Shen , Fast sparse coding networks for anomaly detection in videos, Pattern Recognit. 107 (2020) 107515. Crossref, Web of Science, Google Scholar
42. D. Xu, E. Ricci, Y. Yan, J. Song and N. Sebe , Learning deep representations of appearance and motion for anomalous event detection, in Proc. British Machine Vision Conf. 2015, BMVC 2015, Swansea, UK, 2015, pp. 8.1–8.12. Crossref, Google Scholar
43. K. Xu, T. Sun and X. Jiang , Video anomaly detection and localization based on an adaptive intra-frame classification network, in IEEE Trans. Multimedia 22 (2020) 394–406. Crossref, Web of Science, Google Scholar
44. D. Xu, Y. Yan, E. Ricci and N. Sebe , Detecting anomalous events in videos by learning deep representations of appearance and motion, Comput. Vis. Image Underst. 156 (2017) 117. Crossref, Web of Science, Google Scholar
45. B. Yu, Y. Liu and Q. Sun , A content-adaptively sparse reconstruction method for abnormal events detection with low-rank property, IEEE Trans. Syst. Man Cybern.: Syst. 47 (2017) 704–716. Crossref, Web of Science, Google Scholar
46. J. Zhang, S. Shan, M. Kan and X. Chen , Coarse-to-fine auto-encoder networks (CFAN) for real-time face alignment, in European Conf. Computer Vision (Springer, 2014), pp. 1–16. Crossref, Google Scholar
47. H. Zhiheng, W. Xu and K. Yu, Bidirectional LSTM-CRF models for sequence tagging, preprint (2015), arXiv:1508.01991. Google Scholar
48. J.-X. Zhong, N. Li, W. Kong, S. Liu, T. H. Li and G. Li , Graph convolutional label noise cleaner: Train a plug-and-play action classifier for anomaly detection, in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition (CVPR) (IEEE, 2019), pp. 1237–1246. Crossref, Google Scholar
49. Y. Zhu and S. Newsam , Motion-aware feature for improved video anomaly detection, in Proc. British Machine Vision Conf. (BMVC) (Cardiff, UK, 2019), pp. 1–12. Google Scholar