Pattern RecognitionNo Access

Computer Science and Engineering, N.B.K.R. Institute of Science & Technology, Vidyanagar, Andhra Pradesh 524413, India

E-mail Address: veera_raghavulu@rediff.com

Corresponding author.

Search for more papers by this author

and

Ande Prasad

Computer Science and Engineering, Vikrama Simhapuri University, Kakutur, Nellore, Andhra Pradesh 524324, India

E-mail Address: prasadjkc@yahoo.co.in

Search for more papers by this author

https://doi.org/10.1142/S0218001424500125Cited by:0 (Source: Crossref)

Abstract

In this study, a novel hybrid deep clustering approach is proposed for the effective moving object segmentation. Initially, the data is collected, and the keyframe selection is performed using the threshold-based Kennard–Stone method. Then, the preprocessing step involves noise filtering using bilateral wavelet thresholding and binary color conversion. The blob detection is performed using normalized Laplacian of Gaussian. Finally, the segmentation of moving objects is performed using a hybrid clustering approach called improved fuzzy C-mean (IFCM) clustering with chaotic salp swarm (CSS) optimization algorithm (Hybrid IFCM-CSS). The overall evaluation is done in MATLAB. The performance of the hybrid IFCM-CSS is compared to other approaches based on some measures. The proposed Hybrid IFCM-CSS achieves the highest precision of 0.971, using the SBM-RGBD dataset.

Keywords:

References

1. S. Agrawal and P. Natu, ABGS segmenter: Pixel wise adaptive background subtraction and intensity ratio based shadow removal approach for moving object detection, J. Supercomput. 79(7) (2023) 7937–7969. Crossref, Web of Science, Google Scholar
2. T. Akilan, Q. J. Wu, A. Safaei, J. Huo and Y. Yang, A 3d cnn-lstm-based image-to-image foreground segmentation, IEEE Trans. Intell. Transport. Syst. 21 (2019) 959–971. Crossref, Google Scholar
3. T. Akilan, Q. J. Wu and W. Zhang, Video foreground extraction using multi-view receptive field and encoder-decoder dcnn for traffic and surveillance applications, IEEE Trans. Vehicular Technol. 68 (2019) 9478–9493. Crossref, Google Scholar
4. T. Akilan and Q. J. Wu, sendec: An improved image to image cnn for foreground localization, IEEE Trans. Intell. Transport. Syst. 21 (2019) 4435–4443. Crossref, Google Scholar
5. N. Aslam and V. Sharma, Foreground detection of moving object using Gaussian mixture model, in 2017 Int. Conf. Commun. Signal Process. (ICCSP) (IEEE, 2017), pp. 1071–1074. Crossref, Google Scholar
6. Y. Chen, J. Wang, B. Zhu, M. Tang and H. Lu, Pixel-wise deep sequence learning for moving object detection, IEEE Trans. Circuits Syst. Video Technol. 29 (2017) 2567–2579. Crossref, Google Scholar
7. J. Cho, Y. Jung, D. S. Kim, S. Lee and Y. Jung, Moving object detection based on optical flow estimation and a Gaussian mixture model for advanced driver assistance systems, Sensors 19(14) (2019) 3217. Crossref, Web of Science, Google Scholar
8. A. Darwich, P. A. Hébert, A. Bigand and Y. Mohanna, Background subtraction based on a new fuzzy mixture of Gaussians for moving object detection, J. Imaging 4(7) (2018) 92. Crossref, Google Scholar
9. M. De Gregorio and M. Giordano, Cwisardh+: Background detection in rgbd videos by learning of weightless neural networks, in Int. Conf. Image Analysis and Processing (Springer, 2017), pp. 242–253. Crossref, Google Scholar
10. J. Dou, Q. Qin and Z. Tu, Background subtraction based on deep convolutional neural networks features, Multimedia Tools Appl. 78(11) (2019) 14549–14571. Crossref, Web of Science, Google Scholar
11. L. Fu, Y. Zhao, X. Sun, J. Huang, D. Wang and Y. Ding, Video object segmentation based on motion-aware ROI prediction and adaptive reference updating, Expert Syst. Appl. 167 (2021) 114153. Crossref, Web of Science, Google Scholar
12. N. S. Ghedia and C. H. Vithalani, Outdoor object detection for surveillance based on modified GMM and adaptive thresholding, Int. J. Inf. Technol. 13(1) (2021) 185–193. Google Scholar
13. J. H. Giraldo, S. Javed, M. Sultana, S. K. Jung and T. Bouwmans, The emerging field of graph signal processing for moving object segmentation, in Int. Workshop on Frontiers of Computer Vision (Springer, Cham, 2021), pp. 31–45. Google Scholar
14. Y. T. Hu, J. B. Huang and A. G. Schwing, Unsupervised video object segmentation using motion saliency-guided spatio-temporal propagation, in Proc. Eur. Conf. Computer Vision (ECCV), Munich, Germany, 2018, pp. 786–802. Crossref, Google Scholar
15. E. Ilg, T. Saikia, M. Keuper and T. Brox, Occlusions, motion and depth boundaries with a generic network for disparity, optical flow or scene flow estimation, in Proc. Eur. Conf. Computer Vision (ECCV), Munich, Germany, 2018, pp. 614–630. Crossref, Google Scholar
16. S. Javed, T. Bouwmans, M. Sultana and S. K. Jung, Moving object detection on rgb-d videos using graph regularized spatiotemporal rpca, in New Trends in Image Analysis and Processing — ICIAP 2017, eds. S. Battiato, G. M. Farinella, M. Leo and G. Gallo (Springer International Publishing, 2017), pp. 230–241. Crossref, Google Scholar
17. S. Javed, A. Mahmood, S. Al-Maadeed, T. Bouwmans and S. K. Jung, Moving object detection in complex scene using spatiotemporal structured-sparse rpca, IEEE Trans. Image Process. 28(2) (2018) 1007–1022. Crossref, Google Scholar
18. G. Jemilda and S. Baulkani, Integration of new moving object segmentation and classification techniques using optimal salp swarm-based feature fusion with linear multi k-SVM classifier, EURASIP J. Image Video Process. 2020(1) (2020) 1–10. Web of Science, Google Scholar
19. J. Jeong, T. S. Yoon and J. B. Park, MOSnet: Moving object segmentation with convolutional networks, Electron. Lett. 54(3) (2018) 136–138. Crossref, Web of Science, Google Scholar
20. J. Ju and J. Xing, Moving object detection based on smoothing three frame difference method fused with RPCA, Multimedia Tools Appl. 78(21) (2019) 29937–29951. Crossref, Web of Science, Google Scholar
21. C. Kim, J. Lee, T. Han and Y. M. Kim, A hybrid framework combining background subtraction and deep neural networks for rapid person detection, J. Big Data 5(1) (2018) 1–24. Crossref, Google Scholar
22. A. Kushwaha, A. Khare, O. Prakash and M. Khare, Dense optical flow based background subtraction technique for object segmentation in moving camera environment, IET Image Process. 14(14) (2020) 3393–3404. Crossref, Web of Science, Google Scholar
23. J. Luiten, P. Voigtlaender and B. Leibe, Premvos: Proposal-generation, refinement and merging for video object segmentation, in Asian Conf. Computer Vision (Springer, 2018), pp. 565–580. Google Scholar
24. L. Maddalena and A. Petrosino, Exploiting color and depth for background subtraction, in New Trends in Image Analysis and Processing — ICIAP 2017, eds. S. Battiato, G. M. Farinella, M. Leo, G. Gallo (Springer International Publishing, 2017), pp. 254–265. Crossref, Google Scholar
25. K. K. Maninis, S. Caelles, Y. Chen, J. Pont-Tuset, L. Leal-Taixé, D. Cremers and L. Van Gool, Video object segmentation without temporal information, IEEE Trans. Pattern Anal. Mach. Intell. 41(6) (2018) 1515–1530. Crossref, Google Scholar
26. T. Minematsu, A. Shimada, H. Uchiyama and R. I. Taniguchi, Simple combination of appearance and depth for foreground segmentation, in New Trends in Image Analysis and Processing — ICIAP 2017, eds. S. Battiato, G. M. Farinella, M. Leo and G. Gallo (Springer International Publishing, 2017), pp. 266–277. Crossref, Google Scholar
27. S. Mirjalili, A. H. Gandomi, S. Z. Mirjalili, S. Saremi, H. Faris and S. M. Mirjalili, Salp swarm algorithm: A bio-inspired optimizer for engineering design problems, Adv. Eng. Software 114 (2017) 163–191. Crossref, Web of Science, Google Scholar
28. H. Park, J. Yoo, S. Jeong, G. Venkatesh and N. Kwak, Learning dynamic network using a reuse gate function in semi-supervised video object segmentation, in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition, Nashville, TN, USA, 2021, pp. 8405–8414. Crossref, Google Scholar
29. P. W. Patil, K. M. Biradar, A. Dudhane and S. Murala, An end-to-end edge aggregation network for moving object segmentation, in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition, Seattle, Washington, USA, 2020, pp. 8149–8158. Crossref, Google Scholar
30. P. W. Patil, A. Dudhane and S. Murala, End-to-end recurrent generative adversarial network for traffic and surveillance applications, IEEE Trans. Vehicular Technol. 69(12) (2020) 14550–14562. Crossref, Web of Science, Google Scholar
31. P. W. Patil, A. Dudhane and S. Murala, Multi-frame recurrent adversarial network for moving object segmentation, in Proc. IEEE/CVF Winter Conf. Applications of Computer Vision, Waikoloa, Hawaii, USA, 2021, pp. 2302–2311. Crossref, Google Scholar
32. P. W. Patil, A. Dudhane, S. Murala and A. B. Gonde, Deep adversarial network for scene independent moving object segmentation, IEEE Signal Process. Lett. 28 (2021) 489–493. Crossref, Web of Science, Google Scholar
33. P. W. Patil and S. Murala, Msfgnet: A novel compact end-to-end deep network for moving object detection, IEEE Trans. Intell. Transp. Syst. 20(10) (2019) 4066–4077. Crossref, Google Scholar
34. F. Perazzi, J. Pont-Tuset, B. McWilliams, L. Van Gool, M. Gross and A. Sorkine-Hornung, A benchmark dataset and evaluation methodology for video object segmentation, in Proc. IEEE Conf. CVPR, Las Vegas, NV, USA, 2016, pp. 724–732. Crossref, Google Scholar
35. V. V. Raghavulu and A. Prasad, Moving object segmentation using level set algorithm with GWO-KFCM clustering, Int. J. Intell. Eng. Syst. 13 (2020) 374–383. Google Scholar
36. A. F. M. Saif and Z. R. Mahayuddin, Moving object segmentation using various features from aerial images: A review, Adv. Sci. Lett. 24(2) (2018) 961–965. Crossref, Google Scholar
37. S. S. Sengar and S. Mukhopadhyay, Moving object detection using statistical background subtraction in wavelet compressed domain, Multimedia Tools Appl. 79(9) (2020) 5919–5940. Crossref, Web of Science, Google Scholar
38. K. K. Singh and Y. J. Lee, You reap what you sow: Using videos to generate high precision object proposals for weakly-supervised object detection, in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition, Long Beach, CA, USA, 2019, pp. 9414–9422. Crossref, Google Scholar
39. M. Sultana, A. Mahmood, S. Javed and S. K. Jung, Unsupervised rgbd video object segmentation using gans, arXiv preprint (2018), arXiv:1811.01526. Google Scholar
40. Y. Tang and X. Wu, Salient object detection using cascaded convolutional neural networks and adversarial learning, IEEE Trans. Multimedia 21 (2019) 2237–2247. Crossref, Web of Science, Google Scholar
41. U. A. Usmani, J. Watada, J. Jaafar, I. A. Aziz and A. Roy, A reinforcement learning based adaptive ROI generation for video object segmentation, IEEE Access 9 (2021) 161959–161977. Crossref, Web of Science, Google Scholar
42. Y. Wang, P. M. Jodoin, F. Porikli, J. Konrad, Y. Benezeth and P. Ishwar, Cdnet 2014: An expanded change detection benchmark dataset, in Proc. IEEE Conf. CVPRW, Columbus, Ohio, 2014, pp. 387–394. Crossref, Google Scholar
43. W. Wang, X. Lu, J. Shen, D. J. Crandall and L. Shao, Zero-shot video object segmentation via attentive graph neural networks, in Proc. IEEE/CVF Int. Conf. Computer Vision, Seoul, Korea (South), 2019, pp. 9236–9245. Crossref, Google Scholar
44. Z. Wang, J. Xu, L. Liu, F. Zhu and L. Shao, Ranet: Ranking attention network for fast video object segmentation, in Proc. IEEE Int. Conf. Computer Vision, Seoul, South Korea, 2019, pp. 3978–3987. Crossref, Google Scholar
45. W. Xie, P. X. Liu and M. Zheng, Moving object segmentation and detection for robust RGBD-SLAM in dynamic environments, IEEE Trans. Instrum. Meas. 70 (2020) 1–8. Google Scholar
46. X. Xie, H. Wei and Y. Yang, Real-time LiDAR point-cloud moving object segmentation for autonomous driving, Sensors 23(1) (2023) 547. Crossref, Web of Science, Google Scholar
47. P. Yan, G. Li, Y. Xie, Z. Li, C. Wang, T. Chen and L. Lin, Semi-supervised video salient object detection using pseudo-labels, in Proc. IEEE/CVF Int. Conf. Computer Vision, Seoul, South Korea, 2019, pp. 7284–7293. Crossref, Google Scholar
48. R. Yao, G. Lin, S. Xia, J. Zhao, Y. Zhou, Video object segmentation and tracking: A survey, ACM Trans. Intell. Syst. Technol. 11(4) (23 05 2020) 1–47. Crossref, Web of Science, Google Scholar
49. S. Yu, J. Xiao, B. Zhang, E. G. Lim and Y. Zhao, Fast pixel-matching for video object segmentation, Signal Process.: Image Commun. 98 (2021) 116373. Crossref, Web of Science, Google Scholar
50. W. Zhang, X. Sun and Q. Yu, Accurate moving object segmentation in unconstraint videos based on robust seed pixels selection, Int. J. Adv. Robot. Syst. 17(4) (2020) 1729881420947273. Crossref, Web of Science, Google Scholar
51. K. Zhang, Z. Zhao, D. Liu, Q. Liu and B. Liu, Deep transport network for unsupervised video object segmentation, in Proc. IEEE/CVF Int. Conf. Computer Vision, Montreal, BC, Canada, 2021, pp. 8781–8790. Crossref, Google Scholar
52. B. Zhou, J. Xie, Y. Pan, J. Wu and C. Lu, MotionBEV: Attention-aware online LiDAR moving object segmentation with bird’s eye view based appearance and motion features, arXiv preprint (2023), arXiv:2305.07336. Google Scholar
53. X. Zhou, C. Yang and W. Yu, Moving object detection by detecting contiguous outliers in the low-rank representation, IEEE Trans. Pattern Anal. Mach. Intell. 35(3) (2013) 597–610. Crossref, Web of Science, Google Scholar