No Access

Camouflaged Object Detection and Tracking: A Survey

Ajoy Mondal

CVIT, International Institute of Information Technology, Hyderabad, India

https://doi.org/10.1142/S021946782050028XCited by:39 (Source: Crossref)

Abstract

Moving object detection and tracking have various applications, including surveillance, anomaly detection, vehicle navigation, etc. The literature on object detection and tracking is rich enough, and there exist several essential survey papers. However, the research on camouflage object detection and tracking is limited due to the complexity of the problem. Existing work on this problem has been done based on either biological characteristics of the camouflaged objects or computer vision techniques. In this paper, we review the existing camouflaged object detection and tracking techniques using computer vision algorithms from the theoretical point of view. This paper also addresses several issues of interest as well as future research direction in this area. We hope this paper will help the reader to learn the recent advances in camouflaged object detection and tracking.

Keywords:

Remember to check out the Check out our Most Cited Articles!
Check out these titles on Image Analysis

References

1. A. C. Copeland and M. M. Trivedi, “Models and metrics for signature strength evaluation of camouflaged targets,” in SPIE Proc. Series, Society of Photo-Optical Instrumentation Engineers, 1997, pp. 194–199. Google Scholar
2. Y. Beiderman, M. Teicher, J. Garcia, V. Mico and Z. Zalevsky, “Optical technique for classification, recognition and identification of obscured objects,” Opt. Commun. 283(21), 4274–4282 (2010). Crossref, Web of Science, Google Scholar
3. N. U. Bhajantri and P. Nagabhushan, “Camouflage defect identification: A novel approach,” in 9th IEEE Int. Conf. Information Technology, ICIT’06, pp. 145–148 (2006). Crossref, Google Scholar
4. W. R. Boot, M. B. Neider and A. F. Kramer, “Training and transfer of training in the search for camouflaged targets,” Attention Perception Psychophys. 71(4), 950–963 (2009). Crossref, Web of Science, Google Scholar
5. T. E. Boult, R. J. Micheals, X. Gao and M. Eckmann, “Into the woods: Visual surveillance of noncooperative and camouflaged targets in complex outdoor settings,” Proc. IEEE 89(10), 1382–1402 (2001). Crossref, Web of Science, Google Scholar
6. M. J. Brady and D. Kersten, “Bootstrapped learning of novel objects,” J. Vis. 3(6), 413–422 (2003). Crossref, Web of Science, Google Scholar
7. J. Canny, “A computational approach to edge detection,” IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986). Crossref, Web of Science, Google Scholar
8. T. Chandesa, T. Pridmore and A. Bargiela, “Detecting occlusion and camouflage during visual tracking,” in IEEE Int. Conf. Signal and Image Processing Applications (ICSIPA), pp. 468–473 (2009). Crossref, Google Scholar
9. D. Conte, P. Foggia, G. Percannella, F. Tufano and M. Vento, “An algorithm for detection of partially camouflaged people,” in 6th IEEE Int. Conf. Advanced Video and Signal Based Surveillance, AVSS’09, pp. 340–345 (2009). Crossref, Google Scholar
10. A. C. Copeland and M. M. Trivedi, “Models and metrics for signature strength evaluation of camouflaged targets,” in AeroSense’97, pp. 194–199 (1997). Google Scholar
11. M. Galun, E. Sharon, R. Basri and A. Brandt, “Texture segmentation by multiscale aggregation of filter responses and shape elements,” in Proc. 9th IEEE Int. Conf. Computer Vision, pp. 716–723 (2003). Crossref, Google Scholar
12. F. M. Gretzmacher, G. S. Ruppert and S. Nyberg, “Camouflage assessment considering human perception data,” in Aerospace/Defense Sensing and Controls, pp. 58–67 (1998). Google Scholar
13. M. Harville, G. Gordon and J. Woodfill, “Foreground segmentation using adaptive mixture models in color and depth,” in Proc. IEEE Workshop on Detection and Recognition of Events in Video, pp. 3–11 (2001). Crossref, Google Scholar
14. J. Y. Y. H. W. Hou and J. Li, “Detection of the mobile object with camouflage color under dynamic background based on optical flow,” Proc. Eng. 15, 2201–2205 (2011). Crossref, Google Scholar
15. Z. Q. Huang and Z. Jiang, “Tracking camouflaged objects with weighted region consolidation,” in Proc. Digital Image Computing: Techniques and Applications, DICTA’05, pp. 24–31 (2005). Crossref, Google Scholar
16. Z. Jiang, “Object modelling and tracking in videos via multidimensional features,” ISRN Signal Process. 2011, 1–15 (2011). Crossref, Google Scholar
17. P. KaewTrakulPong and R. Bowden, “A real time adaptive visual surveillance system for tracking low-resolution colour targets in dynamically changing scenes,” Image Vis. Comput. 21(10), 913–929 (2003). Crossref, Web of Science, Google Scholar
18. S. Kim, “Unsupervised spectral-spatial feature selection-based camouflaged object detection using VNIR hyperspectral camera,” Sci. World J. 2014, 1–8 (2014). Google Scholar
19. C. Li, X. Zhao and Y. Wan, “The camouflage color target detection with deep networks,” in Int. Conf. Neural Information Processing (Springer, 2017), pp. 476–485. Crossref, Google Scholar
20. S. Li, D. Florencio, Y. Zhao, C. Cook and W. Li, Foreground detection in camouflaged scenes, arXiv:1707.03166 (2017). Google Scholar
21. S. Liming and G. Weidong, “A new camouflage texture evaluation method based on WSSIM and nature image features,” in IEEE Int. Conf. Multimedia Technology (ICMT), pp. 1–4 (2010). Google Scholar
22. Z. Liu, K. Huang and T. Tan, “Foreground object detection using top-down information based on EM framework,” IEEE Trans. Image Process. 21(9), 4204–4217 (2012). Crossref, Web of Science, Google Scholar
23. A. Łoza, L. Mihaylova, D. Bull and N. Canagarajah, “Structural similarity-based object tracking in multimodality surveillance videos,” Mach. Vis. Appl. 20(2), 71–83 (2009). Crossref, Web of Science, Google Scholar
24. H. Lu, X. Wang, S. Liu, M. Shi and A. Guo, “The possible mechanism underlying visual anti-camouflage: A model and its real-time simulation,” IEEE Trans. Syst. Man Cybern. Part A, Syst. Humans 29(3), 314–318 (1999). Crossref, Web of Science, Google Scholar
25. T. Malathi and K. M. Bhuyan, “Foreground object detection under camouflage using multiple camera-based codebooks,” in Annual IEEE India Conf. (INDICON), pp. 1–6 (2013). Crossref, Google Scholar
26. S. Marouani, A. Huertas and G. Medioni, “Model-based aircraft recognition in perspective aerial imagery,” in Proc. Int. Symp. Computer Vision, pp. 371–376 (1995). Crossref, Google Scholar
27. S. P. McKee, S. N. Watamaniuk, J. M. Harris, H. S. Smallman and D. G. Taylor, “Is stereopsis effective in breaking camouflage for moving targets? Vis. Res. 37(15), 2047–2055 (1997). Crossref, Web of Science, Google Scholar
28. A. Mondal, S. Ghosh and A. Ghosh, “Partially camouflaged object tracking using modified probabilistic neural network and fuzzy energy based active contour,” Int. J. Comput. Vis. 122(1), 1–33 (2016). Web of Science, Google Scholar
29. M. B. Neider and G. J. Zelinsky, “Searching for camouflaged targets: Effects of target-background similarity on visual search,” Vis. Res. 46(14), 2217–2235 (2006). Crossref, Web of Science, Google Scholar
30. A. Owens, C. Barnes, A. Flint, H. Singh and W. Freeman, “Camouflaging an object from many viewpoints,” in IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp. 2782–2789 (2014). Crossref, Google Scholar
31. Y. Pan, Y. Chen, Q. Fu, P. Zhang and X. Xu, “Study on the camouflaged target detection method based on 3D convexity,” Mod. Appl. Sci. 5(4), 152–156 (2011). Crossref, Google Scholar
32. W. Reichardt, M. Egelhaaf and A. K. Guo, “Processing of figure and background motion in the visual system of the fly,” Biol. Cybernet. 61(5), 327–345 (1989). Crossref, Web of Science, Google Scholar
33. M. H. Robert, K. Shanmugam and I. Dinstein, “Textural features for image classification,” IEEE Trans. Syst. Man Cybernet. 3(6), 610–621 (1973). Crossref, Web of Science, Google Scholar
34. P. Sengottuvelan, A. Wahi and A. Shanmugam, “Performance of decamouflaging through exploratory image analysis,” in 1st IEEE Int. Conf. Emerging Trends in Engineering and Technology, ICETET’08, pp. 6–10 (2008). Crossref, Google Scholar
35. S. K. Singh, C. A. Dhawale and S. Misra, “Survey of object detection methods in camouflaged image,” IERI Procedia 4, 351–357 (2013). Crossref, Google Scholar
36. G. Song and T. Shunqing, “Method for spectral pattern recognition of color camouflage,” Opt. Eng. 36(6), 1779–1781 (1997). Crossref, Web of Science, Google Scholar
37. A. Tankus and Y. Yeshurun, “Detection of regions of interest and camouflage breaking by direct convexity estimation,” in Proc. IEEE Workshop on Visual Surveillance, pp. 42–48 (1998). Google Scholar
38. A. Tankus and Y. Yeshurun, “Convexity-based camouflage breaking,” in Proc. 15th Int. Conf. Pattern Recognition, Vol. 1, pp. 454–457 (2000). Crossref, Google Scholar
39. A. Tankus and Y. Yeshurun, “A model for visual camouflage breaking,” in Biologically Motivated Computer Vision, pp. 139–149 (2000). Crossref, Google Scholar
40. A. Tankus and Y. Yeshurun, “Convexity-based visual camouflage breaking,” Comput. Vis. Image Understand. 82(3), 208–237 (2001). Crossref, Web of Science, Google Scholar
41. A. Tankus and Y. Yeshurun, “Computer vision, camouflage breaking and countershading,” Philos. Trans. R. Soc. Lond. B, Biol. Sci. 364(1516), 529–536 (2009). Crossref, Web of Science, Google Scholar
42. I. V. Ternovskiy and T. P. Jannson, “Mapping-singularities-based motion estimation,” in Optical Science, Engineering and Instrumentation’97, Vol. 3173, pp. 317–321 (1997). Google Scholar
43. P. C. Zhou and C. C. Liu, “Camouflaged target separation by spectral-polarimetric imagery fusion with shearlet transform and clustering segmentation,” in ISPDI 2013-5th Int. Symp. Photoelectronic. Google Scholar
44. A. W. M. Smeulders, D. M. Chu, R. Cucchiara, S. Calderara, A. Dehghan and M. Shah, “Visual tracking: An experimental survey,” IEEE Trans. Pattern Anal. Mach. Intell. 37(7), 1442–1468 (2013). Google Scholar
45. X. Li, W. Hu, C. Shen, Z. Zhang, A. Dick and A. V. D. Hengel, “A survey of appearance models in visual object tracking,” ACM Trans. Intell. Syst. Technol. (TIST) 4(4), 1–58 (2013). Crossref, Web of Science, Google Scholar
46. A. Yilmaz, O. Javed and M. Shah, “Object tracking: A survey,” ACM Comput. Surveys (CSUR) 34(4), 1–45 (2006). Google Scholar
47. Z. Fang, X. Zhang and X. Deng, Camouflage people detection via strong semantic dilation network, TURC-AIS, pp. 1–7 (2019). Google Scholar
48. X. Rong, Q. Jia, W. Xu, X. Lv and J. Hu, “Camouflage effect evaluation of pattern painting based on moving object detection,” Int. Conf. Energy, Power and Electrical Engineering, pp. 244–247 (2016). Crossref, Google Scholar
49. Y. Zhang, H. Foroosh, P. David and B. Gong, CAMOU: Learning a Vehicle Camouflage for Physical Adversarial Attack on Object Detectors in the Wild ICRL 1–20 (2019). Google Scholar
50. S. Mangale and M. Khambete, “Camouflaged target detection and tracking using thermal infrared and visible spectrum imaging,” Int. Symp. Intelligent Systems Technologies and Applications, pp. 193–207 (2016). Crossref, Google Scholar
51. X. Zhang, C. Zhu, S. Wang, Y. Liu and M. Ye, “A Bayesian approach to camouflaged moving object detection,” IEEE Trans. Circuits Syst. Video Technol. 27(9), 2001–2013 (2016). Crossref, Web of Science, Google Scholar
52. S. Li, D. Florencio, W. Li, Y. Zhao and C. Cook, “A fusion framework for camouflaged moving foreground detection in the wavelet domain,” IEEE Trans. Image Process. 27(8), 3918–3930 (2018). Crossref, Web of Science, Google Scholar