No Access

Domain Adaptation Infrared Forest Fire Detection Method Based on YOLOv5 Framework

Guangdong Key Laboratory of Electric Power Equipment Reliability, Electric Power Research, Institute of Guangdong Power Grid Co., Ltd., Guangzhou, P. R. China

E-mail Address: raccoonhe@gmail.com

Corresponding author.

Search for more papers by this author

Lei Wang

Guangdong Key Laboratory of Electric Power Equipment Reliability, Electric Power Research, Institute of Guangdong Power Grid Co., Ltd., Guangzhou, P. R. China

E-mail Address: wanglei129@163.com

Search for more papers by this author

Enze Zhou

Guangdong Key Laboratory of Electric Power Equipment Reliability, Electric Power Research, Institute of Guangdong Power Grid Co., Ltd., Guangzhou, P. R. China

E-mail Address: zhou_dky@163.com

Search for more papers by this author

Ruizeng Wei

Guangdong Key Laboratory of Electric Power Equipment Reliability, Electric Power Research, Institute of Guangdong Power Grid Co., Ltd., Guangzhou, P. R. China

E-mail Address: weiruizeng@foxmail.com

Search for more papers by this author

, and

Shuqin Liu

Guangdong Key Laboratory of Electric Power Equipment Reliability, Electric Power Research, Institute of Guangdong Power Grid Co., Ltd., Guangzhou, P. R. China

E-mail Address: 508064710@qq.com

Search for more papers by this author

https://doi.org/10.1142/S0218213024400074Cited by:1 (Source: Crossref)

This article is part of the issue:

Special Issue on Heterogeneous Domain Adaptation Learning and its Applications in Intelligent System
Guest Editors: Fa Zhu, Xiaochun Cheng and Sotiris Kotsiantis

Abstract

Deep networks have achieved great success in forest fire detection by exploiting visible light images. However, visible light images are susceptible to strong light, smoke, and obstruction interference. The infrared image has high sensitivity to temperature changes of targets, which can alleviate the deficiency of visible light image. Due to the significant distribution shift between visible light and infrared images, directly using the visible light-based pre-trained network for infrared forest fire results in a significant decrease in performance. To resolve this issue, this paper proposes an infrared image forest fire detection system based on domain adaptive learning. We adopt two YOLOv5 frameworks to extract features from visible light images (source domain) and infrared images (target domain). To align the features of the two domains, we construct a novel adaptation learning mechanism based on Kullback–Leibler (KL) loss and feature maximum mean discrepancy (FMMD) loss. We conducted extensive comparative experiments on two publicly available datasets to verify the effectiveness of the proposed model. All experimental results indicate that our proposed domain adaptive learning mechanism effectively improves the performance of infrared forest fire detection.

Keywords:

Remember to check out the Most Cited Articles!
Check out Notable Titles in Artificial Intelligence.

References

1. D. S. Boyd and F. Danson, Satellite remote sensing of forest resources: Three decades of research development, Progress in Physical Geography 29(1) (2005) 1–26. Crossref, Web of Science, Google Scholar
2. G. Češljar and S. Stevović, Small reservoirs and their sustainable role in fires protection of forest resources, Renewable and Sustainable Energy Reviews 47 (2015) 496–503. Crossref, Web of Science, Google Scholar
3. D. W. Casbeer, R. W. Beard, T. W. McLain, S.-M. Li and R. K. Mehra, Forest fire monitoring with multiple small uavs, in Proc. 2005, American Control Conf., 2005 (IEEE, 2005), pp. 3530–3535. Crossref, Google Scholar
4. J. R. Martinez-de Dios, B. C. Arrue, A. Ollero, L. Merino and F. Gómez-Rodríguez, Computer vision techniques for forest fire perception, Image and Vision Computing 26(4) (2008) 550–562. Crossref, Google Scholar
5. H. Zhao, J. Jin, Y. Liu, Y. Guo and Y. Shen, FSDF: A high-performance fire detection framework, Expert Systems with Applications 238 (2024) 121665. Crossref, Web of Science, Google Scholar
6. A. K. Gupta, A. Seal, M. Prasad and P. Khanna, Salient object detection techniques in computer vision — A survey, Entropy 22(10) (2020) 1174. Crossref, Web of Science, Google Scholar
7. B. C. Arrue, A. Ollero and J. M. De Dios, An intelligent system for false alarm reduction in infrared forest-fire detection, IEEE Intelligent Systems and Their Applications 15(3) (2000) 64–73. Crossref, Google Scholar
8. N. Ghassempour, J. J. Zou and Y. He, A sift-based forest fire detection framework using static images, 2018 12th Int. Conf. Signal Processing and Communication Systems (ICSPCS) (IEEE, 2018), pp. 1–7. Crossref, Google Scholar
9. M. Yan and Y. Yan, Fire detection based on improved hog, 2018 17th Int. Symp. on Distributed Computing and Applications for Business Engineering and Science (DCABES) (IEEE, 2018), pp. 111–114. Crossref, Google Scholar
10. K. Muhammad, S. Khan and S. W. Baik, Efficient convolutional neural networks for fire detection in surveillance applications, in Deep Learning in Computer Vision (CRC Press, 2020), pp. 63–88. Crossref, Google Scholar
11. S. Kong, J. Deng, L. Yang and Y. Liu, An attention-based dual-encoding network for fire flame detection using optical remote sensing, Engineering Applications of Artificial Intelligence 127 (2024) 107238. Crossref, Web of Science, Google Scholar
12. Y. Guo, Y. Liu, A. Oerlemans, S. Lao, S. Wu and M. S. Lew, Deep learning for visual understanding: A review, Neurocomputing 187 (2016) 27–48. Crossref, Web of Science, Google Scholar
13. L. Alzubaidi, J. Zhang, A. J. Humaidi, A. Al-Dujaili, Y. Duan, O. Al-Shamma, J. Santamaría, M. A. Fadhel, M. Al-Amidie and L. Farhan, Review of deep learning: Concepts, CNN architectures, challenges, applications, future directions, Journal of Big Data 8 (2021) 1–74. Crossref, Web of Science, Google Scholar
14. M. Shahid, S.-F. Chen, Y.-L. Hsu, Y.-Y. Chen, Y.-L. Chen and K.-L. Hua, Forest fire segmentation via temporal transformer from aerial images, Forests 14(3) (2023) 563. Crossref, Web of Science, Google Scholar
15. L. Wang, H. Li, F. Siewe, W. Ming and H. Li, Forest fire detection utilizing ghost swin transformer with attention and auxiliary geometric loss, Digital Signal Processing (2024) 104662. Crossref, Web of Science, Google Scholar
16. Z.-Q. Zhao, P. Zheng, S.-T. Xu and X. Wu, Object detection with deep learning: A review, IEEE Transactions on Neural Networks and Learning Systems 30(11) (2019) 3212–3232. Crossref, Web of Science, Google Scholar
17. A. E. Çetin, K. Dimitropoulos, B. Gouverneur, N. Grammalidis, O. Günay, Y. H. Habibolu, B. U. Töreyin and S. Verstockt, Video fire detection–Review, Digital Signal Processing 23(6) (2013) 1827–1843. Crossref, Web of Science, Google Scholar
18. Q. Lin, Z. Li, K. Zeng, H. Fan, W. Li and X. Zhou, Firematch: A semi-supervised video fire detection network based on consistency and distribution alignment, Expert Systems with Applications 248 (2024) 123409. Crossref, Web of Science, Google Scholar
19. C. Yuan, Z. Liu and Y. Zhang, Fire detection using infrared images for UAV-based forest fire surveillance, 2017 Int. Conf. Unmanned Aircraft Systems (ICUAS) (IEEE, 2017), pp. 567–572. Crossref, Google Scholar
20. A. Khan, B. Hassan, S. Khan, R. Ahmed, A. Abuassba et al., Deepfire: A novel dataset and deep transfer learning benchmark for forest fire detection, Mobile Information Systems 2022 (2022). Crossref, Web of Science, Google Scholar
21. H. Pan, D. Badawi and A. E. Cetin, Computationally efficient wildfire detection method using a deep convolutional network pruned via fourier analysis, Sensors 20(10) (2020) 2891. Crossref, Web of Science, Google Scholar
22. K. Weiss, T. M. Khoshgoftaar and D. Wang, A survey of transfer learning, Journal of Big data 3(1) (2016) 1–40. Crossref, Google Scholar
23. N. Al-Qubaydhi, A. Alenezi, T. Alanazi, A. Senyor, N. Alanezi, B. Alotaibi, M. Alotaibi, A. Razaque, A. A. Abdelhamid and A. Alotaibi, Detection of unauthorized unmanned aerial vehicles using YOLOV5 and transfer learning, Electronics 11(17) (2022) 2669. Crossref, Web of Science, Google Scholar
24. S. Sudhakar, V. Vijayakumar, C. S. Kumar, V. Priya, L. Ravi and V. Subramaniyaswamy, Unmanned aerial vehicle (UAV) based forest fire detection and monitoring for reducing false alarms in forest-fires, Computer Communications 149 (2020) 1–16. Crossref, Web of Science, Google Scholar
25. T.-H. Chen, P.-H. Wu and Y.-C. Chiou, An early fire-detection method based on image processing, 2004 Int. Conf. Image Processing, 2004. ICIP’04, Vol. 3 (IEEE, 2004), pp. 1707–1710. Google Scholar
26. T. Celik and K.-K. Ma, Computer vision based fire detection in color images, 2008 IEEE Conf. Soft Computing in Industrial Applications (IEEE, 2008), pp. 258–263. Crossref, Google Scholar
27. C. E. Premal and S. Vinsley, Image processing based forest fire detection using YCbCr colour model, 2014 Int. Conf. Circuits, Power and Computing Technologies [ICCPCT-2014] (IEEE, 2014), pp. 1229–1237. Crossref, Google Scholar
28. M. A. I. Mahmoud and H. Ren, Forest fire detection and identification using image processing and svm, Journal of Information Processing Systems 15(1) (2019) 159–168. Web of Science, Google Scholar
29. G. Wang, Y. Zhang, Y. Qu, Y. Chen and H. Maqsood, Early forest fire region segmentation based on deep learning, 2019 Chinese Control and Decision Conf. (CCDC) (IEEE, 2019), pp. 6237–6241. Crossref, Google Scholar
30. N. Yaacob, M. S. M. Najib, N. Tajudin, A. L. Yusof and M. Kassim, Image processing based forest fire detection using infrared camera, Journal of Physics: Conference Series 1768(1) (2021) 012014. Crossref, Google Scholar
31. K. Wang, Y. Zhang, J. Wang, Q. Zhang, B. Chen and D. Liu, Fire detection in infrared video surveillance based on convolutional neural network and SVM, 2018 IEEE 3rd Int. Conf. Signal and Image Processing (ICSIP) (IEEE, 2018), pp. 162–167. Crossref, Google Scholar
32. B. U. Töreyin, R. G. Cinbiş, Y. Dedeoğlu and A. E. Çetin, Fire detection in infrared video using wavelet analysis, Optical Engineering 46(6) (2007) 067204–067204. Crossref, Web of Science, Google Scholar
33. S. Verstockt, Multi-modal video analysis for early fire detection, PhD Thesis, Ghent University (2011). Google Scholar
34. K. Muhammad, J. Ahmad, I. Mehmood, S. Rho and S. W. Baik, Convolutional neural networks based fire detection in surveillance videos, IEEE Access 6 (2018) 18174–18183. Crossref, Web of Science, Google Scholar
35. Q. Zhang, J. Xu, L. Xu and H. Guo, Deep convolutional neural networks for forest fire detection, 2016 Int. Forum on Management, Education and Information Technology Application (Atlantis Press, 2016), pp. 568–575. Crossref, Google Scholar
36. K. Muhammad, J. Ahmad, Z. Lv, P. Bellavista, P. Yang and S. W. Baik, Efficient deep cnn-based fire detection and localization in video surveillance applications, IEEE Transactions on Systems, Man, and Cybernetics: Systems 49(7) (2018) 1419–1434. Crossref, Google Scholar
37. J. E. Van Engelen and H. H. Hoos, A survey on semi-supervised learning, Machine Learning 109(2) (2020) 373–440. Crossref, Web of Science, Google Scholar
38. F. Zhuang, Z. Qi, K. Duan, D. Xi, Y. Zhu, H. Zhu, H. Xiong and Q. He, A comprehensive survey on transfer learning, Proceedings of the IEEE 109(1) (2020) 43–76. Crossref, Web of Science, Google Scholar
39. C. Tan, F. Sun, T. Kong, W. Zhang, C. Yang and C. Liu, A survey on deep transfer learning, in Artificial Neural Networks and Machine Learning–ICANN 2018: 27th Int. Conf. Artificial Neural Networks, Rhodes, Greece, October 4–7, 2018, Proc., Part III 27 (Springer, 2018), pp. 270–279. Crossref, Google Scholar
40. M. Sugiyama, S. Nakajima, H. Kashima, P. Buenau and M. Kawanabe, Directvimportance estimation with model selection and its application to covariate shift adaptation, in Advances in Neural Information Processing Systems, Vol. 20 (Curran Associates, Inc., 2007), pp. 1433–1440. Google Scholar
41. Z. Cao, M. Long, J. Wang and M. I. Jordan, Partial transfer learning with selective adversarial networks, in Proc. IEEE Conf. Computer Vision and Pattern Recognition (2018), pp. 2724–2732. Crossref, Google Scholar
42. M. Oquab, L. Bottou, I. Laptev and J. Sivic, Learning and transferring mid-level image representations using convolutional neural networks, in Proc. IEEE Conf. Computer Vision and Pattern Recognition (2014), pp. 1717–1724. Crossref, Google Scholar
43. T. Teshima, I. Sato and M. Sugiyama, Few-shot domain adaptation by causal mechanism transfer, Int. Conf. Machine Learning (2020), pp. 9458–9469. Google Scholar
44. M. Long, Y. Cao, J. Wang and M. Jordan, Learning transferable features with deep adaptation networks, Int. Conf. Machine Learning (2015), pp. 97–105. Google Scholar
45. J. Xu, S. Ramos, D. Vázquez and A. M. López, Domain adaptation of deformable part-based models, IEEE Transactions on Pattern Analysis and Machine Intelligence 36(12) (2014) 2367–2380. Crossref, Web of Science, Google Scholar
46. A. Raj, V. P. Namboodiri and T. Tuytelaars, Subspace alignment based domain adaptation for RCNN detector (2015), arXiv:1507.05578. Google Scholar
47. T. Toulouse, L. Rossi, A. Campana, T. Celik and M. A. Akhloufi, Computer vision for wildfire research: An evolving image dataset for processing and analysis, Fire Safety Journal 92 (2017) 188–194. Crossref, Web of Science, Google Scholar
48. A. Shamsoshoara, F. Afghah, A. Razi, L. Zheng, P. Z. Fulé and E. Blasch, Aerial imagery pile burn detection using deep learning: The flame dataset, Computer Networks 193 (2021) 108001. Crossref, Web of Science, Google Scholar