Research PaperNo Access

An Effective and Visualized State Detection of Metro Vehicle Door System

Artificial Intelligence Industrial Technology Research Institute, Nanjing Institute of Technology, Nanjing 211167, P. R. China

Group Technology Center, Nanjing Kangni Mechanical and Electrical Company Limited, Nanjing 210009, P. R. China

E-mail Address: zhangjc07@njit.edu.cn

Corresponding author.

Search for more papers by this author

Liangbao Jiao

Artificial Intelligence Industrial Technology Research Institute, Nanjing Institute of Technology, Nanjing 211167, P. R. China

E-mail Address: jiaoliangbao@njit.edu.cn

Search for more papers by this author

, and

Wei Zhang

Group Technology Center, Nanjing Kangni Mechanical and Electrical Company Limited, Nanjing 210009, P. R. China

E-mail Address: zhangw@kn-nanjing.com

Search for more papers by this author

https://doi.org/10.1142/S0218126622501328Cited by:1 (Source: Crossref)

Abstract

Metro Vehicle Door System (MVDS) is one of the most frequently used parts in rail transit. In this work, we propose an effective and visualized state detection technique of MVDS by utilizing feature extraction and matching, which is helpful to improve the safety and reliability of the door system. Five states of MVDS, the normal opening, opened, closing and closed state, as well as the anti-extrusion (also named as anti-drag) state, are to be detected in our work. In particular, we design an improved Speeded Up Robust Features (SURF) method to reduce the mismatching pairs by exploiting local space distance, which is crucial for practical usage. Furthermore, we present a scheme to detect the five states of MVDS mentioned above via our improved SURF. Finally, we conduct experiments in subjective and objective, and the resultant performance shows the effectiveness of our method.

This paper was recommended by Regional Editor Tongquan Wei.

Keywords:

References

1. M. Almatrafi, R. Baldwin, K. Aizawa and K. Hirakawa , Distance surface for event-based optical flow, IEEE Trans. Pattern Anal. Mach. Intell. 42 (2020) 1547–1556. Crossref, Web of Science, Google Scholar
2. J. Tang, X. Shu, R. Yan and L. Zhang , Coherence constrained graph LSTM for group activity recognition, IEEE Trans. Pattern Anal. Mach. Intell. (2019), https://doi.org/10.1109/TPAMI.2019.2928540. Google Scholar
3. Z. Zha, X. Yuan, B. Wen, J. Zhang, J. Zhou and C. Zhu , Image restoration using joint patch-group-based sparse representation, IEEE Trans. Image Process. 29 (2020) 7735–7750. Crossref, Web of Science, Google Scholar
4. Z. Zha, B. Wen, X. Yuan, J. Zhou, C. Zhu and A. C. Kot , A hybrid structural sparsification error model for image restoration, IEEE Trans. Neural Netw. Learn. Syst. (2021), https://doi.org/10.1109/TNNLS.2021.3057439. Web of Science, Google Scholar
5. C. Zhang, W. Cheng and K. Hirakawa , Corrupted reference image quality assessment of denoised images, IEEE Trans. Image Process. 28 (2018) 1732–1747. Crossref, Web of Science, Google Scholar
6. S. Miller, C. Zhang and K. Hirakawa , Multi-resolution Aitchison geometry image denoising for low-light photography, IEEE Trans. Image Process. 30 (2021) 5724–5738. Crossref, Web of Science, Google Scholar
7. X. Shu, L. Zhang, G.-J. Qi, W. Liu and J. Tang , Spatiotemporal co-attention recurrent neural networks for human-skeleton motion prediction, IEEE Trans. Pattern Anal. Mach. Intell. (2021), https://doi.org/10.1109/TPAMI.2021.3050918. Crossref, Web of Science, Google Scholar
8. X. Shu, L. Zhang, Y. Sun and J. Tang , Host–parasite: Graph LSTM-in-LSTM for group activity recognition, IEEE Trans. Neural Netw. Learn. Syst. 32 (2020) 663–674. Crossref, Web of Science, Google Scholar
9. Y. Ou, J. Luo, B. Li and B. He , A classification model of railway fasteners based on computer vision, Neural. Comput. Appl. 31 (2019) 9307–9319. Crossref, Web of Science, Google Scholar
10. H. Zhang, X. Jin, Q. J. Wu, Y. Wang, Z. He and Y. Yang , Automatic visual detection system of railway surface defects with curvature filter and improved gaussian mixture model, IEEE Trans. Instrum. Meas. 67 (2018) 1593–1608. Crossref, Web of Science, Google Scholar
11. H. Feng, Z. Jiang, F. Xie, P. Yang, J. Shi and L. Chen , Automatic fastener classification and defect detection in vision-based railway inspection systems, IEEE Trans. Instrum. Meas 63 (2013) 877–888. Crossref, Web of Science, Google Scholar
12. H. Huang, W. Liu, J. Li, F. Tan, X. Lu and M. Guangzhou , Automatic foreign object detection technology between PSD and subway doors, Railway Comput. Appl. 24 (2015) 64–65. Google Scholar
13. F. Tan and J. Liu , Foreign object detection algorithm for subway platform based on computer vision, Railway Comput. Appl. 21 (2017) 32–43. Google Scholar
14. T. Feigang, Z. Xiaoju and L. Kaiyuan , Foreign body detection between train doors and PSD based on multi-source data fusion, in Int. Conf. Intelligent Computation Technology and Automation (2020), pp. 596–597. Crossref, Google Scholar
15. S. A. K. Tareen and Z. Saleem , A comparative analysis of SIFT, SURF, KAZE, AKAZE, ORB, and BRISK, in Int. Conf. Computing, Mathematics and Engineering Technologies, Sukkur, Pakistan, 2018, pp. 10–17. Crossref, Google Scholar
16. Y. Z. M. Jiang and J. Kong , Mutual learning and feature fusion siamese networks for visual object tracking, IEEE Trans. Circuits Syst. Video Technol. 31 (2021) 3154–3167. Crossref, Web of Science, Google Scholar
17. Y. Y. Z. Xiong and Q. Wang , Ask: Adaptively selecting key local features for RGB-D scene recognition, IEEE Trans. Image Process. 30 (2021) 2722–2733. Crossref, Web of Science, Google Scholar
18. M. Hassaballah, A. A. Ali and H. A. Alshazly , Image features detection, description and matching, in Image Feature Detectors and Descriptors. Studies in Computational Intelligence, Springer, 2016, pp. 11–15. Crossref, Google Scholar
19. C. Harris et al., A combined corner and edge detector, in Alvey Vision Conf., Manchester, UK, 1988, pp. 5238–5244. Crossref, Google Scholar
20. T. Lindeberg, Scale-space theory in computer vision 2013, Stockholm, Sweden. Google Scholar
21. D. G. Lowe , Distinctive image features from scale-invariant keypoints, Int. J. Comput. Vis. 60 (2004) 91–110. Crossref, Web of Science, Google Scholar
22. H. Bay, A. Ess, T. Tuytelaars and L. Van Gool , Speeded-up robust features (surf), Comput. Vis. Image Underst. 110 (2008) 346–359. Crossref, Web of Science, Google Scholar
23. P. F. Alcantarilla, A. Bartoli and A. J. Davison , Kaze features, in European Conf. Computer Vision, Florence, Italy, 2012, pp. 214–227. Crossref, Google Scholar
24. P. F. Alcantarilla and T. Solutions , Fast explicit diffusion for accelerated features in nonlinear scale spaces, in British Machine Vision Conf., Bristol, UK, 2013, pp. 214–227. Crossref, Google Scholar
25. E. Rosten and T. Drummond , Machine learning for high-speed corner detection, in European Conf. Computer Vision, Graz, Austria, 2006, pp. 430–443. Crossref, Google Scholar
26. M. Calonder, V. Lepetit, C. Strecha and P. Fua , Brief: Binary robust independent elementary features, in European Conf. Computer Vision, Crete, Greece, 2010, pp. 778–792. Crossref, Google Scholar
27. S. Leutenegger, M. Chli and R. Y. Siegwart , Brisk: Binary robust invariant scalable keypoints, in Int. Conf. Computer Vision, Barcelona, Spain, 2011, pp. 2548–2555. Crossref, Google Scholar
28. M. Dusmanu, I. Rocco, T. Pajdla, M. Pollefeys, J. Sivic, A. Torii and T. Sattler, D2-Net: A trainable CNN for joint detection and description of local features, preprint (2019), arXiv:1905.03561. Google Scholar
29. Y. Ono, E. Trulls, P. Fua and K. M. Yi, LF-Net: Learning local features from images, preprint (2018), arXiv:1805.09662. Google Scholar
30. Y. Tian, B. Fan and F. Wu , L2-Net: Deep learning of discriminative patch descriptor in Euclidean space, in IEEE Conf. Computer Vision and Pattern Recognition (2017), pp. 661–669. Crossref, Google Scholar
31. Z. Luo, T. Shen, L. Zhou, S. Zhu, R. Zhang, Y. Yao, T. Fang and L. Quan , GeoDesc: Learning local descriptors by integrating geometry constraints, in European Conf. Computer Vision, Honolulu, USA, 2018, pp. 168–183. Crossref, Google Scholar
32. Z. Luo, L. Zhou, X. Bai, H. Chen, J. Zhang, Y. Yao, S. Li, T. Fang and L. Quan , ASLFeat: Learning local features of accurate shape and localization, in IEEE/CVF Conf. Computer Vision and Pattern Recognition, Seattle, USA, 2020, pp. 6589–6598. Crossref, Google Scholar
33. Y. L. M. Ghahremani and B. Tiddeman , FFD: Fast feature detector, IEEE Trans. Image Process. 30 (2020) 1153–1168. Crossref, Web of Science, Google Scholar
34. D. W. Z. H. Z. Li, F. Nie and X. Li , Unsupervised feature selection with weighted and projected adaptive neighbors, IEEE Trans. Cybern. (2021), https://doi.org/10.1109/TCYB.2021.3087632. Web of Science, Google Scholar
35. R. B. J. Spencer and S. Hadfield , Same features, different day: Weakly supervised feature learning for seasonal invariance, in IEEE/CVF Conf. Computer Vision and Pattern Recognition, Seattle, USA, 2020, pp. 6459–6468. Crossref, Google Scholar
36. K. Mikolajczyk and C. Schmid , A performance evaluation of local descriptors, IEEE Trans. Pattern Anal. Mach. Intell. 27 (2005) 1615–1630. Crossref, Web of Science, Google Scholar
37. K. G. C. G. M. Y. Cui, K. Cao and T. Wei , Client scheduling and resource management for efficient training in heterogeneous IoT-edge federated learning, IEEE Trans. Comput. Aided Design Integr. Circuits Syst. (2021), https://doi.org/10.1109/TCAD.2021.3110743. Crossref, Web of Science, Google Scholar
38. M. A. Fischler and R. C. Bolles , Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography, Commun. ACM 24 (1981) 381–395. Crossref, Web of Science, Google Scholar