No Access

Padeep: A Patched Deep Learning Based Model for Plants Recognition on Small Size Dataset: Chenopodiaceae Case Study

Ahmad Heidary-Sharifabad

Department of Computer Engineering, Maybod Branch, Islamic Azad University, Maybod, Iran

E-mail Address: ahmad.heidary@maybodiau.ac.ir

Search for more papers by this author

Mohsen Sardari Zarchi

Department of Computer Engineering, Meybod University, Meybod, Iran

E-mail Address: sardari@meybod.ac.ir

Corresponding author.

Search for more papers by this author

, and

Gholamreza Zarei

Department of Agronomy, Maybod Branch, Islamic Azad University, Maybod, Iran

E-mail Address: zareigholamreza@maybodiau.ac.ir

Search for more papers by this author

https://doi.org/10.1142/S1469026822500055Cited by:2 (Source: Crossref)

Abstract

A large training sample is prerequisite for the successful training of each deep learning model for image classification. Collecting a large dataset is time-consuming and costly, especially for plants. When a large dataset is not available, the challenge is how to use a small or medium size dataset to train a deep model optimally. To overcome this challenge, a novel model is proposed to use the available small size plant dataset efficiently. This model focuses on data augmentation and aims to improve the learning accuracy by oversampling the dataset through representative image patches. To extract the relevant patches, ORB key points are detected in the training images and then image patches are extracted using an innovative algorithm. The extracted ORB image patches are used for dataset augmentation to avoid overfitting during the training phase. The proposed model is implemented using convolutional neural layers, where its structure is based on ResNet architecture. The proposed model is evaluated on a challenging ACHENY dataset. ACHENY is a Chenopodiaceae plant dataset, comprising 27030 images from 30 classes. The experimental results show that the patch-based strategy outperforms the classification accuracy achieved by traditional deep models by 9%.

Keywords:

Remember to check out the Most Cited Articles!
Check out these titles in artificial intelligence!

References

1. T. Abe, N. Tanaka and Y. Shimizu, Plant species diversity, community structure and invasion status in insular primary forests on the Sekimon uplifted limestone (Ogasawara Islands), J. Plant Res. 131 (2018) 1001–1014. Crossref, Google Scholar
2. H. Bay, A. Ess, T. Tuytelaars and L. Van Gool, Speeded-Up Robust Features (SURF), Comput. Vis. Image Understand. 110 (2008) 346–359. Crossref, Google Scholar
3. M. Calonder, V. Lepetit, C. Strecha and P. Fua, BRIEF: Binary robust independent elementary features, in Computer Vision – ECCV 2010 (Springer, Berlin, Heidelberg, 2010), pp. 778–792. Crossref, Google Scholar
4. T. B. Do, H. H. Nguyen, T. T. N. Nguyen, H. Vu, T. T. H. Tran and T. L. Le, Plant identification using score-based fusion of multi-organ images, in Proc. 2017 9th Int. Conf. Knowledge and Systems Engineering, KSE 2017, Vol. 2017 (2017), pp. 191–196. Crossref, Google Scholar
5. N. Gessert, M. Nielsen, M. Shaikh, R. Werner and A. Schlaefer, Skin lesion classification using ensembles of multi-resolution efficientnets with meta data, Methods X (2020) 100864. Google Scholar
6. G. L. Grinblat, L. C. Uzal, M. G. Larese and P. M. Granitto, Deep learning for plant identification using vein morphological patterns, Comput. Electron. Agriculture 127 (2016) 418–424. Crossref, Google Scholar
7. K. He, X. Zhang, S. Ren and J. Sun, Deep residual learning for image recognition, in 2016 IEEE Conf. Computer Vision and Pattern Recognition (CVPR) (IEEE, 2016), pp. 770–778. Crossref, Google Scholar
8. A. Heidary-Sharifabad, M. Sardari Zarchi, S. Emadi and G. Zarei, ACHENY: A standard chenopodiaceae image dataset for deep learning models, Data in Brief (Accepted). Google Scholar
9. A. Heidary-Sharifabad, M. S. Zarchi, S. Emadi and G. Zarei, An efficient deep learning model for cultivar identification of a pistachio tree, Br. Food J. (2021). Crossref, Google Scholar
10. A. Heidary-sharifabad, M. S. Zarchi, S. Emadi and G. Zarei, Efficient Deep learning models for categorizing chenopodiaceae in the wild, Int. J. Pattern Recogn. Artif. Intell. (2021). Link, Google Scholar
11. A. Heidary-Sharifabad, M. S. Zarchi and G. Zarei, ICPTC: Iranian commercial pistachio tree cultivars standard dataset, Data in Brief 38 (2021) 107348. Crossref, Google Scholar
12. T. Hinz, N. Navarro-Guerrero, S. Magg and S. Wermter, Speeding up the hyperparameter optimization of deep convolutional neural networks, Int. J. Comput. Intell. Appl. 17 (2018) 1850008. Link, Google Scholar
13. L. Hou, D. Samaras, T. M. Kurc, Y. Gao, J. E. Davis and J. H. Saltz, Patch-based convolutional neural network for whole slide tissue image classification, Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (2016), pp. 2424–2433. Crossref, Google Scholar
14. A. Kadir, L. E. Nugroho, A. Susanto and P. I. Santosa, Neural network application on foliage plant identification (2013). Google Scholar
15. D. P. Kingma and J. Ba, Adam: A method for stochastic optimization (2014), pp. 1–15. Google Scholar
16. A. Krizhevsky, G. E. Hinton, I. Sutskever and G. E. Hinton, ImageNet classification with deep convolutional neural networks, Commun. ACM 60 (2012) 1097–1105. Google Scholar
17. N. Kumar, P. N. Belhumeur, A. Biswas, D. W. Jacobs, W. J. Kress, I. C. Lopez and J. V. B. Soares, Leafsnap: A computer vision system for automatic plant species identification, in Computer Vision – ECCV 2012 (Springer, Berlin Heidelberg, 2012) pp. 502–516. Crossref, Google Scholar
18. Y. LeCun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard and L. D. Jackel, Backpropagation applied to handwritten zip code recognition, Neural Computation 1 (1989) 541–551. Crossref, Google Scholar
19. Y. LeCun, Y. Bengio and G. Hinton, Deep learning, Nature 521(7553) (2015) 436. Crossref, Google Scholar
20. S. H. Lee, C. S. Chan and P. Remagnino, Multi-organ plant classification based on convolutional and recurrent neural networks, IEEE Trans. Image Process. 27 (2018) 4287–4301. Crossref, Google Scholar
21. G. P. B. Lillian M. Weber and O. S. A. Contributors, Tree (2019). Google Scholar
22. D. G. Lowe, Distinctive image features from scale-invariant keypoints, Int. J. Comput. Vis. 60 (2004) 91–110. Crossref, Google Scholar
23. F. Perronnin, Y. Liu, J. Sanchez and H. Poirier, Large-scale image retrieval with compressed Fisher vectors, in 2010 IEEE Computer Society Conf. Computer Vision and Pattern Recognition (IEEE, 2010), pp. 3384–3391. Crossref, Google Scholar
24. E. Rosten, R. Porter and T. Drummond, Faster and better: a machine learning approach to corner detection, IEEE Trans. Pattern Anal. Mach. Intelli. 32 (2010) 105–119. Crossref, Google Scholar
25. E. Rosten and T. Drummond, Machine learning for high-speed corner detection, in European Conf. Computer Vision (Springer, 2006), pp. 430–443. Crossref, Google Scholar
26. E. Rublee, V. Rabaud, K. Konolige and G. Bradski, ORB: An efficient alternative to SIFT or SURF, in 2011 Int. Conf. Computer Vision (IEEE, 2011), pp. 2564–2571. Crossref, Google Scholar
27. C. Schmid, Bag-of-features for category classification, ENS/INRIA Visual Recognition and Machine Learning … (2011). Google Scholar
28. A. Simon, R. Vinayakumar, V. Sowmya, K. P. Soman and E. A. A. Gopalakrishnan, A deep learning approach for patch-based disease diagnosis from microscopic images, in Classification Techniques for Medical Image Analysis and Computer Aided Diagnosis (Elsevier, 2019), pp. 109–127. Crossref, Google Scholar
29. K. Simonyan and A. Zisserman, Very deep convolutional networks for large-scale image recognition, arXiv:1409.1556. Google Scholar
30. C. Szegedy, Wei Liu, Yangqing Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke and A. Rabinovich, Going deeper with convolutions, in 2015 IEEE Conf. Computer Vision and Pattern Recognition (CVPR) (IEEE, 2015), pp. 1–9. Crossref, Google Scholar
31. G. K. Verma and P. Gupta, Wild animal detection from highly cluttered images using deep convolutional neural network, Int. J. Comput. Intell. Appl. 17 (2018) 1850021. Link, Google Scholar
32. J. Wäldchen, M. Rzanny, M. Seeland and P. Mäder, Automated plant species identification Trends and future directions, PLoS Comput. Biol. 14(4) (2018) 1–19. Crossref, Google Scholar
33. A. Wang, W. Zhang and X. Wei, A review on weed detection using ground-based machine vision and image processing techniques, Comput. Electron. Agriculture 158 (2019) 226–240. Crossref, Google Scholar
34. X. Yang, R. Zhang, Z. Zhai, Y. Pang and Z. Jin, Machine learning for cultivar classification of apricots (Prunus armeniaca L.) based on shape features, Scientia Horticulturae 256 (2019) 108524. Crossref, Google Scholar
35. L. Yu, Z. Wang, S. Tian, F. Ye, J. Ding and J. Kong, Convolutional neural networks for water body extraction from landsat imagery, Int. J. Comput. Intell. Appl. 16 (2017) 1750001. Link, Google Scholar
36. X. Yuan, J. Yu, Z. Qin and T. Wan, A SIFT-LBP image retrieval model based on bag of features, Icip (2011) 1061–1064. Google Scholar
37. M. S. Zarchi, R. T. Tan, C. Van Gemeren, A. Monadjemi and R. C. Veltkamp, Understanding image concepts using ISTOP model, Pattern Recogn. 53 (2016) 174–183. Crossref, Google Scholar
38. D. Zhang and A. Zakir, Top down saliency detection based on deep-learned features, Int. J. Comput. Intell. Appl. 18 (2019) 1950009. Link, Google Scholar