Cleanliness of city streets has an important impact on city environment and public health. Conventional street cleaning methods involve street sweepers going to many spots and manually confirming if the street needs to be clean. However, this method takes a substantial amount of manual operations for detection and assessment of street’s cleanliness which leads to a high cost for cities. Using pervasive mobile devices and AI technology, it is now possible to develop smart edge-based service system for monitoring and detecting the cleanliness of streets at scale. This paper explores an important aspect of cities — how to automatically analyze street imagery to understand the level of street litter. A vehicle (i.e. trash truck) equipped with smart edge station and cameras is used to collect and process street images in real time. A deep learning model is developed to detect, classify and analyze the diverse types of street litters such as tree branches, leaves, bottles and so on. In addition, two case studies are reported to show its strong potential and effectiveness in smart city systems.

Keywords:

References

1. A. Gertler, H. Kuhns, M. Abu-Allaban, C. Damm, J. Gillies, V. Etyemezian, R. Clayton and D. Proffitt, A case study of the impact of winter road sand/salt and street sweeping on road dust re-entrainment, Atmos. Environ. 40(31) (2006) 5976–5985. Web of Science, Google Scholar
2. A. Iriarte, X. Gabarrell and J. Rieradevall, LCA of selective waste collection systems in dense urban areas, Waste Manage. 29(2) (2009) 903–914. Web of Science, Google Scholar
3. G. Van Ryzin, S. Immerwahr and S. Altman, Measuring street cleanliness: A comparison of New York City’s scorecard and results from a citizen survey, Publ. Adm. Rev. 68(3) (2008) 295–303. Web of Science, Google Scholar
4. A. Sevilla, M. L. Rodrguez, Ngela Garca-Maraver and M. Zamorano, An index to quantify street cleanliness: The case of Granada (Spain), Waste Manage. 33(5) (2013) 1037–1046. Web of Science, Google Scholar
5. A. Imteaj, M. Chowdhury and M. A. Mahamud, Dissipation of waste using dynamic perception and alarming system: A smart city application, in Proc. Int. Conf. Electrical Engineering and Information Communication Technology, 2015, pp. 1–5. Google Scholar
6. S. Ladin-Sienne, Turning dirty streets clean through comprehensive open data mapping (2017). Available: http://datasmart.ash.harvard.edu/news/article/turning-dirty-streets-clean-through-comprehensiveopen-data-mapping-1001. Google Scholar
7. B. N. Silva, M. Khan and K. Han, Towards sustainable smart cities: A review of trends, architectures, components, and open challenges in smart cities, Sustain. Cities Soc. 38 (2018) 697–713. Web of Science, Google Scholar
8. I. Lpez, V. Gutirrez, F. Collantes, D. Gil, R. Revilla and J. L. Gil, Developing an indicators plan and software for evaluating street cleanliness and waste collection services, J. Urban Manage. 6(2) (2017) 66–79. Web of Science, Google Scholar
9. W. Li, B. Bhushan, J. Gao and P. Zhang, Smartclean: Smart city street cleanliness system using multi-level assessment model, Int. J. Softw. Eng. Knowl. Eng. 28(11) (2018) 1755–1774. Link, Web of Science, Google Scholar
10. A. Rovetta, F. Xiumin, F. Vicentini, Z. Minghua, A. Giusti and H. Qichang, Early detection and evaluation of waste through sensorized containers for a collection monitoring application, Waste Manage. 29(12) (2009) 2939–2949. Web of Science, Google Scholar
11. H. Begur, M. Dhawade, N. Gaur, P. Dureja, J. Gao, M. Mahmoud, J. Huang, S. Chen and X. Ding, An edge-based smart mobile service system for illegal dumping detection and monitoring in san jose, in Proc. IEEE SmartWorld, Ubiquitous Intelligence Computing, Advanced Trusted Computed, Scalable Computing Communications, Cloud Big Data Computing, Internet of People and Smart City Innovation, 2017, pp. 1–6. Google Scholar
12. A. Alfarrarjeh, S. H. Kim, S. Agrawal, M. Ashok, S. Y. Kim and C. Shahabi, Image classification to determine the level of street cleanliness: A case study, in Proc. IEEE Fourth Int. Conf. Multimedia Big Data, 2018, pp. 1–5. Google Scholar
13. C. Balchandani, R. K. Hatwar, P. Makkar, Y. Shah, P. Yelure and M. Eirinaki, A deep learning framework for smart street cleaning, in Proc. IEEE Third Inter. Conf. Big Data Computing Service and Applications, 2017, pp. 112–117. Google Scholar
14. A. Krizhevsky, I. Sutskever and G. E. Hinton, Imagenet classification with deep convolutional neural networks, in Advances in Neural Information Processing Systems, 2012, pp. 1097–1105. Google Scholar
15. A. Berg, J. Deng and F.-F. Li, Large scale visual recognition challenge (2010). Available: http://www.imagenet.org/challenges/LSVRC/2010/. 1, 4. Google Scholar
16. R. Girshick, J. Donahue, T. Darrell and J. Malik, Rich feature hierarchies for accurate object detection and semantic segmentation, in Proc. IEEE Conf. Comput. Vision and Pattern Recognition, 2014, pp. 580–587. Google Scholar
17. K. He, X. Zhang, S. Ren and J. Sun, Spatial pyramid pooling in deep convolutional networks for visual recognition, IEEE Trans. Pattern Anal. Mach. Intell. 37(9) (2015) 1904–1916. Web of Science, Google Scholar
18. R. Girshick, Fast R-CNN, in Proc. IEEE Int. Conf. Computer Vision, 2015, pp. 1440–1448. Google Scholar
19. S. Ren, K. He, R. Girshick and J. Sun, Faster R-CNN: Towards real-time object detection with region proposal networks, in Advances in Neural Information Processing Systems, 2015, pp. 91–99. Google Scholar
20. H. Li, K. Ota and M. Dong, Learning IoT in edge: Deep learning for the internet of things with edge computing, IEEE Network 32(1) (2018) 96–101. Web of Science, Google Scholar
21. C. Liu, Y. Cao, Y. Luo, G. Chen, V. Vokkarane, M. Yunsheng, S. Chen and P. Hou, A new deep learning-based food recognition system for dietary assessment on an edge computing service infrastructure, IEEE Trans. Serv. Comput. 11(2) (2018) 249–261. Web of Science, Google Scholar
22. L.-P. Huang, M.-H. Hong, C.-H. Luo, S. Mahajan and L.-J. Chen, A vector mosquitoes classification system based on edge computing and deep learning, in Proc. Conf. Technologies and Applications of Artificial Intelligence, IEEE, 2018, pp. 24–27. Google Scholar
23. S. Ren, K. He, R. Girshick and J. Sun, Faster R-CNN: Towards real-time object detection with region proposal networks, in Advances in Neural Information Processing Systems, Vol. 28 (Curran Associates, 2015), pp. 91–99. Google Scholar
24. N. Tajbakhsh, J. Y. Shin, S. R. Gurudu, R. T. Hurst, C. B. Kendall, M. B. Gotway and J. Liang, Convolutional neural networks for medical image analysis: Full training or fine tuning? IEEE Trans. Med. Imag. 35(5) (2016) 1299–1312. Web of Science, Google Scholar