https://scholars.lib.ntu.edu.tw/handle/123456789/605941
標題: | Remote surveillance video activity recognition using spatiotemporal convolutional neural networks for greenhouse workload analysis | 作者: | Liu L.-C Rustia D.J.A TA-TE LIN |
關鍵字: | Activity recognition;Computer vision;Deep learning;Greenhouse management;Spatiotemporal convolutional neural network;Agricultural robots;Agriculture;Convolution;Convolutional neural networks;Data streams;Pattern recognition;Security systems;Video streaming;Agricultural workers;Convolutional networks;Human activity recognition;Management strategies;Messaging protocols;Monitoring applications;Remote surveillance;Wireless monitoring;Quality control | 公開日期: | 2021 | 卷: | 3 | 起(迄)頁: | 1632-1639 | 來源出版物: | American Society of Agricultural and Biological Engineers Annual International Meeting, ASABE 2021 | 摘要: | With the advances of computer vision over the recent years, its applications have extended from handling static images to tackling the challenging domain of video analysis, with human activity recognition being among the core research topics. However, recognizing and recording the activity of agricultural workers through surveillance videos is still understudied. By workload efficiency analysis, the quality of agricultural produce can be determined and improved. In this work, an IoT system that utilizes MQTT messaging protocol to stream visual data collected from wireless monitoring nodes was developed. The video streams were displayed in a mobile APP for farm owners to remotely monitor their workplace and crop situation. A spatiotemporal convolutional network was trained to recognize the actions of the workers from the video streams, while the timestamp and duration were recorded in a remote server. Through vision-based analysis, workload data can be seamlessly extracted from the streaming footage, thereby eliminating the need for additional hardware setup, such as wearable sensors. The proposed algorithm was capable of achieving an average F1 score of 96.9%. The workload data analysis results could be beneficial for farm owners in reevaluating and improving their management strategy. Accurate detection and recording of farm activities will allow them to see if a particular activity had been performed appropriately and at the proper time. Furthermore, the usage of resources, including pesticide and water, can be tracked based on the frequency and duration of the activities. The proposed techniques and methods can be employed not only for agricultural applications, but also for other workplace monitoring applications. ? ASABE 2021 Annual International Meeting |
URI: | https://www.scopus.com/inward/record.uri?eid=2-s2.0-85114209651&doi=10.13031%2faim.202100608&partnerID=40&md5=92dde7473531c1b8b6ed7ece5e955f99 https://scholars.lib.ntu.edu.tw/handle/123456789/605941 |
DOI: | 10.13031/aim.202100608 |
顯示於: | 生物機電工程學系 |
在 IR 系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。