https://scholars.lib.ntu.edu.tw/handle/123456789/581380
標題: | ResFlow: Multi-tasking of Sequentially Pooling Spatiotemporal Features for Action Recognition and Optical Flow Estimation | 作者: | Yeh T.-H Kuo C Liu A.-S Liu Y.-H Yang Y.-H Li Z.-J Shen J.-T LI-CHEN FU |
關鍵字: | Aggregates; Costs; Deep learning; Intelligent robots; Learning systems; Action recognition; Aggregation mechanism; Generic modeling; Learning-based methods; Optical flow estimation; Spatio temporal features; Temporal features; Temporal information; Optical flows | 公開日期: | 2019 | 起(迄)頁: | 2835-2840 | 來源出版物: | IEEE International Conference on Intelligent Robots and Systems | 摘要: | Since deep-learning-based method has been widely-used and is capable of generating generic model, most existing methods about action recognition use either two-stream structure, considering spatial and temporal features separately, or C3D, costing lots of prices in memory and time. We aim to design a robust system to extract spatiotemporal features with aggregation mechanism to integrate local features in temporal order. In light of this, we propose ResFlow to estimate optical flow and predict action recognition simultaneously. Leveraging the characteristic of optical flow estimation, we extract spatiotemporal feature via an autoencoder. Via a novel Sequentially Pooling Mechanism which literally pool global spatiotemporal feature sequentially, we extract spatiotemporal feature at each time and aggregate these local features into global feature. This design use only RGB images as input with temporal information encoded, pre-trained by optical flow, and sequentially aggregate spatiotemporal features in high efficiency. We evaluate our ability of estimating optical flow on FlyingChairs dataset and show the promising results of action recognition on UCF-101 dataset through a series of experiments. ? 2019 IEEE. |
URI: | https://www.scopus.com/inward/record.uri?eid=2-s2.0-85081161040&doi=10.1109%2fIROS40897.2019.8968533&partnerID=40&md5=85c3a1fa8569911fdc9966c09649626c https://scholars.lib.ntu.edu.tw/handle/123456789/581380 |
ISSN: | 21530858 | DOI: | 10.1109/IROS40897.2019.8968533 |
顯示於: | 資訊工程學系 |
在 IR 系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。