YOLOv3-based matching approach for roof region detection from drone images
Journal
Remote Sensing
Journal Volume
13
Journal Issue
1
Pages
1-23
Date Issued
2021
Author(s)
Abstract
Due to the large data volume, the UAV image stitching and matching suffers from high computational cost. The traditional feature extraction algorithms—such as Scale-Invariant Feature Transform (SIFT), Speeded Up Robust Features (SURF), and Oriented FAST Rotated BRIEF (ORB)— require heavy computation to extract and describe features in high-resolution UAV images. To overcome this issue, You Only Look Once version 3 (YOLOv3) combined with the traditional feature point matching algorithms is utilized to extract descriptive features from the drone dataset of residential areas for roof detection. Unlike the traditional feature extraction algorithms, YOLOv3 performs the feature extraction solely on the proposed candidate regions instead of the entire image, thus the complexity of the image matching is reduced significantly. Then, all the extracted features are fed into Structural Similarity Index Measure (SSIM) to identify the corresponding roof region pair between consecutive image sequences. In addition, the candidate corresponding roof pair by our architecture serves as the coarse matching region pair and limits the search range of features matching to only the detected roof region. This further improves the feature matching consistency and reduces the chances of wrong feature matching. Analytical results show that the proposed method is 13× faster than the traditional image matching methods with comparable performance. ? 2021 by the authors. Licensee MDPI, Basel, Switzerland.
Subjects
Aircraft detection; Drones; Extraction; Fire fighting equipment; Image matching; Image processing; Roofs; Analytical results; Computational costs; Feature extraction algorithms; Feature point matching; Large data volumes; Scale invariant feature transforms; Speeded up robust features; Structural similarity index measures (SSIM); Feature extraction
Type
journal article