A Recurrent Deep Network for Estimating the Pose of Real Indoor Images from Synthetic Image Sequences

Download
Citations
Altmetric
Author
Acharya, D; Singha Roy, S; Khoshelham, K; Winter, SDate
2020-10-01Source Title
SensorsPublisher
MDPIUniversity of Melbourne Author/s
Acharya, Debaditya; Winter, Stephan; Khoshelham, Kourosh; Acharya, DebadityaAffiliation
Infrastructure EngineeringMetadata
Show full item recordDocument Type
Journal ArticleCitations
Acharya, D., Singha Roy, S., Khoshelham, K. & Winter, S. (2020). A Recurrent Deep Network for Estimating the Pose of Real Indoor Images from Synthetic Image Sequences. SENSORS, 20 (19), https://doi.org/10.3390/s20195492.Access Status
Open AccessOpen Access at PMC
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC7582800Abstract
Recently, deep convolutional neural networks (CNN) have become popular for indoor visual localisation, where the networks learn to regress the camera pose from images directly. However, these approaches perform a 3D image-based reconstruction of the indoor spaces beforehand to determine camera poses, which is a challenge for large indoor spaces. Synthetic images derived from 3D indoor models have been used to eliminate the requirement of 3D reconstruction. A limitation of the approach is the low accuracy that occurs as a result of estimating the pose of each image frame independently. In this article, a visual localisation approach is proposed that exploits the spatio-temporal information from synthetic image sequences to improve localisation accuracy. A deep Bayesian recurrent CNN is fine-tuned using synthetic image sequences obtained from a building information model (BIM) to regress the pose of real image sequences. The results of the experiments indicate that the proposed approach estimates a smoother trajectory with smaller inter-frame error as compared to existing methods. The achievable accuracy with the proposed approach is 1.6 m, which is an improvement of approximately thirty per cent compared to the existing approaches. A Keras implementation can be found in our Github repository.
Export Reference in RIS Format
Endnote
- Click on "Export Reference in RIS Format" and choose "open with... Endnote".
Refworks
- Click on "Export Reference in RIS Format". Login to Refworks, go to References => Import References