Title Reconstruction of 3D object shape using hybrid modular neural network architecture trained on 3D models from ShapeNetCore dataset /
Authors Kulikajevas, Audrius ; Maskeliūnas, Rytis ; Damaševičius, Robertas ; Misra, Sanjay
DOI 10.3390/s19071553
Full Text Download
Is Part of Sensors.. Basel : MDPI. 2019, vol. 19, iss. 7, art. no. 1553, p. 1-21.. ISSN 1424-8220
Keywords [eng] 3D depth shape recognition ; 3D depth scanning ; RGB-D sensors ; hybrid neural networks
Abstract [eng] Depth-based reconstruction of three-dimensional (3D) shape of objects is one of core problems in computer vision with a lot of commercial applications. However, the 3D scanning for point cloud-based video streaming is expensive and is generally unattainable to an average user due to required setup of multiple depth sensors. We propose a novel hybrid modular artificial neural network (ANN) architecture, which can reconstruct smooth polygonal meshes from a single depth frame, using a priori knowledge. The architecture of neural network consists of separate nodes for recognition of object type and reconstruction thus allowing for easy retraining and extension for new object types. We performed recognition of nine real-world objects using the neural network trained on the ShapeNetCore model dataset. The results evaluated quantitatively using the Intersection-over-Union (IoU), Completeness, Correctness and Quality metrics, and qualitative evaluation by visual inspection demonstrate the robustness of the proposed architecture with respect to different viewing angles and illumination conditions.
Published Basel : MDPI
Type Journal article
Language English
Publication date 2019
CC license CC license description