Title: Transfer Learning and Hyperparameter Optimization for Instance Segmentation with RGB-D Images in Reflective Elevator Environments
Authors: Reithmeier, Lukas
Krauss, Oliver
Zwettler, Adam Gerald
Citation: WSCG 2021: full papers proceedings: 29. International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, p. 273-282.
Issue Date: 2021
Publisher: Václav Skala - UNION Agency
Document type: conferenceObject
konferenční příspěvek
URI: http://hdl.handle.net/11025/45033
ISBN: 978-80-86943-34-3
ISSN: 2464-4617
2464–4625(CD/DVD)
Keywords: segmentace instance;RGB-D data;přenosové učení;reflexní prostředí
Keywords in different language: instance segmentation;RGB-D data;transfer learning;reflective environments
Abstract in different language: Elevators, a vital means for urban transportation, are generally lacking proper emergency call systems besidesan emergency button. In the case of unconscious or otherwise incapacitated passengers this can lead to lethalsituations. A camera-based surveillance system with AI-based alerts utilizing an elevator state machine can helppassengers unable to initiate an emergency call. In this research work, the applicability of RGB-D images asinput for instance segmentation in the highly reflective environment of an elevator cabin is evaluated. For objectsegmentation, a Region-based Convolution Neural Network (R-CNN) deep learning model is adapted to use depthinput data besides RGB by applying transfer learning, hyperparameter optimization and re-training on a newlyprepared elevator image dataset. Evaluations prove that with the chosen strategy, the accuracy of R-CNN instancesegmentation is applicable on RGB-D data, thereby resolving lack of image quality in the noise affected andreflective elevator cabins. The mean average precision (mAP) of 0.753 is increased to 0.768 after the incorporationof additional depth data and with additional FuseNet-FPN backbone on RGB-D the mAP is further increased to0.794. With the proposed instance segmentation model, reliable elevator surveillance becomes feasible as firstprototypes and on-road tests proof.
Rights: © Václav Skala - UNION Agency
Appears in Collections:WSCG 2021: Full Papers Proceedings

Files in This Item:
File Description SizeFormat 
J71.pdfPlný text4,43 MBAdobe PDFView/Open


Please use this identifier to cite or link to this item: http://hdl.handle.net/11025/45033

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.