Dietz, A.; Pösch, A.; Reithmeier, E.: Hand hygiene monitoring based on segmentation of interacting hands with convolutional networks. In: Proceedings of SPIE - The International Society for Optical Engineering 10579 (2018), 1057914. DOI: https://doi.org/10.1117/12.2294047
Abstract: | |
The number of health-care associated infections is increasing worldwide. Hand hygiene has been identified as one of the most crucial measures to prevent bacteria from spreading. However, compliance with recommended procedures for hand hygiene is generally poor, even in modern, industrialized regions. We present an optical assistance system for monitoring the hygienic hand disinfection procedure which is based on machine learning. Firstly, each hand and underarm of a person is detected in a down-sampled 96 px x 96 px depth video stream by pixelwise classification using a fully convolutional network. To gather the required amount of training data, we present a novel approach in automatically labeling recorded data using colored gloves and a color video stream that is registered to the depth stream. The colored gloves are used to segment the depth data in the training phase. During inference, the colored gloves are not required. The system detects and separates detailed hand parts of interacting, self-occluded hands within the observation zone of the sensor. Based on the location of the segmented hands, a full resolution region of interest (ROI) is cropped. A second deep neural network classifies the ROI into ten separate process steps (gestures), with nine of them based on the recommended hand disinfection procedure of the World Health Organization, and an additional error class. The combined system is cross-validated with 21 subjects and predicts with an accuracy of 93.37% (± 2.67%) which gesture is currently executed. The feedback is provided with 30 frames per second. | |
License of this version: | Es gilt deutsches Urheberrecht. Das Dokument darf zum eigenen Gebrauch kostenfrei genutzt, aber nicht im Internet bereitgestellt oder an Außenstehende weitergegeben werden. Dieser Beitrag ist aufgrund einer (DFG-geförderten) Allianz- bzw. Nationallizenz frei zugänglich. |
Document Type: | BookPart |
Publishing status: | publishedVersion |
Issue Date: | 2018 |
Appears in Collections: | Fakultät für Maschinenbau |
pos. | country | downloads | ||
---|---|---|---|---|
total | perc. | |||
1 | Germany | 150 | 60.98% | |
2 | United States | 40 | 16.26% | |
3 | China | 13 | 5.28% | |
4 | Vietnam | 4 | 1.63% | |
5 | Korea, Republic of | 4 | 1.63% | |
6 | India | 2 | 0.81% | |
7 | France | 2 | 0.81% | |
8 | Finland | 2 | 0.81% | |
9 | Spain | 2 | 0.81% | |
10 | Czech Republic | 2 | 0.81% | |
other countries | 25 | 10.16% |
Hinweis
Zur Erhebung der Downloadstatistiken kommen entsprechend dem „COUNTER Code of Practice for e-Resources“ international anerkannte Regeln und Normen zur Anwendung. COUNTER ist eine internationale Non-Profit-Organisation, in der Bibliotheksverbände, Datenbankanbieter und Verlage gemeinsam an Standards zur Erhebung, Speicherung und Verarbeitung von Nutzungsdaten elektronischer Ressourcen arbeiten, welche so Objektivität und Vergleichbarkeit gewährleisten sollen. Es werden hierbei ausschließlich Zugriffe auf die entsprechenden Volltexte ausgewertet, keine Aufrufe der Website an sich.