Badilla-Solórzano, J.; Spindeldreier, S.; Ihler, S.; Gellrich, N.-C.; Spalthoff, S.: Deep-learning-based instrument detection for intra-operative robotic assistance. In: International Journal of Computer Assisted Radiology and Surgery 17 (2022), Nr. 9, S. 1685-1695. DOI: https://doi.org/10.1007/s11548-022-02715-y
Abstract: | |
Purpose:Robotic scrub nurses have the potential to become an attractive solution for the operating room. Surgical instrument detection is a fundamental task for these systems, which is the focus of this work. We address the detection of the complete surgery set for wisdom teeth extraction, and propose a data augmentation technique tailored for this task.Methods:Using a robotic scrub nurse system, we create a dataset of 369 unique multi-instrument images with manual annotations. We then propose the Mask-Based Object Insertion method, capable of automatically generating a large amount of synthetic images. By using both real and artificial data, different Mask R-CNN models are trained and evaluated.Results:Our experiments reveal that models trained on the synthetic data created with our method achieve comparable performance to that of models trained on real images. Moreover, we demonstrate that the combination of real and our artificial data can lead to a superior level of generalization.Conclusion:The proposed data augmentation technique is capable of dramatically reducing the labelling work required for training a deep-learning-based detection algorithm. A dataset for the complete instrument set for wisdom teeth extraction is made available for the scientific community, as well as the raw information required for the generation of the synthetic data (https://github.com/Jorebs/Deep-learning-based-instrument-detection-for-intra operative-robotic-assistance). | |
License of this version: | CC BY 4.0 Unported |
Document Type: | Article |
Publishing status: | publishedVersion |
Issue Date: | 2022 |
Appears in Collections: | Fakultät für Maschinenbau |
pos. | country | downloads | ||
---|---|---|---|---|
total | perc. | |||
1 | ![]() |
Germany | 13 | 40.62% |
2 | ![]() |
United States | 11 | 34.38% |
3 | ![]() |
Czech Republic | 3 | 9.38% |
4 | ![]() |
France | 2 | 6.25% |
5 | ![]() |
China | 2 | 6.25% |
6 | ![]() |
Japan | 1 | 3.12% |
Hinweis
Zur Erhebung der Downloadstatistiken kommen entsprechend dem „COUNTER Code of Practice for e-Resources“ international anerkannte Regeln und Normen zur Anwendung. COUNTER ist eine internationale Non-Profit-Organisation, in der Bibliotheksverbände, Datenbankanbieter und Verlage gemeinsam an Standards zur Erhebung, Speicherung und Verarbeitung von Nutzungsdaten elektronischer Ressourcen arbeiten, welche so Objektivität und Vergleichbarkeit gewährleisten sollen. Es werden hierbei ausschließlich Zugriffe auf die entsprechenden Volltexte ausgewertet, keine Aufrufe der Website an sich.