Kang, J.; Chen, L.; Deng, F.; Heipke, C.: Improving disparity estimation based on residual cost volume and reconstruction error volume . In: Paparoditis, N. et al. (Eds.): XXIV ISPRS Congress, Commission II : edition 2020. Katlenburg-Lindau : Copernicus Publications, 2020. (ISPRS Archives ; 43,B2), S. 135-142. DOI: https://doi.org/10.5194/isprs-archives-XLIII-B2-2020-135-2020
Zusammenfassung: | |
Recently, great progress has been made in formulating dense disparity estimation as a pixel-wise learning task to be solved by deep convolutional neural networks. However, most resulting pixel-wise disparity maps only show little detail for small structures. In this paper, we propose a two-stage architecture: we first learn initial disparities using an initial network, and then employ a disparity refinement network, guided by the initial results, which directly learns disparity corrections. Based on the initial disparities, we construct a residual cost volume between shared left and right feature maps in a potential disparity residual interval, which can capture more detailed context information. Then, the right feature map is warped with the initial disparity and a reconstruction error volume is constructed between the warped right feature map and the original left feature map, which provides a measure of correctness of the initial disparities. The main contribution of this paper is to combine the residual cost volume and the reconstruction error volume to guide training of the refinement network. We use a shallow encoder-decoder module in the refinement network and do learning from coarse to fine, which simplifies the learning problem. We evaluate our method on several challenging stereo datasets. Experimental results demonstrate that our refinement network can significantly improve the overall accuracy by reducing the estimation error by 30% compared with our initial network. Moreover, our network also achieves competitive performance compared with other CNN-based methods. © 2020 International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives. | |
Lizenzbestimmungen: | CC BY 4.0 Unported |
Publikationstyp: | BookPart |
Publikationsstatus: | publishedVersion |
Erstveröffentlichung: | 2020 |
Die Publikation erscheint in Sammlung(en): | Fakultät für Bauingenieurwesen und Geodäsie |
Pos. | Land | Downloads | ||
---|---|---|---|---|
Anzahl | Proz. | |||
1 | Germany | 52 | 43,33% | |
2 | United States | 26 | 21,67% | |
3 | India | 13 | 10,83% | |
4 | China | 10 | 8,33% | |
5 | United Kingdom | 3 | 2,50% | |
6 | No geo information available | 2 | 1,67% | |
7 | Israel | 2 | 1,67% | |
8 | Hong Kong | 2 | 1,67% | |
9 | France | 2 | 1,67% | |
10 | Indonesia | 1 | 0,83% | |
andere | 7 | 5,83% |
Hinweis
Zur Erhebung der Downloadstatistiken kommen entsprechend dem „COUNTER Code of Practice for e-Resources“ international anerkannte Regeln und Normen zur Anwendung. COUNTER ist eine internationale Non-Profit-Organisation, in der Bibliotheksverbände, Datenbankanbieter und Verlage gemeinsam an Standards zur Erhebung, Speicherung und Verarbeitung von Nutzungsdaten elektronischer Ressourcen arbeiten, welche so Objektivität und Vergleichbarkeit gewährleisten sollen. Es werden hierbei ausschließlich Zugriffe auf die entsprechenden Volltexte ausgewertet, keine Aufrufe der Website an sich.