Multiclass Level-Set Segmentation of Rust and Coating Damages in Images of Metal Structures

This paper describes the combined detection of coating and rust damages on painted metal structures through the multiclass image segmentation technique. Our prior works were focused solely on the localization of rust damages and rust segmentation under different ambient conditions (different lighting conditions, presence of shadows, low background/object color contrast). This paper method proposes three types of damages: coating crack, coating flaking, and rust damage. Background, paint flaking, and rust damage are objects that can be separated in RGB color-space alone. For their preliminary classification SVM is used. As for paint cracks, color features are insufficient for separating it from other defect types as they overlap with the other three classes in RGB color space. For preliminary paint crack segmentation we use the valley detection approach, which analyses the shape of defects. A multiclass level-set approach with a developed penalty term is used as a framework for the advanced final damage segmentation stage. Model training and accuracy assessment are fulfilled on the created dataset, which contains input images of corresponding defects with respective ground truth data provided by the expert. A quantitative analysis of the accuracy of the proposed approach is provided. The efficiency of the approach is demonstrated on authentic images of coated surfaces.