Hypergraph Transformer Model for Masonry Quality Defect Recognition from Close-Range Wall Images
Year: 2026
Type: article
Abstract: Close-range masonry inspection requires recognition of local damage while retaining the relation between brick texture, mortar continuity and visible wall geometry. This study specifies a structure-guided Hypergraph Transformer for region- level classification of intact surface, cracks, joint anomalies, chipped edges and surface spalling. Colour photographs are padded to a 1024 by 1024 reference input while preserving aspect ratio, and larger images are processed through overlapping tiles linked to their parent coordinates. A feature pyramid and a layout branch support regional sampling with a maximum of 256 nodes per tile. Each region combines appearance, normalized geometry and observation-quality descriptors in a 384-dimensional embedding. Local, mortar-joint and texture hyperedges encode complementary spatial and structural associations. Three hypergraph blocks use four attention heads to aggregate region states within typed relations and redistribute relation-conditioned evidence before classification. Boundary supervision and matched-region augmentation consistency supplement class-weighted learning, with initial auxiliary coefficients of 0.3 and 0.1. The evaluation protocol assigns independent wall groups in planned proportions of 70% training, 15% validation and 15% testing. Half of the validation pool, or 7.5% of total groups, serves checkpoint selection; the other half serves probability- temperature calibration. Planned comparisons include regional MLP, convolutional, pairwise graph-attention and dense Transformer alternatives under matched wall assignments, alongside relation-family and supervision ablations. Class- specific recall, macro-F1, balanced accuracy, wall-level uncertainty, computational cost and controlled imaging disturbances define the intended assessment. A confidence-based review policy is specified at candidate-region budgets of 5%, 10%, 15%, 20% and 30%. The manuscript establishes a traceable computational and evaluation design; realized wall- group counts, recognition scores and prospective inspection yield remain subjects for empirical validation.
Authors: Vesna Erjavec, Julija Rozman
Institution: University of Ljubljana
Language: English
Subfield: Civil and Structural Engineering
Field: Engineering
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W7225100740
