Work

Zero-Shot Degradation Segmentation on Historical Buildings Using Vision LLM and SAM2

Year: 2026
Type: conference-paper
Abstract: The automated detection and classification of surface degradation on historical buildings represents a critical challenge in architectural heritage conservation. Conventional approaches relying on manual inspection or supervised machine learning require extensive annotated datasets and expert involvement, limiting their scalability. This paper presents a novel zero-shot pipeline for degradation segmentation on historical civil architecture, combining UAV-acquired photogrammetric data processed in Agisoft Metashape with Gemma 4 31B, Google DeepMind's flagship open-weight vision language model, running locally via LM Studio, and the Segment Anything Model 2 (SAM2) for pixel-accurate mask generation. The system operates entirely without task-specific training data, producing segmentation masks overlaid on the RGB orthomosaic for expert visual evaluation. A case study on a degraded historical building in Calabria, southern Italy, demonstrates the pipeline's ability to detect and categorize detachment, cracking, and lacunae in a unified, reproducible workflow. Results are evaluated through structured expert visual assessment. The approach offers a replicable, low-cost alternative to supervised segmentation, particularly suited to contexts where labeled data is unavailable.
Language: English
Open Access status: hybrid
OpenAlex ID: W7204154349
FWCI:
Cites: 14
Cited by:
Related to: 10