Work

Multimodal deep learning enables forest height mapping from patchy spaceborne LiDAR using SAR and passive optical satellite data

Year: 2025

Type: article

Abstract: Accurate estimation of forest height plays a pivotal role in mapping carbon stocks from space. Spaceborne LiDARs give accurate spot estimates of forest canopy height, but sample only a tiny fraction of the landscape. The gaps must therefore be filled using other satellite remote sensing data. Deep learning models may improve the process of this spatial extrapolation. We found that the Global Ecosystem Dynamics Investigation (GEDI) LiDAR relative heights (RH) metrics exhibited strong correlation with the mean of the tallest 10 trees (dominant height) measured in situ in forests in China. Having shown this, we propose a novel deep learning framework termed the multi-modal attention remote sensing network (MARSNet) to extrapolate dominant heights derived from GEDI, using Setinel-1 C-band Synthetic Aperture Radar (SAR) data, Advanced Land Observing Satellite-2 (ALOS-2) Phased Array type L-band Synthetic Aperture Radar-2 (PALSAR-2) data, and Sentinel-2 passive optical data. MARSNet comprises separate encoders for each remote sensing data modality to extract multi-scale features, and a shared decoder to fuse the features and estimate height. Using individual encoders for each remote sensing data source avoids interference across modalities and extracts distinct representations. To focus on the useful information from each dataset, we reduced the prevalent spatial and layer redundancies in each remote sensing data by incorporating the extended spatial and layer reconstruction convolution (ESLConv) modules in the encoders. MARSNet achieved good performance in estimating dominant height, with a R2 of 0.62 and RMSE of 2.82 m on test data, outperforming the widely used random forest (RF) approach which attained an R2 of 0.55 and RMSE of 3.05 m using the same layers. We demonstrated the efficacy of the MARSNet modules and the expansion of data sources for improving dominant height estimation through network ablation studies and data ablation studies. Finally, we applied the trained MARSNet model to generate wall-to-wall maps at 10 m resolution for Jilin province, China. Through independent validation using field measurements, MARSNet demonstrated an R2 of 0.58 and RMSE of 3.76 m, compared to 0.41 and 4.37 m for the random forest baseline model. Additionally, MARSNet effectively mitigated the common tendency of RF models to overestimate in low height areas and underestimate in high canopy areas (low sensitivity). Our research demonstrates the effectiveness of a multimodal deep learning approach fusing GEDI with SAR and passive optical imagery for enhancing the accuracy of high resolution dominant height estimation. This method shows promise for enabling accurate large-scale forest height mapping in areas where high-quality ground data are available, potentially revolutionizing our understanding of global forest structure and carbon stocks.

Source: International Journal of Applied Earth Observation and Geoinformation

DOI: 10.1016/j.jag.2025.104814