CarbonCrediBERT: Expert-Guided Few-Shot and Selective Classification of Carbon Credit Disclosures
Year: 2026
Type: preprint
Abstract: Corporate reports increasingly discuss carbon credits in relation to net-zero targets, offsetting claims, and climate transition plans, particularly as climate-related financial disclosure requirements expand. Analysing these disclosures at scale remains difficult because terms such as credit, offset, and net also occur in unrelated financial, accounting, and operational contexts. Expert-labelled data are also costly to produce and often contain substantial class imbalance. We propose CarbonCrediBERT, an expert-guided natural language processing framework that classifies paragraphs according to carbon credit relevance, sentiment, and reported credit use, while referring uncertain cases for human review. CarbonCrediBERT combines an expert defined taxonomy, hard-negative examples drawn from closely related but nonrelevant passages, and classification methods suited to small expert-labelled datasets. Using annual, climate, sustainability, and ESG reports published by ASX100 companies in 2024–2025, the framework produced 8,299 keyword-matched sentence records and a balanced candidate pool of 15,026 paragraphs. We evaluated ClimateBERT and DistilRoBERTa fine-tuning and SetFit–MiniLM few-shot learning using three task-specific datasets of 100 expert-labelled paragraphs each. Five-fold development cross-validation selected fine-tuned ClimateBERT for carbon credit relevance, achieving 93.8% accuracy, and SetFit–MiniLM for sentiment and reported credit use. These results show that broad climate-language detection alone is insufficient for identifying carbon credit disclosures and that no single modelling approach performs best across all three tasks. They also highlight the continuing importance of expert judgement, particularly for sentiment and ambiguous statements about credit use. Future work will expand the domain corpus and expert-labelled evidence and evaluate transfer across companies, reporting years, and jurisdictions, establishing a pathway towards a reusable CarbonCrediBERT foundation model for carbon credit disclosure analysis.
Source: Research Square
Authors: Hang Thanh Bui, Eric Lee, Megan C Evans
Institutions: Australian Defence Force Academy, UNSW Canberra
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7225782631
Cites:
Cited by:
Related to: