Work

A data-driven machine learning framework for predicting total agricultural food grain yield

Year: 2025
Type: article
Abstract: India's agricultural sector is experiencing significant shifts due to climate variability, evolving farming practices, and changing crop patterns. While previous studies have explored crop yield prediction using machine learning commonly adopt image-based Machine learning techniques, many relied on manual hyperparameter tuning and rarely applied these techniques to decision tree based algorithms, limiting reproducibility and optimization. To address this gap, our study presents a consistent, data-driven approach using automated hyperparameter configuration and a moderate-scale, publicly available dataset from the Reserve Bank of India (1967–2024), covering key crops such as Groundnut, Rapeseed, Mustard, Soybean, Coffee, Sugarcane, and Tea. Four ensemble models - Gradient Boost, XGBoost, LightGBM, and CatBoost are used to predict total food grain yield. The model pipeline incorporates five-fold cross-validation, GridSearchCV for hyperparameter tuning, early stopping to prevent overfitting, and SHapley Additive exPlanations(SHAP) for interpretability. Model performance is evaluated using Mean Error (ME), Mean Absolute Error (MAE), Mean Percentage Error (MPE), Root Mean Squared Error (RMSE), Mean Squared Error (MSE), and Coefficient of Determination (R 2 ). Gradient Boost achieved the highest accuracy, followed by CatBoost, XGBoost, and LightGBM. The results demonstrate the reliability and scalability of ensemble models and provide a strong foundation for future integration of geographic and climatic variables into yield forecasting systems. • An ensemble ML framework predicts India's total food grain yield. • Uses GridSearchCV + 5-fold CV and early stopping to prevent overfitting. • Gradient Boost achieves the best test accuracy (R 2 0.955, RMSE 1.478). • SHAP reveals Coffee and Rapeseed & Mustard as key yield drivers. • Scalable, reliable framework ready to integrate climate and geography.
Language: English
Subfield: Plant Science
Open Access status: gold
Estimated APC paid: $1,940
OpenAlex ID: W4413883789
FWCI: 2.045
Cites: 50
Cited by: 4
Related to: 10