Work

Simple Linear Regression Analysis with Non-Normal Errors

Year: 2025

Type: article

Abstract: We consider a simple linear regression with non-normal errors; specifically, errors follow the double exponential distribution and uniform distribution. Maximum likelihood estimates for parameters (intercept and slope) are investigated. Although they do not have closed mathematical forms, they can be derived uniquely by numerical methods. Through Monte Carlo simulation, ordinary least square estimates (LSE) and maximum likelihood estimates (MLE) are derived and compared through their biases, variances and mean squared errors. Simulation studies show that both MLE and LSE follow normal distributions and MLE has smaller mean squared errors compared to LSE. This paper suggests or confirms that one prefers to use MLE to estimate unknown parameters if there exists strong evidence that errors do not follow a normal distribution.

Source: Science and Technology of Engineering Chemistry and Environmental Protection

DOI: 10.61173/q51d8721

Author: Yinhao Wang

Language: English

Topic: Advanced Statistical Methods and Models

Subfield: Statistics and Probability

Field: Mathematics

Domain: Physical Sciences

Open Access status: hybrid

OpenAlex ID: W4407979087

FWCI:

Cites:

Cited by:

Related to: 10