Work

The Online LSTM Prediction Models and The Term Structure of Predictions

Year: 2026
Type: preprint
Abstract: We examine and illustrate the properties of the Long Short Term Memory (LSTM) prediction models applied online to stationary inputs. We discuss the effects of: a) the network architecture that defines the admissible prediction functions, b) the objective function used to measure the prediction accuracy, and c) the Stochastic Gradient Descent (SGD) algorithm. We also study the prediction optimality, the term structure of predictions, the filtered memory dynamics. We also introduce a set of diagnostic tools for memory-based prediction models that focus on the estimated dynamics of the hidden states.
Language: English
Open Access status: green
OpenAlex ID: W7236321546
Cites: 35
Cited by:
Related to: 10