Work

MRF: MapReduce based Forecasting Algorithm for Time Series Data

Year: 2018
Type: conference-paper
Abstract: Weighted moving average (WMA) is extensively used for short term forecasting to remove random fluctuations in cyclical data. However, it is susceptible to the number of previous observations (window size), used to predict the next element. A large value of window size increases the model risk whereas a smaller one poses parameter risk. For training data size of N, checking the window size ranging from 2 to N-1 needs O(N 3 ) time. In this paper, we propose MRF (Map Reduce based forecasting algorithm), which checks the possible window values in parallel and reduces the time complexity to O(N 2 ). The algorithm meticulously designs < key, value > for each window size, which distributes the job equally in the reduce phase. We have shown MRF to be the correct implementation of sequential algorithm. Extensive experiments were performed on MRF. The predicted values for real life meteorological and computing datasets generated using MRF are highly correlated to actual ones. Real and predicted are also validated using paired sample t tests. Results on synthetic data exhibits scalability of MRF algorithm.
Language: English
Open Access status: diamond
OpenAlex ID: W2807372743
FWCI: 1.052
Cites: 23
Cited by: 10
Related to: 9