Work

A Survey of Machine Learning Techniques for Self-tuning Hadoop Performance

Year: 2018

Type: article

Abstract: The Apache Hadoop framework is an open source implementation of MapReduce for processing and storing big data. However, to get the best performance from this is a big challenge because of its large number configuration parameters. In this paper, the concept of critical issues of Hadoop system, big data and machine learning have been highlighted and an analysis of some machine learning techniques applied so far, for improving the Hadoop performance is presented. Then, a promising machine learning technique using deep learning algorithm is proposed for Hadoop system performance improvement.

Source: International Journal of Electrical and Computer Engineering (IJECE)

DOI: 10.11591/ijece.v8i3.pp1854-1862

Authors: Md. Armanur Rahman, J. Hossen, Venkataseshaiah C, CK Ho, Tan Kim Geok, Aziza Sultana, Jesmeen M. Z. H., Ferdous Hossain

Institutions: Multimedia University, Dhaka International University

Language: English

Topic: Cloud Computing and Resource Management

Subfield: Information Systems

Field: Computer Science

Domain: Physical Sciences

Open Access status: diamond

OpenAlex ID: W2788602129

FWCI: 4.838

Cites: 23

Cited by: 13

Related to: 10