Kun Liu
College of Computer Science and Technology, Jilin University, Jilin, Changchun, 130012, China
Gaochao Xu
College of Computer Science and Technology, Jilin University, Jilin, Changchun, 130012, China
Tingmei Wang
College of Applied Science and Technology, Beijing Union University, Beijing, 102200, China
Jun`e Yuan
College of Applied Science and Technology, Beijing Union University, Beijing, 102200, China
ABSTRACT
This study is designed to solve the problem of Hadoop data load balancing algorithm. A big difference arises in response time for similar files as it balances the data according to the space usage of each node and doesn't handle the factors like processing power, bandwidth and files' access frequency. This study proposes a novel load balancing model based on the factors of files size, files concurrent access time, files access frequency, nodes' processing power, bandwidth and nodes available storage space. Experimental results reveal that the new model can not only guarantee the storage space load balancing, but also maintain similar response time for similar files.
PDF References
How to cite this article
Kun Liu, Gaochao Xu, Tingmei Wang and Jun`e Yuan, 2013. A Novel Improved Data Load Balancing Algorithm for Hadoop. Information Technology Journal, 12: 7260-7264.
DOI: 10.3923/itj.2013.7260.7264
URL: https://scialert.net/abstract/?doi=itj.2013.7260.7264
DOI: 10.3923/itj.2013.7260.7264
URL: https://scialert.net/abstract/?doi=itj.2013.7260.7264
REFERENCES
- Chen, K. and W.M. Zheng, 2009. Cloud computing: System instances and current research. J. Software, 20: 1337-1348.
Direct Link