Journal of Beijing University of Posts and Telecommunications

  • EI核心期刊

JOURNAL OF BEIJING UNIVERSITY OF POSTS AND TELECOM ›› 2014, Vol. 37 ›› Issue (s1): 115-119.doi: 10.13190/j.jbupt.2014.s1.022

• Reports • Previous Articles     Next Articles

Resource Modeling and Performance Prediction of MapReduce in Cloud Computing Environment

QIAO Yuan-yuan, LIU Fang, LING Yan, YIN Jin-song   

  1. School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China
  • Received:2014-01-01 Online:2014-06-28 Published:2014-06-28
  • Supported by:
     

Abstract:

The prediction of job running time and computing resource is very important in production environment. However, the performance of cloud computing is not easy to be predicted due to complicated computing resources in environment of cloud platform. A model is proposed based on resource consumption patterns for predicting the running time and central processing unit (CPU) resources consuming of MapReduce job in cloud computing environment. This model comes from polynomial regression modeling to predict the performance of MapReduce job. A variety of criteria is used to evaluate the model. Experiment shows that this model could predict the running time and CPU resources consuming of MapReduce job with high accuracy.

Key words: cloud computing, MapReduce, resource modeling, MapReduce job time modeling, performance prediction

CLC Number: