BE/BTech & ME/MTech Final Year Projects for Computer Science | Information Technology | ECE Engineer | IEEE Projects Topics, PHD Projects Reports, Ideas and Download | Sai Info Solution | Nashik |Pune |Mumbai
director@saiinfo settings_phone02536644344 settings_phone+919270574718 +919096813348 settings_phone+917447889268
logo


SAI INFO SOLUTION


Diploma | BE |B.Tech |ME | M.Tech |PHD

Project Development and Training

Search Project by Domainwise


An Energy Efficiency Optimization and Control Model for Hadoop Clusters


Scalable and Secure Big Data I
Abstract


The majority of large-scale data intensive applications designed by MapReduce model are deployed and executed on large-scale distributed Hadoop system. Running such application on large cluster requires large amount of energy. Therefore improving energy efficiency and minimizing energy consumption when executing each MapReduce job is a critical concern for data centers. We propose a control model based on Model Prediction Control (MPC) for improving energy efficiency of Hadoop cluster, while satisfying performance goal. The controller can dynamically scale CPU frequency in facing the workloads changes. The wavelet neural network is utilized to build the prediction model, which can accurately estimate energy efficiency ratio based on the features extracting from the variation of Hadoop workloads. With the help of wavelet neural network, the controller can guarantee the energy efficiency ratio converges to an ideal set point within a finite settling time. We perform the extensive experiments on a Hadoop cluster to compare our controller with the previous MPC controller. The results demonstrate that our controller outperforms the baseline on energy efficiency control and adapts to workloads of Hadoop cluster.

KeyWords
DVFS, Energy Efficiency Control, Hadoop Cluster, Minimizing Energy Consumption, Model Prediction Control, Wavelet Neural Networks



Share
Share via WhatsApp
BE/BTech & ME/MTech Final Year Projects for Computer Science | Information Technology | ECE Engineer | IEEE Projects Topics, PHD Projects Reports, Ideas and Download | Sai Info Solution | Nashik |Pune |Mumbai
Call us : 09096813348 / 02536644344
Mail ID : developer.saiinfo@gmail.com
Skype ID : saiinfosolutionnashik