|
|
a new data layout scheme for energy-efficient mapreduce processing tasks
|
|
|
|
|
نویسنده
|
tran xuan t. ,do tien van ,rotter csaba ,hwang dosam
|
منبع
|
journal of grid computing - 2018 - دوره : 16 - شماره : 2 - صفحه:285 -298
|
چکیده
|
Yet another resource negotiator (yarn) is a framework to manage and allocate resource requests from applications that process big data stored in hdfs. however, dynamic power management methods are not efficient when yarn manage applications to process big data stored in the default data layout of hdfs. in this paper, we propose a new data layout scheme that can be implemented for hdfs. a comparison between our proposal and the existing hdfs data layout scheme shows that the new data layout algorithm significantly reduces the energy consumption at the slight expense of the mean response time of jobs.
|
کلیدواژه
|
hadoop ,layout ,big data processing ,data locality ,dynamic power management
|
آدرس
|
budapest university of technology and economics, department of networked systems and services, hungary, ton duc thang university, faculty of information technology, division of knowledge and system engineering for ict, vietnam. budapest university of technology and economics, department of networked systems and services, hungary, nokia bell labs, bókay jános u. 36-42, hungary, yeungnam university, department of computer engineering, korea
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Authors
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|