论坛 › Hadoop › hadoop内存分配方案

阿尔哦覅和 发表于 2017-12-17 14:33:05

hadoop内存分配方案

　　Configuration File
Configuration SettingValue Calculation       8G VM (4G For MR)   yarn-site.xmlyarn.nodemanager.resource.memory-mb= containers * RAM-per-container4096yarn-site.xmlyarn.scheduler.minimum-allocation-mb= RAM-per-container1024yarn-site.xmlyarn.scheduler.maximum-allocation-mb= containers * RAM-per-container4096mapred-site.xmlmapreduce.map.memory.mb= RAM-per-container1024mapred-site.xml      mapreduce.reduce.memory.mb= 2 * RAM-per-container2048mapred-site.xmlmapreduce.map.java.opts= 0.8 * RAM-per-container819mapred-site.xmlmapreduce.reduce.java.opts= 0.8 * 2 * RAM-per-container1638yarn-site.xml (check)yarn.app.mapreduce.am.resource.mb= 2 * RAM-per-container2048yarn-site.xml (check)yarn.app.mapreduce.am.command-opts= 0.8 * 2 * RAM-per-container1638tez-site.xmltez.am.resource.memory.mb= RAM-per-container1024tez-site.xmltez.am.java.opts= 0.8 * RAM-per-container819tez-site.xmlhive.tez.container.size= RAM-per-container1024tez-site.xmlhive.tez.java.opts= 0.8 * RAM-per-container819

查看完整版本: hadoop内存分配方案