Hadoop之wordcount性能测试

骞没蕴

　　概述：
　　利用wordcount做hadoop性能测试，依据count的数据规模增长进行性能分析评测
　　版本：
　　bin/hadoop version
　　Hadoop 2.3.0-cdh5.0.0
　　测试步骤：
　　1.利用randomtextwriter生成指定规模的测试集合
　　2.执行wordcount：

nohup bin/hadoop jar share/hadoop/mapreduce2/hadoop-mapreduce-examples-2.3.0-cdh5.0.0.jar wordcount /home/test/mrinput50 /home/test/mroutput50 > wc.log 2>&1 &
　　3.评测内容：

Total time spent by all maps in occupied slots (ms)=1504892
Total time spent by all reduces in occupied slots (ms)=84038
Total time spent by all map tasks (ms)=1504892
Total time spent by all reduce tasks (ms)=84038
GC time elapsed (ms)=17285
CPU time spent (ms)=1812107