CentOS 6.5 搭建Hadoop 1.2.1集群
Number of Maps= 10 Samples per Map = 10Wrote input for Map #0
Wrote input for Map #1
Wrote input for Map #2
Wrote input for Map #3
Wrote input for Map #4
Wrote input for Map #5
Wrote input for Map #6
Wrote input for Map #7
Wrote input for Map #8
Wrote input for Map #9
Starting Job
18/01/10 13:49:35 INFO mapred.FileInputFormat: Total input paths to process : 10
18/01/10 13:49:36 INFO mapred.JobClient: Running job: job_201801101031_0002
18/01/10 13:49:37 INFO mapred.JobClient:map 0% reduce 0%
18/01/10 13:49:49 INFO mapred.JobClient:map 10% reduce 0%
18/01/10 13:49:50 INFO mapred.JobClient:map 30% reduce 0%
18/01/10 13:49:51 INFO mapred.JobClient:map 40% reduce 0%
18/01/10 13:49:59 INFO mapred.JobClient:map 50% reduce 0%
18/01/10 13:50:00 INFO mapred.JobClient:map 60% reduce 0%
18/01/10 13:50:02 INFO mapred.JobClient:map 80% reduce 0%
18/01/10 13:50:07 INFO mapred.JobClient:map 100% reduce 0%
18/01/10 13:50:12 INFO mapred.JobClient:map 100% reduce 33%
18/01/10 13:50:14 INFO mapred.JobClient:map 100% reduce 100%
18/01/10 13:50:16 INFO mapred.JobClient: Job complete: job_201801101031_0002
18/01/10 13:50:16 INFO mapred.JobClient: Counters: 30
18/01/10 13:50:16 INFO mapred.JobClient: Job Counters
18/01/10 13:50:16 INFO mapred.JobClient: Launched reduce tasks=1
18/01/10 13:50:16 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=95070
18/01/10 13:50:16 INFO mapred.JobClient: Total time spent by all reduces waiting after reserving slots (ms)=0
18/01/10 13:50:16 INFO mapred.JobClient: Total time spent by all maps waiting after reserving slots (ms)=0
18/01/10 13:50:16 INFO mapred.JobClient: Launched map tasks=10
18/01/10 13:50:16 INFO mapred.JobClient: Data-local map tasks=10
18/01/10 13:50:16 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=25054
18/01/10 13:50:16 INFO mapred.JobClient: File Input Format Counters
18/01/10 13:50:16 INFO mapred.JobClient: Bytes Read=1180
18/01/10 13:50:16 INFO mapred.JobClient: File Output Format Counters
18/01/10 13:50:16 INFO mapred.JobClient: Bytes Written=97
18/01/10 13:50:16 INFO mapred.JobClient: FileSystemCounters
18/01/10 13:50:16 INFO mapred.JobClient: FILE_BYTES_READ=226
18/01/10 13:50:16 INFO mapred.JobClient: HDFS_BYTES_READ=2450
18/01/10 13:50:16 INFO mapred.JobClient: FILE_BYTES_WRITTEN=682653
18/01/10 13:50:16 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=215
18/01/10 13:50:16 INFO mapred.JobClient: Map-Reduce Framework
18/01/10 13:50:16 INFO mapred.JobClient: Map output materialized bytes=280
18/01/10 13:50:16 INFO mapred.JobClient: Map input records=10
18/01/10 13:50:16 INFO mapred.JobClient: Reduce shuffle bytes=280
18/01/10 13:50:16 INFO mapred.JobClient: Spilled Records=40
18/01/10 13:50:16 INFO mapred.JobClient: Map output bytes=180
18/01/10 13:50:16 INFO mapred.JobClient: Total committed heap usage (bytes)=1146068992
18/01/10 13:50:16 INFO mapred.JobClient: CPU time spent (ms)=7050
18/01/10 13:50:16 INFO mapred.JobClient: Map input bytes=240
18/01/10 13:50:16 INFO mapred.JobClient: SPLIT_RAW_BYTES=1270
18/01/10 13:50:16 INFO mapred.JobClient: Combine input records=0
18/01/10 13:50:16 INFO mapred.JobClient: Reduce input records=20
18/01/10 13:50:16 INFO mapred.JobClient: Reduce input groups=20
18/01/10 13:50:16 INFO mapred.JobClient: Combine output records=0
18/01/10 13:50:16 INFO mapred.JobClient: Physical memory (bytes) snapshot=1843138560
18/01/10 13:50:16 INFO mapred.JobClient: Reduce output records=0
18/01/10 13:50:16 INFO mapred.JobClient: Virtual memory (bytes) snapshot=7827865600
18/01/10 13:50:16 INFO mapred.JobClient: Map output records=20
Job Finished in 41.091 seconds
Estimated value of Pi is 3.20000000000000000000
页:
[1]