-
Notifications
You must be signed in to change notification settings - Fork 1
Expand file tree
/
Copy pathresults2NodesFirstRun
More file actions
192 lines (192 loc) · 8.57 KB
/
results2NodesFirstRun
File metadata and controls
192 lines (192 loc) · 8.57 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
14/11/29 13:05:45 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
14/11/29 13:05:45 INFO client.RMProxy: Connecting to ResourceManager at adelie-05.cs.wisc.edu/128.105.112.48:8032
14/11/29 13:05:45 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
14/11/29 13:05:46 INFO input.FileInputFormat: Total input paths to process : 4
14/11/29 13:05:46 INFO mapreduce.JobSubmitter: number of splits:93
14/11/29 13:05:46 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1417281389355_0004
14/11/29 13:05:46 INFO impl.YarnClientImpl: Submitted application application_1417281389355_0004
14/11/29 13:05:46 INFO mapreduce.Job: The url to track the job: http://adelie-05.cs.wisc.edu:8088/proxy/application_1417281389355_0004/
14/11/29 13:05:46 INFO mapreduce.Job: Running job: job_1417281389355_0004
14/11/29 13:05:52 INFO mapreduce.Job: Job job_1417281389355_0004 running in uber mode : false
14/11/29 13:05:52 INFO mapreduce.Job: map 0% reduce 0%
14/11/29 13:06:05 INFO mapreduce.Job: map 1% reduce 0%
14/11/29 13:06:06 INFO mapreduce.Job: map 2% reduce 0%
14/11/29 13:06:07 INFO mapreduce.Job: map 4% reduce 0%
14/11/29 13:06:08 INFO mapreduce.Job: map 5% reduce 0%
14/11/29 13:06:10 INFO mapreduce.Job: map 7% reduce 0%
14/11/29 13:06:11 INFO mapreduce.Job: map 10% reduce 0%
14/11/29 13:06:13 INFO mapreduce.Job: map 12% reduce 0%
14/11/29 13:06:14 INFO mapreduce.Job: map 15% reduce 0%
14/11/29 13:06:22 INFO mapreduce.Job: map 16% reduce 0%
14/11/29 13:06:24 INFO mapreduce.Job: map 17% reduce 0%
14/11/29 13:06:26 INFO mapreduce.Job: map 18% reduce 0%
14/11/29 13:06:27 INFO mapreduce.Job: map 20% reduce 0%
14/11/29 13:06:28 INFO mapreduce.Job: map 22% reduce 0%
14/11/29 13:06:29 INFO mapreduce.Job: map 23% reduce 0%
14/11/29 13:06:30 INFO mapreduce.Job: map 25% reduce 6%
14/11/29 13:06:33 INFO mapreduce.Job: map 28% reduce 7%
14/11/29 13:06:34 INFO mapreduce.Job: map 29% reduce 7%
14/11/29 13:06:36 INFO mapreduce.Job: map 29% reduce 10%
14/11/29 13:06:39 INFO mapreduce.Job: map 30% reduce 10%
14/11/29 13:06:42 INFO mapreduce.Job: map 31% reduce 10%
14/11/29 13:06:44 INFO mapreduce.Job: map 33% reduce 10%
14/11/29 13:06:45 INFO mapreduce.Job: map 34% reduce 10%
14/11/29 13:06:46 INFO mapreduce.Job: map 36% reduce 10%
14/11/29 13:06:47 INFO mapreduce.Job: map 38% reduce 10%
14/11/29 13:06:48 INFO mapreduce.Job: map 38% reduce 12%
14/11/29 13:06:49 INFO mapreduce.Job: map 39% reduce 12%
14/11/29 13:06:50 INFO mapreduce.Job: map 41% reduce 12%
14/11/29 13:06:51 INFO mapreduce.Job: map 41% reduce 13%
14/11/29 13:06:52 INFO mapreduce.Job: map 43% reduce 13%
14/11/29 13:06:54 INFO mapreduce.Job: map 43% reduce 14%
14/11/29 13:06:57 INFO mapreduce.Job: map 44% reduce 14%
14/11/29 13:06:59 INFO mapreduce.Job: map 45% reduce 14%
14/11/29 13:07:02 INFO mapreduce.Job: map 46% reduce 14%
14/11/29 13:07:03 INFO mapreduce.Job: map 47% reduce 14%
14/11/29 13:07:04 INFO mapreduce.Job: map 49% reduce 14%
14/11/29 13:07:05 INFO mapreduce.Job: map 51% reduce 14%
14/11/29 13:07:06 INFO mapreduce.Job: map 52% reduce 14%
14/11/29 13:07:07 INFO mapreduce.Job: map 52% reduce 16%
14/11/29 13:07:08 INFO mapreduce.Job: map 54% reduce 16%
14/11/29 13:07:09 INFO mapreduce.Job: map 55% reduce 16%
14/11/29 13:07:10 INFO mapreduce.Job: map 55% reduce 18%
14/11/29 13:07:11 INFO mapreduce.Job: map 57% reduce 18%
14/11/29 13:07:13 INFO mapreduce.Job: map 57% reduce 19%
14/11/29 13:07:15 INFO mapreduce.Job: map 58% reduce 19%
14/11/29 13:07:18 INFO mapreduce.Job: map 60% reduce 19%
14/11/29 13:07:20 INFO mapreduce.Job: map 61% reduce 19%
14/11/29 13:07:21 INFO mapreduce.Job: map 62% reduce 19%
14/11/29 13:07:22 INFO mapreduce.Job: map 63% reduce 20%
14/11/29 13:07:23 INFO mapreduce.Job: map 65% reduce 20%
14/11/29 13:07:24 INFO mapreduce.Job: map 67% reduce 20%
14/11/29 13:07:25 INFO mapreduce.Job: map 67% reduce 22%
14/11/29 13:07:26 INFO mapreduce.Job: map 68% reduce 22%
14/11/29 13:07:27 INFO mapreduce.Job: map 69% reduce 22%
14/11/29 13:07:28 INFO mapreduce.Job: map 70% reduce 22%
14/11/29 13:07:31 INFO mapreduce.Job: map 70% reduce 23%
14/11/29 13:07:32 INFO mapreduce.Job: map 71% reduce 23%
14/11/29 13:07:33 INFO mapreduce.Job: map 72% reduce 23%
14/11/29 13:07:34 INFO mapreduce.Job: map 72% reduce 24%
14/11/29 13:07:35 INFO mapreduce.Job: map 73% reduce 24%
14/11/29 13:07:36 INFO mapreduce.Job: map 74% reduce 24%
14/11/29 13:07:38 INFO mapreduce.Job: map 75% reduce 24%
14/11/29 13:07:39 INFO mapreduce.Job: map 77% reduce 24%
14/11/29 13:07:40 INFO mapreduce.Job: map 79% reduce 24%
14/11/29 13:07:41 INFO mapreduce.Job: map 80% reduce 24%
14/11/29 13:07:42 INFO mapreduce.Job: map 81% reduce 24%
14/11/29 13:07:43 INFO mapreduce.Job: map 81% reduce 26%
14/11/29 13:07:44 INFO mapreduce.Job: map 82% reduce 26%
14/11/29 13:07:45 INFO mapreduce.Job: map 83% reduce 26%
14/11/29 13:07:46 INFO mapreduce.Job: map 84% reduce 27%
14/11/29 13:07:49 INFO mapreduce.Job: map 85% reduce 28%
14/11/29 13:07:51 INFO mapreduce.Job: map 86% reduce 28%
14/11/29 13:07:53 INFO mapreduce.Job: map 87% reduce 28%
14/11/29 13:07:54 INFO mapreduce.Job: map 88% reduce 28%
14/11/29 13:07:55 INFO mapreduce.Job: map 89% reduce 29%
14/11/29 13:07:56 INFO mapreduce.Job: map 91% reduce 29%
14/11/29 13:07:57 INFO mapreduce.Job: map 92% reduce 29%
14/11/29 13:07:58 INFO mapreduce.Job: map 93% reduce 29%
14/11/29 13:07:59 INFO mapreduce.Job: map 95% reduce 30%
14/11/29 13:08:00 INFO mapreduce.Job: map 96% reduce 30%
14/11/29 13:08:01 INFO mapreduce.Job: map 98% reduce 30%
14/11/29 13:08:02 INFO mapreduce.Job: map 100% reduce 32%
14/11/29 13:08:03 INFO mapreduce.Job: map 100% reduce 100%
14/11/29 13:08:03 INFO mapreduce.Job: Job job_1417281389355_0004 completed successfully
14/11/29 13:08:03 INFO mapreduce.Job: Counters: 84
File System Counters
FILE: Number of bytes read=71678
FILE: Number of bytes written=9238718
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=12241334131
HDFS: Number of bytes written=6584
HDFS: Number of read operations=282
HDFS: Number of large read operations=0
HDFS: Number of write operations=2
Job Counters
Killed map tasks=1
Launched map tasks=94
Launched reduce tasks=1
Data-local map tasks=94
Total time spent by all maps in occupied slots (ms)=1563513
Total time spent by all reduces in occupied slots (ms)=106197
Total time spent by all map tasks (ms)=1563513
Total time spent by all reduce tasks (ms)=106197
Total vcore-seconds taken by all map tasks=1563513
Total vcore-seconds taken by all reduce tasks=106197
Total megabyte-seconds taken by all map tasks=1601037312
Total megabyte-seconds taken by all reduce tasks=108745728
Map-Reduce Framework
Map input records=99297257
Map output records=623250
Map output bytes=13606760
Map output materialized bytes=72230
Input split bytes=12883
Combine input records=623250
Combine output records=2918
Reduce input groups=293
Reduce shuffle bytes=72230
Reduce input records=2918
Reduce output records=293
Spilled Records=5836
Shuffled Maps =93
Failed Shuffles=0
Merged Map outputs=93
GC time elapsed (ms)=28494
CPU time spent (ms)=521100
Physical memory (bytes) snapshot=25201291264
Virtual memory (bytes) snapshot=92739047424
Total committed heap usage (bytes)=19560136704
MapCount
galapagos-39.cs.wisc.edu=92511418
galapagos-40.cs.wisc.edu=106083057
MapDuration
galapagos-39.cs.wisc.edu=214147
galapagos-40.cs.wisc.edu=256134
MapLineCount
galapagos-39.cs.wisc.edu=46255707
galapagos-40.cs.wisc.edu=53041547
ReduceCount
galapagos-39.cs.wisc.edu=1312
galapagos-40.cs.wisc.edu=1899
ReduceDuration
galapagos-39.cs.wisc.edu=2796
galapagos-40.cs.wisc.edu=3399
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
TotalTechWordCount
Fri Nov 14=22275
Fri Nov 21=56119
Mon Nov 17=2892
Mon Nov 24=101281
Sat Nov 15=528
Sat Nov 22=103353
Sun Nov 23=106799
Thu Nov 13=59682
Thu Nov 20=16258
Tue Nov 18=43777
Tue Nov 25=92967
Wed Nov 19=17319
TotalWordCount
Fri Nov 14=63884723
Fri Nov 21=188674779
Mon Nov 17=7838438
Mon Nov 24=349935981
Sat Nov 15=1854964
Sat Nov 22=331033618
Sun Nov 23=343899429
Thu Nov 13=178321131
Thu Nov 20=58215162
Tue Nov 18=138238376
Tue Nov 25=277807648
Wed Nov 19=54568860
File Input Format Counters
Bytes Read=12241321248
File Output Format Counters
Bytes Written=6584