2015-04-13 19:02:14,427 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-04-13 19:02:14,436 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: net.topology.script.file.name;  Ignoring.
2015-04-13 19:02:14,454 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: yarn.nodemanager.log-dirs;  Ignoring.
2015-04-13 19:02:14,517 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: yarn.nodemanager.local-dirs;  Ignoring.
2015-04-13 19:02:14,518 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: yarn.nodemanager.linux-container-executor.group;  Ignoring.
2015-04-13 19:02:14,531 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: yarn.nodemanager.container-executor.class;  Ignoring.
2015-04-13 19:02:14,532 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-04-13 19:02:14,533 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.jobhistory.webapp.address;  Ignoring.
2015-04-13 19:02:15,533 INFO [main] org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
2015-04-13 19:02:15,753 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
2015-04-13 19:02:15,759 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ReduceTask metrics system started
2015-04-13 19:02:15,777 INFO [main] org.apache.hadoop.mapred.YarnChild: Executing with tokens:
2015-04-13 19:02:15,777 INFO [main] org.apache.hadoop.mapred.YarnChild: Kind: mapreduce.job, Service: job_1426279437401_714565, Ident: (org.apache.hadoop.mapreduce.security.token.JobTokenIdentifier@5a8e261b)
2015-04-13 19:02:15,939 INFO [main] org.apache.hadoop.mapred.YarnChild: Sleeping for 0ms before retrying again. Got null now.
2015-04-13 19:02:16,442 INFO [main] org.apache.hadoop.mapred.YarnChild: mapreduce.cluster.local.dir for child: /hadoop/1/scratch/local/usercache/b_pulsar_coe/appcache/application_1426279437401_714565,/hadoop/2/scratch/local/usercache/b_pulsar_coe/appcache/application_1426279437401_714565,/hadoop/3/scratch/local/usercache/b_pulsar_coe/appcache/application_1426279437401_714565,/hadoop/4/scratch/local/usercache/b_pulsar_coe/appcache/application_1426279437401_714565,/hadoop/5/scratch/local/usercache/b_pulsar_coe/appcache/application_1426279437401_714565,/hadoop/6/scratch/local/usercache/b_pulsar_coe/appcache/application_1426279437401_714565,/hadoop/7/scratch/local/usercache/b_pulsar_coe/appcache/application_1426279437401_714565,/hadoop/8/scratch/local/usercache/b_pulsar_coe/appcache/application_1426279437401_714565
2015-04-13 19:02:16,664 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: hadoop.security.authentication;  Ignoring.
2015-04-13 19:02:16,665 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
2015-04-13 19:02:16,666 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: net.topology.script.file.name;  Ignoring.
2015-04-13 19:02:16,667 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: dfs.namenode.checkpoint.dir;  Ignoring.
2015-04-13 19:02:16,668 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: yarn.nodemanager.log-dirs;  Ignoring.
2015-04-13 19:02:16,670 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: dfs.namenode.name.dir;  Ignoring.
2015-04-13 19:02:16,673 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: yarn.nodemanager.local-dirs;  Ignoring.
2015-04-13 19:02:16,673 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: yarn.nodemanager.linux-container-executor.group;  Ignoring.
2015-04-13 19:02:16,673 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: yarn.nodemanager.container-executor.class;  Ignoring.
2015-04-13 19:02:16,674 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
2015-04-13 19:02:16,674 WARN [main] org.apache.hadoop.conf.Configuration: job.xml:an attempt to override final parameter: mapreduce.jobhistory.webapp.address;  Ignoring.
2015-04-13 19:02:17,397 INFO [main] org.apache.hadoop.conf.Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
2015-04-13 19:02:18,231 INFO [main] org.apache.hadoop.mapred.Task:  Using ResourceCalculatorProcessTree : [ ]
2015-04-13 19:02:18,616 INFO [main] com.hadoop.compression.lzo.GPLNativeCodeLoader: Loaded native gpl library
2015-04-13 19:02:18,627 INFO [main] com.hadoop.compression.lzo.LzoCodec: Successfully loaded & initialized native-lzo library [hadoop-lzo rev dbd51f0fb61f5347228a7a23fe0765ac1242fcdf]
2015-04-13 19:02:18,634 INFO [main] org.apache.hadoop.mapred.ReduceTask: Using ShuffleConsumerPlugin: org.apache.hadoop.mapreduce.task.reduce.Shuffle@6fd134fc
2015-04-13 19:02:18,672 INFO [main] org.apache.hadoop.conf.Configuration.deprecation: slave.host.name is deprecated. Instead, use mapreduce.tasktracker.host.name
2015-04-13 19:02:18,820 INFO [main] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: MergerManager: memoryLimit=1073741824, maxSingleShuffleLimit=268435456, mergeThreshold=708669632, ioSortFactor=100, memToMemMergeOutputsThreshold=100
2015-04-13 19:02:18,837 INFO [EventFetcher for fetching Map Completion Events] org.apache.hadoop.mapreduce.task.reduce.EventFetcher: attempt_1426279437401_714565_r_000318_0 Thread started: EventFetcher for fetching Map Completion Events
2015-04-13 19:02:18,890 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0264.stratus.lvs.ebay.com:13562 with 1 to fetcher#9
2015-04-13 19:02:18,891 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0264.stratus.lvs.ebay.com:13562 to fetcher#9
2015-04-13 19:02:18,891 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0429.stratus.lvs.ebay.com:13562 with 1 to fetcher#8
2015-04-13 19:02:18,898 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0429.stratus.lvs.ebay.com:13562 to fetcher#8
2015-04-13 19:02:18,912 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0324.stratus.lvs.ebay.com:13562 with 1 to fetcher#12
2015-04-13 19:02:18,912 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0324.stratus.lvs.ebay.com:13562 to fetcher#12
2015-04-13 19:02:18,912 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0504.stratus.lvs.ebay.com:13562 with 1 to fetcher#1
2015-04-13 19:02:18,912 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0504.stratus.lvs.ebay.com:13562 to fetcher#1
2015-04-13 19:02:18,913 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0584.stratus.lvs.ebay.com:13562 with 1 to fetcher#2
2015-04-13 19:02:18,913 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0584.stratus.lvs.ebay.com:13562 to fetcher#2
2015-04-13 19:02:18,913 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0574.stratus.lvs.ebay.com:13562 with 1 to fetcher#3
2015-04-13 19:02:18,913 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0574.stratus.lvs.ebay.com:13562 to fetcher#3
2015-04-13 19:02:18,913 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0725.stratus.lvs.ebay.com:13562 with 1 to fetcher#4
2015-04-13 19:02:18,913 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0725.stratus.lvs.ebay.com:13562 to fetcher#4
2015-04-13 19:02:18,913 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 with 1 to fetcher#5
2015-04-13 19:02:18,914 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 to fetcher#5
2015-04-13 19:02:18,914 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0458.stratus.lvs.ebay.com:13562 with 2 to fetcher#6
2015-04-13 19:02:18,914 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0458.stratus.lvs.ebay.com:13562 to fetcher#6
2015-04-13 19:02:18,914 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0699.stratus.lvs.ebay.com:13562 with 1 to fetcher#7
2015-04-13 19:02:18,914 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0699.stratus.lvs.ebay.com:13562 to fetcher#7
2015-04-13 19:02:18,937 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0448.stratus.lvs.ebay.com:13562 with 1 to fetcher#10
2015-04-13 19:02:18,937 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0108.stratus.lvs.ebay.com:13562 with 1 to fetcher#11
2015-04-13 19:02:18,937 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0448.stratus.lvs.ebay.com:13562 to fetcher#10
2015-04-13 19:02:18,938 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0163.stratus.lvs.ebay.com:13562 with 1 to fetcher#15
2015-04-13 19:02:18,938 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0163.stratus.lvs.ebay.com:13562 to fetcher#15
2015-04-13 19:02:18,938 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0202.stratus.lvs.ebay.com:13562 with 1 to fetcher#14
2015-04-13 19:02:18,938 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0202.stratus.lvs.ebay.com:13562 to fetcher#14
2015-04-13 19:02:18,938 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0669.stratus.lvs.ebay.com:13562 with 1 to fetcher#13
2015-04-13 19:02:18,938 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0669.stratus.lvs.ebay.com:13562 to fetcher#13
2015-04-13 19:02:18,938 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0108.stratus.lvs.ebay.com:13562 to fetcher#11
2015-04-13 19:02:18,950 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0358.stratus.lvs.ebay.com:13562 with 2 to fetcher#16
2015-04-13 19:02:18,951 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0358.stratus.lvs.ebay.com:13562 to fetcher#16
2015-04-13 19:02:18,959 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0698.stratus.lvs.ebay.com:13562 with 1 to fetcher#17
2015-04-13 19:02:18,960 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0698.stratus.lvs.ebay.com:13562 to fetcher#17
2015-04-13 19:02:18,975 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0234.stratus.lvs.ebay.com:13562 with 2 to fetcher#18
2015-04-13 19:02:18,975 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0234.stratus.lvs.ebay.com:13562 to fetcher#18
2015-04-13 19:02:18,976 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0243.stratus.lvs.ebay.com:13562 with 2 to fetcher#19
2015-04-13 19:02:18,976 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0243.stratus.lvs.ebay.com:13562 to fetcher#19
2015-04-13 19:02:18,991 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0683.stratus.lvs.ebay.com:13562 with 3 to fetcher#20
2015-04-13 19:02:18,992 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0683.stratus.lvs.ebay.com:13562 to fetcher#20
2015-04-13 19:02:19,002 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0762.stratus.lvs.ebay.com:13562 with 5 to fetcher#21
2015-04-13 19:02:19,003 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0762.stratus.lvs.ebay.com:13562 to fetcher#21
2015-04-13 19:02:19,017 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0457.stratus.lvs.ebay.com:13562 with 2 to fetcher#22
2015-04-13 19:02:19,017 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0457.stratus.lvs.ebay.com:13562 to fetcher#22
2015-04-13 19:02:19,029 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0162.stratus.lvs.ebay.com:13562 with 4 to fetcher#23
2015-04-13 19:02:19,029 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0162.stratus.lvs.ebay.com:13562 to fetcher#23
2015-04-13 19:02:19,149 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0135.stratus.lvs.ebay.com:13562 with 1 to fetcher#24
2015-04-13 19:02:19,149 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0135.stratus.lvs.ebay.com:13562 to fetcher#24
2015-04-13 19:02:19,160 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0226.stratus.lvs.ebay.com:13562 with 3 to fetcher#25
2015-04-13 19:02:19,160 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0226.stratus.lvs.ebay.com:13562 to fetcher#25
2015-04-13 19:02:19,172 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0582.stratus.lvs.ebay.com:13562 with 2 to fetcher#26
2015-04-13 19:02:19,172 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0582.stratus.lvs.ebay.com:13562 to fetcher#26
2015-04-13 19:02:19,183 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0365.stratus.lvs.ebay.com:13562 with 2 to fetcher#27
2015-04-13 19:02:19,183 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0365.stratus.lvs.ebay.com:13562 to fetcher#27
2015-04-13 19:02:19,191 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0456.stratus.lvs.ebay.com:13562 with 1 to fetcher#28
2015-04-13 19:02:19,192 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0456.stratus.lvs.ebay.com:13562 to fetcher#28
2015-04-13 19:02:19,195 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0394.stratus.lvs.ebay.com:13562 with 3 to fetcher#29
2015-04-13 19:02:19,195 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0394.stratus.lvs.ebay.com:13562 to fetcher#29
2015-04-13 19:02:19,205 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0569.stratus.lvs.ebay.com:13562 with 4 to fetcher#31
2015-04-13 19:02:19,206 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0569.stratus.lvs.ebay.com:13562 to fetcher#31
2015-04-13 19:02:19,207 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0511.stratus.lvs.ebay.com:13562 with 4 to fetcher#30
2015-04-13 19:02:19,207 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0511.stratus.lvs.ebay.com:13562 to fetcher#30
2015-04-13 19:02:19,217 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0111.stratus.lvs.ebay.com:13562 with 1 to fetcher#32
2015-04-13 19:02:19,217 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0111.stratus.lvs.ebay.com:13562 to fetcher#32
2015-04-13 19:02:19,226 INFO [EventFetcher for fetching Map Completion Events] org.apache.hadoop.mapreduce.task.reduce.EventFetcher: attempt_1426279437401_714565_r_000318_0: Got 571 new map-outputs
2015-04-13 19:02:19,232 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0321.stratus.lvs.ebay.com:13562 with 1 to fetcher#33
2015-04-13 19:02:19,232 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0321.stratus.lvs.ebay.com:13562 to fetcher#33
2015-04-13 19:02:19,249 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0668.stratus.lvs.ebay.com:13562 with 1 to fetcher#34
2015-04-13 19:02:19,268 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0668.stratus.lvs.ebay.com:13562 to fetcher#34
2015-04-13 19:02:19,274 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0303.stratus.lvs.ebay.com:13562 with 5 to fetcher#35
2015-04-13 19:02:19,275 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0303.stratus.lvs.ebay.com:13562 to fetcher#35
2015-04-13 19:02:19,275 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0553.stratus.lvs.ebay.com:13562 with 3 to fetcher#36
2015-04-13 19:02:19,275 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0553.stratus.lvs.ebay.com:13562 to fetcher#36
2015-04-13 19:02:19,472 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000477_0 sent hash and received reply
2015-04-13 19:02:19,472 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000441_0 sent hash and received reply
2015-04-13 19:02:19,473 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000379_0,attempt_1426279437401_714565_m_000380_0,attempt_1426279437401_714565_m_000235_0 sent hash and received reply
2015-04-13 19:02:19,472 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000570_0 sent hash and received reply
2015-04-13 19:02:19,473 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000255_0 sent hash and received reply
2015-04-13 19:02:19,474 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000305_0,attempt_1426279437401_714565_m_000249_0,attempt_1426279437401_714565_m_000421_0,attempt_1426279437401_714565_m_000289_0 sent hash and received reply
2015-04-13 19:02:19,474 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000569_0 sent hash and received reply
2015-04-13 19:02:19,474 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000563_0 sent hash and received reply
2015-04-13 19:02:19,475 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000547_0 sent hash and received reply
2015-04-13 19:02:19,476 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000523_0 sent hash and received reply
2015-04-13 19:02:19,477 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000565_0 sent hash and received reply
2015-04-13 19:02:19,478 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000409_0,attempt_1426279437401_714565_m_000428_0,attempt_1426279437401_714565_m_000226_0,attempt_1426279437401_714565_m_000208_0,attempt_1426279437401_714565_m_000131_0 sent hash and received reply
2015-04-13 19:02:19,479 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000375_0,attempt_1426279437401_714565_m_000347_0,attempt_1426279437401_714565_m_000418_0,attempt_1426279437401_714565_m_000403_0 sent hash and received reply
2015-04-13 19:02:19,483 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000557_0 sent hash and received reply
2015-04-13 19:02:19,483 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000564_0 sent hash and received reply
2015-04-13 19:02:19,486 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000492_0,attempt_1426279437401_714565_m_000506_0 sent hash and received reply
2015-04-13 19:02:19,486 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000541_0,attempt_1426279437401_714565_m_000548_0 sent hash and received reply
2015-04-13 19:02:19,486 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000552_0,attempt_1426279437401_714565_m_000538_0 sent hash and received reply
2015-04-13 19:02:19,487 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000568_0 sent hash and received reply
2015-04-13 19:02:19,487 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000395_0,attempt_1426279437401_714565_m_000287_0,attempt_1426279437401_714565_m_000332_0,attempt_1426279437401_714565_m_000410_0,attempt_1426279437401_714565_m_000173_0 sent hash and received reply
2015-04-13 19:02:19,488 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000442_0 sent hash and received reply
2015-04-13 19:02:19,489 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000539_0,attempt_1426279437401_714565_m_000360_0 sent hash and received reply
2015-04-13 19:02:19,489 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000536_0 sent hash and received reply
2015-04-13 19:02:19,491 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000419_0,attempt_1426279437401_714565_m_000390_0,attempt_1426279437401_714565_m_000359_0 sent hash and received reply
2015-04-13 19:02:19,491 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000522_0 sent hash and received reply
2015-04-13 19:02:19,491 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000566_0 sent hash and received reply
2015-04-13 19:02:19,495 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000555_0,attempt_1426279437401_714565_m_000314_0 sent hash and received reply
2015-04-13 19:02:19,497 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000482_0,attempt_1426279437401_714565_m_000338_0,attempt_1426279437401_714565_m_000301_0 sent hash and received reply
2015-04-13 19:02:19,498 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000405_0 sent hash and received reply
2015-04-13 19:02:19,498 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000550_0 sent hash and received reply
2015-04-13 19:02:19,499 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000214_0,attempt_1426279437401_714565_m_000062_0 sent hash and received reply
2015-04-13 19:02:19,500 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000182_0,attempt_1426279437401_714565_m_000126_0 sent hash and received reply
2015-04-13 19:02:19,500 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000562_0 sent hash and received reply
2015-04-13 19:02:19,501 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000381_0 sent hash and received reply
2015-04-13 19:02:19,503 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000546_0,attempt_1426279437401_714565_m_000543_0,attempt_1426279437401_714565_m_000456_0,attempt_1426279437401_714565_m_000230_0 sent hash and received reply
2015-04-13 19:02:19,514 INFO [fetcher#23] org.apache.hadoop.conf.Configuration.deprecation: hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-04-13 19:02:19,520 INFO [fetcher#23] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,543 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000375_0 decomp: 7563311 len: 2249816 to MEMORY
2015-04-13 19:02:19,547 INFO [fetcher#30] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,547 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 about to shuffle output of map attempt_1426279437401_714565_m_000546_0 decomp: 6816133 len: 2420651 to MEMORY
2015-04-13 19:02:19,550 INFO [fetcher#33] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,551 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 about to shuffle output of map attempt_1426279437401_714565_m_000381_0 decomp: 12640224 len: 4425772 to MEMORY
2015-04-13 19:02:19,551 INFO [fetcher#14] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,551 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 about to shuffle output of map attempt_1426279437401_714565_m_000562_0 decomp: 136794 len: 60244 to MEMORY
2015-04-13 19:02:19,554 INFO [fetcher#26] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,555 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 about to shuffle output of map attempt_1426279437401_714565_m_000182_0 decomp: 10031492 len: 2774812 to MEMORY
2015-04-13 19:02:19,558 INFO [fetcher#27] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,558 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 about to shuffle output of map attempt_1426279437401_714565_m_000214_0 decomp: 12730880 len: 4476647 to MEMORY
2015-04-13 19:02:19,562 INFO [fetcher#1] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,563 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle output of map attempt_1426279437401_714565_m_000550_0 decomp: 4550162 len: 1650487 to MEMORY
2015-04-13 19:02:19,569 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 136794 bytes from map-output for attempt_1426279437401_714565_m_000562_0
2015-04-13 19:02:19,570 INFO [fetcher#17] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,575 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 about to shuffle output of map attempt_1426279437401_714565_m_000405_0 decomp: 7409282 len: 2313191 to MEMORY
2015-04-13 19:02:19,575 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#36 about to shuffle output of map attempt_1426279437401_714565_m_000482_0 decomp: 6556769 len: 2365450 to MEMORY
2015-04-13 19:02:19,595 INFO [fetcher#22] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,595 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#22 about to shuffle output of map attempt_1426279437401_714565_m_000555_0 decomp: 5653103 len: 1867345 to MEMORY
2015-04-13 19:02:19,596 INFO [fetcher#8] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,596 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 about to shuffle output of map attempt_1426279437401_714565_m_000566_0 decomp: 136961 len: 19888 to MEMORY
2015-04-13 19:02:19,597 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 136961 bytes from map-output for attempt_1426279437401_714565_m_000566_0
2015-04-13 19:02:19,610 INFO [fetcher#10] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,610 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#10 about to shuffle output of map attempt_1426279437401_714565_m_000522_0 decomp: 6564641 len: 1870814 to MEMORY
2015-04-13 19:02:19,611 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 about to shuffle output of map attempt_1426279437401_714565_m_000419_0 decomp: 9523959 len: 2945106 to MEMORY
2015-04-13 19:02:19,615 INFO [fetcher#4] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,637 INFO [fetcher#16] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,637 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 about to shuffle output of map attempt_1426279437401_714565_m_000539_0 decomp: 5320049 len: 1700994 to MEMORY
2015-04-13 19:02:19,639 INFO [fetcher#28] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,640 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 about to shuffle output of map attempt_1426279437401_714565_m_000442_0 decomp: 6392645 len: 1952581 to MEMORY
2015-04-13 19:02:19,640 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#4 about to shuffle output of map attempt_1426279437401_714565_m_000536_0 decomp: 4950302 len: 1760931 to MEMORY
2015-04-13 19:02:19,642 INFO [fetcher#21] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,642 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000395_0 decomp: 8594313 len: 2311277 to MEMORY
2015-04-13 19:02:19,644 INFO [fetcher#2] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,644 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 about to shuffle output of map attempt_1426279437401_714565_m_000568_0 decomp: 139791 len: 20426 to MEMORY
2015-04-13 19:02:19,645 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 139791 bytes from map-output for attempt_1426279437401_714565_m_000568_0
2015-04-13 19:02:19,656 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 about to shuffle output of map attempt_1426279437401_714565_m_000379_0 decomp: 11024959 len: 3533532 to MEMORY
2015-04-13 19:02:19,675 INFO [fetcher#34] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,675 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 about to shuffle output of map attempt_1426279437401_714565_m_000255_0 decomp: 11461814 len: 3462322 to MEMORY
2015-04-13 19:02:19,675 INFO [fetcher#9] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,676 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#9 about to shuffle output of map attempt_1426279437401_714565_m_000570_0 decomp: 64833 len: 11367 to MEMORY
2015-04-13 19:02:19,676 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 64833 bytes from map-output for attempt_1426279437401_714565_m_000570_0
2015-04-13 19:02:19,683 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7409282 bytes from map-output for attempt_1426279437401_714565_m_000405_0
2015-04-13 19:02:19,686 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000320_0,attempt_1426279437401_714565_m_000232_0,attempt_1426279437401_714565_m_000167_0 sent hash and received reply
2015-04-13 19:02:19,686 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 about to shuffle output of map attempt_1426279437401_714565_m_000305_0 decomp: 9810575 len: 3213018 to MEMORY
2015-04-13 19:02:19,687 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 5653103 bytes from map-output for attempt_1426279437401_714565_m_000555_0
2015-04-13 19:02:19,696 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 about to shuffle output of map attempt_1426279437401_714565_m_000320_0 decomp: 9809506 len: 3181991 to MEMORY
2015-04-13 19:02:19,696 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7563311 bytes from map-output for attempt_1426279437401_714565_m_000375_0
2015-04-13 19:02:19,700 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 about to shuffle output of map attempt_1426279437401_714565_m_000552_0 decomp: 6269698 len: 2369771 to MEMORY
2015-04-13 19:02:19,704 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#6 about to shuffle output of map attempt_1426279437401_714565_m_000541_0 decomp: 3969959 len: 1390299 to MEMORY
2015-04-13 19:02:19,706 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6816133 bytes from map-output for attempt_1426279437401_714565_m_000546_0
2015-04-13 19:02:19,707 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6392645 bytes from map-output for attempt_1426279437401_714565_m_000442_0
2015-04-13 19:02:19,709 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10031492 bytes from map-output for attempt_1426279437401_714565_m_000182_0
2015-04-13 19:02:19,709 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 about to shuffle output of map attempt_1426279437401_714565_m_000492_0 decomp: 6710918 len: 2115065 to MEMORY
2015-04-13 19:02:19,722 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 4550162 bytes from map-output for attempt_1426279437401_714565_m_000550_0
2015-04-13 19:02:19,722 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6556769 bytes from map-output for attempt_1426279437401_714565_m_000482_0
2015-04-13 19:02:19,729 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#32 about to shuffle output of map attempt_1426279437401_714565_m_000477_0 decomp: 7460778 len: 2431555 to MEMORY
2015-04-13 19:02:19,729 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 about to shuffle output of map attempt_1426279437401_714565_m_000564_0 decomp: 172129 len: 27618 to MEMORY
2015-04-13 19:02:19,733 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#15 about to shuffle output of map attempt_1426279437401_714565_m_000557_0 decomp: 5618983 len: 2102119 to MEMORY
2015-04-13 19:02:19,734 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#12 about to shuffle output of map attempt_1426279437401_714565_m_000569_0 decomp: 76129 len: 36618 to MEMORY
2015-04-13 19:02:19,734 INFO [fetcher#3] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,734 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 about to shuffle output of map attempt_1426279437401_714565_m_000563_0 decomp: 185811 len: 29431 to MEMORY
2015-04-13 19:02:19,735 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 185811 bytes from map-output for attempt_1426279437401_714565_m_000563_0
2015-04-13 19:02:19,736 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 about to shuffle output of map attempt_1426279437401_714565_m_000547_0 decomp: 4239866 len: 1410033 to MEMORY
2015-04-13 19:02:19,742 INFO [fetcher#35] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,742 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 about to shuffle output of map attempt_1426279437401_714565_m_000409_0 decomp: 8622832 len: 3159783 to MEMORY
2015-04-13 19:02:19,744 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 5320049 bytes from map-output for attempt_1426279437401_714565_m_000539_0
2015-04-13 19:02:19,745 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 4950302 bytes from map-output for attempt_1426279437401_714565_m_000536_0
2015-04-13 19:02:19,757 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 about to shuffle output of map attempt_1426279437401_714565_m_000441_0 decomp: 10606105 len: 3988036 to MEMORY
2015-04-13 19:02:19,761 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 about to shuffle output of map attempt_1426279437401_714565_m_000523_0 decomp: 5701668 len: 1772396 to MEMORY
2015-04-13 19:02:19,762 INFO [fetcher#11] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:19,762 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#11 about to shuffle output of map attempt_1426279437401_714565_m_000565_0 decomp: 127223 len: 23309 to MEMORY
2015-04-13 19:02:19,763 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 127223 bytes from map-output for attempt_1426279437401_714565_m_000565_0
2015-04-13 19:02:19,764 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12730880 bytes from map-output for attempt_1426279437401_714565_m_000214_0
2015-04-13 19:02:19,766 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6564641 bytes from map-output for attempt_1426279437401_714565_m_000522_0
2015-04-13 19:02:19,770 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7460778 bytes from map-output for attempt_1426279437401_714565_m_000477_0
2015-04-13 19:02:19,784 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 76129 bytes from map-output for attempt_1426279437401_714565_m_000569_0
2015-04-13 19:02:19,786 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12640224 bytes from map-output for attempt_1426279437401_714565_m_000381_0
2015-04-13 19:02:19,762 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 136794, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->217644597
2015-04-13 19:02:19,800 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9523959 bytes from map-output for attempt_1426279437401_714565_m_000419_0
2015-04-13 19:02:19,807 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 172129 bytes from map-output for attempt_1426279437401_714565_m_000564_0
2015-04-13 19:02:19,808 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11461814 bytes from map-output for attempt_1426279437401_714565_m_000255_0
2015-04-13 19:02:19,813 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11461814, inMemoryMapOutputs.size() -> 2, commitMemory -> 136794, usedMemory ->217644597
2015-04-13 19:02:19,829 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0668.stratus.lvs.ebay.com:13562 freed by fetcher#34 in 561ms
2015-04-13 19:02:19,830 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0598.stratus.lvs.ebay.com:13562 with 1 to fetcher#34
2015-04-13 19:02:19,830 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0598.stratus.lvs.ebay.com:13562 to fetcher#34
2015-04-13 19:02:19,831 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 172129, inMemoryMapOutputs.size() -> 3, commitMemory -> 11598608, usedMemory ->217644597
2015-04-13 19:02:19,831 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 freed by fetcher#5 in 917ms
2015-04-13 19:02:19,832 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0037.stratus.lvs.ebay.com:13562 with 2 to fetcher#5
2015-04-13 19:02:19,832 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0037.stratus.lvs.ebay.com:13562 to fetcher#5
2015-04-13 19:02:19,834 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8594313 bytes from map-output for attempt_1426279437401_714565_m_000395_0
2015-04-13 19:02:19,834 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 3969959 bytes from map-output for attempt_1426279437401_714565_m_000541_0
2015-04-13 19:02:19,834 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8594313, inMemoryMapOutputs.size() -> 4, commitMemory -> 11770737, usedMemory ->217644597
2015-04-13 19:02:19,836 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000503_0,attempt_1426279437401_714565_m_000361_0 sent hash and received reply
2015-04-13 19:02:19,837 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000113_0 sent hash and received reply
2015-04-13 19:02:19,841 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 4239866 bytes from map-output for attempt_1426279437401_714565_m_000547_0
2015-04-13 19:02:19,846 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11024959 bytes from map-output for attempt_1426279437401_714565_m_000379_0
2015-04-13 19:02:19,846 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000287_0 decomp: 11118180 len: 3430146 to MEMORY
2015-04-13 19:02:19,848 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6269698 bytes from map-output for attempt_1426279437401_714565_m_000552_0
2015-04-13 19:02:19,848 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6710918 bytes from map-output for attempt_1426279437401_714565_m_000492_0
2015-04-13 19:02:19,851 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9523959, inMemoryMapOutputs.size() -> 5, commitMemory -> 20365050, usedMemory ->237114778
2015-04-13 19:02:19,852 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12640224, inMemoryMapOutputs.size() -> 6, commitMemory -> 29889009, usedMemory ->237114778
2015-04-13 19:02:19,851 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 about to shuffle output of map attempt_1426279437401_714565_m_000503_0 decomp: 8352001 len: 2912458 to MEMORY
2015-04-13 19:02:19,866 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 about to shuffle output of map attempt_1426279437401_714565_m_000390_0 decomp: 9790645 len: 3073007 to MEMORY
2015-04-13 19:02:19,870 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 5701668 bytes from map-output for attempt_1426279437401_714565_m_000523_0
2015-04-13 19:02:19,873 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 5618983 bytes from map-output for attempt_1426279437401_714565_m_000557_0
2015-04-13 19:02:19,874 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9810575 bytes from map-output for attempt_1426279437401_714565_m_000305_0
2015-04-13 19:02:19,875 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 76129, inMemoryMapOutputs.size() -> 7, commitMemory -> 42529233, usedMemory ->261265987
2015-04-13 19:02:19,875 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7460778, inMemoryMapOutputs.size() -> 8, commitMemory -> 42605362, usedMemory ->261265987
2015-04-13 19:02:19,876 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0111.stratus.lvs.ebay.com:13562 freed by fetcher#32 in 659ms
2015-04-13 19:02:19,876 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0275.stratus.lvs.ebay.com:13562 with 3 to fetcher#32
2015-04-13 19:02:19,876 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0275.stratus.lvs.ebay.com:13562 to fetcher#32
2015-04-13 19:02:19,877 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6564641, inMemoryMapOutputs.size() -> 9, commitMemory -> 50066140, usedMemory ->261265987
2015-04-13 19:02:19,878 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0448.stratus.lvs.ebay.com:13562 freed by fetcher#10 in 941ms
2015-04-13 19:02:19,878 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0238.stratus.lvs.ebay.com:13562 with 2 to fetcher#10
2015-04-13 19:02:19,878 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0238.stratus.lvs.ebay.com:13562 to fetcher#10
2015-04-13 19:02:19,879 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12730880, inMemoryMapOutputs.size() -> 10, commitMemory -> 56630781, usedMemory ->261265987
2015-04-13 19:02:19,879 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 127223, inMemoryMapOutputs.size() -> 11, commitMemory -> 69361661, usedMemory ->261265987
2015-04-13 19:02:19,875 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 about to shuffle output of map attempt_1426279437401_714565_m_000113_0 decomp: 14360564 len: 5115133 to MEMORY
2015-04-13 19:02:19,883 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000457_0,attempt_1426279437401_714565_m_000312_0 sent hash and received reply
2015-04-13 19:02:19,884 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000308_0,attempt_1426279437401_714565_m_000425_0,attempt_1426279437401_714565_m_000010_0 sent hash and received reply
2015-04-13 19:02:19,889 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8622832 bytes from map-output for attempt_1426279437401_714565_m_000409_0
2015-04-13 19:02:19,894 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 about to shuffle output of map attempt_1426279437401_714565_m_000062_0 decomp: 16907238 len: 5470590 to MEMORY
2015-04-13 19:02:19,905 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10606105 bytes from map-output for attempt_1426279437401_714565_m_000441_0
2015-04-13 19:02:19,909 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 4950302, inMemoryMapOutputs.size() -> 12, commitMemory -> 69488884, usedMemory ->297097465
2015-04-13 19:02:19,909 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#10 about to shuffle output of map attempt_1426279437401_714565_m_000457_0 decomp: 9888978 len: 3181041 to MEMORY
2015-04-13 19:02:19,909 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0725.stratus.lvs.ebay.com:13562 freed by fetcher#4 in 996ms
2015-04-13 19:02:19,909 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0704.stratus.lvs.ebay.com:13562 with 5 to fetcher#4
2015-04-13 19:02:19,909 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0704.stratus.lvs.ebay.com:13562 to fetcher#4
2015-04-13 19:02:19,910 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#32 about to shuffle output of map attempt_1426279437401_714565_m_000308_0 decomp: 9035262 len: 3163206 to MEMORY
2015-04-13 19:02:19,911 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 5320049, inMemoryMapOutputs.size() -> 13, commitMemory -> 74439186, usedMemory ->297097465
2015-04-13 19:02:19,918 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 185811, inMemoryMapOutputs.size() -> 14, commitMemory -> 79759235, usedMemory ->305222916
2015-04-13 19:02:19,918 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0574.stratus.lvs.ebay.com:13562 freed by fetcher#3 in 1005ms
2015-04-13 19:02:19,918 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0178.stratus.lvs.ebay.com:13562 with 3 to fetcher#3
2015-04-13 19:02:19,918 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0178.stratus.lvs.ebay.com:13562 to fetcher#3
2015-04-13 19:02:19,921 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000512_0,attempt_1426279437401_714565_m_000480_0,attempt_1426279437401_714565_m_000498_0,attempt_1426279437401_714565_m_000256_0,attempt_1426279437401_714565_m_000127_0 sent hash and received reply
2015-04-13 19:02:19,926 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6556769, inMemoryMapOutputs.size() -> 15, commitMemory -> 79945046, usedMemory ->311019655
2015-04-13 19:02:19,926 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 4550162, inMemoryMapOutputs.size() -> 16, commitMemory -> 86501815, usedMemory ->311019655
2015-04-13 19:02:19,926 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0504.stratus.lvs.ebay.com:13562 freed by fetcher#1 in 1014ms
2015-04-13 19:02:19,926 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0724.stratus.lvs.ebay.com:13562 with 2 to fetcher#1
2015-04-13 19:02:19,927 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0724.stratus.lvs.ebay.com:13562 to fetcher#1
2015-04-13 19:02:19,927 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 about to shuffle output of map attempt_1426279437401_714565_m_000360_0 decomp: 8125451 len: 2229835 to MEMORY
2015-04-13 19:02:19,926 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#4 about to shuffle output of map attempt_1426279437401_714565_m_000512_0 decomp: 5796739 len: 1465331 to MEMORY
2015-04-13 19:02:19,934 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000436_0,attempt_1426279437401_714565_m_000288_0,attempt_1426279437401_714565_m_000092_0 sent hash and received reply
2015-04-13 19:02:19,935 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10031492, inMemoryMapOutputs.size() -> 17, commitMemory -> 91051977, usedMemory ->321506195
2015-04-13 19:02:19,933 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#36 about to shuffle output of map attempt_1426279437401_714565_m_000338_0 decomp: 10486540 len: 3853929 to MEMORY
2015-04-13 19:02:19,930 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000150_0,attempt_1426279437401_714565_m_000302_0 sent hash and received reply
2015-04-13 19:02:19,927 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8352001 bytes from map-output for attempt_1426279437401_714565_m_000503_0
2015-04-13 19:02:19,950 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 about to shuffle output of map attempt_1426279437401_714565_m_000126_0 decomp: 12990002 len: 3740497 to MEMORY
2015-04-13 19:02:19,953 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6392645, inMemoryMapOutputs.size() -> 18, commitMemory -> 101083469, usedMemory ->343794414
2015-04-13 19:02:19,954 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6816133, inMemoryMapOutputs.size() -> 19, commitMemory -> 107476114, usedMemory ->343794414
2015-04-13 19:02:19,963 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 about to shuffle output of map attempt_1426279437401_714565_m_000436_0 decomp: 9298217 len: 3618550 to MEMORY
2015-04-13 19:02:20,037 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle output of map attempt_1426279437401_714565_m_000150_0 decomp: 13447717 len: 3876387 to MEMORY
2015-04-13 19:02:20,042 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7563311, inMemoryMapOutputs.size() -> 20, commitMemory -> 114292247, usedMemory ->363930466
2015-04-13 19:02:20,042 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 about to shuffle output of map attempt_1426279437401_714565_m_000543_0 decomp: 6688335 len: 2394355 to MEMORY
2015-04-13 19:02:20,042 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 5653103, inMemoryMapOutputs.size() -> 21, commitMemory -> 121855558, usedMemory ->363930466
2015-04-13 19:02:20,059 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7409282, inMemoryMapOutputs.size() -> 22, commitMemory -> 127508661, usedMemory ->373895559
2015-04-13 19:02:20,059 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000347_0 decomp: 9965093 len: 3252493 to MEMORY
2015-04-13 19:02:20,059 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 64833, inMemoryMapOutputs.size() -> 23, commitMemory -> 134917943, usedMemory ->373895559
2015-04-13 19:02:20,315 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#22 about to shuffle output of map attempt_1426279437401_714565_m_000314_0 decomp: 11606864 len: 3715085 to MEMORY
2015-04-13 19:02:20,317 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 139791, inMemoryMapOutputs.size() -> 24, commitMemory -> 134982776, usedMemory ->385502423
2015-04-13 19:02:20,318 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 136961, inMemoryMapOutputs.size() -> 25, commitMemory -> 135122567, usedMemory ->385502423
2015-04-13 19:02:20,318 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0429.stratus.lvs.ebay.com:13562 freed by fetcher#8 in 1420ms
2015-04-13 19:02:20,318 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0082.stratus.lvs.ebay.com:13562 with 3 to fetcher#8
2015-04-13 19:02:20,318 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0082.stratus.lvs.ebay.com:13562 to fetcher#8
2015-04-13 19:02:20,318 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0584.stratus.lvs.ebay.com:13562 freed by fetcher#2 in 1405ms
2015-04-13 19:02:20,318 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0003.stratus.lvs.ebay.com:13562 with 2 to fetcher#2
2015-04-13 19:02:20,319 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0003.stratus.lvs.ebay.com:13562 to fetcher#2
2015-04-13 19:02:20,319 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0264.stratus.lvs.ebay.com:13562 freed by fetcher#9 in 1428ms
2015-04-13 19:02:20,319 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0066.stratus.lvs.ebay.com:13562 with 3 to fetcher#9
2015-04-13 19:02:20,319 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0066.stratus.lvs.ebay.com:13562 to fetcher#9
2015-04-13 19:02:20,319 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0698.stratus.lvs.ebay.com:13562 freed by fetcher#17 in 1359ms
2015-04-13 19:02:20,319 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0065.stratus.lvs.ebay.com:13562 with 3 to fetcher#17
2015-04-13 19:02:20,319 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0065.stratus.lvs.ebay.com:13562 to fetcher#17
2015-04-13 19:02:20,320 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0456.stratus.lvs.ebay.com:13562 freed by fetcher#28 in 1128ms
2015-04-13 19:02:20,320 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0151.stratus.lvs.ebay.com:13562 with 1 to fetcher#28
2015-04-13 19:02:20,320 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0151.stratus.lvs.ebay.com:13562 to fetcher#28
2015-04-13 19:02:20,320 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8352001, inMemoryMapOutputs.size() -> 26, commitMemory -> 135259528, usedMemory ->385502423
2015-04-13 19:02:20,326 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000265_0,attempt_1426279437401_714565_m_000396_0,attempt_1426279437401_714565_m_000136_0 sent hash and received reply
2015-04-13 19:02:20,327 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11118180 bytes from map-output for attempt_1426279437401_714565_m_000287_0
2015-04-13 19:02:20,327 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 about to shuffle output of map attempt_1426279437401_714565_m_000361_0 decomp: 8193479 len: 2529736 to MEMORY
2015-04-13 19:02:20,331 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10606105, inMemoryMapOutputs.size() -> 27, commitMemory -> 143611529, usedMemory ->403095582
2015-04-13 19:02:20,331 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 about to shuffle output of map attempt_1426279437401_714565_m_000265_0 decomp: 9399680 len: 2930316 to MEMORY
2015-04-13 19:02:20,331 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0135.stratus.lvs.ebay.com:13562 freed by fetcher#24 in 1182ms
2015-04-13 19:02:20,331 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0671.stratus.lvs.ebay.com:13562 with 3 to fetcher#24
2015-04-13 19:02:20,331 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0671.stratus.lvs.ebay.com:13562 to fetcher#24
2015-04-13 19:02:20,333 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8622832, inMemoryMapOutputs.size() -> 28, commitMemory -> 154217634, usedMemory ->403095582
2015-04-13 19:02:20,333 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0108.stratus.lvs.ebay.com:13562 freed by fetcher#11 in 1396ms
2015-04-13 19:02:20,333 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0338.stratus.lvs.ebay.com:13562 with 2 to fetcher#11
2015-04-13 19:02:20,333 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0338.stratus.lvs.ebay.com:13562 to fetcher#11
2015-04-13 19:02:20,333 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0324.stratus.lvs.ebay.com:13562 freed by fetcher#12 in 1421ms
2015-04-13 19:02:20,333 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0452.stratus.lvs.ebay.com:13562 with 5 to fetcher#12
2015-04-13 19:02:20,333 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0452.stratus.lvs.ebay.com:13562 to fetcher#12
2015-04-13 19:02:20,335 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9810575, inMemoryMapOutputs.size() -> 29, commitMemory -> 162840466, usedMemory ->410313170
2015-04-13 19:02:20,337 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000069_0 sent hash and received reply
2015-04-13 19:02:20,338 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 about to shuffle output of map attempt_1426279437401_714565_m_000249_0 decomp: 9061688 len: 3184954 to MEMORY
2015-04-13 19:02:20,335 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 about to shuffle output of map attempt_1426279437401_714565_m_000428_0 decomp: 7217588 len: 2424601 to MEMORY
2015-04-13 19:02:20,339 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000509_0,attempt_1426279437401_714565_m_000426_0 sent hash and received reply
2015-04-13 19:02:20,341 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000205_0,attempt_1426279437401_714565_m_000108_0 sent hash and received reply
2015-04-13 19:02:20,342 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 about to shuffle output of map attempt_1426279437401_714565_m_000069_0 decomp: 14390802 len: 4750197 to MEMORY
2015-04-13 19:02:20,342 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000392_0,attempt_1426279437401_714565_m_000309_0,attempt_1426279437401_714565_m_000141_0,attempt_1426279437401_714565_m_000087_0,attempt_1426279437401_714565_m_000051_0 sent hash and received reply
2015-04-13 19:02:20,342 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000294_0,attempt_1426279437401_714565_m_000061_0,attempt_1426279437401_714565_m_000043_0 sent hash and received reply
2015-04-13 19:02:20,343 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000384_0,attempt_1426279437401_714565_m_000341_0,attempt_1426279437401_714565_m_000357_0 sent hash and received reply
2015-04-13 19:02:20,345 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#11 about to shuffle output of map attempt_1426279437401_714565_m_000205_0 decomp: 13769811 len: 4630328 to MEMORY
2015-04-13 19:02:20,348 INFO [fetcher#2] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:20,378 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 about to shuffle output of map attempt_1426279437401_714565_m_000509_0 decomp: 9460664 len: 3632548 to MEMORY
2015-04-13 19:02:20,381 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 5618983, inMemoryMapOutputs.size() -> 30, commitMemory -> 172651041, usedMemory ->456996135
2015-04-13 19:02:20,384 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 5796739 bytes from map-output for attempt_1426279437401_714565_m_000512_0
2015-04-13 19:02:20,384 INFO [fetcher#17] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:20,385 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 about to shuffle output of map attempt_1426279437401_714565_m_000384_0 decomp: 9183491 len: 3333397 to MEMORY
2015-04-13 19:02:20,393 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000420_0,attempt_1426279437401_714565_m_000281_0,attempt_1426279437401_714565_m_000155_0 sent hash and received reply
2015-04-13 19:02:20,396 INFO [fetcher#12] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:20,396 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#12 about to shuffle output of map attempt_1426279437401_714565_m_000392_0 decomp: 9371257 len: 3194492 to MEMORY
2015-04-13 19:02:20,397 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 about to shuffle output of map attempt_1426279437401_714565_m_000294_0 decomp: 10609709 len: 3279391 to MEMORY
2015-04-13 19:02:20,399 INFO [fetcher#9] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:20,399 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 5701668, inMemoryMapOutputs.size() -> 31, commitMemory -> 178270024, usedMemory ->492860525
2015-04-13 19:02:20,399 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#9 about to shuffle output of map attempt_1426279437401_714565_m_000420_0 decomp: 6699933 len: 2260411 to MEMORY
2015-04-13 19:02:20,399 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0321.stratus.lvs.ebay.com:13562 freed by fetcher#33 in 1167ms
2015-04-13 19:02:20,399 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0699.stratus.lvs.ebay.com:13562 freed by fetcher#7 in 1485ms
2015-04-13 19:02:20,399 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0606.stratus.lvs.ebay.com:13562 with 1 to fetcher#7
2015-04-13 19:02:20,400 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0606.stratus.lvs.ebay.com:13562 to fetcher#7
2015-04-13 19:02:20,400 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6710918, inMemoryMapOutputs.size() -> 32, commitMemory -> 183971692, usedMemory ->492860525
2015-04-13 19:02:20,403 INFO [fetcher#19] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:20,403 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 about to shuffle output of map attempt_1426279437401_714565_m_000506_0 decomp: 7825818 len: 2549952 to MEMORY
2015-04-13 19:02:20,405 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000238_0 sent hash and received reply
2015-04-13 19:02:20,409 INFO [fetcher#7] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:20,409 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6269698, inMemoryMapOutputs.size() -> 33, commitMemory -> 190682610, usedMemory ->510736455
2015-04-13 19:02:20,409 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11024959, inMemoryMapOutputs.size() -> 34, commitMemory -> 196952308, usedMemory ->510736455
2015-04-13 19:02:20,409 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 about to shuffle output of map attempt_1426279437401_714565_m_000238_0 decomp: 10050112 len: 2841848 to MEMORY
2015-04-13 19:02:20,411 INFO [fetcher#18] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:20,420 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 about to shuffle output of map attempt_1426279437401_714565_m_000538_0 decomp: 5712500 len: 2063877 to MEMORY
2015-04-13 19:02:20,431 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 4239866, inMemoryMapOutputs.size() -> 35, commitMemory -> 207977267, usedMemory ->516448955
2015-04-13 19:02:20,432 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0669.stratus.lvs.ebay.com:13562 freed by fetcher#13 in 1494ms
2015-04-13 19:02:20,432 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0108.stratus.lvs.ebay.com:13562 with 6 to fetcher#13
2015-04-13 19:02:20,432 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 6 of 6 to lvsdpehdc25dn0108.stratus.lvs.ebay.com:13562 to fetcher#13
2015-04-13 19:02:20,449 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9035262 bytes from map-output for attempt_1426279437401_714565_m_000308_0
2015-04-13 19:02:20,451 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 3969959, inMemoryMapOutputs.size() -> 36, commitMemory -> 212217133, usedMemory ->516448955
2015-04-13 19:02:20,453 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#6 about to shuffle output of map attempt_1426279437401_714565_m_000548_0 decomp: 4587474 len: 1332597 to MEMORY
2015-04-13 19:02:20,456 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9790645 bytes from map-output for attempt_1426279437401_714565_m_000390_0
2015-04-13 19:02:20,456 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9790645, inMemoryMapOutputs.size() -> 37, commitMemory -> 216187092, usedMemory ->521036429
2015-04-13 19:02:20,456 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0202.stratus.lvs.ebay.com:13562 freed by fetcher#14 in 1518ms
2015-04-13 19:02:20,456 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0444.stratus.lvs.ebay.com:13562 with 3 to fetcher#14
2015-04-13 19:02:20,456 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0444.stratus.lvs.ebay.com:13562 to fetcher#14
2015-04-13 19:02:20,459 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 about to shuffle output of map attempt_1426279437401_714565_m_000359_0 decomp: 9499919 len: 2433196 to MEMORY
2015-04-13 19:02:20,466 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000422_0,attempt_1426279437401_714565_m_000467_0,attempt_1426279437401_714565_m_000066_0 sent hash and received reply
2015-04-13 19:02:20,470 INFO [fetcher#14] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:20,470 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 about to shuffle output of map attempt_1426279437401_714565_m_000422_0 decomp: 9959450 len: 3489929 to MEMORY
2015-04-13 19:02:20,476 INFO [fetcher#29] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:20,476 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 about to shuffle output of map attempt_1426279437401_714565_m_000380_0 decomp: 11173741 len: 3832861 to MEMORY
2015-04-13 19:02:20,478 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8125451 bytes from map-output for attempt_1426279437401_714565_m_000360_0
2015-04-13 19:02:20,478 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8125451, inMemoryMapOutputs.size() -> 38, commitMemory -> 225977737, usedMemory ->551669539
2015-04-13 19:02:20,479 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0358.stratus.lvs.ebay.com:13562 freed by fetcher#16 in 1528ms
2015-04-13 19:02:20,479 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0008.stratus.lvs.ebay.com:13562 with 5 to fetcher#16
2015-04-13 19:02:20,479 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0008.stratus.lvs.ebay.com:13562 to fetcher#16
2015-04-13 19:02:20,482 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9035262, inMemoryMapOutputs.size() -> 39, commitMemory -> 234103188, usedMemory ->551669539
2015-04-13 19:02:20,482 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0353.stratus.lvs.ebay.com:13562 with 3 to fetcher#33
2015-04-13 19:02:20,483 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0353.stratus.lvs.ebay.com:13562 to fetcher#33
2015-04-13 19:02:20,486 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#32 about to shuffle output of map attempt_1426279437401_714565_m_000425_0 decomp: 9800878 len: 3808198 to MEMORY
2015-04-13 19:02:20,488 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8193479 bytes from map-output for attempt_1426279437401_714565_m_000361_0
2015-04-13 19:02:20,488 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8193479, inMemoryMapOutputs.size() -> 40, commitMemory -> 243138450, usedMemory ->561470417
2015-04-13 19:02:20,488 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0037.stratus.lvs.ebay.com:13562 freed by fetcher#5 in 656ms
2015-04-13 19:02:20,488 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 5796739, inMemoryMapOutputs.size() -> 41, commitMemory -> 251331929, usedMemory ->561470417
2015-04-13 19:02:20,489 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0163.stratus.lvs.ebay.com:13562 freed by fetcher#15 in 1551ms
2015-04-13 19:02:20,489 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0204.stratus.lvs.ebay.com:13562 with 2 to fetcher#15
2015-04-13 19:02:20,489 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0204.stratus.lvs.ebay.com:13562 to fetcher#15
2015-04-13 19:02:20,491 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11118180, inMemoryMapOutputs.size() -> 42, commitMemory -> 257128668, usedMemory ->571963906
2015-04-13 19:02:20,491 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#4 about to shuffle output of map attempt_1426279437401_714565_m_000480_0 decomp: 10493489 len: 3201429 to MEMORY
2015-04-13 19:02:20,492 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14360564 bytes from map-output for attempt_1426279437401_714565_m_000113_0
2015-04-13 19:02:20,494 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6688335 bytes from map-output for attempt_1426279437401_714565_m_000543_0
2015-04-13 19:02:20,495 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000332_0 decomp: 11214737 len: 3506614 to MEMORY
2015-04-13 19:02:20,495 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000323_0,attempt_1426279437401_714565_m_000139_0 sent hash and received reply
2015-04-13 19:02:20,495 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000519_0,attempt_1426279437401_714565_m_000370_0,attempt_1426279437401_714565_m_000304_0,attempt_1426279437401_714565_m_000349_0,attempt_1426279437401_714565_m_000401_0,attempt_1426279437401_714565_m_000016_0 sent hash and received reply
2015-04-13 19:02:20,498 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#15 about to shuffle output of map attempt_1426279437401_714565_m_000323_0 decomp: 10274409 len: 3360671 to MEMORY
2015-04-13 19:02:20,499 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000484_0,attempt_1426279437401_714565_m_000065_0,attempt_1426279437401_714565_m_000003_0 sent hash and received reply
2015-04-13 19:02:20,502 INFO [fetcher#33] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:20,502 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 about to shuffle output of map attempt_1426279437401_714565_m_000484_0 decomp: 7286761 len: 2346333 to MEMORY
2015-04-13 19:02:20,509 INFO [fetcher#13] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:20,509 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 about to shuffle output of map attempt_1426279437401_714565_m_000519_0 decomp: 9327522 len: 3210816 to MEMORY
2015-04-13 19:02:20,510 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14360564, inMemoryMapOutputs.size() -> 43, commitMemory -> 268246848, usedMemory ->610067335
2015-04-13 19:02:20,510 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0598.stratus.lvs.ebay.com:13562 freed by fetcher#34 in 680ms
2015-04-13 19:02:20,510 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0716.stratus.lvs.ebay.com:13562 with 1 to fetcher#34
2015-04-13 19:02:20,510 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0716.stratus.lvs.ebay.com:13562 to fetcher#34
2015-04-13 19:02:20,523 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0236.stratus.lvs.ebay.com:13562 with 2 to fetcher#5
2015-04-13 19:02:20,523 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0236.stratus.lvs.ebay.com:13562 to fetcher#5
2015-04-13 19:02:20,523 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000542_0,attempt_1426279437401_714565_m_000532_0,attempt_1426279437401_714565_m_000446_0,attempt_1426279437401_714565_m_000463_0,attempt_1426279437401_714565_m_000081_0 sent hash and received reply
2015-04-13 19:02:20,525 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000339_0 sent hash and received reply
2015-04-13 19:02:20,525 INFO [fetcher#16] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:20,526 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 about to shuffle output of map attempt_1426279437401_714565_m_000542_0 decomp: 5948131 len: 1737271 to MEMORY
2015-04-13 19:02:20,528 INFO [fetcher#34] org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor [.lzo_deflate]
2015-04-13 19:02:20,529 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 about to shuffle output of map attempt_1426279437401_714565_m_000339_0 decomp: 8650721 len: 2737399 to MEMORY
2015-04-13 19:02:20,530 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7217588 bytes from map-output for attempt_1426279437401_714565_m_000428_0
2015-04-13 19:02:20,532 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 5712500 bytes from map-output for attempt_1426279437401_714565_m_000538_0
2015-04-13 19:02:20,532 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6688335, inMemoryMapOutputs.size() -> 44, commitMemory -> 282607412, usedMemory ->624666187
2015-04-13 19:02:20,535 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 about to shuffle output of map attempt_1426279437401_714565_m_000456_0 decomp: 9884191 len: 3053267 to MEMORY
2015-04-13 19:02:20,552 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7825818 bytes from map-output for attempt_1426279437401_714565_m_000506_0
2015-04-13 19:02:20,552 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 4587474 bytes from map-output for attempt_1426279437401_714565_m_000548_0
2015-04-13 19:02:20,559 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9888978 bytes from map-output for attempt_1426279437401_714565_m_000457_0
2015-04-13 19:02:20,565 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11606864 bytes from map-output for attempt_1426279437401_714565_m_000314_0
2015-04-13 19:02:20,566 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9965093 bytes from map-output for attempt_1426279437401_714565_m_000347_0
2015-04-13 19:02:20,573 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 16907238 bytes from map-output for attempt_1426279437401_714565_m_000062_0
2015-04-13 19:02:20,585 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13447717 bytes from map-output for attempt_1426279437401_714565_m_000150_0
2015-04-13 19:02:20,597 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10486540 bytes from map-output for attempt_1426279437401_714565_m_000338_0
2015-04-13 19:02:20,621 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9499919 bytes from map-output for attempt_1426279437401_714565_m_000359_0
2015-04-13 19:02:20,622 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7217588, inMemoryMapOutputs.size() -> 45, commitMemory -> 289295747, usedMemory ->634550378
2015-04-13 19:02:20,623 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 5712500, inMemoryMapOutputs.size() -> 46, commitMemory -> 296513335, usedMemory ->634550378
2015-04-13 19:02:20,623 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0234.stratus.lvs.ebay.com:13562 freed by fetcher#18 in 1648ms
2015-04-13 19:02:20,623 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0734.stratus.lvs.ebay.com:13562 with 2 to fetcher#18
2015-04-13 19:02:20,623 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0734.stratus.lvs.ebay.com:13562 to fetcher#18
2015-04-13 19:02:20,625 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9183491 bytes from map-output for attempt_1426279437401_714565_m_000384_0
2015-04-13 19:02:20,626 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9499919, inMemoryMapOutputs.size() -> 47, commitMemory -> 302225835, usedMemory ->644252958
2015-04-13 19:02:20,626 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 about to shuffle output of map attempt_1426279437401_714565_m_000226_0 decomp: 9702580 len: 2960542 to MEMORY
2015-04-13 19:02:20,636 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9371257 bytes from map-output for attempt_1426279437401_714565_m_000392_0
2015-04-13 19:02:20,640 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9460664 bytes from map-output for attempt_1426279437401_714565_m_000509_0
2015-04-13 19:02:20,641 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9399680 bytes from map-output for attempt_1426279437401_714565_m_000265_0
2015-04-13 19:02:20,641 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000533_0,attempt_1426279437401_714565_m_000524_0 sent hash and received reply
2015-04-13 19:02:20,643 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 about to shuffle output of map attempt_1426279437401_714565_m_000533_0 decomp: 5078256 len: 1472929 to MEMORY
2015-04-13 19:02:20,646 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10609709 bytes from map-output for attempt_1426279437401_714565_m_000294_0
2015-04-13 19:02:20,647 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9298217 bytes from map-output for attempt_1426279437401_714565_m_000436_0
2015-04-13 19:02:20,651 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9327522 bytes from map-output for attempt_1426279437401_714565_m_000519_0
2015-04-13 19:02:20,652 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13769811 bytes from map-output for attempt_1426279437401_714565_m_000205_0
2015-04-13 19:02:20,657 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12990002 bytes from map-output for attempt_1426279437401_714565_m_000126_0
2015-04-13 19:02:20,659 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9061688 bytes from map-output for attempt_1426279437401_714565_m_000249_0
2015-04-13 19:02:20,663 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000296_0,attempt_1426279437401_714565_m_000074_0 sent hash and received reply
2015-04-13 19:02:20,663 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11214737 bytes from map-output for attempt_1426279437401_714565_m_000332_0
2015-04-13 19:02:20,667 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 about to shuffle output of map attempt_1426279437401_714565_m_000296_0 decomp: 11588363 len: 3786748 to MEMORY
2015-04-13 19:02:20,668 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10486540, inMemoryMapOutputs.size() -> 48, commitMemory -> 311725754, usedMemory ->660919577
2015-04-13 19:02:20,668 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13447717, inMemoryMapOutputs.size() -> 49, commitMemory -> 322212294, usedMemory ->660919577
2015-04-13 19:02:20,672 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6699933 bytes from map-output for attempt_1426279437401_714565_m_000420_0
2015-04-13 19:02:20,672 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#36 about to shuffle output of map attempt_1426279437401_714565_m_000301_0 decomp: 11400894 len: 3981302 to MEMORY
2015-04-13 19:02:20,672 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 16907238, inMemoryMapOutputs.size() -> 50, commitMemory -> 335660011, usedMemory ->672320471
2015-04-13 19:02:20,672 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0365.stratus.lvs.ebay.com:13562 freed by fetcher#27 in 1489ms
2015-04-13 19:02:20,672 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0090.stratus.lvs.ebay.com:13562 with 3 to fetcher#27
2015-04-13 19:02:20,672 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0090.stratus.lvs.ebay.com:13562 to fetcher#27
2015-04-13 19:02:20,676 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle output of map attempt_1426279437401_714565_m_000302_0 decomp: 13631758 len: 4372570 to MEMORY
2015-04-13 19:02:20,676 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9965093, inMemoryMapOutputs.size() -> 51, commitMemory -> 352567249, usedMemory ->685952229
2015-04-13 19:02:20,677 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10050112 bytes from map-output for attempt_1426279437401_714565_m_000238_0
2015-04-13 19:02:20,678 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 5078256 bytes from map-output for attempt_1426279437401_714565_m_000533_0
2015-04-13 19:02:20,678 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000487_0,attempt_1426279437401_714565_m_000187_0,attempt_1426279437401_714565_m_000242_0 sent hash and received reply
2015-04-13 19:02:20,679 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9959450 bytes from map-output for attempt_1426279437401_714565_m_000422_0
2015-04-13 19:02:20,679 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000418_0 decomp: 10265481 len: 3590544 to MEMORY
2015-04-13 19:02:20,682 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 about to shuffle output of map attempt_1426279437401_714565_m_000487_0 decomp: 7439015 len: 2510303 to MEMORY
2015-04-13 19:02:20,672 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9884191 bytes from map-output for attempt_1426279437401_714565_m_000456_0
2015-04-13 19:02:20,691 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14390802 bytes from map-output for attempt_1426279437401_714565_m_000069_0
2015-04-13 19:02:20,693 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9800878 bytes from map-output for attempt_1426279437401_714565_m_000425_0
2015-04-13 19:02:20,684 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 5948131 bytes from map-output for attempt_1426279437401_714565_m_000542_0
2015-04-13 19:02:20,702 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11173741 bytes from map-output for attempt_1426279437401_714565_m_000380_0
2015-04-13 19:02:20,703 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10050112, inMemoryMapOutputs.size() -> 52, commitMemory -> 362532342, usedMemory ->703656725
2015-04-13 19:02:20,703 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11606864, inMemoryMapOutputs.size() -> 53, commitMemory -> 372582454, usedMemory ->703656725
2015-04-13 19:02:20,704 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9888978, inMemoryMapOutputs.size() -> 54, commitMemory -> 384189318, usedMemory ->703656725
2015-04-13 19:02:20,704 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 4587474, inMemoryMapOutputs.size() -> 55, commitMemory -> 394078296, usedMemory ->703656725
2015-04-13 19:02:20,707 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7825818, inMemoryMapOutputs.size() -> 56, commitMemory -> 398665770, usedMemory ->714841887
2015-04-13 19:02:20,707 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#10 about to shuffle output of map attempt_1426279437401_714565_m_000312_0 decomp: 11185162 len: 3925463 to MEMORY
2015-04-13 19:02:20,737 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0458.stratus.lvs.ebay.com:13562 freed by fetcher#6 in 1823ms
2015-04-13 19:02:20,737 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0374.stratus.lvs.ebay.com:13562 with 2 to fetcher#6
2015-04-13 19:02:20,737 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0374.stratus.lvs.ebay.com:13562 to fetcher#6
2015-04-13 19:02:20,737 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10274409 bytes from map-output for attempt_1426279437401_714565_m_000323_0
2015-04-13 19:02:20,738 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10274409, inMemoryMapOutputs.size() -> 57, commitMemory -> 406491588, usedMemory ->714841887
2015-04-13 19:02:20,739 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0457.stratus.lvs.ebay.com:13562 freed by fetcher#22 in 1722ms
2015-04-13 19:02:20,739 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0025.stratus.lvs.ebay.com:13562 with 1 to fetcher#22
2015-04-13 19:02:20,739 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0025.stratus.lvs.ebay.com:13562 to fetcher#22
2015-04-13 19:02:20,740 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11173741, inMemoryMapOutputs.size() -> 58, commitMemory -> 416765997, usedMemory ->714841887
2015-04-13 19:02:20,745 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000340_0,attempt_1426279437401_714565_m_000188_0 sent hash and received reply
2015-04-13 19:02:20,746 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10493489 bytes from map-output for attempt_1426279437401_714565_m_000480_0
2015-04-13 19:02:20,742 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7286761 bytes from map-output for attempt_1426279437401_714565_m_000484_0
2015-04-13 19:02:20,745 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000537_0 sent hash and received reply
2015-04-13 19:02:20,745 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8650721 bytes from map-output for attempt_1426279437401_714565_m_000339_0
2015-04-13 19:02:20,763 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9702580 bytes from map-output for attempt_1426279437401_714565_m_000226_0
2015-04-13 19:02:20,747 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0606.stratus.lvs.ebay.com:13562 freed by fetcher#7 in 348ms
2015-04-13 19:02:20,764 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 with 8 to fetcher#7
2015-04-13 19:02:20,764 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 8 of 8 to lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 to fetcher#7
2015-04-13 19:02:20,767 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#22 about to shuffle output of map attempt_1426279437401_714565_m_000537_0 decomp: 4741479 len: 1566972 to MEMORY
2015-04-13 19:02:20,770 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11185162 bytes from map-output for attempt_1426279437401_714565_m_000312_0
2015-04-13 19:02:20,775 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#6 about to shuffle output of map attempt_1426279437401_714565_m_000340_0 decomp: 11203390 len: 3448385 to MEMORY
2015-04-13 19:02:20,775 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000531_0,attempt_1426279437401_714565_m_000431_0,attempt_1426279437401_714565_m_000248_0,attempt_1426279437401_714565_m_000325_0,attempt_1426279437401_714565_m_000285_0,attempt_1426279437401_714565_m_000100_0,attempt_1426279437401_714565_m_000272_0,attempt_1426279437401_714565_m_000180_0 sent hash and received reply
2015-04-13 19:02:20,797 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 5948131, inMemoryMapOutputs.size() -> 59, commitMemory -> 427939738, usedMemory ->744888408
2015-04-13 19:02:20,775 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7439015 bytes from map-output for attempt_1426279437401_714565_m_000487_0
2015-04-13 19:02:20,794 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#15 about to shuffle output of map attempt_1426279437401_714565_m_000139_0 decomp: 14101652 len: 5123201 to MEMORY
2015-04-13 19:02:20,801 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11400894 bytes from map-output for attempt_1426279437401_714565_m_000301_0
2015-04-13 19:02:20,812 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10265481 bytes from map-output for attempt_1426279437401_714565_m_000418_0
2015-04-13 19:02:20,820 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 about to shuffle output of map attempt_1426279437401_714565_m_000235_0 decomp: 15354274 len: 4731104 to MEMORY
2015-04-13 19:02:20,825 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9800878, inMemoryMapOutputs.size() -> 60, commitMemory -> 433887869, usedMemory ->767684230
2015-04-13 19:02:20,825 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 about to shuffle output of map attempt_1426279437401_714565_m_000532_0 decomp: 7441548 len: 2662937 to MEMORY
2015-04-13 19:02:20,827 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 about to shuffle output of map attempt_1426279437401_714565_m_000531_0 decomp: 5987267 len: 2197486 to MEMORY
2015-04-13 19:02:20,830 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11588363 bytes from map-output for attempt_1426279437401_714565_m_000296_0
2015-04-13 19:02:20,827 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 4741479 bytes from map-output for attempt_1426279437401_714565_m_000537_0
2015-04-13 19:02:20,842 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14390802, inMemoryMapOutputs.size() -> 61, commitMemory -> 443688747, usedMemory ->791559209
2015-04-13 19:02:20,842 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0151.stratus.lvs.ebay.com:13562 freed by fetcher#28 in 522ms
2015-04-13 19:02:20,843 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0170.stratus.lvs.ebay.com:13562 with 2 to fetcher#28
2015-04-13 19:02:20,843 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0170.stratus.lvs.ebay.com:13562 to fetcher#28
2015-04-13 19:02:20,844 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9884191, inMemoryMapOutputs.size() -> 62, commitMemory -> 458079549, usedMemory ->791559209
2015-04-13 19:02:20,844 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9959450, inMemoryMapOutputs.size() -> 63, commitMemory -> 467963740, usedMemory ->791559209
2015-04-13 19:02:20,842 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#32 about to shuffle output of map attempt_1426279437401_714565_m_000010_0 decomp: 17887712 len: 5349704 to MEMORY
2015-04-13 19:02:20,853 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000365_0,attempt_1426279437401_714565_m_000164_0 sent hash and received reply
2015-04-13 19:02:20,863 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13631758 bytes from map-output for attempt_1426279437401_714565_m_000302_0
2015-04-13 19:02:20,867 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 5987267 bytes from map-output for attempt_1426279437401_714565_m_000531_0
2015-04-13 19:02:20,869 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14101652 bytes from map-output for attempt_1426279437401_714565_m_000139_0
2015-04-13 19:02:20,871 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11203390 bytes from map-output for attempt_1426279437401_714565_m_000340_0
2015-04-13 19:02:20,872 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 about to shuffle output of map attempt_1426279437401_714565_m_000365_0 decomp: 10410420 len: 3441946 to MEMORY
2015-04-13 19:02:20,872 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 about to shuffle output of map attempt_1426279437401_714565_m_000230_0 decomp: 12988939 len: 4323887 to MEMORY
2015-04-13 19:02:20,873 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7441548 bytes from map-output for attempt_1426279437401_714565_m_000532_0
2015-04-13 19:02:20,881 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 5078256, inMemoryMapOutputs.size() -> 64, commitMemory -> 477923190, usedMemory ->825334572
2015-04-13 19:02:20,881 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6699933, inMemoryMapOutputs.size() -> 65, commitMemory -> 483001446, usedMemory ->825334572
2015-04-13 19:02:20,881 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 about to shuffle output of map attempt_1426279437401_714565_m_000467_0 decomp: 10376004 len: 2645636 to MEMORY
2015-04-13 19:02:20,889 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 about to shuffle output of map attempt_1426279437401_714565_m_000524_0 decomp: 9344782 len: 3205728 to MEMORY
2015-04-13 19:02:20,911 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#9 about to shuffle output of map attempt_1426279437401_714565_m_000281_0 decomp: 10743140 len: 3459358 to MEMORY
2015-04-13 19:02:20,911 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11214737, inMemoryMapOutputs.size() -> 66, commitMemory -> 489701379, usedMemory ->845422494
2015-04-13 19:02:20,911 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9061688, inMemoryMapOutputs.size() -> 67, commitMemory -> 500916116, usedMemory ->845422494
2015-04-13 19:02:20,921 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12990002, inMemoryMapOutputs.size() -> 68, commitMemory -> 509977804, usedMemory ->855933632
2015-04-13 19:02:20,921 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0582.stratus.lvs.ebay.com:13562 freed by fetcher#26 in 1749ms
2015-04-13 19:02:20,921 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0196.stratus.lvs.ebay.com:13562 with 1 to fetcher#26
2015-04-13 19:02:20,922 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0196.stratus.lvs.ebay.com:13562 to fetcher#26
2015-04-13 19:02:20,921 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000410_0 decomp: 10511138 len: 3578219 to MEMORY
2015-04-13 19:02:20,930 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000525_0 sent hash and received reply
2015-04-13 19:02:20,933 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10376004 bytes from map-output for attempt_1426279437401_714565_m_000467_0
2015-04-13 19:02:20,936 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 about to shuffle output of map attempt_1426279437401_714565_m_000421_0 decomp: 9676557 len: 3375892 to MEMORY
2015-04-13 19:02:20,977 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 about to shuffle output of map attempt_1426279437401_714565_m_000525_0 decomp: 8500682 len: 2960865 to MEMORY
2015-04-13 19:02:20,978 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13769811, inMemoryMapOutputs.size() -> 69, commitMemory -> 522967806, usedMemory ->874110871
2015-04-13 19:02:20,978 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9327522, inMemoryMapOutputs.size() -> 70, commitMemory -> 536737617, usedMemory ->874110871
2015-04-13 19:02:20,992 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9344782 bytes from map-output for attempt_1426279437401_714565_m_000524_0
2015-04-13 19:02:20,992 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9298217, inMemoryMapOutputs.size() -> 71, commitMemory -> 546065139, usedMemory ->889299040
2015-04-13 19:02:20,992 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10609709, inMemoryMapOutputs.size() -> 72, commitMemory -> 555363356, usedMemory ->889299040
2015-04-13 19:02:21,003 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 about to shuffle output of map attempt_1426279437401_714565_m_000288_0 decomp: 12001511 len: 3897586 to MEMORY
2015-04-13 19:02:20,992 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#11 about to shuffle output of map attempt_1426279437401_714565_m_000108_0 decomp: 15188169 len: 5112328 to MEMORY
2015-04-13 19:02:21,026 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 about to shuffle output of map attempt_1426279437401_714565_m_000370_0 decomp: 9682345 len: 3210491 to MEMORY
2015-04-13 19:02:21,032 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10511138 bytes from map-output for attempt_1426279437401_714565_m_000410_0
2015-04-13 19:02:21,033 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10410420 bytes from map-output for attempt_1426279437401_714565_m_000365_0
2015-04-13 19:02:21,038 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 17887712 bytes from map-output for attempt_1426279437401_714565_m_000010_0
2015-04-13 19:02:21,043 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9399680, inMemoryMapOutputs.size() -> 73, commitMemory -> 565973065, usedMemory ->929631069
2015-04-13 19:02:21,043 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9460664, inMemoryMapOutputs.size() -> 74, commitMemory -> 575372745, usedMemory ->929631069
2015-04-13 19:02:21,043 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0683.stratus.lvs.ebay.com:13562 freed by fetcher#20 in 2052ms
2015-04-13 19:02:21,043 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0530.stratus.lvs.ebay.com:13562 with 1 to fetcher#20
2015-04-13 19:02:21,043 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0530.stratus.lvs.ebay.com:13562 to fetcher#20
2015-04-13 19:02:21,043 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 about to shuffle output of map attempt_1426279437401_714565_m_000061_0 decomp: 18648173 len: 5937458 to MEMORY
2015-04-13 19:02:21,047 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10743140 bytes from map-output for attempt_1426279437401_714565_m_000281_0
2015-04-13 19:02:21,048 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12988939 bytes from map-output for attempt_1426279437401_714565_m_000230_0
2015-04-13 19:02:21,056 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9676557 bytes from map-output for attempt_1426279437401_714565_m_000421_0
2015-04-13 19:02:21,058 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000335_0 sent hash and received reply
2015-04-13 19:02:21,067 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15354274 bytes from map-output for attempt_1426279437401_714565_m_000235_0
2015-04-13 19:02:21,076 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 about to shuffle output of map attempt_1426279437401_714565_m_000396_0 decomp: 9984263 len: 3271465 to MEMORY
2015-04-13 19:02:21,086 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9371257, inMemoryMapOutputs.size() -> 75, commitMemory -> 584833409, usedMemory ->950568237
2015-04-13 19:02:21,086 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 about to shuffle output of map attempt_1426279437401_714565_m_000335_0 decomp: 10952905 len: 3484954 to MEMORY
2015-04-13 19:02:21,093 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 about to shuffle output of map attempt_1426279437401_714565_m_000426_0 decomp: 7763547 len: 2215516 to MEMORY
2015-04-13 19:02:21,097 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15188169 bytes from map-output for attempt_1426279437401_714565_m_000108_0
2015-04-13 19:02:21,099 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12001511 bytes from map-output for attempt_1426279437401_714565_m_000288_0
2015-04-13 19:02:21,103 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9183491, inMemoryMapOutputs.size() -> 76, commitMemory -> 594204666, usedMemory ->969868968
2015-04-13 19:02:21,112 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 about to shuffle output of map attempt_1426279437401_714565_m_000341_0 decomp: 9645483 len: 3567492 to MEMORY
2015-04-13 19:02:21,117 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9682345 bytes from map-output for attempt_1426279437401_714565_m_000370_0
2015-04-13 19:02:21,117 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12001511, inMemoryMapOutputs.size() -> 77, commitMemory -> 603388157, usedMemory ->979514451
2015-04-13 19:02:21,117 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15188169, inMemoryMapOutputs.size() -> 78, commitMemory -> 615389668, usedMemory ->979514451
2015-04-13 19:02:21,103 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#12 about to shuffle output of map attempt_1426279437401_714565_m_000309_0 decomp: 11537184 len: 3632905 to MEMORY
2015-04-13 19:02:21,141 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7763547 bytes from map-output for attempt_1426279437401_714565_m_000426_0
2015-04-13 19:02:21,153 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9984263 bytes from map-output for attempt_1426279437401_714565_m_000396_0
2015-04-13 19:02:21,154 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 about to shuffle output of map attempt_1426279437401_714565_m_000092_0 decomp: 14132904 len: 4944752 to MEMORY
2015-04-13 19:02:21,154 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15354274, inMemoryMapOutputs.size() -> 79, commitMemory -> 630577837, usedMemory ->993647355
2015-04-13 19:02:21,154 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9676557, inMemoryMapOutputs.size() -> 80, commitMemory -> 645932111, usedMemory ->993647355
2015-04-13 19:02:21,154 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12988939, inMemoryMapOutputs.size() -> 81, commitMemory -> 655608668, usedMemory ->993647355
2015-04-13 19:02:21,155 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0511.stratus.lvs.ebay.com:13562 freed by fetcher#30 in 1948ms
2015-04-13 19:02:21,155 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0107.stratus.lvs.ebay.com:13562 with 3 to fetcher#30
2015-04-13 19:02:21,155 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0107.stratus.lvs.ebay.com:13562 to fetcher#30
2015-04-13 19:02:21,161 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000029_0,attempt_1426279437401_714565_m_000115_0,attempt_1426279437401_714565_m_000036_0 sent hash and received reply
2015-04-13 19:02:21,166 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 about to shuffle output of map attempt_1426279437401_714565_m_000289_0 decomp: 12975619 len: 4633976 to MEMORY
2015-04-13 19:02:21,169 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10952905 bytes from map-output for attempt_1426279437401_714565_m_000335_0
2015-04-13 19:02:21,184 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8500682 bytes from map-output for attempt_1426279437401_714565_m_000525_0
2015-04-13 19:02:21,185 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11537184 bytes from map-output for attempt_1426279437401_714565_m_000309_0
2015-04-13 19:02:21,192 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10743140, inMemoryMapOutputs.size() -> 82, commitMemory -> 668597607, usedMemory ->1023960831
2015-04-13 19:02:21,197 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9645483 bytes from map-output for attempt_1426279437401_714565_m_000341_0
2015-04-13 19:02:21,201 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 about to shuffle output of map attempt_1426279437401_714565_m_000029_0 decomp: 17337857 len: 5532141 to MEMORY
2015-04-13 19:02:21,206 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 17887712, inMemoryMapOutputs.size() -> 83, commitMemory -> 679340747, usedMemory ->1037965893
2015-04-13 19:02:21,206 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10410420, inMemoryMapOutputs.size() -> 84, commitMemory -> 697228459, usedMemory ->1037965893
2015-04-13 19:02:21,206 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#9 about to shuffle output of map attempt_1426279437401_714565_m_000155_0 decomp: 14005062 len: 4365600 to MEMORY
2015-04-13 19:02:21,207 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10511138, inMemoryMapOutputs.size() -> 85, commitMemory -> 707638879, usedMemory ->1037965893
2015-04-13 19:02:21,207 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Starting inMemoryMerger's merge since commitMemory=718150017 > mergeThreshold=708669632. Current usedMemory=1037965893
2015-04-13 19:02:21,207 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeThread: InMemoryMerger - Thread to merge in-memory shuffled map-outputs: Starting merge with 85 segments, while ignoring 0 segments
2015-04-13 19:02:21,228 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 about to shuffle output of map attempt_1426279437401_714565_m_000164_0 decomp: 15739817 len: 5147364 to MEMORY
2015-04-13 19:02:21,238 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9809506 bytes from map-output for attempt_1426279437401_714565_m_000320_0
2015-04-13 19:02:21,240 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9344782, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->1066118539
2015-04-13 19:02:21,240 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000173_0 decomp: 12412829 len: 3673141 to MEMORY
2015-04-13 19:02:21,240 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10376004, inMemoryMapOutputs.size() -> 2, commitMemory -> 9344782, usedMemory ->1066118539
2015-04-13 19:02:21,249 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.io.compress.CodecPool: Got brand-new compressor [.lzo_deflate]
2015-04-13 19:02:21,261 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14132904 bytes from map-output for attempt_1426279437401_714565_m_000092_0
2015-04-13 19:02:21,261 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12975619 bytes from map-output for attempt_1426279437401_714565_m_000289_0
2015-04-13 19:02:21,263 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7441548, inMemoryMapOutputs.size() -> 3, commitMemory -> 19720786, usedMemory ->1083859463
2015-04-13 19:02:21,264 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11203390, inMemoryMapOutputs.size() -> 4, commitMemory -> 27162334, usedMemory ->1083859463
2015-04-13 19:02:21,264 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 - MergeManager returned status WAIT ...
2015-04-13 19:02:21,264 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#6 - MergeManager returned status WAIT ...
2015-04-13 19:02:21,264 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0008.stratus.lvs.ebay.com:13562 freed by fetcher#16 in 785ms
2015-04-13 19:02:21,264 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0374.stratus.lvs.ebay.com:13562 freed by fetcher#6 in 527ms
2015-04-13 19:02:21,264 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 about to shuffle output of map attempt_1426279437401_714565_m_000066_0 decomp: 17740924 len: 5726968 to MEMORY
2015-04-13 19:02:21,264 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14101652, inMemoryMapOutputs.size() -> 5, commitMemory -> 38365724, usedMemory ->1083859463
2015-04-13 19:02:21,265 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0204.stratus.lvs.ebay.com:13562 freed by fetcher#15 in 776ms
2015-04-13 19:02:21,265 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 5987267, inMemoryMapOutputs.size() -> 6, commitMemory -> 52467376, usedMemory ->1083859463
2015-04-13 19:02:21,265 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13631758, inMemoryMapOutputs.size() -> 7, commitMemory -> 58454643, usedMemory ->1083859463
2015-04-13 19:02:21,265 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 - MergeManager returned status WAIT ...
2015-04-13 19:02:21,265 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0724.stratus.lvs.ebay.com:13562 freed by fetcher#1 in 1338ms
2015-04-13 19:02:21,265 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 4741479, inMemoryMapOutputs.size() -> 8, commitMemory -> 72086401, usedMemory ->1083859463
2015-04-13 19:02:21,265 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11588363, inMemoryMapOutputs.size() -> 9, commitMemory -> 76827880, usedMemory ->1083859463
2015-04-13 19:02:21,266 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10265481, inMemoryMapOutputs.size() -> 10, commitMemory -> 88416243, usedMemory ->1083859463
2015-04-13 19:02:21,266 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 - MergeManager returned status WAIT ...
2015-04-13 19:02:21,266 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 - MergeManager returned status WAIT ...
2015-04-13 19:02:21,266 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 18648173 bytes from map-output for attempt_1426279437401_714565_m_000061_0
2015-04-13 19:02:21,264 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Initiating in-memory merge with 85 segments...
2015-04-13 19:02:21,266 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0734.stratus.lvs.ebay.com:13562 freed by fetcher#18 in 643ms
2015-04-13 19:02:21,278 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11400894, inMemoryMapOutputs.size() -> 11, commitMemory -> 98681724, usedMemory ->1083859463
2015-04-13 19:02:21,279 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7439015, inMemoryMapOutputs.size() -> 12, commitMemory -> 110082618, usedMemory ->1083859463
2015-04-13 19:02:21,279 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11185162, inMemoryMapOutputs.size() -> 13, commitMemory -> 117521633, usedMemory ->1083859463
2015-04-13 19:02:21,279 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 - MergeManager returned status WAIT ...
2015-04-13 19:02:21,279 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9702580, inMemoryMapOutputs.size() -> 14, commitMemory -> 128706795, usedMemory ->1083859463
2015-04-13 19:02:21,279 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 - MergeManager returned status WAIT ...
2015-04-13 19:02:21,279 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0090.stratus.lvs.ebay.com:13562 freed by fetcher#27 in 607ms
2015-04-13 19:02:21,280 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0303.stratus.lvs.ebay.com:13562 freed by fetcher#35 in 2005ms
2015-04-13 19:02:21,280 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8650721, inMemoryMapOutputs.size() -> 15, commitMemory -> 138409375, usedMemory ->1083859463
2015-04-13 19:02:21,280 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7286761, inMemoryMapOutputs.size() -> 16, commitMemory -> 147060096, usedMemory ->1083859463
2015-04-13 19:02:21,280 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10493489, inMemoryMapOutputs.size() -> 17, commitMemory -> 154346857, usedMemory ->1083859463
2015-04-13 19:02:21,280 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0243.stratus.lvs.ebay.com:13562 freed by fetcher#19 in 2304ms
2015-04-13 19:02:21,280 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0716.stratus.lvs.ebay.com:13562 freed by fetcher#34 in 770ms
2015-04-13 19:02:21,280 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0238.stratus.lvs.ebay.com:13562 freed by fetcher#10 in 1402ms
2015-04-13 19:02:21,280 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#4 - MergeManager returned status WAIT ...
2015-04-13 19:02:21,281 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0553.stratus.lvs.ebay.com:13562 freed by fetcher#36 in 2006ms
2015-04-13 19:02:21,280 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 - MergeManager returned status WAIT ...
2015-04-13 19:02:21,281 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 18648173, inMemoryMapOutputs.size() -> 18, commitMemory -> 164840346, usedMemory ->1083859463
2015-04-13 19:02:21,281 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0353.stratus.lvs.ebay.com:13562 freed by fetcher#33 in 798ms
2015-04-13 19:02:21,281 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 - MergeManager returned status WAIT ...
2015-04-13 19:02:21,281 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0671.stratus.lvs.ebay.com:13562 freed by fetcher#24 in 950ms
2015-04-13 19:02:21,281 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0162.stratus.lvs.ebay.com:13562 freed by fetcher#23 in 2252ms
2015-04-13 19:02:21,281 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0025.stratus.lvs.ebay.com:13562 freed by fetcher#22 in 542ms
2015-04-13 19:02:21,282 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 freed by fetcher#7 in 518ms
2015-04-13 19:02:21,282 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12975619, inMemoryMapOutputs.size() -> 19, commitMemory -> 183488519, usedMemory ->1083859463
2015-04-13 19:02:21,282 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14132904, inMemoryMapOutputs.size() -> 20, commitMemory -> 196464138, usedMemory ->1083859463
2015-04-13 19:02:21,282 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0236.stratus.lvs.ebay.com:13562 freed by fetcher#5 in 759ms
2015-04-13 19:02:21,282 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9809506, inMemoryMapOutputs.size() -> 21, commitMemory -> 210597042, usedMemory ->1083859463
2015-04-13 19:02:21,282 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 - MergeManager returned status WAIT ...
2015-04-13 19:02:21,283 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0226.stratus.lvs.ebay.com:13562 freed by fetcher#25 in 2123ms
2015-04-13 19:02:21,283 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0275.stratus.lvs.ebay.com:13562 freed by fetcher#32 in 1407ms
2015-04-13 19:02:21,283 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9645483, inMemoryMapOutputs.size() -> 22, commitMemory -> 220406548, usedMemory ->1083859463
2015-04-13 19:02:21,283 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 - MergeManager returned status WAIT ...
2015-04-13 19:02:21,284 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0065.stratus.lvs.ebay.com:13562 freed by fetcher#17 in 965ms
2015-04-13 19:02:21,284 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11537184, inMemoryMapOutputs.size() -> 23, commitMemory -> 230052031, usedMemory ->1083859463
2015-04-13 19:02:21,284 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8500682, inMemoryMapOutputs.size() -> 24, commitMemory -> 241589215, usedMemory ->1083859463
2015-04-13 19:02:21,284 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#12 - MergeManager returned status WAIT ...
2015-04-13 19:02:21,284 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10952905, inMemoryMapOutputs.size() -> 25, commitMemory -> 250089897, usedMemory ->1083859463
2015-04-13 19:02:21,284 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0530.stratus.lvs.ebay.com:13562 freed by fetcher#20 in 241ms
2015-04-13 19:02:21,284 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0394.stratus.lvs.ebay.com:13562 freed by fetcher#29 in 2089ms
2015-04-13 19:02:21,285 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9984263, inMemoryMapOutputs.size() -> 26, commitMemory -> 261042802, usedMemory ->1083859463
2015-04-13 19:02:21,285 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7763547, inMemoryMapOutputs.size() -> 27, commitMemory -> 271027065, usedMemory ->1083859463
2015-04-13 19:02:21,285 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0338.stratus.lvs.ebay.com:13562 freed by fetcher#11 in 952ms
2015-04-13 19:02:21,285 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 - MergeManager returned status WAIT ...
2015-04-13 19:02:21,285 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0082.stratus.lvs.ebay.com:13562 freed by fetcher#8 in 967ms
2015-04-13 19:02:21,285 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9682345, inMemoryMapOutputs.size() -> 28, commitMemory -> 278790612, usedMemory ->1083859463
2015-04-13 19:02:21,286 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 - MergeManager returned status WAIT ...
2015-04-13 19:02:21,286 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0108.stratus.lvs.ebay.com:13562 freed by fetcher#13 in 854ms
2015-04-13 19:02:21,286 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0003.stratus.lvs.ebay.com:13562 freed by fetcher#2 in 968ms
2015-04-13 19:02:21,286 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0452.stratus.lvs.ebay.com:13562 freed by fetcher#12 in 953ms
2015-04-13 19:02:21,286 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0196.stratus.lvs.ebay.com:13562 freed by fetcher#26 in 365ms
2015-04-13 19:02:21,287 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0178.stratus.lvs.ebay.com:13562 freed by fetcher#3 in 1369ms
2015-04-13 19:02:21,287 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0569.stratus.lvs.ebay.com:13562 freed by fetcher#31 in 2081ms
2015-04-13 19:02:21,287 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0704.stratus.lvs.ebay.com:13562 freed by fetcher#4 in 1378ms
2015-04-13 19:02:21,290 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapred.Merger: Merging 85 sorted segments
2015-04-13 19:02:21,292 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 85 segments left of total size: 718146957 bytes
2015-04-13 19:02:21,347 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14005062 bytes from map-output for attempt_1426279437401_714565_m_000155_0
2015-04-13 19:02:21,347 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14005062, inMemoryMapOutputs.size() -> 29, commitMemory -> 288472957, usedMemory ->1083859463
2015-04-13 19:02:21,348 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0066.stratus.lvs.ebay.com:13562 freed by fetcher#9 in 1029ms
2015-04-13 19:02:21,367 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 17337857 bytes from map-output for attempt_1426279437401_714565_m_000029_0
2015-04-13 19:02:21,367 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 17337857, inMemoryMapOutputs.size() -> 30, commitMemory -> 302478019, usedMemory ->1083859463
2015-04-13 19:02:21,367 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 - MergeManager returned status WAIT ...
2015-04-13 19:02:21,368 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0107.stratus.lvs.ebay.com:13562 freed by fetcher#30 in 213ms
2015-04-13 19:02:21,380 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12412829 bytes from map-output for attempt_1426279437401_714565_m_000173_0
2015-04-13 19:02:21,381 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12412829, inMemoryMapOutputs.size() -> 31, commitMemory -> 319815876, usedMemory ->1083859463
2015-04-13 19:02:21,384 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0762.stratus.lvs.ebay.com:13562 freed by fetcher#21 in 2381ms
2015-04-13 19:02:21,419 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 17740924 bytes from map-output for attempt_1426279437401_714565_m_000066_0
2015-04-13 19:02:21,420 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 17740924, inMemoryMapOutputs.size() -> 32, commitMemory -> 332228705, usedMemory ->1083859463
2015-04-13 19:02:21,420 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0444.stratus.lvs.ebay.com:13562 freed by fetcher#14 in 964ms
2015-04-13 19:02:21,715 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15739817 bytes from map-output for attempt_1426279437401_714565_m_000164_0
2015-04-13 19:02:21,715 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15739817, inMemoryMapOutputs.size() -> 33, commitMemory -> 349969629, usedMemory ->1083859463
2015-04-13 19:02:21,715 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0170.stratus.lvs.ebay.com:13562 freed by fetcher#28 in 872ms
2015-04-13 19:02:31,670 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: attempt_1426279437401_714565_r_000318_0 Merge of the 85 files in-memory complete. Local file is /hadoop/8/scratch/local/usercache/b_pulsar_coe/appcache/application_1426279437401_714565/output/attempt_1426279437401_714565_r_000318_0/map_570.out.merged of size 225700899
2015-04-13 19:02:31,680 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0685.stratus.lvs.ebay.com:13562 with 5 to fetcher#28
2015-04-13 19:02:31,680 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0685.stratus.lvs.ebay.com:13562 to fetcher#28
2015-04-13 19:02:31,681 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0580.stratus.lvs.ebay.com:13562 with 2 to fetcher#17
2015-04-13 19:02:31,681 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0580.stratus.lvs.ebay.com:13562 to fetcher#17
2015-04-13 19:02:31,681 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0100.stratus.lvs.ebay.com:13562 with 6 to fetcher#14
2015-04-13 19:02:31,681 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 6 of 6 to lvsdpehdc25dn0100.stratus.lvs.ebay.com:13562 to fetcher#14
2015-04-13 19:02:31,682 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0762.stratus.lvs.ebay.com:13562 with 3 to fetcher#23
2015-04-13 19:02:31,682 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0762.stratus.lvs.ebay.com:13562 to fetcher#23
2015-04-13 19:02:31,682 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0617.stratus.lvs.ebay.com:13562 with 1 to fetcher#24
2015-04-13 19:02:31,683 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0617.stratus.lvs.ebay.com:13562 to fetcher#24
2015-04-13 19:02:31,683 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0070.stratus.lvs.ebay.com:13562 with 3 to fetcher#33
2015-04-13 19:02:31,683 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0070.stratus.lvs.ebay.com:13562 to fetcher#33
2015-04-13 19:02:31,683 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0414.stratus.lvs.ebay.com:13562 with 2 to fetcher#36
2015-04-13 19:02:31,683 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0414.stratus.lvs.ebay.com:13562 to fetcher#36
2015-04-13 19:02:31,683 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0010.stratus.lvs.ebay.com:13562 with 3 to fetcher#16
2015-04-13 19:02:31,684 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0010.stratus.lvs.ebay.com:13562 to fetcher#16
2015-04-13 19:02:31,684 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0195.stratus.lvs.ebay.com:13562 with 2 to fetcher#13
2015-04-13 19:02:31,684 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0195.stratus.lvs.ebay.com:13562 to fetcher#13
2015-04-13 19:02:31,684 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0325.stratus.lvs.ebay.com:13562 with 2 to fetcher#2
2015-04-13 19:02:31,684 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0325.stratus.lvs.ebay.com:13562 to fetcher#2
2015-04-13 19:02:31,684 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0264.stratus.lvs.ebay.com:13562 with 2 to fetcher#12
2015-04-13 19:02:31,684 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0264.stratus.lvs.ebay.com:13562 to fetcher#12
2015-04-13 19:02:31,685 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0412.stratus.lvs.ebay.com:13562 with 2 to fetcher#26
2015-04-13 19:02:31,685 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0412.stratus.lvs.ebay.com:13562 to fetcher#26
2015-04-13 19:02:31,685 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0364.stratus.lvs.ebay.com:13562 with 1 to fetcher#3
2015-04-13 19:02:31,685 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0364.stratus.lvs.ebay.com:13562 to fetcher#3
2015-04-13 19:02:31,686 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0458.stratus.lvs.ebay.com:13562 with 3 to fetcher#31
2015-04-13 19:02:31,686 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0458.stratus.lvs.ebay.com:13562 to fetcher#31
2015-04-13 19:02:31,686 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000348_0,attempt_1426279437401_714565_m_000343_0 sent hash and received reply
2015-04-13 19:02:31,686 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0225.stratus.lvs.ebay.com:13562 with 1 to fetcher#4
2015-04-13 19:02:31,686 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0225.stratus.lvs.ebay.com:13562 to fetcher#4
2015-04-13 19:02:31,687 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0730.stratus.lvs.ebay.com:13562 with 1 to fetcher#9
2015-04-13 19:02:31,687 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0730.stratus.lvs.ebay.com:13562 to fetcher#9
2015-04-13 19:02:31,687 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0515.stratus.lvs.ebay.com:13562 with 1 to fetcher#30
2015-04-13 19:02:31,687 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0515.stratus.lvs.ebay.com:13562 to fetcher#30
2015-04-13 19:02:31,687 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0618.stratus.lvs.ebay.com:13562 with 4 to fetcher#21
2015-04-13 19:02:31,687 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0618.stratus.lvs.ebay.com:13562 to fetcher#21
2015-04-13 19:02:31,687 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0044.stratus.lvs.ebay.com:13562 with 3 to fetcher#6
2015-04-13 19:02:31,687 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0044.stratus.lvs.ebay.com:13562 to fetcher#6
2015-04-13 19:02:31,688 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0386.stratus.lvs.ebay.com:13562 with 4 to fetcher#15
2015-04-13 19:02:31,688 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0386.stratus.lvs.ebay.com:13562 to fetcher#15
2015-04-13 19:02:31,689 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 about to shuffle output of map attempt_1426279437401_714565_m_000348_0 decomp: 8388064 len: 2685464 to MEMORY
2015-04-13 19:02:31,689 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0493.stratus.lvs.ebay.com:13562 with 1 to fetcher#1
2015-04-13 19:02:31,689 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0493.stratus.lvs.ebay.com:13562 to fetcher#1
2015-04-13 19:02:31,689 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000027_0 sent hash and received reply
2015-04-13 19:02:31,689 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000553_0,attempt_1426279437401_714565_m_000185_0 sent hash and received reply
2015-04-13 19:02:31,689 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0090.stratus.lvs.ebay.com:13562 with 2 to fetcher#18
2015-04-13 19:02:31,690 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0090.stratus.lvs.ebay.com:13562 to fetcher#18
2015-04-13 19:02:31,690 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000493_0,attempt_1426279437401_714565_m_000297_0,attempt_1426279437401_714565_m_000212_0 sent hash and received reply
2015-04-13 19:02:31,690 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0008.stratus.lvs.ebay.com:13562 with 3 to fetcher#27
2015-04-13 19:02:31,690 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000250_0 sent hash and received reply
2015-04-13 19:02:31,690 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000507_0 sent hash and received reply
2015-04-13 19:02:31,691 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000310_0 sent hash and received reply
2015-04-13 19:02:31,692 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000346_0 sent hash and received reply
2015-04-13 19:02:31,693 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000123_0,attempt_1426279437401_714565_m_000079_0,attempt_1426279437401_714565_m_000012_0 sent hash and received reply
2015-04-13 19:02:31,693 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000242_0,attempt_1426279437401_714565_m_000187_0 sent hash and received reply
2015-04-13 19:02:31,690 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0008.stratus.lvs.ebay.com:13562 to fetcher#27
2015-04-13 19:02:31,693 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000458_0,attempt_1426279437401_714565_m_000216_0,attempt_1426279437401_714565_m_000088_0 sent hash and received reply
2015-04-13 19:02:31,693 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0219.stratus.lvs.ebay.com:13562 with 4 to fetcher#35
2015-04-13 19:02:31,693 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0219.stratus.lvs.ebay.com:13562 to fetcher#35
2015-04-13 19:02:31,694 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0300.stratus.lvs.ebay.com:13562 with 3 to fetcher#19
2015-04-13 19:02:31,694 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000151_0,attempt_1426279437401_714565_m_000095_0 sent hash and received reply
2015-04-13 19:02:31,694 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0300.stratus.lvs.ebay.com:13562 to fetcher#19
2015-04-13 19:02:31,694 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0687.stratus.lvs.ebay.com:13562 with 2 to fetcher#34
2015-04-13 19:02:31,694 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0687.stratus.lvs.ebay.com:13562 to fetcher#34
2015-04-13 19:02:31,694 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000124_0,attempt_1426279437401_714565_m_000129_0 sent hash and received reply
2015-04-13 19:02:31,695 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0082.stratus.lvs.ebay.com:13562 with 1 to fetcher#10
2015-04-13 19:02:31,695 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0082.stratus.lvs.ebay.com:13562 to fetcher#10
2015-04-13 19:02:31,695 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0078.stratus.lvs.ebay.com:13562 with 1 to fetcher#22
2015-04-13 19:02:31,695 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000224_0 sent hash and received reply
2015-04-13 19:02:31,695 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000319_0,attempt_1426279437401_714565_m_000004_0 sent hash and received reply
2015-04-13 19:02:31,695 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0078.stratus.lvs.ebay.com:13562 to fetcher#22
2015-04-13 19:02:31,695 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000489_0,attempt_1426279437401_714565_m_000461_0,attempt_1426279437401_714565_m_000260_0,attempt_1426279437401_714565_m_000147_0,attempt_1426279437401_714565_m_000274_0 sent hash and received reply
2015-04-13 19:02:31,695 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0535.stratus.lvs.ebay.com:13562 with 6 to fetcher#7
2015-04-13 19:02:31,696 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 6 of 6 to lvsdpehdc25dn0535.stratus.lvs.ebay.com:13562 to fetcher#7
2015-04-13 19:02:31,696 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0218.stratus.lvs.ebay.com:13562 with 1 to fetcher#5
2015-04-13 19:02:31,696 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0218.stratus.lvs.ebay.com:13562 to fetcher#5
2015-04-13 19:02:31,696 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0138.stratus.lvs.ebay.com:13562 with 2 to fetcher#25
2015-04-13 19:02:31,696 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0138.stratus.lvs.ebay.com:13562 to fetcher#25
2015-04-13 19:02:31,697 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0305.stratus.lvs.ebay.com:13562 with 2 to fetcher#32
2015-04-13 19:02:31,697 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0305.stratus.lvs.ebay.com:13562 to fetcher#32
2015-04-13 19:02:31,697 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0077.stratus.lvs.ebay.com:13562 with 1 to fetcher#20
2015-04-13 19:02:31,697 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0077.stratus.lvs.ebay.com:13562 to fetcher#20
2015-04-13 19:02:31,697 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000315_0,attempt_1426279437401_714565_m_000358_0,attempt_1426279437401_714565_m_000098_0 sent hash and received reply
2015-04-13 19:02:31,698 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0395.stratus.lvs.ebay.com:13562 with 2 to fetcher#29
2015-04-13 19:02:31,698 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0395.stratus.lvs.ebay.com:13562 to fetcher#29
2015-04-13 19:02:31,698 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000336_0,attempt_1426279437401_714565_m_000330_0,attempt_1426279437401_714565_m_000190_0,attempt_1426279437401_714565_m_000044_0 sent hash and received reply
2015-04-13 19:02:31,698 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0313.stratus.lvs.ebay.com:13562 with 2 to fetcher#11
2015-04-13 19:02:31,698 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0313.stratus.lvs.ebay.com:13562 to fetcher#11
2015-04-13 19:02:31,698 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 about to shuffle output of map attempt_1426279437401_714565_m_000027_0 decomp: 18213638 len: 5643991 to MEMORY
2015-04-13 19:02:31,698 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000068_0 sent hash and received reply
2015-04-13 19:02:31,698 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0469.stratus.lvs.ebay.com:13562 with 2 to fetcher#8
2015-04-13 19:02:31,698 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0469.stratus.lvs.ebay.com:13562 to fetcher#8
2015-04-13 19:02:31,699 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000571_0,attempt_1426279437401_714565_m_000400_0,attempt_1426279437401_714565_m_000169_0,attempt_1426279437401_714565_m_000118_0 sent hash and received reply
2015-04-13 19:02:31,700 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000554_0,attempt_1426279437401_714565_m_000500_0 sent hash and received reply
2015-04-13 19:02:31,700 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#15 about to shuffle output of map attempt_1426279437401_714565_m_000336_0 decomp: 8184588 len: 2493373 to MEMORY
2015-04-13 19:02:31,700 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000446_0,attempt_1426279437401_714565_m_000081_0,attempt_1426279437401_714565_m_000463_0 sent hash and received reply
2015-04-13 19:02:31,698 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 about to shuffle output of map attempt_1426279437401_714565_m_000489_0 decomp: 9205774 len: 2891040 to MEMORY
2015-04-13 19:02:31,699 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000136_0 sent hash and received reply
2015-04-13 19:02:31,701 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000466_0,attempt_1426279437401_714565_m_000329_0,attempt_1426279437401_714565_m_000300_0,attempt_1426279437401_714565_m_000148_0,attempt_1426279437401_714565_m_000048_0,attempt_1426279437401_714565_m_000050_0 sent hash and received reply
2015-04-13 19:02:31,701 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000475_0,attempt_1426279437401_714565_m_000104_0,attempt_1426279437401_714565_m_000133_0,attempt_1426279437401_714565_m_000031_0 sent hash and received reply
2015-04-13 19:02:31,702 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000511_0,attempt_1426279437401_714565_m_000440_0 sent hash and received reply
2015-04-13 19:02:31,702 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000439_0 sent hash and received reply
2015-04-13 19:02:31,702 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000120_0,attempt_1426279437401_714565_m_000014_0 sent hash and received reply
2015-04-13 19:02:31,702 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000254_0,attempt_1426279437401_714565_m_000158_0 sent hash and received reply
2015-04-13 19:02:31,702 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 about to shuffle output of map attempt_1426279437401_714565_m_000446_0 decomp: 8194870 len: 2867583 to MEMORY
2015-04-13 19:02:31,704 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000146_0,attempt_1426279437401_714565_m_000106_0 sent hash and received reply
2015-04-13 19:02:31,704 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000474_0,attempt_1426279437401_714565_m_000435_0 sent hash and received reply
2015-04-13 19:02:31,705 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000174_0,attempt_1426279437401_714565_m_000072_0,attempt_1426279437401_714565_m_000006_0 sent hash and received reply
2015-04-13 19:02:31,706 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#32 about to shuffle output of map attempt_1426279437401_714565_m_000254_0 decomp: 12717545 len: 4044708 to MEMORY
2015-04-13 19:02:31,708 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 about to shuffle output of map attempt_1426279437401_714565_m_000319_0 decomp: 10493654 len: 3351097 to MEMORY
2015-04-13 19:02:31,710 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000204_0 sent hash and received reply
2015-04-13 19:02:31,711 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000423_0,attempt_1426279437401_714565_m_000177_0,attempt_1426279437401_714565_m_000203_0,attempt_1426279437401_714565_m_000160_0,attempt_1426279437401_714565_m_000090_0,attempt_1426279437401_714565_m_000037_0 sent hash and received reply
2015-04-13 19:02:31,712 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 about to shuffle output of map attempt_1426279437401_714565_m_000224_0 decomp: 11615252 len: 3613361 to MEMORY
2015-04-13 19:02:31,718 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 about to shuffle output of map attempt_1426279437401_714565_m_000124_0 decomp: 14585852 len: 4913878 to MEMORY
2015-04-13 19:02:31,721 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#36 about to shuffle output of map attempt_1426279437401_714565_m_000151_0 decomp: 12197721 len: 3822839 to MEMORY
2015-04-13 19:02:31,724 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 about to shuffle output of map attempt_1426279437401_714565_m_000458_0 decomp: 10492067 len: 3288436 to MEMORY
2015-04-13 19:02:31,729 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 about to shuffle output of map attempt_1426279437401_714565_m_000242_0 decomp: 14540567 len: 5073162 to MEMORY
2015-04-13 19:02:31,732 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 about to shuffle output of map attempt_1426279437401_714565_m_000123_0 decomp: 12716900 len: 3550689 to MEMORY
2015-04-13 19:02:31,735 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle output of map attempt_1426279437401_714565_m_000346_0 decomp: 11048841 len: 3694644 to MEMORY
2015-04-13 19:02:31,738 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 about to shuffle output of map attempt_1426279437401_714565_m_000310_0 decomp: 9064975 len: 3237616 to MEMORY
2015-04-13 19:02:31,749 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000189_0,attempt_1426279437401_714565_m_000172_0,attempt_1426279437401_714565_m_000024_0 sent hash and received reply
2015-04-13 19:02:31,761 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8388064 bytes from map-output for attempt_1426279437401_714565_m_000348_0
2015-04-13 19:02:31,765 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#9 about to shuffle output of map attempt_1426279437401_714565_m_000507_0 decomp: 8046685 len: 2459759 to MEMORY
2015-04-13 19:02:31,770 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#4 about to shuffle output of map attempt_1426279437401_714565_m_000250_0 decomp: 14805678 len: 4636244 to MEMORY
2015-04-13 19:02:31,772 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 about to shuffle output of map attempt_1426279437401_714565_m_000493_0 decomp: 9655005 len: 3246024 to MEMORY
2015-04-13 19:02:31,779 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8388064, inMemoryMapOutputs.size() -> 34, commitMemory -> 365709446, usedMemory ->573880403
2015-04-13 19:02:31,779 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#12 about to shuffle output of map attempt_1426279437401_714565_m_000553_0 decomp: 4003281 len: 1625332 to MEMORY
2015-04-13 19:02:31,782 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 about to shuffle output of map attempt_1426279437401_714565_m_000343_0 decomp: 10308979 len: 3230406 to MEMORY
2015-04-13 19:02:31,783 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000257_0,attempt_1426279437401_714565_m_000144_0 sent hash and received reply
2015-04-13 19:02:31,807 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9205774 bytes from map-output for attempt_1426279437401_714565_m_000489_0
2015-04-13 19:02:31,821 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8194870 bytes from map-output for attempt_1426279437401_714565_m_000446_0
2015-04-13 19:02:31,826 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000189_0 decomp: 12974495 len: 3920667 to MEMORY
2015-04-13 19:02:31,829 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 about to shuffle output of map attempt_1426279437401_714565_m_000423_0 decomp: 9668724 len: 3400439 to MEMORY
2015-04-13 19:02:31,833 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 about to shuffle output of map attempt_1426279437401_714565_m_000204_0 decomp: 11905369 len: 3294388 to MEMORY
2015-04-13 19:02:31,849 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10308979 bytes from map-output for attempt_1426279437401_714565_m_000343_0
2015-04-13 19:02:31,850 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8184588 bytes from map-output for attempt_1426279437401_714565_m_000336_0
2015-04-13 19:02:31,855 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10492067 bytes from map-output for attempt_1426279437401_714565_m_000458_0
2015-04-13 19:02:31,858 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 about to shuffle output of map attempt_1426279437401_714565_m_000174_0 decomp: 12593978 len: 4541925 to MEMORY
2015-04-13 19:02:31,861 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 about to shuffle output of map attempt_1426279437401_714565_m_000474_0 decomp: 9517552 len: 2952254 to MEMORY
2015-04-13 19:02:31,865 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9064975 bytes from map-output for attempt_1426279437401_714565_m_000310_0
2015-04-13 19:02:31,865 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#11 about to shuffle output of map attempt_1426279437401_714565_m_000146_0 decomp: 12455298 len: 4460727 to MEMORY
2015-04-13 19:02:31,873 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 about to shuffle output of map attempt_1426279437401_714565_m_000439_0 decomp: 11922815 len: 4298713 to MEMORY
2015-04-13 19:02:31,873 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 about to shuffle output of map attempt_1426279437401_714565_m_000120_0 decomp: 16744376 len: 5266622 to MEMORY
2015-04-13 19:02:31,875 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 about to shuffle output of map attempt_1426279437401_714565_m_000511_0 decomp: 7192697 len: 2486686 to MEMORY
2015-04-13 19:02:31,877 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000475_0 decomp: 9542580 len: 3554669 to MEMORY
2015-04-13 19:02:31,902 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12717545 bytes from map-output for attempt_1426279437401_714565_m_000254_0
2015-04-13 19:02:31,902 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 4003281 bytes from map-output for attempt_1426279437401_714565_m_000553_0
2015-04-13 19:02:31,903 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8046685 bytes from map-output for attempt_1426279437401_714565_m_000507_0
2015-04-13 19:02:31,904 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11048841 bytes from map-output for attempt_1426279437401_714565_m_000346_0
2015-04-13 19:02:31,908 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10493654 bytes from map-output for attempt_1426279437401_714565_m_000319_0
2015-04-13 19:02:31,909 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 about to shuffle output of map attempt_1426279437401_714565_m_000466_0 decomp: 9656560 len: 3237261 to MEMORY
2015-04-13 19:02:31,915 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 about to shuffle output of map attempt_1426279437401_714565_m_000554_0 decomp: 4736505 len: 1227763 to MEMORY
2015-04-13 19:02:31,915 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 about to shuffle output of map attempt_1426279437401_714565_m_000571_0 decomp: 56953 len: 11524 to MEMORY
2015-04-13 19:02:31,915 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 56953 bytes from map-output for attempt_1426279437401_714565_m_000571_0
2015-04-13 19:02:31,916 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#10 about to shuffle output of map attempt_1426279437401_714565_m_000136_0 decomp: 14759762 len: 5199193 to MEMORY
2015-04-13 19:02:31,919 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#22 about to shuffle output of map attempt_1426279437401_714565_m_000068_0 decomp: 15220023 len: 5036209 to MEMORY
2015-04-13 19:02:31,929 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9205774, inMemoryMapOutputs.size() -> 35, commitMemory -> 374097510, usedMemory ->752527341
2015-04-13 19:02:31,930 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 56953, inMemoryMapOutputs.size() -> 36, commitMemory -> 383303284, usedMemory ->752527341
2015-04-13 19:02:31,931 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12197721 bytes from map-output for attempt_1426279437401_714565_m_000151_0
2015-04-13 19:02:31,932 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 about to shuffle output of map attempt_1426279437401_714565_m_000461_0 decomp: 9241684 len: 3097463 to MEMORY
2015-04-13 19:02:31,933 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9655005 bytes from map-output for attempt_1426279437401_714565_m_000493_0
2015-04-13 19:02:31,938 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12197721, inMemoryMapOutputs.size() -> 37, commitMemory -> 383360237, usedMemory ->774669933
2015-04-13 19:02:31,941 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 about to shuffle output of map attempt_1426279437401_714565_m_000400_0 decomp: 10540739 len: 3542348 to MEMORY
2015-04-13 19:02:31,938 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 about to shuffle output of map attempt_1426279437401_714565_m_000257_0 decomp: 12900908 len: 4679801 to MEMORY
2015-04-13 19:02:31,981 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11615252 bytes from map-output for attempt_1426279437401_714565_m_000224_0
2015-04-13 19:02:31,983 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9517552 bytes from map-output for attempt_1426279437401_714565_m_000474_0
2015-04-13 19:02:31,996 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 4736505 bytes from map-output for attempt_1426279437401_714565_m_000554_0
2015-04-13 19:02:31,996 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9668724 bytes from map-output for attempt_1426279437401_714565_m_000423_0
2015-04-13 19:02:31,979 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14540567 bytes from map-output for attempt_1426279437401_714565_m_000242_0
2015-04-13 19:02:31,979 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14805678 bytes from map-output for attempt_1426279437401_714565_m_000250_0
2015-04-13 19:02:31,975 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12716900 bytes from map-output for attempt_1426279437401_714565_m_000123_0
2015-04-13 19:02:31,973 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10493654, inMemoryMapOutputs.size() -> 38, commitMemory -> 395557958, usedMemory ->801094129
2015-04-13 19:02:31,971 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#36 about to shuffle output of map attempt_1426279437401_714565_m_000095_0 decomp: 15883457 len: 5254398 to MEMORY
2015-04-13 19:02:31,969 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7192697 bytes from map-output for attempt_1426279437401_714565_m_000511_0
2015-04-13 19:02:31,965 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14585852 bytes from map-output for attempt_1426279437401_714565_m_000124_0
2015-04-13 19:02:32,003 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7192697, inMemoryMapOutputs.size() -> 39, commitMemory -> 406051612, usedMemory ->801094129
2015-04-13 19:02:31,953 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#6 about to shuffle output of map attempt_1426279437401_714565_m_000315_0 decomp: 9390272 len: 3325267 to MEMORY
2015-04-13 19:02:32,009 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 about to shuffle output of map attempt_1426279437401_714565_m_000004_0 decomp: 23040391 len: 7352405 to MEMORY
2015-04-13 19:02:32,012 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11048841, inMemoryMapOutputs.size() -> 40, commitMemory -> 413244309, usedMemory ->834155515
2015-04-13 19:02:32,012 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 about to shuffle output of map attempt_1426279437401_714565_m_000440_0 decomp: 10020995 len: 3233327 to MEMORY
2015-04-13 19:02:32,012 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8046685, inMemoryMapOutputs.size() -> 41, commitMemory -> 424293150, usedMemory ->834155515
2015-04-13 19:02:32,012 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 4003281, inMemoryMapOutputs.size() -> 42, commitMemory -> 432339835, usedMemory ->834155515
2015-04-13 19:02:32,015 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9542580 bytes from map-output for attempt_1426279437401_714565_m_000475_0
2015-04-13 19:02:32,015 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#12 about to shuffle output of map attempt_1426279437401_714565_m_000185_0 decomp: 11543081 len: 3966221 to MEMORY
2015-04-13 19:02:32,017 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9241684 bytes from map-output for attempt_1426279437401_714565_m_000461_0
2015-04-13 19:02:32,018 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12593978 bytes from map-output for attempt_1426279437401_714565_m_000174_0
2015-04-13 19:02:32,020 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12974495 bytes from map-output for attempt_1426279437401_714565_m_000189_0
2015-04-13 19:02:32,022 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9542580, inMemoryMapOutputs.size() -> 43, commitMemory -> 436343116, usedMemory ->845698596
2015-04-13 19:02:32,022 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12717545, inMemoryMapOutputs.size() -> 44, commitMemory -> 445885696, usedMemory ->845698596
2015-04-13 19:02:32,012 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9656560 bytes from map-output for attempt_1426279437401_714565_m_000466_0
2015-04-13 19:02:32,026 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000104_0 decomp: 10201129 len: 3207977 to MEMORY
2015-04-13 19:02:32,029 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9064975, inMemoryMapOutputs.size() -> 45, commitMemory -> 458603241, usedMemory ->870147917
2015-04-13 19:02:32,029 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#32 about to shuffle output of map attempt_1426279437401_714565_m_000158_0 decomp: 14248192 len: 4745893 to MEMORY
2015-04-13 19:02:32,029 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0515.stratus.lvs.ebay.com:13562 freed by fetcher#30 in 342ms
2015-04-13 19:02:32,029 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0358.stratus.lvs.ebay.com:13562 with 1 to fetcher#30
2015-04-13 19:02:32,030 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0358.stratus.lvs.ebay.com:13562 to fetcher#30
2015-04-13 19:02:32,033 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10492067, inMemoryMapOutputs.size() -> 46, commitMemory -> 467668216, usedMemory ->870147917
2015-04-13 19:02:32,033 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8184588, inMemoryMapOutputs.size() -> 47, commitMemory -> 478160283, usedMemory ->870147917
2015-04-13 19:02:32,033 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000192_0 sent hash and received reply
2015-04-13 19:02:32,037 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 about to shuffle output of map attempt_1426279437401_714565_m_000216_0 decomp: 12558357 len: 4478587 to MEMORY
2015-04-13 19:02:32,040 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11922815 bytes from map-output for attempt_1426279437401_714565_m_000439_0
2015-04-13 19:02:32,043 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10308979, inMemoryMapOutputs.size() -> 48, commitMemory -> 486344871, usedMemory ->905236325
2015-04-13 19:02:32,043 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0580.stratus.lvs.ebay.com:13562 freed by fetcher#17 in 362ms
2015-04-13 19:02:32,044 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0664.stratus.lvs.ebay.com:13562 with 4 to fetcher#17
2015-04-13 19:02:32,044 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0664.stratus.lvs.ebay.com:13562 to fetcher#17
2015-04-13 19:02:32,046 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8194870, inMemoryMapOutputs.size() -> 49, commitMemory -> 496653850, usedMemory ->905236325
2015-04-13 19:02:32,046 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9656560, inMemoryMapOutputs.size() -> 50, commitMemory -> 504848720, usedMemory ->905236325
2015-04-13 19:02:32,049 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000491_0,attempt_1426279437401_714565_m_000290_0,attempt_1426279437401_714565_m_000220_0,attempt_1426279437401_714565_m_000035_0 sent hash and received reply
2015-04-13 19:02:32,050 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11905369 bytes from map-output for attempt_1426279437401_714565_m_000204_0
2015-04-13 19:02:32,040 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 about to shuffle output of map attempt_1426279437401_714565_m_000192_0 decomp: 10955887 len: 3091263 to MEMORY
2015-04-13 19:02:32,043 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#15 about to shuffle output of map attempt_1426279437401_714565_m_000330_0 decomp: 11574164 len: 3655928 to MEMORY
2015-04-13 19:02:32,051 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 about to shuffle output of map attempt_1426279437401_714565_m_000081_0 decomp: 17154035 len: 5989641 to MEMORY
2015-04-13 19:02:32,053 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 about to shuffle output of map attempt_1426279437401_714565_m_000491_0 decomp: 9034815 len: 2956704 to MEMORY
2015-04-13 19:02:32,056 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12974495, inMemoryMapOutputs.size() -> 51, commitMemory -> 514505280, usedMemory ->942914515
2015-04-13 19:02:32,056 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 about to shuffle output of map attempt_1426279437401_714565_m_000329_0 decomp: 11489340 len: 3998466 to MEMORY
2015-04-13 19:02:32,061 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12593978, inMemoryMapOutputs.size() -> 52, commitMemory -> 527479775, usedMemory ->957157508
2015-04-13 19:02:32,061 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9241684, inMemoryMapOutputs.size() -> 53, commitMemory -> 540073753, usedMemory ->957157508
2015-04-13 19:02:32,061 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0730.stratus.lvs.ebay.com:13562 freed by fetcher#9 in 374ms
2015-04-13 19:02:32,061 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0557.stratus.lvs.ebay.com:13562 with 1 to fetcher#9
2015-04-13 19:02:32,061 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0557.stratus.lvs.ebay.com:13562 to fetcher#9
2015-04-13 19:02:32,063 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0493.stratus.lvs.ebay.com:13562 freed by fetcher#1 in 374ms
2015-04-13 19:02:32,063 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0533.stratus.lvs.ebay.com:13562 with 1 to fetcher#1
2015-04-13 19:02:32,063 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0533.stratus.lvs.ebay.com:13562 to fetcher#1
2015-04-13 19:02:32,066 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14585852, inMemoryMapOutputs.size() -> 54, commitMemory -> 549315437, usedMemory ->975144669
2015-04-13 19:02:32,066 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000172_0 decomp: 14242993 len: 4189912 to MEMORY
2015-04-13 19:02:32,066 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000388_0 sent hash and received reply
2015-04-13 19:02:32,067 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10540739 bytes from map-output for attempt_1426279437401_714565_m_000400_0
2015-04-13 19:02:32,068 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000313_0 sent hash and received reply
2015-04-13 19:02:32,069 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 about to shuffle output of map attempt_1426279437401_714565_m_000260_0 decomp: 9556580 len: 3023883 to MEMORY
2015-04-13 19:02:32,072 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle output of map attempt_1426279437401_714565_m_000313_0 decomp: 12275820 len: 4162181 to MEMORY
2015-04-13 19:02:32,073 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12455298 bytes from map-output for attempt_1426279437401_714565_m_000146_0
2015-04-13 19:02:32,076 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12716900, inMemoryMapOutputs.size() -> 55, commitMemory -> 563901289, usedMemory ->1008082697
2015-04-13 19:02:32,076 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14805678, inMemoryMapOutputs.size() -> 56, commitMemory -> 576618189, usedMemory ->1008082697
2015-04-13 19:02:32,066 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 about to shuffle output of map attempt_1426279437401_714565_m_000072_0 decomp: 17987161 len: 6079374 to MEMORY
2015-04-13 19:02:32,076 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#9 about to shuffle output of map attempt_1426279437401_714565_m_000388_0 decomp: 11105628 len: 3563644 to MEMORY
2015-04-13 19:02:32,081 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10020995 bytes from map-output for attempt_1426279437401_714565_m_000440_0
2015-04-13 19:02:32,089 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 about to shuffle output of map attempt_1426279437401_714565_m_000079_0 decomp: 16992910 len: 4965923 to MEMORY
2015-04-13 19:02:32,095 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14540567, inMemoryMapOutputs.size() -> 57, commitMemory -> 591423867, usedMemory ->1041874889
2015-04-13 19:02:32,095 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 about to shuffle output of map attempt_1426279437401_714565_m_000129_0 decomp: 16799282 len: 5803268 to MEMORY
2015-04-13 19:02:32,097 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15220023 bytes from map-output for attempt_1426279437401_714565_m_000068_0
2015-04-13 19:02:32,099 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 about to shuffle output of map attempt_1426279437401_714565_m_000187_0 decomp: 12991412 len: 4029887 to MEMORY
2015-04-13 19:02:32,104 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14759762 bytes from map-output for attempt_1426279437401_714565_m_000136_0
2015-04-13 19:02:32,105 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 4736505, inMemoryMapOutputs.size() -> 58, commitMemory -> 605964434, usedMemory ->1054866301
2015-04-13 19:02:32,105 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9668724, inMemoryMapOutputs.size() -> 59, commitMemory -> 610700939, usedMemory ->1054866301
2015-04-13 19:02:32,107 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 about to shuffle output of map attempt_1426279437401_714565_m_000500_0 decomp: 6932741 len: 1987078 to MEMORY
2015-04-13 19:02:32,112 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9517552, inMemoryMapOutputs.size() -> 60, commitMemory -> 620369663, usedMemory ->1074621542
2015-04-13 19:02:32,112 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11615252, inMemoryMapOutputs.size() -> 61, commitMemory -> 629887215, usedMemory ->1074621542
2015-04-13 19:02:32,112 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,112 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0364.stratus.lvs.ebay.com:13562 freed by fetcher#3 in 427ms
2015-04-13 19:02:32,112 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0310.stratus.lvs.ebay.com:13562 with 1 to fetcher#3
2015-04-13 19:02:32,112 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0310.stratus.lvs.ebay.com:13562 to fetcher#3
2015-04-13 19:02:32,112 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0469.stratus.lvs.ebay.com:13562 freed by fetcher#8 in 414ms
2015-04-13 19:02:32,113 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0633.stratus.lvs.ebay.com:13562 with 3 to fetcher#8
2015-04-13 19:02:32,113 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0633.stratus.lvs.ebay.com:13562 to fetcher#8
2015-04-13 19:02:32,113 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9655005, inMemoryMapOutputs.size() -> 62, commitMemory -> 641502467, usedMemory ->1074621542
2015-04-13 19:02:32,113 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,114 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0010.stratus.lvs.ebay.com:13562 freed by fetcher#16 in 431ms
2015-04-13 19:02:32,114 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0748.stratus.lvs.ebay.com:13562 with 7 to fetcher#16
2015-04-13 19:02:32,114 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 7 of 7 to lvsdpehdc25dn0748.stratus.lvs.ebay.com:13562 to fetcher#16
2015-04-13 19:02:32,114 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 16744376 bytes from map-output for attempt_1426279437401_714565_m_000120_0
2015-04-13 19:02:32,114 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 16744376, inMemoryMapOutputs.size() -> 63, commitMemory -> 651157472, usedMemory ->1074621542
2015-04-13 19:02:32,114 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,114 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0395.stratus.lvs.ebay.com:13562 freed by fetcher#29 in 416ms
2015-04-13 19:02:32,114 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0116.stratus.lvs.ebay.com:13562 with 2 to fetcher#29
2015-04-13 19:02:32,114 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0116.stratus.lvs.ebay.com:13562 to fetcher#29
2015-04-13 19:02:32,112 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 about to shuffle output of map attempt_1426279437401_714565_m_000177_0 decomp: 12822500 len: 4078649 to MEMORY
2015-04-13 19:02:32,116 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 18213638 bytes from map-output for attempt_1426279437401_714565_m_000027_0
2015-04-13 19:02:32,116 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 18213638, inMemoryMapOutputs.size() -> 64, commitMemory -> 667901848, usedMemory ->1074621542
2015-04-13 19:02:32,116 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0617.stratus.lvs.ebay.com:13562 freed by fetcher#24 in 434ms
2015-04-13 19:02:32,116 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0710.stratus.lvs.ebay.com:13562 with 1 to fetcher#24
2015-04-13 19:02:32,116 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0710.stratus.lvs.ebay.com:13562 to fetcher#24
2015-04-13 19:02:32,120 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14759762, inMemoryMapOutputs.size() -> 65, commitMemory -> 686115486, usedMemory ->1074621542
2015-04-13 19:02:32,120 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000080_0 sent hash and received reply
2015-04-13 19:02:32,120 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,120 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0082.stratus.lvs.ebay.com:13562 freed by fetcher#10 in 425ms
2015-04-13 19:02:32,120 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0227.stratus.lvs.ebay.com:13562 with 6 to fetcher#10
2015-04-13 19:02:32,120 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 6 of 6 to lvsdpehdc25dn0227.stratus.lvs.ebay.com:13562 to fetcher#10
2015-04-13 19:02:32,121 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15220023, inMemoryMapOutputs.size() -> 66, commitMemory -> 700875248, usedMemory ->1074621542
2015-04-13 19:02:32,121 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Starting inMemoryMerger's merge since commitMemory=716095271 > mergeThreshold=708669632. Current usedMemory=1074621542
2015-04-13 19:02:32,121 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.MergeThread: InMemoryMerger - Thread to merge in-memory shuffled map-outputs: Starting merge with 66 segments, while ignoring 0 segments
2015-04-13 19:02:32,123 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9390272 bytes from map-output for attempt_1426279437401_714565_m_000315_0
2015-04-13 19:02:32,125 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11489340 bytes from map-output for attempt_1426279437401_714565_m_000329_0
2015-04-13 19:02:32,132 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9556580 bytes from map-output for attempt_1426279437401_714565_m_000260_0
2015-04-13 19:02:32,134 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10020995, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->1074621542
2015-04-13 19:02:32,134 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0138.stratus.lvs.ebay.com:13562 freed by fetcher#25 in 438ms
2015-04-13 19:02:32,134 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0225.stratus.lvs.ebay.com:13562 freed by fetcher#4 in 448ms
2015-04-13 19:02:32,134 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12455298, inMemoryMapOutputs.size() -> 2, commitMemory -> 10020995, usedMemory ->1074621542
2015-04-13 19:02:32,134 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#11 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,135 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0313.stratus.lvs.ebay.com:13562 freed by fetcher#11 in 437ms
2015-04-13 19:02:32,135 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10540739, inMemoryMapOutputs.size() -> 3, commitMemory -> 22476293, usedMemory ->1074621542
2015-04-13 19:02:32,135 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,135 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0219.stratus.lvs.ebay.com:13562 freed by fetcher#35 in 442ms
2015-04-13 19:02:32,135 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11922815, inMemoryMapOutputs.size() -> 4, commitMemory -> 33017032, usedMemory ->1074621542
2015-04-13 19:02:32,135 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0077.stratus.lvs.ebay.com:13562 freed by fetcher#20 in 438ms
2015-04-13 19:02:32,136 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11905369, inMemoryMapOutputs.size() -> 5, commitMemory -> 44939847, usedMemory ->1074621542
2015-04-13 19:02:32,136 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0218.stratus.lvs.ebay.com:13562 freed by fetcher#5 in 440ms
2015-04-13 19:02:32,137 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000021_0 sent hash and received reply
2015-04-13 19:02:32,138 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000355_0,attempt_1426279437401_714565_m_000280_0,attempt_1426279437401_714565_m_000175_0 sent hash and received reply
2015-04-13 19:02:32,138 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,138 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0710.stratus.lvs.ebay.com:13562 freed by fetcher#24 in 22ms
2015-04-13 19:02:32,138 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,138 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0633.stratus.lvs.ebay.com:13562 freed by fetcher#8 in 25ms
2015-04-13 19:02:32,140 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12900908 bytes from map-output for attempt_1426279437401_714565_m_000257_0
2015-04-13 19:02:32,140 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11543081 bytes from map-output for attempt_1426279437401_714565_m_000185_0
2015-04-13 19:02:32,140 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12900908, inMemoryMapOutputs.size() -> 6, commitMemory -> 56845216, usedMemory ->1074621542
2015-04-13 19:02:32,141 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,141 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0195.stratus.lvs.ebay.com:13562 freed by fetcher#13 in 457ms
2015-04-13 19:02:32,141 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000453_0,attempt_1426279437401_714565_m_000109_0 sent hash and received reply
2015-04-13 19:02:32,141 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,141 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0116.stratus.lvs.ebay.com:13562 freed by fetcher#29 in 27ms
2015-04-13 19:02:32,142 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0078.stratus.lvs.ebay.com:13562 freed by fetcher#22 in 447ms
2015-04-13 19:02:32,148 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000364_0,attempt_1426279437401_714565_m_000331_0,attempt_1426279437401_714565_m_000385_0,attempt_1426279437401_714565_m_000184_0,attempt_1426279437401_714565_m_000153_0,attempt_1426279437401_714565_m_000166_0 sent hash and received reply
2015-04-13 19:02:32,149 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#10 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,149 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0227.stratus.lvs.ebay.com:13562 freed by fetcher#10 in 29ms
2015-04-13 19:02:32,157 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9034815 bytes from map-output for attempt_1426279437401_714565_m_000491_0
2015-04-13 19:02:32,157 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9034815, inMemoryMapOutputs.size() -> 7, commitMemory -> 69746124, usedMemory ->1074621542
2015-04-13 19:02:32,158 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,158 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12558357 bytes from map-output for attempt_1426279437401_714565_m_000216_0
2015-04-13 19:02:32,158 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0664.stratus.lvs.ebay.com:13562 freed by fetcher#17 in 114ms
2015-04-13 19:02:32,158 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9556580, inMemoryMapOutputs.size() -> 8, commitMemory -> 78780939, usedMemory ->1074621542
2015-04-13 19:02:32,159 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11489340, inMemoryMapOutputs.size() -> 9, commitMemory -> 88337519, usedMemory ->1074621542
2015-04-13 19:02:32,159 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10955887 bytes from map-output for attempt_1426279437401_714565_m_000192_0
2015-04-13 19:02:32,159 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9390272, inMemoryMapOutputs.size() -> 10, commitMemory -> 99826859, usedMemory ->1074621542
2015-04-13 19:02:32,159 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0310.stratus.lvs.ebay.com:13562 freed by fetcher#3 in 47ms
2015-04-13 19:02:32,159 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#6 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,159 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0044.stratus.lvs.ebay.com:13562 freed by fetcher#6 in 472ms
2015-04-13 19:02:32,162 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10955887, inMemoryMapOutputs.size() -> 11, commitMemory -> 109217131, usedMemory ->1074621542
2015-04-13 19:02:32,162 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0358.stratus.lvs.ebay.com:13562 freed by fetcher#30 in 132ms
2015-04-13 19:02:32,164 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14242993 bytes from map-output for attempt_1426279437401_714565_m_000172_0
2015-04-13 19:02:32,165 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14242993, inMemoryMapOutputs.size() -> 12, commitMemory -> 120173018, usedMemory ->1074621542
2015-04-13 19:02:32,165 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12558357, inMemoryMapOutputs.size() -> 13, commitMemory -> 134416011, usedMemory ->1074621542
2015-04-13 19:02:32,165 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11543081, inMemoryMapOutputs.size() -> 14, commitMemory -> 146974368, usedMemory ->1074621542
2015-04-13 19:02:32,165 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,165 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0264.stratus.lvs.ebay.com:13562 freed by fetcher#12 in 481ms
2015-04-13 19:02:32,166 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0070.stratus.lvs.ebay.com:13562 freed by fetcher#33 in 483ms
2015-04-13 19:02:32,168 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,168 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,168 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0685.stratus.lvs.ebay.com:13562 freed by fetcher#28 in 488ms
2015-04-13 19:02:32,168 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0100.stratus.lvs.ebay.com:13562 freed by fetcher#14 in 487ms
2015-04-13 19:02:32,170 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6932741 bytes from map-output for attempt_1426279437401_714565_m_000500_0
2015-04-13 19:02:32,170 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6932741, inMemoryMapOutputs.size() -> 15, commitMemory -> 158517449, usedMemory ->1074621542
2015-04-13 19:02:32,170 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0687.stratus.lvs.ebay.com:13562 freed by fetcher#34 in 476ms
2015-04-13 19:02:32,173 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11105628 bytes from map-output for attempt_1426279437401_714565_m_000388_0
2015-04-13 19:02:32,173 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11105628, inMemoryMapOutputs.size() -> 16, commitMemory -> 165450190, usedMemory ->1074621542
2015-04-13 19:02:32,173 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0557.stratus.lvs.ebay.com:13562 freed by fetcher#9 in 112ms
2015-04-13 19:02:32,176 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11574164 bytes from map-output for attempt_1426279437401_714565_m_000330_0
2015-04-13 19:02:32,176 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14248192 bytes from map-output for attempt_1426279437401_714565_m_000158_0
2015-04-13 19:02:32,176 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11574164, inMemoryMapOutputs.size() -> 17, commitMemory -> 176555818, usedMemory ->1074621542
2015-04-13 19:02:32,176 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14248192, inMemoryMapOutputs.size() -> 18, commitMemory -> 188129982, usedMemory ->1074621542
2015-04-13 19:02:32,177 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#15 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,177 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,177 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0305.stratus.lvs.ebay.com:13562 freed by fetcher#32 in 480ms
2015-04-13 19:02:32,181 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0762.stratus.lvs.ebay.com:13562 freed by fetcher#23 in 499ms
2015-04-13 19:02:32,187 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0386.stratus.lvs.ebay.com:13562 freed by fetcher#15 in 499ms
2015-04-13 19:02:32,192 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12822500 bytes from map-output for attempt_1426279437401_714565_m_000177_0
2015-04-13 19:02:32,193 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12275820 bytes from map-output for attempt_1426279437401_714565_m_000313_0
2015-04-13 19:02:32,193 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12822500, inMemoryMapOutputs.size() -> 19, commitMemory -> 202378174, usedMemory ->1074621542
2015-04-13 19:02:32,193 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,193 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0535.stratus.lvs.ebay.com:13562 freed by fetcher#7 in 498ms
2015-04-13 19:02:32,194 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12275820, inMemoryMapOutputs.size() -> 20, commitMemory -> 215200674, usedMemory ->1074621542
2015-04-13 19:02:32,194 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0533.stratus.lvs.ebay.com:13562 freed by fetcher#1 in 131ms
2015-04-13 19:02:32,204 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 23040391 bytes from map-output for attempt_1426279437401_714565_m_000004_0
2015-04-13 19:02:32,204 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 23040391, inMemoryMapOutputs.size() -> 21, commitMemory -> 227476494, usedMemory ->1074621542
2015-04-13 19:02:32,205 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0412.stratus.lvs.ebay.com:13562 freed by fetcher#26 in 520ms
2015-04-13 19:02:32,219 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10201129 bytes from map-output for attempt_1426279437401_714565_m_000104_0
2015-04-13 19:02:32,220 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10201129, inMemoryMapOutputs.size() -> 22, commitMemory -> 250516885, usedMemory ->1074621542
2015-04-13 19:02:32,220 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,220 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0618.stratus.lvs.ebay.com:13562 freed by fetcher#21 in 533ms
2015-04-13 19:02:32,220 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 17154035 bytes from map-output for attempt_1426279437401_714565_m_000081_0
2015-04-13 19:02:32,221 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 17154035, inMemoryMapOutputs.size() -> 23, commitMemory -> 260718014, usedMemory ->1074621542
2015-04-13 19:02:32,221 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,221 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0008.stratus.lvs.ebay.com:13562 freed by fetcher#27 in 531ms
2015-04-13 19:02:32,228 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12991412 bytes from map-output for attempt_1426279437401_714565_m_000187_0
2015-04-13 19:02:32,228 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12991412, inMemoryMapOutputs.size() -> 24, commitMemory -> 277872049, usedMemory ->1074621542
2015-04-13 19:02:32,228 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0090.stratus.lvs.ebay.com:13562 freed by fetcher#18 in 538ms
2015-04-13 19:02:32,230 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 16799282 bytes from map-output for attempt_1426279437401_714565_m_000129_0
2015-04-13 19:02:32,230 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 16799282, inMemoryMapOutputs.size() -> 25, commitMemory -> 290863461, usedMemory ->1074621542
2015-04-13 19:02:32,230 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0325.stratus.lvs.ebay.com:13562 freed by fetcher#2 in 546ms
2015-04-13 19:02:32,231 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 16992910 bytes from map-output for attempt_1426279437401_714565_m_000079_0
2015-04-13 19:02:32,231 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 16992910, inMemoryMapOutputs.size() -> 26, commitMemory -> 307662743, usedMemory ->1074621542
2015-04-13 19:02:32,231 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,231 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0458.stratus.lvs.ebay.com:13562 freed by fetcher#31 in 545ms
2015-04-13 19:02:32,232 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000501_0,attempt_1426279437401_714565_m_000450_0,attempt_1426279437401_714565_m_000488_0,attempt_1426279437401_714565_m_000372_0,attempt_1426279437401_714565_m_000449_0,attempt_1426279437401_714565_m_000298_0,attempt_1426279437401_714565_m_000111_0 sent hash and received reply
2015-04-13 19:02:32,232 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,233 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0748.stratus.lvs.ebay.com:13562 freed by fetcher#16 in 119ms
2015-04-13 19:02:32,236 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 17987161 bytes from map-output for attempt_1426279437401_714565_m_000072_0
2015-04-13 19:02:32,236 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 17987161, inMemoryMapOutputs.size() -> 27, commitMemory -> 324655653, usedMemory ->1074621542
2015-04-13 19:02:32,236 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 - MergeManager returned status WAIT ...
2015-04-13 19:02:32,237 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0300.stratus.lvs.ebay.com:13562 freed by fetcher#19 in 543ms
2015-04-13 19:02:32,250 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15883457 bytes from map-output for attempt_1426279437401_714565_m_000095_0
2015-04-13 19:02:32,251 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15883457, inMemoryMapOutputs.size() -> 28, commitMemory -> 342642814, usedMemory ->1074621542
2015-04-13 19:02:32,251 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0414.stratus.lvs.ebay.com:13562 freed by fetcher#36 in 568ms
2015-04-13 19:02:32,282 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Initiating in-memory merge with 66 segments...
2015-04-13 19:02:32,282 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapred.Merger: Merging 66 sorted segments
2015-04-13 19:02:32,283 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 66 segments left of total size: 716092895 bytes
2015-04-13 19:02:37,487 INFO [EventFetcher for fetching Map Completion Events] org.apache.hadoop.mapreduce.task.reduce.EventFetcher: attempt_1426279437401_714565_r_000318_0: Got 1 new map-outputs
2015-04-13 19:02:44,354 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: attempt_1426279437401_714565_r_000318_0 Merge of the 66 files in-memory complete. Local file is /hadoop/1/scratch/local/usercache/b_pulsar_coe/appcache/application_1426279437401_714565/output/attempt_1426279437401_714565_r_000318_0/map_571.out.merged of size 223534248
2015-04-13 19:02:44,354 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0446.stratus.lvs.ebay.com:13562 with 5 to fetcher#36
2015-04-13 19:02:44,355 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0516.stratus.lvs.ebay.com:13562 with 3 to fetcher#16
2015-04-13 19:02:44,355 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0581.stratus.lvs.ebay.com:13562 with 1 to fetcher#1
2015-04-13 19:02:44,355 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0065.stratus.lvs.ebay.com:13562 with 1 to fetcher#34
2015-04-13 19:02:44,355 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0065.stratus.lvs.ebay.com:13562 to fetcher#34
2015-04-13 19:02:44,355 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0389.stratus.lvs.ebay.com:13562 with 1 to fetcher#19
2015-04-13 19:02:44,355 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0389.stratus.lvs.ebay.com:13562 to fetcher#19
2015-04-13 19:02:44,356 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0319.stratus.lvs.ebay.com:13562 with 5 to fetcher#5
2015-04-13 19:02:44,356 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0319.stratus.lvs.ebay.com:13562 to fetcher#5
2015-04-13 19:02:44,356 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0094.stratus.lvs.ebay.com:13562 with 4 to fetcher#24
2015-04-13 19:02:44,356 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0094.stratus.lvs.ebay.com:13562 to fetcher#24
2015-04-13 19:02:44,357 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0219.stratus.lvs.ebay.com:13562 with 2 to fetcher#8
2015-04-13 19:02:44,357 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0219.stratus.lvs.ebay.com:13562 to fetcher#8
2015-04-13 19:02:44,357 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0376.stratus.lvs.ebay.com:13562 with 1 to fetcher#13
2015-04-13 19:02:44,357 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0376.stratus.lvs.ebay.com:13562 to fetcher#13
2015-04-13 19:02:44,357 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000357_0 sent hash and received reply
2015-04-13 19:02:44,358 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0323.stratus.lvs.ebay.com:13562 with 1 to fetcher#29
2015-04-13 19:02:44,359 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0574.stratus.lvs.ebay.com:13562 with 4 to fetcher#22
2015-04-13 19:02:44,359 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0574.stratus.lvs.ebay.com:13562 to fetcher#22
2015-04-13 19:02:44,359 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0413.stratus.lvs.ebay.com:13562 with 2 to fetcher#10
2015-04-13 19:02:44,359 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0413.stratus.lvs.ebay.com:13562 to fetcher#10
2015-04-13 19:02:44,359 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0116.stratus.lvs.ebay.com:13562 with 2 to fetcher#17
2015-04-13 19:02:44,359 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000266_0 sent hash and received reply
2015-04-13 19:02:44,359 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0116.stratus.lvs.ebay.com:13562 to fetcher#17
2015-04-13 19:02:44,360 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0359.stratus.lvs.ebay.com:13562 with 3 to fetcher#3
2015-04-13 19:02:44,360 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0359.stratus.lvs.ebay.com:13562 to fetcher#3
2015-04-13 19:02:44,360 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 about to shuffle output of map attempt_1426279437401_714565_m_000357_0 decomp: 9831906 len: 3099250 to MEMORY
2015-04-13 19:02:44,361 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0081.stratus.lvs.ebay.com:13562 with 1 to fetcher#6
2015-04-13 19:02:44,361 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0081.stratus.lvs.ebay.com:13562 to fetcher#6
2015-04-13 19:02:44,361 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0115.stratus.lvs.ebay.com:13562 with 6 to fetcher#30
2015-04-13 19:02:44,361 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 6 of 6 to lvsdpehdc25dn0115.stratus.lvs.ebay.com:13562 to fetcher#30
2015-04-13 19:02:44,362 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0748.stratus.lvs.ebay.com:13562 with 7 to fetcher#12
2015-04-13 19:02:44,362 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 7 of 7 to lvsdpehdc25dn0748.stratus.lvs.ebay.com:13562 to fetcher#12
2015-04-13 19:02:44,363 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0186.stratus.lvs.ebay.com:13562 with 2 to fetcher#33
2015-04-13 19:02:44,363 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0186.stratus.lvs.ebay.com:13562 to fetcher#33
2015-04-13 19:02:44,363 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000109_0,attempt_1426279437401_714565_m_000453_0 sent hash and received reply
2015-04-13 19:02:44,363 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 about to shuffle output of map attempt_1426279437401_714565_m_000266_0 decomp: 11047446 len: 3832824 to MEMORY
2015-04-13 19:02:44,363 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 with 8 to fetcher#28
2015-04-13 19:02:44,363 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 8 of 8 to lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 to fetcher#28
2015-04-13 19:02:44,363 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0261.stratus.lvs.ebay.com:13562 with 3 to fetcher#14
2015-04-13 19:02:44,363 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0261.stratus.lvs.ebay.com:13562 to fetcher#14
2015-04-13 19:02:44,363 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0581.stratus.lvs.ebay.com:13562 to fetcher#1
2015-04-13 19:02:44,363 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0188.stratus.lvs.ebay.com:13562 with 2 to fetcher#9
2015-04-13 19:02:44,364 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0188.stratus.lvs.ebay.com:13562 to fetcher#9
2015-04-13 19:02:44,364 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000270_0,attempt_1426279437401_714565_m_000246_0,attempt_1426279437401_714565_m_000337_0,attempt_1426279437401_714565_m_000239_0,attempt_1426279437401_714565_m_000161_0 sent hash and received reply
2015-04-13 19:02:44,364 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0734.stratus.lvs.ebay.com:13562 with 1 to fetcher#32
2015-04-13 19:02:44,364 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000118_0,attempt_1426279437401_714565_m_000169_0 sent hash and received reply
2015-04-13 19:02:44,364 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0734.stratus.lvs.ebay.com:13562 to fetcher#32
2015-04-13 19:02:44,365 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000447_0,attempt_1426279437401_714565_m_000262_0,attempt_1426279437401_714565_m_000231_0,attempt_1426279437401_714565_m_000156_0 sent hash and received reply
2015-04-13 19:02:44,365 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0019.stratus.lvs.ebay.com:13562 with 2 to fetcher#23
2015-04-13 19:02:44,365 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0019.stratus.lvs.ebay.com:13562 to fetcher#23
2015-04-13 19:02:44,365 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000039_0 sent hash and received reply
2015-04-13 19:02:44,366 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000517_0,attempt_1426279437401_714565_m_000221_0,attempt_1426279437401_714565_m_000213_0,attempt_1426279437401_714565_m_000055_0 sent hash and received reply
2015-04-13 19:02:44,366 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000223_0,attempt_1426279437401_714565_m_000084_0 sent hash and received reply
2015-04-13 19:02:44,366 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0671.stratus.lvs.ebay.com:13562 with 1 to fetcher#15
2015-04-13 19:02:44,366 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0671.stratus.lvs.ebay.com:13562 to fetcher#15
2015-04-13 19:02:44,366 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000318_0 sent hash and received reply
2015-04-13 19:02:44,366 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0386.stratus.lvs.ebay.com:13562 with 2 to fetcher#7
2015-04-13 19:02:44,367 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0386.stratus.lvs.ebay.com:13562 to fetcher#7
2015-04-13 19:02:44,367 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000560_0,attempt_1426279437401_714565_m_000376_0,attempt_1426279437401_714565_m_000112_0 sent hash and received reply
2015-04-13 19:02:44,367 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 about to shuffle output of map attempt_1426279437401_714565_m_000109_0 decomp: 14339005 len: 5052282 to MEMORY
2015-04-13 19:02:44,367 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0516.stratus.lvs.ebay.com:13562 to fetcher#16
2015-04-13 19:02:44,367 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0442.stratus.lvs.ebay.com:13562 with 4 to fetcher#26
2015-04-13 19:02:44,367 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0442.stratus.lvs.ebay.com:13562 to fetcher#26
2015-04-13 19:02:44,368 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000445_0,attempt_1426279437401_714565_m_000264_0 sent hash and received reply
2015-04-13 19:02:44,368 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000526_0,attempt_1426279437401_714565_m_000227_0,attempt_1426279437401_714565_m_000085_0 sent hash and received reply
2015-04-13 19:02:44,369 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000074_0 sent hash and received reply
2015-04-13 19:02:44,368 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0187.stratus.lvs.ebay.com:13562 with 2 to fetcher#21
2015-04-13 19:02:44,369 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0187.stratus.lvs.ebay.com:13562 to fetcher#21
2015-04-13 19:02:44,369 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0230.stratus.lvs.ebay.com:13562 with 7 to fetcher#27
2015-04-13 19:02:44,369 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 7 of 7 to lvsdpehdc25dn0230.stratus.lvs.ebay.com:13562 to fetcher#27
2015-04-13 19:02:44,370 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000043_0 sent hash and received reply
2015-04-13 19:02:44,370 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000407_0,attempt_1426279437401_714565_m_000119_0,attempt_1426279437401_714565_m_000049_0 sent hash and received reply
2015-04-13 19:02:44,371 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#6 about to shuffle output of map attempt_1426279437401_714565_m_000318_0 decomp: 9811535 len: 2982694 to MEMORY
2015-04-13 19:02:44,371 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0160.stratus.lvs.ebay.com:13562 with 1 to fetcher#18
2015-04-13 19:02:44,371 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0160.stratus.lvs.ebay.com:13562 to fetcher#18
2015-04-13 19:02:44,371 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000298_0,attempt_1426279437401_714565_m_000372_0,attempt_1426279437401_714565_m_000488_0,attempt_1426279437401_714565_m_000450_0,attempt_1426279437401_714565_m_000501_0,attempt_1426279437401_714565_m_000111_0,attempt_1426279437401_714565_m_000449_0 sent hash and received reply
2015-04-13 19:02:44,371 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000044_0,attempt_1426279437401_714565_m_000190_0 sent hash and received reply
2015-04-13 19:02:44,371 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0226.stratus.lvs.ebay.com:13562 with 4 to fetcher#2
2015-04-13 19:02:44,371 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0226.stratus.lvs.ebay.com:13562 to fetcher#2
2015-04-13 19:02:44,371 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0535.stratus.lvs.ebay.com:13562 with 4 to fetcher#31
2015-04-13 19:02:44,371 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0535.stratus.lvs.ebay.com:13562 to fetcher#31
2015-04-13 19:02:44,372 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0446.stratus.lvs.ebay.com:13562 to fetcher#36
2015-04-13 19:02:44,372 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#22 about to shuffle output of map attempt_1426279437401_714565_m_000517_0 decomp: 6283774 len: 1939212 to MEMORY
2015-04-13 19:02:44,373 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0323.stratus.lvs.ebay.com:13562 to fetcher#29
2015-04-13 19:02:44,373 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000140_0,attempt_1426279437401_714565_m_000083_0 sent hash and received reply
2015-04-13 19:02:44,374 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0429.stratus.lvs.ebay.com:13562 with 6 to fetcher#25
2015-04-13 19:02:44,374 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000472_0,attempt_1426279437401_714565_m_000240_0,attempt_1426279437401_714565_m_000128_0,attempt_1426279437401_714565_m_000056_0,attempt_1426279437401_714565_m_000070_0,attempt_1426279437401_714565_m_000009_0 sent hash and received reply
2015-04-13 19:02:44,368 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 about to shuffle output of map attempt_1426279437401_714565_m_000560_0 decomp: 3793928 len: 1348171 to MEMORY
2015-04-13 19:02:44,374 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 6 of 6 to lvsdpehdc25dn0429.stratus.lvs.ebay.com:13562 to fetcher#25
2015-04-13 19:02:44,374 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000209_0,attempt_1426279437401_714565_m_000267_0 sent hash and received reply
2015-04-13 19:02:44,374 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000333_0,attempt_1426279437401_714565_m_000200_0 sent hash and received reply
2015-04-13 19:02:44,375 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0691.stratus.lvs.ebay.com:13562 with 2 to fetcher#4
2015-04-13 19:02:44,375 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0691.stratus.lvs.ebay.com:13562 to fetcher#4
2015-04-13 19:02:44,376 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0269.stratus.lvs.ebay.com:13562 with 2 to fetcher#11
2015-04-13 19:02:44,376 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0269.stratus.lvs.ebay.com:13562 to fetcher#11
2015-04-13 19:02:44,377 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000140_0 decomp: 14000422 len: 5081410 to MEMORY
2015-04-13 19:02:44,377 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0550.stratus.lvs.ebay.com:13562 with 2 to fetcher#35
2015-04-13 19:02:44,377 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0550.stratus.lvs.ebay.com:13562 to fetcher#35
2015-04-13 19:02:44,378 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000544_0 sent hash and received reply
2015-04-13 19:02:44,378 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000366_0,attempt_1426279437401_714565_m_000496_0,attempt_1426279437401_714565_m_000316_0,attempt_1426279437401_714565_m_000038_0 sent hash and received reply
2015-04-13 19:02:44,378 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0148.stratus.lvs.ebay.com:13562 with 2 to fetcher#20
2015-04-13 19:02:44,378 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0148.stratus.lvs.ebay.com:13562 to fetcher#20
2015-04-13 19:02:44,379 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000285_0,attempt_1426279437401_714565_m_000325_0,attempt_1426279437401_714565_m_000100_0,attempt_1426279437401_714565_m_000272_0,attempt_1426279437401_714565_m_000248_0,attempt_1426279437401_714565_m_000180_0,attempt_1426279437401_714565_m_000431_0,attempt_1426279437401_714565_m_000000_0 sent hash and received reply
2015-04-13 19:02:44,380 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000490_0,attempt_1426279437401_714565_m_000417_0,attempt_1426279437401_714565_m_000459_0,attempt_1426279437401_714565_m_000198_0,attempt_1426279437401_714565_m_000102_0 sent hash and received reply
2015-04-13 19:02:44,381 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000448_0,attempt_1426279437401_714565_m_000455_0,attempt_1426279437401_714565_m_000451_0,attempt_1426279437401_714565_m_000306_0,attempt_1426279437401_714565_m_000222_0,attempt_1426279437401_714565_m_000122_0,attempt_1426279437401_714565_m_000135_0 sent hash and received reply
2015-04-13 19:02:44,380 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#10 about to shuffle output of map attempt_1426279437401_714565_m_000223_0 decomp: 11811904 len: 3725762 to MEMORY
2015-04-13 19:02:44,382 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#36 about to shuffle output of map attempt_1426279437401_714565_m_000490_0 decomp: 7723421 len: 2478381 to MEMORY
2015-04-13 19:02:44,384 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000404_0,attempt_1426279437401_714565_m_000382_0 sent hash and received reply
2015-04-13 19:02:44,384 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000397_0,attempt_1426279437401_714565_m_000107_0 sent hash and received reply
2015-04-13 19:02:44,384 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000473_0,attempt_1426279437401_714565_m_000284_0 sent hash and received reply
2015-04-13 19:02:44,385 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000352_0,attempt_1426279437401_714565_m_000225_0 sent hash and received reply
2015-04-13 19:02:44,385 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000470_0,attempt_1426279437401_714565_m_000350_0,attempt_1426279437401_714565_m_000411_0,attempt_1426279437401_714565_m_000244_0,attempt_1426279437401_714565_m_000259_0,attempt_1426279437401_714565_m_000165_0 sent hash and received reply
2015-04-13 19:02:44,388 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000037_0,attempt_1426279437401_714565_m_000203_0,attempt_1426279437401_714565_m_000160_0,attempt_1426279437401_714565_m_000090_0 sent hash and received reply
2015-04-13 19:02:44,393 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 about to shuffle output of map attempt_1426279437401_714565_m_000037_0 decomp: 15904614 len: 5153524 to MEMORY
2015-04-13 19:02:44,396 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 about to shuffle output of map attempt_1426279437401_714565_m_000447_0 decomp: 8609862 len: 2725683 to MEMORY
2015-04-13 19:02:44,400 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000076_0 sent hash and received reply
2015-04-13 19:02:44,401 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 about to shuffle output of map attempt_1426279437401_714565_m_000118_0 decomp: 13900285 len: 4511426 to MEMORY
2015-04-13 19:02:44,404 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 about to shuffle output of map attempt_1426279437401_714565_m_000270_0 decomp: 11275231 len: 3793908 to MEMORY
2015-04-13 19:02:44,405 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 about to shuffle output of map attempt_1426279437401_714565_m_000039_0 decomp: 15038789 len: 4935770 to MEMORY
2015-04-13 19:02:44,409 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 about to shuffle output of map attempt_1426279437401_714565_m_000076_0 decomp: 15368975 len: 5493416 to MEMORY
2015-04-13 19:02:44,411 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 about to shuffle output of map attempt_1426279437401_714565_m_000470_0 decomp: 8224735 len: 2658472 to MEMORY
2015-04-13 19:02:44,414 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#11 about to shuffle output of map attempt_1426279437401_714565_m_000352_0 decomp: 10421800 len: 3233717 to MEMORY
2015-04-13 19:02:44,417 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#4 about to shuffle output of map attempt_1426279437401_714565_m_000473_0 decomp: 6884976 len: 2170423 to MEMORY
2015-04-13 19:02:44,423 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 about to shuffle output of map attempt_1426279437401_714565_m_000397_0 decomp: 12782743 len: 4613817 to MEMORY
2015-04-13 19:02:44,424 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000041_0 sent hash and received reply
2015-04-13 19:02:44,424 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 3793928 bytes from map-output for attempt_1426279437401_714565_m_000560_0
2015-04-13 19:02:44,426 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 about to shuffle output of map attempt_1426279437401_714565_m_000404_0 decomp: 9982490 len: 3643621 to MEMORY
2015-04-13 19:02:44,428 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 about to shuffle output of map attempt_1426279437401_714565_m_000448_0 decomp: 6479671 len: 1941934 to MEMORY
2015-04-13 19:02:44,431 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 about to shuffle output of map attempt_1426279437401_714565_m_000285_0 decomp: 9999165 len: 3322033 to MEMORY
2015-04-13 19:02:44,433 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 about to shuffle output of map attempt_1426279437401_714565_m_000366_0 decomp: 9350097 len: 2333393 to MEMORY
2015-04-13 19:02:44,436 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 about to shuffle output of map attempt_1426279437401_714565_m_000544_0 decomp: 4529999 len: 1466473 to MEMORY
2015-04-13 19:02:44,439 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#9 about to shuffle output of map attempt_1426279437401_714565_m_000209_0 decomp: 11683138 len: 3736711 to MEMORY
2015-04-13 19:02:44,443 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000333_0 decomp: 10102760 len: 3839951 to MEMORY
2015-04-13 19:02:44,446 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 about to shuffle output of map attempt_1426279437401_714565_m_000472_0 decomp: 10133731 len: 3666326 to MEMORY
2015-04-13 19:02:44,455 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#12 about to shuffle output of map attempt_1426279437401_714565_m_000298_0 decomp: 9106902 len: 2397482 to MEMORY
2015-04-13 19:02:44,460 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 about to shuffle output of map attempt_1426279437401_714565_m_000407_0 decomp: 11845250 len: 4338251 to MEMORY
2015-04-13 19:02:44,465 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 about to shuffle output of map attempt_1426279437401_714565_m_000044_0 decomp: 24730404 len: 7625665 to MEMORY
2015-04-13 19:02:44,466 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9831906 bytes from map-output for attempt_1426279437401_714565_m_000357_0
2015-04-13 19:02:44,478 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9811535 bytes from map-output for attempt_1426279437401_714565_m_000318_0
2015-04-13 19:02:44,479 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#15 about to shuffle output of map attempt_1426279437401_714565_m_000043_0 decomp: 28088417 len: 8699931 to MEMORY
2015-04-13 19:02:44,483 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 4529999 bytes from map-output for attempt_1426279437401_714565_m_000544_0
2015-04-13 19:02:44,485 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#32 about to shuffle output of map attempt_1426279437401_714565_m_000074_0 decomp: 21053547 len: 6334882 to MEMORY
2015-04-13 19:02:44,487 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 about to shuffle output of map attempt_1426279437401_714565_m_000526_0 decomp: 4909269 len: 1826381 to MEMORY
2015-04-13 19:02:44,489 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 3793928, inMemoryMapOutputs.size() -> 29, commitMemory -> 358526271, usedMemory ->747009354
2015-04-13 19:02:44,489 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 about to shuffle output of map attempt_1426279437401_714565_m_000445_0 decomp: 9432892 len: 3322422 to MEMORY
2015-04-13 19:02:44,490 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7723421 bytes from map-output for attempt_1426279437401_714565_m_000490_0
2015-04-13 19:02:44,495 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle output of map attempt_1426279437401_714565_m_000041_0 decomp: 19880035 len: 6510252 to MEMORY
2015-04-13 19:02:44,499 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6283774 bytes from map-output for attempt_1426279437401_714565_m_000517_0
2015-04-13 19:02:44,501 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 about to shuffle output of map attempt_1426279437401_714565_m_000376_0 decomp: 8846135 len: 2889765 to MEMORY
2015-04-13 19:02:44,504 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6479671 bytes from map-output for attempt_1426279437401_714565_m_000448_0
2015-04-13 19:02:44,512 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7723421, inMemoryMapOutputs.size() -> 30, commitMemory -> 362320199, usedMemory ->775735524
2015-04-13 19:02:44,512 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 4529999, inMemoryMapOutputs.size() -> 31, commitMemory -> 370043620, usedMemory ->775735524
2015-04-13 19:02:44,513 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0323.stratus.lvs.ebay.com:13562 freed by fetcher#29 in 154ms
2015-04-13 19:02:44,513 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0254.stratus.lvs.ebay.com:13562 with 4 to fetcher#29
2015-04-13 19:02:44,513 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0254.stratus.lvs.ebay.com:13562 to fetcher#29
2015-04-13 19:02:44,514 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#36 about to shuffle output of map attempt_1426279437401_714565_m_000417_0 decomp: 6747194 len: 2126070 to MEMORY
2015-04-13 19:02:44,516 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9811535, inMemoryMapOutputs.size() -> 32, commitMemory -> 374573619, usedMemory ->782482718
2015-04-13 19:02:44,516 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9831906, inMemoryMapOutputs.size() -> 33, commitMemory -> 384385154, usedMemory ->782482718
2015-04-13 19:02:44,516 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0081.stratus.lvs.ebay.com:13562 freed by fetcher#6 in 155ms
2015-04-13 19:02:44,517 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0075.stratus.lvs.ebay.com:13562 with 1 to fetcher#6
2015-04-13 19:02:44,517 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0075.stratus.lvs.ebay.com:13562 to fetcher#6
2015-04-13 19:02:44,517 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 4909269 bytes from map-output for attempt_1426279437401_714565_m_000526_0
2015-04-13 19:02:44,517 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 4909269, inMemoryMapOutputs.size() -> 34, commitMemory -> 394217060, usedMemory ->782482718
2015-04-13 19:02:44,523 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000145_0 sent hash and received reply
2015-04-13 19:02:44,525 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000478_0,attempt_1426279437401_714565_m_000324_0,attempt_1426279437401_714565_m_000073_0,attempt_1426279437401_714565_m_000052_0 sent hash and received reply
2015-04-13 19:02:44,526 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8609862 bytes from map-output for attempt_1426279437401_714565_m_000447_0
2015-04-13 19:02:44,531 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6884976 bytes from map-output for attempt_1426279437401_714565_m_000473_0
2015-04-13 19:02:44,541 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11811904 bytes from map-output for attempt_1426279437401_714565_m_000223_0
2015-04-13 19:02:44,543 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 about to shuffle output of map attempt_1426279437401_714565_m_000478_0 decomp: 7723330 len: 2474532 to MEMORY
2015-04-13 19:02:44,544 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 about to shuffle output of map attempt_1426279437401_714565_m_000227_0 decomp: 14318088 len: 4882856 to MEMORY
2015-04-13 19:02:44,548 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6479671, inMemoryMapOutputs.size() -> 35, commitMemory -> 399126329, usedMemory ->820955154
2015-04-13 19:02:44,548 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#6 about to shuffle output of map attempt_1426279437401_714565_m_000145_0 decomp: 16431018 len: 5787374 to MEMORY
2015-04-13 19:02:44,548 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6283774, inMemoryMapOutputs.size() -> 36, commitMemory -> 405606000, usedMemory ->820955154
2015-04-13 19:02:44,550 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 about to shuffle output of map attempt_1426279437401_714565_m_000455_0 decomp: 7796714 len: 2683460 to MEMORY
2015-04-13 19:02:44,553 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14339005 bytes from map-output for attempt_1426279437401_714565_m_000109_0
2015-04-13 19:02:44,554 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000040_0,attempt_1426279437401_714565_m_000053_0,attempt_1426279437401_714565_m_000167_0,attempt_1426279437401_714565_m_000232_0 sent hash and received reply
2015-04-13 19:02:44,556 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11811904, inMemoryMapOutputs.size() -> 37, commitMemory -> 411889774, usedMemory ->828751868
2015-04-13 19:02:44,558 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11275231 bytes from map-output for attempt_1426279437401_714565_m_000270_0
2015-04-13 19:02:44,558 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9350097 bytes from map-output for attempt_1426279437401_714565_m_000366_0
2015-04-13 19:02:44,560 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#22 about to shuffle output of map attempt_1426279437401_714565_m_000221_0 decomp: 12748045 len: 4248203 to MEMORY
2015-04-13 19:02:44,579 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10421800 bytes from map-output for attempt_1426279437401_714565_m_000352_0
2015-04-13 19:02:44,580 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9106902 bytes from map-output for attempt_1426279437401_714565_m_000298_0
2015-04-13 19:02:44,582 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10133731 bytes from map-output for attempt_1426279437401_714565_m_000472_0
2015-04-13 19:02:44,583 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8224735 bytes from map-output for attempt_1426279437401_714565_m_000470_0
2015-04-13 19:02:44,583 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#10 about to shuffle output of map attempt_1426279437401_714565_m_000084_0 decomp: 16936107 len: 5283430 to MEMORY
2015-04-13 19:02:44,583 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6884976, inMemoryMapOutputs.size() -> 38, commitMemory -> 423701678, usedMemory ->858436020
2015-04-13 19:02:44,588 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8609862, inMemoryMapOutputs.size() -> 39, commitMemory -> 430586654, usedMemory ->875290444
2015-04-13 19:02:44,588 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 about to shuffle output of map attempt_1426279437401_714565_m_000040_0 decomp: 16854424 len: 5987596 to MEMORY
2015-04-13 19:02:44,588 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0065.stratus.lvs.ebay.com:13562 freed by fetcher#34 in 233ms
2015-04-13 19:02:44,588 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0470.stratus.lvs.ebay.com:13562 with 4 to fetcher#34
2015-04-13 19:02:44,588 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0470.stratus.lvs.ebay.com:13562 to fetcher#34
2015-04-13 19:02:44,589 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10102760 bytes from map-output for attempt_1426279437401_714565_m_000333_0
2015-04-13 19:02:44,591 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 about to shuffle output of map attempt_1426279437401_714565_m_000262_0 decomp: 11466126 len: 3799613 to MEMORY
2015-04-13 19:02:44,588 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11047446 bytes from map-output for attempt_1426279437401_714565_m_000266_0
2015-04-13 19:02:44,595 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#4 about to shuffle output of map attempt_1426279437401_714565_m_000284_0 decomp: 10472525 len: 3550276 to MEMORY
2015-04-13 19:02:44,598 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8224735, inMemoryMapOutputs.size() -> 40, commitMemory -> 439196516, usedMemory ->897229095
2015-04-13 19:02:44,598 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10133731, inMemoryMapOutputs.size() -> 41, commitMemory -> 447421251, usedMemory ->897229095
2015-04-13 19:02:44,600 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9106902, inMemoryMapOutputs.size() -> 42, commitMemory -> 457554982, usedMemory ->904786388
2015-04-13 19:02:44,602 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14000422 bytes from map-output for attempt_1426279437401_714565_m_000140_0
2015-04-13 19:02:44,603 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000251_0,attempt_1426279437401_714565_m_000211_0,attempt_1426279437401_714565_m_000207_0,attempt_1426279437401_714565_m_000176_0 sent hash and received reply
2015-04-13 19:02:44,604 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#12 about to shuffle output of map attempt_1426279437401_714565_m_000372_0 decomp: 11114494 len: 3759478 to MEMORY
2015-04-13 19:02:44,607 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 about to shuffle output of map attempt_1426279437401_714565_m_000251_0 decomp: 11146382 len: 3514196 to MEMORY
2015-04-13 19:02:44,607 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15368975 bytes from map-output for attempt_1426279437401_714565_m_000076_0
2015-04-13 19:02:44,609 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 about to shuffle output of map attempt_1426279437401_714565_m_000240_0 decomp: 11037405 len: 3474586 to MEMORY
2015-04-13 19:02:44,613 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8846135 bytes from map-output for attempt_1426279437401_714565_m_000376_0
2015-04-13 19:02:44,616 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14000422, inMemoryMapOutputs.size() -> 43, commitMemory -> 466661884, usedMemory ->938084669
2015-04-13 19:02:44,616 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10421800, inMemoryMapOutputs.size() -> 44, commitMemory -> 480662306, usedMemory ->938084669
2015-04-13 19:02:44,619 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9982490 bytes from map-output for attempt_1426279437401_714565_m_000404_0
2015-04-13 19:02:44,620 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6747194 bytes from map-output for attempt_1426279437401_714565_m_000417_0
2015-04-13 19:02:44,621 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000083_0 decomp: 15422542 len: 5439218 to MEMORY
2015-04-13 19:02:44,623 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9350097, inMemoryMapOutputs.size() -> 45, commitMemory -> 491084106, usedMemory ->964202276
2015-04-13 19:02:44,626 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 about to shuffle output of map attempt_1426279437401_714565_m_000496_0 decomp: 9763943 len: 2985562 to MEMORY
2015-04-13 19:02:44,627 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7796714 bytes from map-output for attempt_1426279437401_714565_m_000455_0
2015-04-13 19:02:44,628 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7796714, inMemoryMapOutputs.size() -> 46, commitMemory -> 500434203, usedMemory ->973966219
2015-04-13 19:02:44,630 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11683138 bytes from map-output for attempt_1426279437401_714565_m_000209_0
2015-04-13 19:02:44,600 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 about to shuffle output of map attempt_1426279437401_714565_m_000350_0 decomp: 7557293 len: 2637419 to MEMORY
2015-04-13 19:02:44,631 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 about to shuffle output of map attempt_1426279437401_714565_m_000451_0 decomp: 10862341 len: 4073609 to MEMORY
2015-04-13 19:02:44,623 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#11 about to shuffle output of map attempt_1426279437401_714565_m_000225_0 decomp: 10695065 len: 3422325 to MEMORY
2015-04-13 19:02:44,631 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11275231, inMemoryMapOutputs.size() -> 47, commitMemory -> 508230917, usedMemory ->984828560
2015-04-13 19:02:44,631 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14339005, inMemoryMapOutputs.size() -> 48, commitMemory -> 519506148, usedMemory ->984828560
2015-04-13 19:02:44,634 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 about to shuffle output of map attempt_1426279437401_714565_m_000246_0 decomp: 10909648 len: 3657563 to MEMORY
2015-04-13 19:02:44,638 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7723330 bytes from map-output for attempt_1426279437401_714565_m_000478_0
2015-04-13 19:02:44,638 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11683138, inMemoryMapOutputs.size() -> 49, commitMemory -> 533845153, usedMemory ->995738208
2015-04-13 19:02:44,640 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 about to shuffle output of map attempt_1426279437401_714565_m_000453_0 decomp: 6928369 len: 2552088 to MEMORY
2015-04-13 19:02:44,642 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11845250 bytes from map-output for attempt_1426279437401_714565_m_000407_0
2015-04-13 19:02:44,646 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9432892 bytes from map-output for attempt_1426279437401_714565_m_000445_0
2015-04-13 19:02:44,648 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15904614 bytes from map-output for attempt_1426279437401_714565_m_000037_0
2015-04-13 19:02:44,650 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12782743 bytes from map-output for attempt_1426279437401_714565_m_000397_0
2015-04-13 19:02:44,651 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15038789 bytes from map-output for attempt_1426279437401_714565_m_000039_0
2015-04-13 19:02:44,652 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6747194, inMemoryMapOutputs.size() -> 50, commitMemory -> 545528291, usedMemory ->1002666577
2015-04-13 19:02:44,656 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9982490, inMemoryMapOutputs.size() -> 51, commitMemory -> 552275485, usedMemory ->1013695165
2015-04-13 19:02:44,656 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8846135, inMemoryMapOutputs.size() -> 52, commitMemory -> 562257975, usedMemory ->1013695165
2015-04-13 19:02:44,660 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 about to shuffle output of map attempt_1426279437401_714565_m_000382_0 decomp: 11897063 len: 3768555 to MEMORY
2015-04-13 19:02:44,664 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#36 about to shuffle output of map attempt_1426279437401_714565_m_000459_0 decomp: 10207761 len: 3300525 to MEMORY
2015-04-13 19:02:44,656 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#9 about to shuffle output of map attempt_1426279437401_714565_m_000267_0 decomp: 11028588 len: 3190259 to MEMORY
2015-04-13 19:02:44,667 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 about to shuffle output of map attempt_1426279437401_714565_m_000112_0 decomp: 14265521 len: 4616036 to MEMORY
2015-04-13 19:02:44,668 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15368975, inMemoryMapOutputs.size() -> 53, commitMemory -> 571104110, usedMemory ->1050065510
2015-04-13 19:02:44,668 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11047446, inMemoryMapOutputs.size() -> 54, commitMemory -> 586473085, usedMemory ->1050065510
2015-04-13 19:02:44,668 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10102760, inMemoryMapOutputs.size() -> 55, commitMemory -> 597520531, usedMemory ->1050065510
2015-04-13 19:02:44,669 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0389.stratus.lvs.ebay.com:13562 freed by fetcher#19 in 314ms
2015-04-13 19:02:44,669 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0026.stratus.lvs.ebay.com:13562 with 5 to fetcher#19
2015-04-13 19:02:44,669 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0026.stratus.lvs.ebay.com:13562 to fetcher#19
2015-04-13 19:02:44,671 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0160.stratus.lvs.ebay.com:13562 freed by fetcher#18 in 300ms
2015-04-13 19:02:44,671 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0280.stratus.lvs.ebay.com:13562 with 5 to fetcher#18
2015-04-13 19:02:44,671 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0280.stratus.lvs.ebay.com:13562 to fetcher#18
2015-04-13 19:02:44,672 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000200_0 decomp: 12550768 len: 4401654 to MEMORY
2015-04-13 19:02:44,673 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15038789, inMemoryMapOutputs.size() -> 56, commitMemory -> 607623291, usedMemory ->1062616278
2015-04-13 19:02:44,673 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0376.stratus.lvs.ebay.com:13562 freed by fetcher#13 in 316ms
2015-04-13 19:02:44,673 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0503.stratus.lvs.ebay.com:13562 with 8 to fetcher#13
2015-04-13 19:02:44,673 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 8 of 8 to lvsdpehdc25dn0503.stratus.lvs.ebay.com:13562 to fetcher#13
2015-04-13 19:02:44,675 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12782743, inMemoryMapOutputs.size() -> 57, commitMemory -> 622662080, usedMemory ->1062616278
2015-04-13 19:02:44,679 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 about to shuffle output of map attempt_1426279437401_714565_m_000107_0 decomp: 12177979 len: 3789918 to MEMORY
2015-04-13 19:02:44,681 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13900285 bytes from map-output for attempt_1426279437401_714565_m_000118_0
2015-04-13 19:02:44,681 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000429_0,attempt_1426279437401_714565_m_000233_0,attempt_1426279437401_714565_m_000159_0,attempt_1426279437401_714565_m_000138_0,attempt_1426279437401_714565_m_000082_0 sent hash and received reply
2015-04-13 19:02:44,682 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000412_0,attempt_1426279437401_714565_m_000275_0,attempt_1426279437401_714565_m_000067_0,attempt_1426279437401_714565_m_000078_0,attempt_1426279437401_714565_m_000002_0 sent hash and received reply
2015-04-13 19:02:44,681 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13900285, inMemoryMapOutputs.size() -> 58, commitMemory -> 635444823, usedMemory ->1074794257
2015-04-13 19:02:44,686 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,686 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0026.stratus.lvs.ebay.com:13562 freed by fetcher#19 in 17ms
2015-04-13 19:02:44,686 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0584.stratus.lvs.ebay.com:13562 with 1 to fetcher#19
2015-04-13 19:02:44,686 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0584.stratus.lvs.ebay.com:13562 to fetcher#19
2015-04-13 19:02:44,687 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,687 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0280.stratus.lvs.ebay.com:13562 freed by fetcher#18 in 16ms
2015-04-13 19:02:44,687 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0045.stratus.lvs.ebay.com:13562 with 3 to fetcher#18
2015-04-13 19:02:44,687 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0045.stratus.lvs.ebay.com:13562 to fetcher#18
2015-04-13 19:02:44,689 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15904614, inMemoryMapOutputs.size() -> 59, commitMemory -> 649345108, usedMemory ->1074794257
2015-04-13 19:02:44,690 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9432892, inMemoryMapOutputs.size() -> 60, commitMemory -> 665249722, usedMemory ->1074794257
2015-04-13 19:02:44,690 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,690 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11845250, inMemoryMapOutputs.size() -> 61, commitMemory -> 674682614, usedMemory ->1074794257
2015-04-13 19:02:44,690 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,690 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,690 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0186.stratus.lvs.ebay.com:13562 freed by fetcher#33 in 327ms
2015-04-13 19:02:44,686 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,690 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0758.stratus.lvs.ebay.com:13562 with 2 to fetcher#33
2015-04-13 19:02:44,690 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0758.stratus.lvs.ebay.com:13562 to fetcher#33
2015-04-13 19:02:44,690 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0516.stratus.lvs.ebay.com:13562 freed by fetcher#16 in 335ms
2015-04-13 19:02:44,691 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0340.stratus.lvs.ebay.com:13562 with 4 to fetcher#16
2015-04-13 19:02:44,691 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0340.stratus.lvs.ebay.com:13562 to fetcher#16
2015-04-13 19:02:44,691 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0535.stratus.lvs.ebay.com:13562 freed by fetcher#31 in 320ms
2015-04-13 19:02:44,691 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0107.stratus.lvs.ebay.com:13562 with 2 to fetcher#31
2015-04-13 19:02:44,691 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0107.stratus.lvs.ebay.com:13562 to fetcher#31
2015-04-13 19:02:44,692 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7723330, inMemoryMapOutputs.size() -> 62, commitMemory -> 686527864, usedMemory ->1074794257
2015-04-13 19:02:44,692 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0219.stratus.lvs.ebay.com:13562 freed by fetcher#8 in 335ms
2015-04-13 19:02:44,692 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,692 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000514_0 sent hash and received reply
2015-04-13 19:02:44,693 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,693 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000530_0,attempt_1426279437401_714565_m_000460_0,attempt_1426279437401_714565_m_000328_0 sent hash and received reply
2015-04-13 19:02:44,693 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,692 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0158.stratus.lvs.ebay.com:13562 with 1 to fetcher#8
2015-04-13 19:02:44,694 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0158.stratus.lvs.ebay.com:13562 to fetcher#8
2015-04-13 19:02:44,694 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0045.stratus.lvs.ebay.com:13562 freed by fetcher#18 in 7ms
2015-04-13 19:02:44,694 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0133.stratus.lvs.ebay.com:13562 with 1 to fetcher#18
2015-04-13 19:02:44,694 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0133.stratus.lvs.ebay.com:13562 to fetcher#18
2015-04-13 19:02:44,694 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000549_0,attempt_1426279437401_714565_m_000011_0 sent hash and received reply
2015-04-13 19:02:44,694 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,694 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0584.stratus.lvs.ebay.com:13562 freed by fetcher#19 in 8ms
2015-04-13 19:02:44,694 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0089.stratus.lvs.ebay.com:13562 with 5 to fetcher#19
2015-04-13 19:02:44,694 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0089.stratus.lvs.ebay.com:13562 to fetcher#19
2015-04-13 19:02:44,695 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0254.stratus.lvs.ebay.com:13562 freed by fetcher#29 in 182ms
2015-04-13 19:02:44,695 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0758.stratus.lvs.ebay.com:13562 freed by fetcher#33 in 5ms
2015-04-13 19:02:44,695 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0584.stratus.lvs.ebay.com:13562 with 1 to fetcher#33
2015-04-13 19:02:44,696 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0584.stratus.lvs.ebay.com:13562 to fetcher#33
2015-04-13 19:02:44,696 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0468.stratus.lvs.ebay.com:13562 with 1 to fetcher#29
2015-04-13 19:02:44,696 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0468.stratus.lvs.ebay.com:13562 to fetcher#29
2015-04-13 19:02:44,697 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000217_0,attempt_1426279437401_714565_m_000183_0,attempt_1426279437401_714565_m_000117_0,attempt_1426279437401_714565_m_000017_0 sent hash and received reply
2015-04-13 19:02:44,697 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,697 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000494_0 sent hash and received reply
2015-04-13 19:02:44,697 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0340.stratus.lvs.ebay.com:13562 freed by fetcher#16 in 6ms
2015-04-13 19:02:44,697 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0599.stratus.lvs.ebay.com:13562 with 1 to fetcher#16
2015-04-13 19:02:44,697 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,697 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0599.stratus.lvs.ebay.com:13562 to fetcher#16
2015-04-13 19:02:44,698 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000115_0,attempt_1426279437401_714565_m_000036_0 sent hash and received reply
2015-04-13 19:02:44,698 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,698 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0107.stratus.lvs.ebay.com:13562 freed by fetcher#31 in 7ms
2015-04-13 19:02:44,698 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0353.stratus.lvs.ebay.com:13562 with 2 to fetcher#31
2015-04-13 19:02:44,699 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0353.stratus.lvs.ebay.com:13562 to fetcher#31
2015-04-13 19:02:44,699 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000514_0 sent hash and received reply
2015-04-13 19:02:44,699 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,699 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0584.stratus.lvs.ebay.com:13562 freed by fetcher#33 in 3ms
2015-04-13 19:02:44,699 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0534.stratus.lvs.ebay.com:13562 with 1 to fetcher#33
2015-04-13 19:02:44,699 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0534.stratus.lvs.ebay.com:13562 to fetcher#33
2015-04-13 19:02:44,700 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000154_0 sent hash and received reply
2015-04-13 19:02:44,700 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,700 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0133.stratus.lvs.ebay.com:13562 freed by fetcher#18 in 6ms
2015-04-13 19:02:44,700 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0618.stratus.lvs.ebay.com:13562 with 2 to fetcher#18
2015-04-13 19:02:44,700 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0618.stratus.lvs.ebay.com:13562 to fetcher#18
2015-04-13 19:02:44,701 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000091_0 sent hash and received reply
2015-04-13 19:02:44,701 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,701 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0468.stratus.lvs.ebay.com:13562 freed by fetcher#29 in 5ms
2015-04-13 19:02:44,701 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0448.stratus.lvs.ebay.com:13562 with 1 to fetcher#29
2015-04-13 19:02:44,701 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0448.stratus.lvs.ebay.com:13562 to fetcher#29
2015-04-13 19:02:44,701 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000433_0 sent hash and received reply
2015-04-13 19:02:44,702 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,702 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0599.stratus.lvs.ebay.com:13562 freed by fetcher#16 in 5ms
2015-04-13 19:02:44,702 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0010.stratus.lvs.ebay.com:13562 with 2 to fetcher#16
2015-04-13 19:02:44,702 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0010.stratus.lvs.ebay.com:13562 to fetcher#16
2015-04-13 19:02:44,702 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0158.stratus.lvs.ebay.com:13562 freed by fetcher#8 in 8ms
2015-04-13 19:02:44,702 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0591.stratus.lvs.ebay.com:13562 with 3 to fetcher#8
2015-04-13 19:02:44,702 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0591.stratus.lvs.ebay.com:13562 to fetcher#8
2015-04-13 19:02:44,702 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000476_0,attempt_1426279437401_714565_m_000277_0,attempt_1426279437401_714565_m_000269_0,attempt_1426279437401_714565_m_000253_0,attempt_1426279437401_714565_m_000195_0,attempt_1426279437401_714565_m_000201_0,attempt_1426279437401_714565_m_000243_0,attempt_1426279437401_714565_m_000086_0 sent hash and received reply
2015-04-13 19:02:44,702 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,703 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0503.stratus.lvs.ebay.com:13562 freed by fetcher#13 in 30ms
2015-04-13 19:02:44,703 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0197.stratus.lvs.ebay.com:13562 with 4 to fetcher#13
2015-04-13 19:02:44,703 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0197.stratus.lvs.ebay.com:13562 to fetcher#13
2015-04-13 19:02:44,703 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000237_0 sent hash and received reply
2015-04-13 19:02:44,703 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,703 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0534.stratus.lvs.ebay.com:13562 freed by fetcher#33 in 4ms
2015-04-13 19:02:44,703 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0324.stratus.lvs.ebay.com:13562 with 3 to fetcher#33
2015-04-13 19:02:44,703 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0324.stratus.lvs.ebay.com:13562 to fetcher#33
2015-04-13 19:02:44,705 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000057_0 sent hash and received reply
2015-04-13 19:02:44,706 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,706 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0448.stratus.lvs.ebay.com:13562 freed by fetcher#29 in 5ms
2015-04-13 19:02:44,706 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0565.stratus.lvs.ebay.com:13562 with 3 to fetcher#29
2015-04-13 19:02:44,706 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0565.stratus.lvs.ebay.com:13562 to fetcher#29
2015-04-13 19:02:44,707 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000516_0,attempt_1426279437401_714565_m_000413_0,attempt_1426279437401_714565_m_000353_0,attempt_1426279437401_714565_m_000103_0,attempt_1426279437401_714565_m_000286_0 sent hash and received reply
2015-04-13 19:02:44,707 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,708 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0089.stratus.lvs.ebay.com:13562 freed by fetcher#19 in 13ms
2015-04-13 19:02:44,708 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0440.stratus.lvs.ebay.com:13562 with 1 to fetcher#19
2015-04-13 19:02:44,708 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0440.stratus.lvs.ebay.com:13562 to fetcher#19
2015-04-13 19:02:44,709 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000513_0,attempt_1426279437401_714565_m_000535_0,attempt_1426279437401_714565_m_000497_0,attempt_1426279437401_714565_m_000443_0 sent hash and received reply
2015-04-13 19:02:44,709 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,709 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0197.stratus.lvs.ebay.com:13562 freed by fetcher#13 in 6ms
2015-04-13 19:02:44,709 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0135.stratus.lvs.ebay.com:13562 with 4 to fetcher#13
2015-04-13 19:02:44,709 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0135.stratus.lvs.ebay.com:13562 to fetcher#13
2015-04-13 19:02:44,712 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6928369 bytes from map-output for attempt_1426279437401_714565_m_000453_0
2015-04-13 19:02:44,712 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000521_0,attempt_1426279437401_714565_m_000307_0,attempt_1426279437401_714565_m_000344_0 sent hash and received reply
2015-04-13 19:02:44,712 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,713 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000369_0 sent hash and received reply
2015-04-13 19:02:44,713 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0591.stratus.lvs.ebay.com:13562 freed by fetcher#8 in 10ms
2015-04-13 19:02:44,713 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0008.stratus.lvs.ebay.com:13562 with 1 to fetcher#8
2015-04-13 19:02:44,713 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0008.stratus.lvs.ebay.com:13562 to fetcher#8
2015-04-13 19:02:44,713 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,713 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0440.stratus.lvs.ebay.com:13562 freed by fetcher#19 in 5ms
2015-04-13 19:02:44,714 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000031_0,attempt_1426279437401_714565_m_000133_0 sent hash and received reply
2015-04-13 19:02:44,714 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,714 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0108.stratus.lvs.ebay.com:13562 with 4 to fetcher#19
2015-04-13 19:02:44,714 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0108.stratus.lvs.ebay.com:13562 to fetcher#19
2015-04-13 19:02:44,714 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0618.stratus.lvs.ebay.com:13562 freed by fetcher#18 in 14ms
2015-04-13 19:02:44,714 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0043.stratus.lvs.ebay.com:13562 with 5 to fetcher#18
2015-04-13 19:02:44,714 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0043.stratus.lvs.ebay.com:13562 to fetcher#18
2015-04-13 19:02:44,714 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6928369, inMemoryMapOutputs.size() -> 63, commitMemory -> 694251194, usedMemory ->1074794257
2015-04-13 19:02:44,715 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0116.stratus.lvs.ebay.com:13562 freed by fetcher#17 in 356ms
2015-04-13 19:02:44,715 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0699.stratus.lvs.ebay.com:13562 with 4 to fetcher#17
2015-04-13 19:02:44,715 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0699.stratus.lvs.ebay.com:13562 to fetcher#17
2015-04-13 19:02:44,716 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10472525 bytes from map-output for attempt_1426279437401_714565_m_000284_0
2015-04-13 19:02:44,716 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10472525, inMemoryMapOutputs.size() -> 64, commitMemory -> 701179563, usedMemory ->1074794257
2015-04-13 19:02:44,716 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Starting inMemoryMerger's merge since commitMemory=711652088 > mergeThreshold=708669632. Current usedMemory=1074794257
2015-04-13 19:02:44,717 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.MergeThread: InMemoryMerger - Thread to merge in-memory shuffled map-outputs: Starting merge with 64 segments, while ignoring 0 segments
2015-04-13 19:02:44,717 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000110_0,attempt_1426279437401_714565_m_000019_0,attempt_1426279437401_714565_m_000015_0,attempt_1426279437401_714565_m_000030_0 sent hash and received reply
2015-04-13 19:02:44,717 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0691.stratus.lvs.ebay.com:13562 freed by fetcher#4 in 342ms
2015-04-13 19:02:44,717 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,717 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0135.stratus.lvs.ebay.com:13562 freed by fetcher#13 in 8ms
2015-04-13 19:02:44,717 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000003_0,attempt_1426279437401_714565_m_000065_0 sent hash and received reply
2015-04-13 19:02:44,717 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,718 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0353.stratus.lvs.ebay.com:13562 freed by fetcher#31 in 19ms
2015-04-13 19:02:44,718 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000545_0,attempt_1426279437401_714565_m_000075_0,attempt_1426279437401_714565_m_000032_0 sent hash and received reply
2015-04-13 19:02:44,718 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,718 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0565.stratus.lvs.ebay.com:13562 freed by fetcher#29 in 12ms
2015-04-13 19:02:44,720 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11466126 bytes from map-output for attempt_1426279437401_714565_m_000262_0
2015-04-13 19:02:44,720 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11466126, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->1074794257
2015-04-13 19:02:44,721 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000463_0 sent hash and received reply
2015-04-13 19:02:44,721 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,721 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,720 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000016_0,attempt_1426279437401_714565_m_000304_0,attempt_1426279437401_714565_m_000349_0,attempt_1426279437401_714565_m_000401_0 sent hash and received reply
2015-04-13 19:02:44,721 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0008.stratus.lvs.ebay.com:13562 freed by fetcher#8 in 8ms
2015-04-13 19:02:44,721 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,721 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0108.stratus.lvs.ebay.com:13562 freed by fetcher#19 in 7ms
2015-04-13 19:02:44,722 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Initiating in-memory merge with 64 segments...
2015-04-13 19:02:44,722 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapred.Merger: Merging 64 sorted segments
2015-04-13 19:02:44,722 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 64 segments left of total size: 711649784 bytes
2015-04-13 19:02:44,723 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000469_0,attempt_1426279437401_714565_m_000327_0,attempt_1426279437401_714565_m_000268_0,attempt_1426279437401_714565_m_000042_0,attempt_1426279437401_714565_m_000007_0 sent hash and received reply
2015-04-13 19:02:44,723 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,723 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0043.stratus.lvs.ebay.com:13562 freed by fetcher#18 in 9ms
2015-04-13 19:02:44,728 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0094.stratus.lvs.ebay.com:13562 freed by fetcher#24 in 372ms
2015-04-13 19:02:44,729 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000297_0,attempt_1426279437401_714565_m_000212_0 sent hash and received reply
2015-04-13 19:02:44,729 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,729 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0010.stratus.lvs.ebay.com:13562 freed by fetcher#16 in 27ms
2015-04-13 19:02:44,741 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7557293 bytes from map-output for attempt_1426279437401_714565_m_000350_0
2015-04-13 19:02:44,742 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7557293, inMemoryMapOutputs.size() -> 2, commitMemory -> 11466126, usedMemory ->1074794257
2015-04-13 19:02:44,742 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11146382 bytes from map-output for attempt_1426279437401_714565_m_000251_0
2015-04-13 19:02:44,742 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11146382, inMemoryMapOutputs.size() -> 3, commitMemory -> 19023419, usedMemory ->1074794257
2015-04-13 19:02:44,742 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,742 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0470.stratus.lvs.ebay.com:13562 freed by fetcher#34 in 154ms
2015-04-13 19:02:44,743 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000408_0,attempt_1426279437401_714565_m_000094_0,attempt_1426279437401_714565_m_000045_0,attempt_1426279437401_714565_m_000034_0 sent hash and received reply
2015-04-13 19:02:44,743 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,743 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0699.stratus.lvs.ebay.com:13562 freed by fetcher#17 in 28ms
2015-04-13 19:02:44,746 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,746 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0429.stratus.lvs.ebay.com:13562 freed by fetcher#25 in 372ms
2015-04-13 19:02:44,752 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10695065 bytes from map-output for attempt_1426279437401_714565_m_000225_0
2015-04-13 19:02:44,752 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10695065, inMemoryMapOutputs.size() -> 4, commitMemory -> 30169801, usedMemory ->1074794257
2015-04-13 19:02:44,753 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0269.stratus.lvs.ebay.com:13562 freed by fetcher#11 in 377ms
2015-04-13 19:02:44,754 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12748045 bytes from map-output for attempt_1426279437401_714565_m_000221_0
2015-04-13 19:02:44,755 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12748045, inMemoryMapOutputs.size() -> 5, commitMemory -> 40864866, usedMemory ->1074794257
2015-04-13 19:02:44,760 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#22 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,760 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0574.stratus.lvs.ebay.com:13562 freed by fetcher#22 in 401ms
2015-04-13 19:02:44,761 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 21053547 bytes from map-output for attempt_1426279437401_714565_m_000074_0
2015-04-13 19:02:44,761 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 21053547, inMemoryMapOutputs.size() -> 6, commitMemory -> 53612911, usedMemory ->1074794257
2015-04-13 19:02:44,761 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0734.stratus.lvs.ebay.com:13562 freed by fetcher#32 in 397ms
2015-04-13 19:02:44,762 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11114494 bytes from map-output for attempt_1426279437401_714565_m_000372_0
2015-04-13 19:02:44,762 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11114494, inMemoryMapOutputs.size() -> 7, commitMemory -> 74666458, usedMemory ->1074794257
2015-04-13 19:02:44,763 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#12 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,763 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0748.stratus.lvs.ebay.com:13562 freed by fetcher#12 in 401ms
2015-04-13 19:02:44,771 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9999165 bytes from map-output for attempt_1426279437401_714565_m_000285_0
2015-04-13 19:02:44,771 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9999165, inMemoryMapOutputs.size() -> 8, commitMemory -> 85780952, usedMemory ->1074794257
2015-04-13 19:02:44,772 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,772 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 freed by fetcher#28 in 409ms
2015-04-13 19:02:44,771 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11037405 bytes from map-output for attempt_1426279437401_714565_m_000240_0
2015-04-13 19:02:44,775 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11037405, inMemoryMapOutputs.size() -> 9, commitMemory -> 95780117, usedMemory ->1074794257
2015-04-13 19:02:44,776 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14318088 bytes from map-output for attempt_1426279437401_714565_m_000227_0
2015-04-13 19:02:44,776 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,776 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14318088, inMemoryMapOutputs.size() -> 10, commitMemory -> 106817522, usedMemory ->1074794257
2015-04-13 19:02:44,776 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,776 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0261.stratus.lvs.ebay.com:13562 freed by fetcher#14 in 413ms
2015-04-13 19:02:44,781 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 19880035 bytes from map-output for attempt_1426279437401_714565_m_000041_0
2015-04-13 19:02:44,781 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 19880035, inMemoryMapOutputs.size() -> 11, commitMemory -> 121135610, usedMemory ->1074794257
2015-04-13 19:02:44,781 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0581.stratus.lvs.ebay.com:13562 freed by fetcher#1 in 426ms
2015-04-13 19:02:44,782 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9763943 bytes from map-output for attempt_1426279437401_714565_m_000496_0
2015-04-13 19:02:44,782 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9763943, inMemoryMapOutputs.size() -> 12, commitMemory -> 141015645, usedMemory ->1074794257
2015-04-13 19:02:44,782 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,782 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0442.stratus.lvs.ebay.com:13562 freed by fetcher#26 in 415ms
2015-04-13 19:02:44,786 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0115.stratus.lvs.ebay.com:13562 freed by fetcher#30 in 425ms
2015-04-13 19:02:44,786 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10909648 bytes from map-output for attempt_1426279437401_714565_m_000246_0
2015-04-13 19:02:44,787 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10909648, inMemoryMapOutputs.size() -> 13, commitMemory -> 150779588, usedMemory ->1074794257
2015-04-13 19:02:44,787 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11028588 bytes from map-output for attempt_1426279437401_714565_m_000267_0
2015-04-13 19:02:44,787 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11028588, inMemoryMapOutputs.size() -> 14, commitMemory -> 161689236, usedMemory ->1074794257
2015-04-13 19:02:44,787 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0188.stratus.lvs.ebay.com:13562 freed by fetcher#9 in 423ms
2015-04-13 19:02:44,787 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 16431018 bytes from map-output for attempt_1426279437401_714565_m_000145_0
2015-04-13 19:02:44,787 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,792 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 16431018, inMemoryMapOutputs.size() -> 15, commitMemory -> 172717824, usedMemory ->1074794257
2015-04-13 19:02:44,792 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0319.stratus.lvs.ebay.com:13562 freed by fetcher#5 in 436ms
2015-04-13 19:02:44,794 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10862341 bytes from map-output for attempt_1426279437401_714565_m_000451_0
2015-04-13 19:02:44,794 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10862341, inMemoryMapOutputs.size() -> 16, commitMemory -> 189148842, usedMemory ->1074794257
2015-04-13 19:02:44,794 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,794 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0230.stratus.lvs.ebay.com:13562 freed by fetcher#27 in 425ms
2015-04-13 19:02:44,797 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0075.stratus.lvs.ebay.com:13562 freed by fetcher#6 in 280ms
2015-04-13 19:02:44,798 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 24730404 bytes from map-output for attempt_1426279437401_714565_m_000044_0
2015-04-13 19:02:44,799 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 24730404, inMemoryMapOutputs.size() -> 17, commitMemory -> 200011183, usedMemory ->1074794257
2015-04-13 19:02:44,799 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10207761 bytes from map-output for attempt_1426279437401_714565_m_000459_0
2015-04-13 19:02:44,799 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10207761, inMemoryMapOutputs.size() -> 18, commitMemory -> 224741587, usedMemory ->1074794257
2015-04-13 19:02:44,799 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,799 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#36 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,804 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 16936107 bytes from map-output for attempt_1426279437401_714565_m_000084_0
2015-04-13 19:02:44,799 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0386.stratus.lvs.ebay.com:13562 freed by fetcher#7 in 433ms
2015-04-13 19:02:44,816 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11897063 bytes from map-output for attempt_1426279437401_714565_m_000382_0
2015-04-13 19:02:44,816 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11897063, inMemoryMapOutputs.size() -> 19, commitMemory -> 234949348, usedMemory ->1074794257
2015-04-13 19:02:44,816 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0550.stratus.lvs.ebay.com:13562 freed by fetcher#35 in 439ms
2015-04-13 19:02:44,818 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14265521 bytes from map-output for attempt_1426279437401_714565_m_000112_0
2015-04-13 19:02:44,818 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14265521, inMemoryMapOutputs.size() -> 20, commitMemory -> 246846411, usedMemory ->1074794257
2015-04-13 19:02:44,818 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0359.stratus.lvs.ebay.com:13562 freed by fetcher#3 in 458ms
2015-04-13 19:02:44,824 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 16936107, inMemoryMapOutputs.size() -> 21, commitMemory -> 261111932, usedMemory ->1074794257
2015-04-13 19:02:44,825 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0446.stratus.lvs.ebay.com:13562 freed by fetcher#36 in 470ms
2015-04-13 19:02:44,825 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0413.stratus.lvs.ebay.com:13562 freed by fetcher#10 in 466ms
2015-04-13 19:02:44,827 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12177979 bytes from map-output for attempt_1426279437401_714565_m_000107_0
2015-04-13 19:02:44,827 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12177979, inMemoryMapOutputs.size() -> 22, commitMemory -> 278048039, usedMemory ->1074794257
2015-04-13 19:02:44,827 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0148.stratus.lvs.ebay.com:13562 freed by fetcher#20 in 449ms
2015-04-13 19:02:44,821 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 28088417 bytes from map-output for attempt_1426279437401_714565_m_000043_0
2015-04-13 19:02:44,837 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 28088417, inMemoryMapOutputs.size() -> 23, commitMemory -> 290226018, usedMemory ->1074794257
2015-04-13 19:02:44,837 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0671.stratus.lvs.ebay.com:13562 freed by fetcher#15 in 471ms
2015-04-13 19:02:44,841 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15422542 bytes from map-output for attempt_1426279437401_714565_m_000083_0
2015-04-13 19:02:44,841 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15422542, inMemoryMapOutputs.size() -> 24, commitMemory -> 318314435, usedMemory ->1074794257
2015-04-13 19:02:44,842 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0019.stratus.lvs.ebay.com:13562 freed by fetcher#23 in 477ms
2015-04-13 19:02:44,861 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12550768 bytes from map-output for attempt_1426279437401_714565_m_000200_0
2015-04-13 19:02:44,862 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12550768, inMemoryMapOutputs.size() -> 25, commitMemory -> 333736977, usedMemory ->1074794257
2015-04-13 19:02:44,862 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0187.stratus.lvs.ebay.com:13562 freed by fetcher#21 in 493ms
2015-04-13 19:02:44,938 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000389_0,attempt_1426279437401_714565_m_000170_0,attempt_1426279437401_714565_m_000059_0 sent hash and received reply
2015-04-13 19:02:44,938 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 - MergeManager returned status WAIT ...
2015-04-13 19:02:44,939 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0324.stratus.lvs.ebay.com:13562 freed by fetcher#33 in 236ms
2015-04-13 19:02:46,057 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 16854424 bytes from map-output for attempt_1426279437401_714565_m_000040_0
2015-04-13 19:02:46,058 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 16854424, inMemoryMapOutputs.size() -> 26, commitMemory -> 346287745, usedMemory ->1074794257
2015-04-13 19:02:46,058 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 - MergeManager returned status WAIT ...
2015-04-13 19:02:46,058 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0226.stratus.lvs.ebay.com:13562 freed by fetcher#2 in 1687ms
2015-04-13 19:02:55,487 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: attempt_1426279437401_714565_r_000318_0 Merge of the 64 files in-memory complete. Local file is /hadoop/2/scratch/local/usercache/b_pulsar_coe/appcache/application_1426279437401_714565/output/attempt_1426279437401_714565_r_000318_0/map_560.out.merged of size 223330780
2015-04-13 19:02:55,487 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0175.stratus.lvs.ebay.com:13562 with 1 to fetcher#2
2015-04-13 19:02:55,487 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0595.stratus.lvs.ebay.com:13562 with 4 to fetcher#20
2015-04-13 19:02:55,487 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0595.stratus.lvs.ebay.com:13562 to fetcher#20
2015-04-13 19:02:55,487 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0274.stratus.lvs.ebay.com:13562 with 1 to fetcher#26
2015-04-13 19:02:55,488 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0274.stratus.lvs.ebay.com:13562 to fetcher#26
2015-04-13 19:02:55,488 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0664.stratus.lvs.ebay.com:13562 with 3 to fetcher#17
2015-04-13 19:02:55,488 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0664.stratus.lvs.ebay.com:13562 to fetcher#17
2015-04-13 19:02:55,488 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0618.stratus.lvs.ebay.com:13562 with 2 to fetcher#15
2015-04-13 19:02:55,488 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0618.stratus.lvs.ebay.com:13562 to fetcher#15
2015-04-13 19:02:55,488 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0470.stratus.lvs.ebay.com:13562 with 3 to fetcher#18
2015-04-13 19:02:55,488 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0470.stratus.lvs.ebay.com:13562 to fetcher#18
2015-04-13 19:02:55,488 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0657.stratus.lvs.ebay.com:13562 with 5 to fetcher#33
2015-04-13 19:02:55,488 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0657.stratus.lvs.ebay.com:13562 to fetcher#33
2015-04-13 19:02:55,489 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0458.stratus.lvs.ebay.com:13562 with 1 to fetcher#19
2015-04-13 19:02:55,489 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0458.stratus.lvs.ebay.com:13562 to fetcher#19
2015-04-13 19:02:55,489 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0230.stratus.lvs.ebay.com:13562 with 4 to fetcher#23
2015-04-13 19:02:55,489 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0230.stratus.lvs.ebay.com:13562 to fetcher#23
2015-04-13 19:02:55,489 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0591.stratus.lvs.ebay.com:13562 with 3 to fetcher#21
2015-04-13 19:02:55,489 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0591.stratus.lvs.ebay.com:13562 to fetcher#21
2015-04-13 19:02:55,489 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0038.stratus.lvs.ebay.com:13562 with 2 to fetcher#8
2015-04-13 19:02:55,489 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0038.stratus.lvs.ebay.com:13562 to fetcher#8
2015-04-13 19:02:55,489 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0349.stratus.lvs.ebay.com:13562 with 2 to fetcher#24
2015-04-13 19:02:55,489 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0349.stratus.lvs.ebay.com:13562 to fetcher#24
2015-04-13 19:02:55,490 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0254.stratus.lvs.ebay.com:13562 with 3 to fetcher#29
2015-04-13 19:02:55,490 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0254.stratus.lvs.ebay.com:13562 to fetcher#29
2015-04-13 19:02:55,490 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0087.stratus.lvs.ebay.com:13562 with 2 to fetcher#16
2015-04-13 19:02:55,490 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0087.stratus.lvs.ebay.com:13562 to fetcher#16
2015-04-13 19:02:55,490 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0727.stratus.lvs.ebay.com:13562 with 2 to fetcher#34
2015-04-13 19:02:55,490 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0727.stratus.lvs.ebay.com:13562 to fetcher#34
2015-04-13 19:02:55,490 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0704.stratus.lvs.ebay.com:13562 with 3 to fetcher#25
2015-04-13 19:02:55,490 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0704.stratus.lvs.ebay.com:13562 to fetcher#25
2015-04-13 19:02:55,490 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0208.stratus.lvs.ebay.com:13562 with 1 to fetcher#11
2015-04-13 19:02:55,491 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0208.stratus.lvs.ebay.com:13562 to fetcher#11
2015-04-13 19:02:55,491 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0135.stratus.lvs.ebay.com:13562 with 4 to fetcher#22
2015-04-13 19:02:55,491 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0135.stratus.lvs.ebay.com:13562 to fetcher#22
2015-04-13 19:02:55,491 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0386.stratus.lvs.ebay.com:13562 with 1 to fetcher#32
2015-04-13 19:02:55,491 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0386.stratus.lvs.ebay.com:13562 to fetcher#32
2015-04-13 19:02:55,491 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0387.stratus.lvs.ebay.com:13562 with 3 to fetcher#12
2015-04-13 19:02:55,491 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0387.stratus.lvs.ebay.com:13562 to fetcher#12
2015-04-13 19:02:55,491 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0699.stratus.lvs.ebay.com:13562 with 4 to fetcher#28
2015-04-13 19:02:55,491 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0699.stratus.lvs.ebay.com:13562 to fetcher#28
2015-04-13 19:02:55,491 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000077_0 sent hash and received reply
2015-04-13 19:02:55,492 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0452.stratus.lvs.ebay.com:13562 with 3 to fetcher#14
2015-04-13 19:02:55,492 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0452.stratus.lvs.ebay.com:13562 to fetcher#14
2015-04-13 19:02:55,492 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0754.stratus.lvs.ebay.com:13562 with 4 to fetcher#1
2015-04-13 19:02:55,492 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0754.stratus.lvs.ebay.com:13562 to fetcher#1
2015-04-13 19:02:55,492 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0107.stratus.lvs.ebay.com:13562 with 2 to fetcher#30
2015-04-13 19:02:55,492 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0107.stratus.lvs.ebay.com:13562 to fetcher#30
2015-04-13 19:02:55,492 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000220_0,attempt_1426279437401_714565_m_000035_0,attempt_1426279437401_714565_m_000290_0 sent hash and received reply
2015-04-13 19:02:55,492 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0121.stratus.lvs.ebay.com:13562 with 4 to fetcher#9
2015-04-13 19:02:55,493 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0121.stratus.lvs.ebay.com:13562 to fetcher#9
2015-04-13 19:02:55,493 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0516.stratus.lvs.ebay.com:13562 with 2 to fetcher#5
2015-04-13 19:02:55,493 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000012_0 sent hash and received reply
2015-04-13 19:02:55,493 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0516.stratus.lvs.ebay.com:13562 to fetcher#5
2015-04-13 19:02:55,493 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000031_0,attempt_1426279437401_714565_m_000133_0 sent hash and received reply
2015-04-13 19:02:55,493 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0762.stratus.lvs.ebay.com:13562 with 1 to fetcher#27
2015-04-13 19:02:55,493 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0762.stratus.lvs.ebay.com:13562 to fetcher#27
2015-04-13 19:02:55,493 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000190_0 sent hash and received reply
2015-04-13 19:02:55,493 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0633.stratus.lvs.ebay.com:13562 with 3 to fetcher#6
2015-04-13 19:02:55,493 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0633.stratus.lvs.ebay.com:13562 to fetcher#6
2015-04-13 19:02:55,493 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0226.stratus.lvs.ebay.com:13562 with 3 to fetcher#7
2015-04-13 19:02:55,493 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0226.stratus.lvs.ebay.com:13562 to fetcher#7
2015-04-13 19:02:55,494 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000344_0,attempt_1426279437401_714565_m_000307_0,attempt_1426279437401_714565_m_000521_0 sent hash and received reply
2015-04-13 19:02:55,494 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000178_0,attempt_1426279437401_714565_m_000054_0 sent hash and received reply
2015-04-13 19:02:55,494 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000556_0,attempt_1426279437401_714565_m_000097_0 sent hash and received reply
2015-04-13 19:02:55,495 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000486_0,attempt_1426279437401_714565_m_000228_0,attempt_1426279437401_714565_m_000452_0,attempt_1426279437401_714565_m_000378_0,attempt_1426279437401_714565_m_000283_0 sent hash and received reply
2015-04-13 19:02:55,495 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000256_0,attempt_1426279437401_714565_m_000498_0,attempt_1426279437401_714565_m_000127_0 sent hash and received reply
2015-04-13 19:02:55,495 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000207_0,attempt_1426279437401_714565_m_000176_0,attempt_1426279437401_714565_m_000211_0 sent hash and received reply
2015-04-13 19:02:55,496 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000499_0 sent hash and received reply
2015-04-13 19:02:55,496 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000119_0,attempt_1426279437401_714565_m_000049_0 sent hash and received reply
2015-04-13 19:02:55,496 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000258_0,attempt_1426279437401_714565_m_000013_0 sent hash and received reply
2015-04-13 19:02:55,496 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000175_0,attempt_1426279437401_714565_m_000280_0,attempt_1426279437401_714565_m_000355_0 sent hash and received reply
2015-04-13 19:02:55,496 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000356_0,attempt_1426279437401_714565_m_000263_0 sent hash and received reply
2015-04-13 19:02:55,496 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000462_0,attempt_1426279437401_714565_m_000368_0,attempt_1426279437401_714565_m_000218_0,attempt_1426279437401_714565_m_000206_0 sent hash and received reply
2015-04-13 19:02:55,496 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000052_0,attempt_1426279437401_714565_m_000324_0,attempt_1426279437401_714565_m_000073_0 sent hash and received reply
2015-04-13 19:02:55,496 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0324.stratus.lvs.ebay.com:13562 with 3 to fetcher#35
2015-04-13 19:02:55,496 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0324.stratus.lvs.ebay.com:13562 to fetcher#35
2015-04-13 19:02:55,497 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0574.stratus.lvs.ebay.com:13562 with 2 to fetcher#3
2015-04-13 19:02:55,497 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0574.stratus.lvs.ebay.com:13562 to fetcher#3
2015-04-13 19:02:55,497 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0261.stratus.lvs.ebay.com:13562 with 1 to fetcher#36
2015-04-13 19:02:55,497 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0261.stratus.lvs.ebay.com:13562 to fetcher#36
2015-04-13 19:02:55,497 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0669.stratus.lvs.ebay.com:13562 with 3 to fetcher#10
2015-04-13 19:02:55,497 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0669.stratus.lvs.ebay.com:13562 to fetcher#10
2015-04-13 19:02:55,497 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0175.stratus.lvs.ebay.com:13562 to fetcher#2
2015-04-13 19:02:55,497 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000408_0,attempt_1426279437401_714565_m_000094_0,attempt_1426279437401_714565_m_000034_0,attempt_1426279437401_714565_m_000045_0 sent hash and received reply
2015-04-13 19:02:55,498 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0476.stratus.lvs.ebay.com:13562 with 1 to fetcher#4
2015-04-13 19:02:55,498 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0476.stratus.lvs.ebay.com:13562 to fetcher#4
2015-04-13 19:02:55,498 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0374.stratus.lvs.ebay.com:13562 with 1 to fetcher#13
2015-04-13 19:02:55,498 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0374.stratus.lvs.ebay.com:13562 to fetcher#13
2015-04-13 19:02:55,498 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000141_0,attempt_1426279437401_714565_m_000051_0,attempt_1426279437401_714565_m_000087_0 sent hash and received reply
2015-04-13 19:02:55,498 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0541.stratus.lvs.ebay.com:13562 with 1 to fetcher#31
2015-04-13 19:02:55,498 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0541.stratus.lvs.ebay.com:13562 to fetcher#31
2015-04-13 19:02:55,498 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000024_0 sent hash and received reply
2015-04-13 19:02:55,498 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000241_0,attempt_1426279437401_714565_m_000179_0,attempt_1426279437401_714565_m_000099_0 sent hash and received reply
2015-04-13 19:02:55,498 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000143_0,attempt_1426279437401_714565_m_000210_0,attempt_1426279437401_714565_m_000194_0,attempt_1426279437401_714565_m_000046_0 sent hash and received reply
2015-04-13 19:02:55,499 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 about to shuffle output of map attempt_1426279437401_714565_m_000077_0 decomp: 18114973 len: 6443519 to MEMORY
2015-04-13 19:02:55,500 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000085_0 sent hash and received reply
2015-04-13 19:02:55,500 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000019_0,attempt_1426279437401_714565_m_000030_0,attempt_1426279437401_714565_m_000110_0,attempt_1426279437401_714565_m_000015_0 sent hash and received reply
2015-04-13 19:02:55,500 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000167_0,attempt_1426279437401_714565_m_000232_0,attempt_1426279437401_714565_m_000053_0 sent hash and received reply
2015-04-13 19:02:55,502 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000389_0,attempt_1426279437401_714565_m_000059_0,attempt_1426279437401_714565_m_000170_0 sent hash and received reply
2015-04-13 19:02:55,502 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000213_0,attempt_1426279437401_714565_m_000055_0 sent hash and received reply
2015-04-13 19:02:55,502 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000485_0,attempt_1426279437401_714565_m_000393_0,attempt_1426279437401_714565_m_000377_0 sent hash and received reply
2015-04-13 19:02:55,502 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000273_0 sent hash and received reply
2015-04-13 19:02:55,503 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000188_0 sent hash and received reply
2015-04-13 19:02:55,503 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000058_0 sent hash and received reply
2015-04-13 19:02:55,504 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000518_0 sent hash and received reply
2015-04-13 19:02:55,504 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 about to shuffle output of map attempt_1426279437401_714565_m_000024_0 decomp: 22353115 len: 6826945 to MEMORY
2015-04-13 19:02:55,504 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000115_0,attempt_1426279437401_714565_m_000036_0 sent hash and received reply
2015-04-13 19:02:55,507 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 about to shuffle output of map attempt_1426279437401_714565_m_000141_0 decomp: 11569416 len: 3377120 to MEMORY
2015-04-13 19:02:55,509 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 about to shuffle output of map attempt_1426279437401_714565_m_000408_0 decomp: 9000315 len: 2624140 to MEMORY
2015-04-13 19:02:55,514 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 about to shuffle output of map attempt_1426279437401_714565_m_000052_0 decomp: 17522238 len: 5870848 to MEMORY
2015-04-13 19:02:55,516 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 about to shuffle output of map attempt_1426279437401_714565_m_000462_0 decomp: 9388866 len: 3185585 to MEMORY
2015-04-13 19:02:55,519 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 about to shuffle output of map attempt_1426279437401_714565_m_000356_0 decomp: 11459154 len: 3897798 to MEMORY
2015-04-13 19:02:55,523 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#6 about to shuffle output of map attempt_1426279437401_714565_m_000175_0 decomp: 12170173 len: 3689939 to MEMORY
2015-04-13 19:02:55,525 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 about to shuffle output of map attempt_1426279437401_714565_m_000258_0 decomp: 9533816 len: 3118435 to MEMORY
2015-04-13 19:02:55,528 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 about to shuffle output of map attempt_1426279437401_714565_m_000119_0 decomp: 11470624 len: 4087624 to MEMORY
2015-04-13 19:02:55,531 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#11 about to shuffle output of map attempt_1426279437401_714565_m_000499_0 decomp: 8645276 len: 2802027 to MEMORY
2015-04-13 19:02:55,534 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 about to shuffle output of map attempt_1426279437401_714565_m_000207_0 decomp: 12689355 len: 4053117 to MEMORY
2015-04-13 19:02:55,537 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 about to shuffle output of map attempt_1426279437401_714565_m_000256_0 decomp: 12146866 len: 3893166 to MEMORY
2015-04-13 19:02:55,540 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 about to shuffle output of map attempt_1426279437401_714565_m_000486_0 decomp: 8946744 len: 3037619 to MEMORY
2015-04-13 19:02:55,541 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 about to shuffle output of map attempt_1426279437401_714565_m_000556_0 decomp: 6552772 len: 2149036 to MEMORY
2015-04-13 19:02:55,545 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 about to shuffle output of map attempt_1426279437401_714565_m_000178_0 decomp: 12583597 len: 4235275 to MEMORY
2015-04-13 19:02:55,548 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000344_0 decomp: 12404663 len: 4012414 to MEMORY
2015-04-13 19:02:55,552 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#32 about to shuffle output of map attempt_1426279437401_714565_m_000190_0 decomp: 13330492 len: 3498853 to MEMORY
2015-04-13 19:02:55,557 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#15 about to shuffle output of map attempt_1426279437401_714565_m_000031_0 decomp: 18195701 len: 5361526 to MEMORY
2015-04-13 19:02:56,073 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000322_0,attempt_1426279437401_714565_m_000202_0,attempt_1426279437401_714565_m_000186_0,attempt_1426279437401_714565_m_000047_0 sent hash and received reply
2015-04-13 19:02:56,079 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 about to shuffle output of map attempt_1426279437401_714565_m_000012_0 decomp: 27931429 len: 8609091 to MEMORY
2015-04-13 19:02:56,083 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 about to shuffle output of map attempt_1426279437401_714565_m_000220_0 decomp: 13391065 len: 4115097 to MEMORY
2015-04-13 19:02:56,084 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9388866 bytes from map-output for attempt_1426279437401_714565_m_000462_0
2015-04-13 19:02:56,086 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9000315 bytes from map-output for attempt_1426279437401_714565_m_000408_0
2015-04-13 19:02:56,087 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8645276 bytes from map-output for attempt_1426279437401_714565_m_000499_0
2015-04-13 19:02:56,087 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#9 about to shuffle output of map attempt_1426279437401_714565_m_000322_0 decomp: 12221208 len: 4207613 to MEMORY
2015-04-13 19:02:56,092 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 about to shuffle output of map attempt_1426279437401_714565_m_000115_0 decomp: 17165481 len: 5749315 to MEMORY
2015-04-13 19:02:56,093 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 about to shuffle output of map attempt_1426279437401_714565_m_000518_0 decomp: 5618404 len: 1929107 to MEMORY
2015-04-13 19:02:56,099 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11569416 bytes from map-output for attempt_1426279437401_714565_m_000141_0
2015-04-13 19:02:56,101 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9533816 bytes from map-output for attempt_1426279437401_714565_m_000258_0
2015-04-13 19:02:56,105 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 about to shuffle output of map attempt_1426279437401_714565_m_000188_0 decomp: 11306474 len: 3861713 to MEMORY
2015-04-13 19:02:56,109 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#4 about to shuffle output of map attempt_1426279437401_714565_m_000273_0 decomp: 12431114 len: 3465664 to MEMORY
2015-04-13 19:02:56,111 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 about to shuffle output of map attempt_1426279437401_714565_m_000058_0 decomp: 17478015 len: 5680128 to MEMORY
2015-04-13 19:02:56,112 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#10 about to shuffle output of map attempt_1426279437401_714565_m_000485_0 decomp: 8426144 len: 2755546 to MEMORY
2015-04-13 19:02:56,115 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12404663 bytes from map-output for attempt_1426279437401_714565_m_000344_0
2015-04-13 19:02:56,116 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 about to shuffle output of map attempt_1426279437401_714565_m_000213_0 decomp: 12554194 len: 4282141 to MEMORY
2015-04-13 19:02:56,118 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 about to shuffle output of map attempt_1426279437401_714565_m_000389_0 decomp: 8973037 len: 2761556 to MEMORY
2015-04-13 19:02:56,122 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 about to shuffle output of map attempt_1426279437401_714565_m_000167_0 decomp: 11808451 len: 3747311 to MEMORY
2015-04-13 19:02:56,125 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6552772 bytes from map-output for attempt_1426279437401_714565_m_000556_0
2015-04-13 19:02:56,128 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#22 about to shuffle output of map attempt_1426279437401_714565_m_000019_0 decomp: 23482399 len: 7928849 to MEMORY
2015-04-13 19:02:56,131 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#36 about to shuffle output of map attempt_1426279437401_714565_m_000085_0 decomp: 12642447 len: 4193079 to MEMORY
2015-04-13 19:02:56,135 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle output of map attempt_1426279437401_714565_m_000143_0 decomp: 13692647 len: 3949360 to MEMORY
2015-04-13 19:02:56,140 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9388866, inMemoryMapOutputs.size() -> 27, commitMemory -> 363142169, usedMemory ->826908519
2015-04-13 19:02:56,143 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6552772, inMemoryMapOutputs.size() -> 28, commitMemory -> 372531035, usedMemory ->838846000
2015-04-13 19:02:56,144 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12404663, inMemoryMapOutputs.size() -> 29, commitMemory -> 379083807, usedMemory ->838846000
2015-04-13 19:02:56,144 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#12 about to shuffle output of map attempt_1426279437401_714565_m_000241_0 decomp: 16565685 len: 5354813 to MEMORY
2015-04-13 19:02:56,143 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 about to shuffle output of map attempt_1426279437401_714565_m_000368_0 decomp: 11937481 len: 3833881 to MEMORY
2015-04-13 19:02:56,149 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 5618404 bytes from map-output for attempt_1426279437401_714565_m_000518_0
2015-04-13 19:02:56,167 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000122_0,attempt_1426279437401_714565_m_000222_0,attempt_1426279437401_714565_m_000135_0,attempt_1426279437401_714565_m_000306_0 sent hash and received reply
2015-04-13 19:02:56,168 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8946744 bytes from map-output for attempt_1426279437401_714565_m_000486_0
2015-04-13 19:02:56,173 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 about to shuffle output of map attempt_1426279437401_714565_m_000097_0 decomp: 19070037 len: 6147281 to MEMORY
2015-04-13 19:02:56,174 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11459154 bytes from map-output for attempt_1426279437401_714565_m_000356_0
2015-04-13 19:02:56,177 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9533816, inMemoryMapOutputs.size() -> 30, commitMemory -> 391488470, usedMemory ->871821993
2015-04-13 19:02:56,177 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11569416, inMemoryMapOutputs.size() -> 31, commitMemory -> 401022286, usedMemory ->871821993
2015-04-13 19:02:56,177 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000122_0 decomp: 13905956 len: 4874384 to MEMORY
2015-04-13 19:02:56,186 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000307_0 decomp: 9955203 len: 2632820 to MEMORY
2015-04-13 19:02:56,190 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8645276, inMemoryMapOutputs.size() -> 32, commitMemory -> 412591702, usedMemory ->918124904
2015-04-13 19:02:56,190 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9000315, inMemoryMapOutputs.size() -> 33, commitMemory -> 421236978, usedMemory ->918124904
2015-04-13 19:02:56,190 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 about to shuffle output of map attempt_1426279437401_714565_m_000051_0 decomp: 16288668 len: 5349040 to MEMORY
2015-04-13 19:02:56,190 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0208.stratus.lvs.ebay.com:13562 freed by fetcher#11 in 699ms
2015-04-13 19:02:56,190 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0299.stratus.lvs.ebay.com:13562 with 1 to fetcher#11
2015-04-13 19:02:56,190 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0299.stratus.lvs.ebay.com:13562 to fetcher#11
2015-04-13 19:02:56,193 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 about to shuffle output of map attempt_1426279437401_714565_m_000013_0 decomp: 20059040 len: 7192230 to MEMORY
2015-04-13 19:02:56,194 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 about to shuffle output of map attempt_1426279437401_714565_m_000094_0 decomp: 12875751 len: 3634060 to MEMORY
2015-04-13 19:02:56,194 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11459154, inMemoryMapOutputs.size() -> 34, commitMemory -> 430237293, usedMemory ->931000655
2015-04-13 19:02:56,194 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8946744, inMemoryMapOutputs.size() -> 35, commitMemory -> 441696447, usedMemory ->931000655
2015-04-13 19:02:56,195 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11470624 bytes from map-output for attempt_1426279437401_714565_m_000119_0
2015-04-13 19:02:56,211 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12170173 bytes from map-output for attempt_1426279437401_714565_m_000175_0
2015-04-13 19:02:56,202 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 about to shuffle output of map attempt_1426279437401_714565_m_000228_0 decomp: 12179267 len: 4224319 to MEMORY
2015-04-13 19:02:56,202 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 5618404, inMemoryMapOutputs.size() -> 36, commitMemory -> 450643191, usedMemory ->956316858
2015-04-13 19:02:56,199 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000430_0 sent hash and received reply
2015-04-13 19:02:56,198 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 about to shuffle output of map attempt_1426279437401_714565_m_000263_0 decomp: 13136936 len: 4559653 to MEMORY
2015-04-13 19:02:56,198 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8973037 bytes from map-output for attempt_1426279437401_714565_m_000389_0
2015-04-13 19:02:56,212 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0541.stratus.lvs.ebay.com:13562 freed by fetcher#31 in 714ms
2015-04-13 19:02:56,212 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0265.stratus.lvs.ebay.com:13562 with 2 to fetcher#31
2015-04-13 19:02:56,212 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0265.stratus.lvs.ebay.com:13562 to fetcher#31
2015-04-13 19:02:56,214 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12146866 bytes from map-output for attempt_1426279437401_714565_m_000256_0
2015-04-13 19:02:56,214 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#11 about to shuffle output of map attempt_1426279437401_714565_m_000430_0 decomp: 9115673 len: 3296382 to MEMORY
2015-04-13 19:02:56,214 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 18114973 bytes from map-output for attempt_1426279437401_714565_m_000077_0
2015-04-13 19:02:56,214 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12146866, inMemoryMapOutputs.size() -> 37, commitMemory -> 456261595, usedMemory ->965432531
2015-04-13 19:02:56,252 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12689355 bytes from map-output for attempt_1426279437401_714565_m_000207_0
2015-04-13 19:02:56,236 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8426144 bytes from map-output for attempt_1426279437401_714565_m_000485_0
2015-04-13 19:02:56,256 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12170173, inMemoryMapOutputs.size() -> 38, commitMemory -> 468408461, usedMemory ->965432531
2015-04-13 19:02:56,259 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11470624, inMemoryMapOutputs.size() -> 39, commitMemory -> 480578634, usedMemory ->974070580
2015-04-13 19:02:56,259 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8426144, inMemoryMapOutputs.size() -> 40, commitMemory -> 492049258, usedMemory ->974070580
2015-04-13 19:02:56,262 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12689355, inMemoryMapOutputs.size() -> 41, commitMemory -> 500475402, usedMemory ->984490472
2015-04-13 19:02:56,263 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 18114973, inMemoryMapOutputs.size() -> 42, commitMemory -> 513164757, usedMemory ->984490472
2015-04-13 19:02:56,259 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 about to shuffle output of map attempt_1426279437401_714565_m_000498_0 decomp: 8638049 len: 2831608 to MEMORY
2015-04-13 19:02:56,262 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#6 about to shuffle output of map attempt_1426279437401_714565_m_000280_0 decomp: 10419892 len: 3588667 to MEMORY
2015-04-13 19:02:56,265 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12583597 bytes from map-output for attempt_1426279437401_714565_m_000178_0
2015-04-13 19:02:56,270 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9955203 bytes from map-output for attempt_1426279437401_714565_m_000307_0
2015-04-13 19:02:56,273 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000438_0,attempt_1426279437401_714565_m_000197_0 sent hash and received reply
2015-04-13 19:02:56,277 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12554194 bytes from map-output for attempt_1426279437401_714565_m_000213_0
2015-04-13 19:02:56,278 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11808451 bytes from map-output for attempt_1426279437401_714565_m_000167_0
2015-04-13 19:02:56,278 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12431114 bytes from map-output for attempt_1426279437401_714565_m_000273_0
2015-04-13 19:02:56,279 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11306474 bytes from map-output for attempt_1426279437401_714565_m_000188_0
2015-04-13 19:02:56,280 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#10 about to shuffle output of map attempt_1426279437401_714565_m_000393_0 decomp: 8052757 len: 2710893 to MEMORY
2015-04-13 19:02:56,282 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 about to shuffle output of map attempt_1426279437401_714565_m_000176_0 decomp: 16287786 len: 4246294 to MEMORY
2015-04-13 19:02:56,284 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 about to shuffle output of map attempt_1426279437401_714565_m_000049_0 decomp: 14459411 len: 4817168 to MEMORY
2015-04-13 19:02:56,287 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 about to shuffle output of map attempt_1426279437401_714565_m_000438_0 decomp: 9106318 len: 2938957 to MEMORY
2015-04-13 19:02:56,288 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 16565685 bytes from map-output for attempt_1426279437401_714565_m_000241_0
2015-04-13 19:02:56,288 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8973037, inMemoryMapOutputs.size() -> 43, commitMemory -> 531279730, usedMemory ->1032396744
2015-04-13 19:02:56,288 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 16565685, inMemoryMapOutputs.size() -> 44, commitMemory -> 540252767, usedMemory ->1032396744
2015-04-13 19:02:56,289 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 18195701 bytes from map-output for attempt_1426279437401_714565_m_000031_0
2015-04-13 19:02:56,293 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 about to shuffle output of map attempt_1426279437401_714565_m_000059_0 decomp: 15037254 len: 4721915 to MEMORY
2015-04-13 19:02:56,294 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 18195701, inMemoryMapOutputs.size() -> 45, commitMemory -> 556818452, usedMemory ->1047433998
2015-04-13 19:02:56,298 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#12 about to shuffle output of map attempt_1426279437401_714565_m_000179_0 decomp: 12290211 len: 3294953 to MEMORY
2015-04-13 19:02:56,299 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 17522238 bytes from map-output for attempt_1426279437401_714565_m_000052_0
2015-04-13 19:02:56,305 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 17165481 bytes from map-output for attempt_1426279437401_714565_m_000115_0
2015-04-13 19:02:56,498 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13692647 bytes from map-output for attempt_1426279437401_714565_m_000143_0
2015-04-13 19:02:56,500 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11306474, inMemoryMapOutputs.size() -> 46, commitMemory -> 575014153, usedMemory ->1073498035
2015-04-13 19:02:56,500 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#15 about to shuffle output of map attempt_1426279437401_714565_m_000133_0 decomp: 13773826 len: 4253323 to MEMORY
2015-04-13 19:02:56,500 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12431114, inMemoryMapOutputs.size() -> 47, commitMemory -> 586320627, usedMemory ->1073498035
2015-04-13 19:02:56,500 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11808451, inMemoryMapOutputs.size() -> 48, commitMemory -> 598751741, usedMemory ->1073498035
2015-04-13 19:02:56,504 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 about to shuffle output of map attempt_1426279437401_714565_m_000232_0 decomp: 13863048 len: 4926008 to MEMORY
2015-04-13 19:02:56,506 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12554194, inMemoryMapOutputs.size() -> 49, commitMemory -> 610560192, usedMemory ->1087361083
2015-04-13 19:02:56,506 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9955203, inMemoryMapOutputs.size() -> 50, commitMemory -> 623114386, usedMemory ->1087361083
2015-04-13 19:02:56,506 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,506 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12583597, inMemoryMapOutputs.size() -> 51, commitMemory -> 633069589, usedMemory ->1087361083
2015-04-13 19:02:56,507 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,507 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0574.stratus.lvs.ebay.com:13562 freed by fetcher#3 in 1010ms
2015-04-13 19:02:56,507 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,516 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11937481 bytes from map-output for attempt_1426279437401_714565_m_000368_0
2015-04-13 19:02:56,507 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0468.stratus.lvs.ebay.com:13562 with 1 to fetcher#3
2015-04-13 19:02:56,521 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0468.stratus.lvs.ebay.com:13562 to fetcher#3
2015-04-13 19:02:56,522 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0274.stratus.lvs.ebay.com:13562 freed by fetcher#26 in 1034ms
2015-04-13 19:02:56,522 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0602.stratus.lvs.ebay.com:13562 with 2 to fetcher#26
2015-04-13 19:02:56,522 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0602.stratus.lvs.ebay.com:13562 to fetcher#26
2015-04-13 19:02:56,523 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0038.stratus.lvs.ebay.com:13562 freed by fetcher#8 in 1034ms
2015-04-13 19:02:56,523 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0591.stratus.lvs.ebay.com:13562 freed by fetcher#21 in 1034ms
2015-04-13 19:02:56,523 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0476.stratus.lvs.ebay.com:13562 freed by fetcher#4 in 1025ms
2015-04-13 19:02:56,524 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0197.stratus.lvs.ebay.com:13562 with 4 to fetcher#4
2015-04-13 19:02:56,524 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0197.stratus.lvs.ebay.com:13562 to fetcher#4
2015-04-13 19:02:56,524 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0374.stratus.lvs.ebay.com:13562 freed by fetcher#13 in 1026ms
2015-04-13 19:02:56,524 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0089.stratus.lvs.ebay.com:13562 with 5 to fetcher#13
2015-04-13 19:02:56,524 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0089.stratus.lvs.ebay.com:13562 to fetcher#13
2015-04-13 19:02:56,524 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13692647, inMemoryMapOutputs.size() -> 52, commitMemory -> 645653186, usedMemory ->1087361083
2015-04-13 19:02:56,525 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,525 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0754.stratus.lvs.ebay.com:13562 freed by fetcher#1 in 1033ms
2015-04-13 19:02:56,525 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0504.stratus.lvs.ebay.com:13562 with 2 to fetcher#1
2015-04-13 19:02:56,525 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0504.stratus.lvs.ebay.com:13562 to fetcher#1
2015-04-13 19:02:56,526 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 17165481, inMemoryMapOutputs.size() -> 53, commitMemory -> 659345833, usedMemory ->1087361083
2015-04-13 19:02:56,526 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 17522238, inMemoryMapOutputs.size() -> 54, commitMemory -> 676511314, usedMemory ->1087361083
2015-04-13 19:02:56,526 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000091_0 sent hash and received reply
2015-04-13 19:02:56,526 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8638049 bytes from map-output for attempt_1426279437401_714565_m_000498_0
2015-04-13 19:02:56,527 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12875751 bytes from map-output for attempt_1426279437401_714565_m_000094_0
2015-04-13 19:02:56,528 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000219_0,attempt_1426279437401_714565_m_000105_0 sent hash and received reply
2015-04-13 19:02:56,529 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000443_0,attempt_1426279437401_714565_m_000535_0,attempt_1426279437401_714565_m_000513_0,attempt_1426279437401_714565_m_000497_0 sent hash and received reply
2015-04-13 19:02:56,529 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000516_0,attempt_1426279437401_714565_m_000413_0,attempt_1426279437401_714565_m_000286_0,attempt_1426279437401_714565_m_000103_0,attempt_1426279437401_714565_m_000353_0 sent hash and received reply
2015-04-13 19:02:56,530 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000561_0,attempt_1426279437401_714565_m_000402_0 sent hash and received reply
2015-04-13 19:02:56,520 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13391065 bytes from map-output for attempt_1426279437401_714565_m_000220_0
2015-04-13 19:02:56,526 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11937481, inMemoryMapOutputs.size() -> 55, commitMemory -> 694033552, usedMemory ->1087361083
2015-04-13 19:02:56,531 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,531 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,531 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0303.stratus.lvs.ebay.com:13562 with 2 to fetcher#21
2015-04-13 19:02:56,531 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,531 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0303.stratus.lvs.ebay.com:13562 to fetcher#21
2015-04-13 19:02:56,531 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,532 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,532 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0158.stratus.lvs.ebay.com:13562 with 1 to fetcher#8
2015-04-13 19:02:56,532 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0158.stratus.lvs.ebay.com:13562 to fetcher#8
2015-04-13 19:02:56,531 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#4 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,532 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0504.stratus.lvs.ebay.com:13562 freed by fetcher#1 in 7ms
2015-04-13 19:02:56,532 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,532 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0107.stratus.lvs.ebay.com:13562 freed by fetcher#30 in 1040ms
2015-04-13 19:02:56,532 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0748.stratus.lvs.ebay.com:13562 with 5 to fetcher#30
2015-04-13 19:02:56,532 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0748.stratus.lvs.ebay.com:13562 to fetcher#30
2015-04-13 19:02:56,532 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,532 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0254.stratus.lvs.ebay.com:13562 freed by fetcher#29 in 1042ms
2015-04-13 19:02:56,532 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0713.stratus.lvs.ebay.com:13562 with 1 to fetcher#29
2015-04-13 19:02:56,532 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0713.stratus.lvs.ebay.com:13562 to fetcher#29
2015-04-13 19:02:56,532 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0602.stratus.lvs.ebay.com:13562 freed by fetcher#26 in 10ms
2015-04-13 19:02:56,533 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0282.stratus.lvs.ebay.com:13562 with 8 to fetcher#26
2015-04-13 19:02:56,533 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 8 of 8 to lvsdpehdc25dn0282.stratus.lvs.ebay.com:13562 to fetcher#26
2015-04-13 19:02:56,534 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13391065, inMemoryMapOutputs.size() -> 56, commitMemory -> 705971033, usedMemory ->1087361083
2015-04-13 19:02:56,534 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Starting inMemoryMerger's merge since commitMemory=719362098 > mergeThreshold=708669632. Current usedMemory=1087361083
2015-04-13 19:02:56,534 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000494_0 sent hash and received reply
2015-04-13 19:02:56,535 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeThread: InMemoryMerger - Thread to merge in-memory shuffled map-outputs: Starting merge with 56 segments, while ignoring 0 segments
2015-04-13 19:02:56,535 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,535 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,535 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000131_0,attempt_1426279437401_714565_m_000208_0 sent hash and received reply
2015-04-13 19:02:56,535 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0664.stratus.lvs.ebay.com:13562 freed by fetcher#17 in 1047ms
2015-04-13 19:02:56,535 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,536 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000363_0 sent hash and received reply
2015-04-13 19:02:56,537 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000450_0,attempt_1426279437401_714565_m_000488_0,attempt_1426279437401_714565_m_000501_0,attempt_1426279437401_714565_m_000449_0,attempt_1426279437401_714565_m_000111_0 sent hash and received reply
2015-04-13 19:02:56,540 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12642447 bytes from map-output for attempt_1426279437401_714565_m_000085_0
2015-04-13 19:02:56,541 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 17478015 bytes from map-output for attempt_1426279437401_714565_m_000058_0
2015-04-13 19:02:56,541 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Initiating in-memory merge with 56 segments...
2015-04-13 19:02:56,541 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapred.Merger: Merging 56 sorted segments
2015-04-13 19:02:56,542 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 56 segments left of total size: 719360082 bytes
2015-04-13 19:02:56,535 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12875751, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->1087361083
2015-04-13 19:02:56,542 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12179267 bytes from map-output for attempt_1426279437401_714565_m_000228_0
2015-04-13 19:02:56,542 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,542 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12179267, inMemoryMapOutputs.size() -> 2, commitMemory -> 12875751, usedMemory ->1087361083
2015-04-13 19:02:56,542 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,542 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,542 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,542 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0713.stratus.lvs.ebay.com:13562 freed by fetcher#29 in 10ms
2015-04-13 19:02:56,543 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0699.stratus.lvs.ebay.com:13562 freed by fetcher#28 in 1052ms
2015-04-13 19:02:56,543 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0657.stratus.lvs.ebay.com:13562 freed by fetcher#33 in 1055ms
2015-04-13 19:02:56,545 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8638049, inMemoryMapOutputs.size() -> 3, commitMemory -> 25055018, usedMemory ->1087361083
2015-04-13 19:02:56,546 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13330492 bytes from map-output for attempt_1426279437401_714565_m_000190_0
2015-04-13 19:02:56,546 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0748.stratus.lvs.ebay.com:13562 freed by fetcher#30 in 14ms
2015-04-13 19:02:56,546 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13330492, inMemoryMapOutputs.size() -> 4, commitMemory -> 33693067, usedMemory ->1087361083
2015-04-13 19:02:56,546 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,546 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0386.stratus.lvs.ebay.com:13562 freed by fetcher#32 in 1055ms
2015-04-13 19:02:56,546 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000520_0,attempt_1426279437401_714565_m_000427_0,attempt_1426279437401_714565_m_000387_0,attempt_1426279437401_714565_m_000394_0,attempt_1426279437401_714565_m_000295_0,attempt_1426279437401_714565_m_000245_0,attempt_1426279437401_714565_m_000149_0,attempt_1426279437401_714565_m_000181_0 sent hash and received reply
2015-04-13 19:02:56,546 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,546 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0282.stratus.lvs.ebay.com:13562 freed by fetcher#26 in 13ms
2015-04-13 19:02:56,550 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 17478015, inMemoryMapOutputs.size() -> 5, commitMemory -> 47023559, usedMemory ->1087361083
2015-04-13 19:02:56,550 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9106318 bytes from map-output for attempt_1426279437401_714565_m_000438_0
2015-04-13 19:02:56,546 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13136936 bytes from map-output for attempt_1426279437401_714565_m_000263_0
2015-04-13 19:02:56,550 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12642447, inMemoryMapOutputs.size() -> 6, commitMemory -> 64501574, usedMemory ->1087361083
2015-04-13 19:02:56,553 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0303.stratus.lvs.ebay.com:13562 freed by fetcher#21 in 22ms
2015-04-13 19:02:56,554 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0158.stratus.lvs.ebay.com:13562 freed by fetcher#8 in 22ms
2015-04-13 19:02:56,554 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0468.stratus.lvs.ebay.com:13562 freed by fetcher#3 in 33ms
2015-04-13 19:02:56,554 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0089.stratus.lvs.ebay.com:13562 freed by fetcher#13 in 30ms
2015-04-13 19:02:56,554 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0183.stratus.lvs.ebay.com:13562 with 3 to fetcher#1
2015-04-13 19:02:56,554 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0183.stratus.lvs.ebay.com:13562 to fetcher#1
2015-04-13 19:02:56,554 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0197.stratus.lvs.ebay.com:13562 freed by fetcher#4 in 30ms
2015-04-13 19:02:56,554 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0595.stratus.lvs.ebay.com:13562 freed by fetcher#20 in 1067ms
2015-04-13 19:02:56,554 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0261.stratus.lvs.ebay.com:13562 freed by fetcher#36 in 1057ms
2015-04-13 19:02:56,559 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9115673 bytes from map-output for attempt_1426279437401_714565_m_000430_0
2015-04-13 19:02:56,559 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9115673, inMemoryMapOutputs.size() -> 7, commitMemory -> 77144021, usedMemory ->1087361083
2015-04-13 19:02:56,560 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0299.stratus.lvs.ebay.com:13562 freed by fetcher#11 in 369ms
2015-04-13 19:02:56,560 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 16288668 bytes from map-output for attempt_1426279437401_714565_m_000051_0
2015-04-13 19:02:56,560 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 16288668, inMemoryMapOutputs.size() -> 8, commitMemory -> 86259694, usedMemory ->1087361083
2015-04-13 19:02:56,560 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13136936, inMemoryMapOutputs.size() -> 9, commitMemory -> 102548362, usedMemory ->1087361083
2015-04-13 19:02:56,560 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9106318, inMemoryMapOutputs.size() -> 10, commitMemory -> 115685298, usedMemory ->1087361083
2015-04-13 19:02:56,560 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0175.stratus.lvs.ebay.com:13562 freed by fetcher#2 in 1073ms
2015-04-13 19:02:56,561 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,561 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0704.stratus.lvs.ebay.com:13562 freed by fetcher#25 in 1071ms
2015-04-13 19:02:56,561 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0087.stratus.lvs.ebay.com:13562 freed by fetcher#16 in 1071ms
2015-04-13 19:02:56,561 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0265.stratus.lvs.ebay.com:13562 freed by fetcher#31 in 349ms
2015-04-13 19:02:56,563 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 22353115 bytes from map-output for attempt_1426279437401_714565_m_000024_0
2015-04-13 19:02:56,563 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 22353115, inMemoryMapOutputs.size() -> 11, commitMemory -> 124791616, usedMemory ->1087361083
2015-04-13 19:02:56,563 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0762.stratus.lvs.ebay.com:13562 freed by fetcher#27 in 1070ms
2015-04-13 19:02:56,567 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,567 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0452.stratus.lvs.ebay.com:13562 freed by fetcher#14 in 1075ms
2015-04-13 19:02:56,573 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10419892 bytes from map-output for attempt_1426279437401_714565_m_000280_0
2015-04-13 19:02:56,574 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10419892, inMemoryMapOutputs.size() -> 12, commitMemory -> 147144731, usedMemory ->1087361083
2015-04-13 19:02:56,574 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#6 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,574 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0633.stratus.lvs.ebay.com:13562 freed by fetcher#6 in 1081ms
2015-04-13 19:02:56,582 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8052757 bytes from map-output for attempt_1426279437401_714565_m_000393_0
2015-04-13 19:02:56,582 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8052757, inMemoryMapOutputs.size() -> 13, commitMemory -> 157564623, usedMemory ->1087361083
2015-04-13 19:02:56,583 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#10 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,583 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0669.stratus.lvs.ebay.com:13562 freed by fetcher#10 in 1086ms
2015-04-13 19:02:56,583 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000354_0,attempt_1426279437401_714565_m_000152_0,attempt_1426279437401_714565_m_000096_0 sent hash and received reply
2015-04-13 19:02:56,583 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,583 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0183.stratus.lvs.ebay.com:13562 freed by fetcher#1 in 29ms
2015-04-13 19:02:56,592 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 23482399 bytes from map-output for attempt_1426279437401_714565_m_000019_0
2015-04-13 19:02:56,592 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 23482399, inMemoryMapOutputs.size() -> 14, commitMemory -> 165617380, usedMemory ->1087361083
2015-04-13 19:02:56,593 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#22 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,593 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0135.stratus.lvs.ebay.com:13562 freed by fetcher#22 in 1102ms
2015-04-13 19:02:56,607 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15037254 bytes from map-output for attempt_1426279437401_714565_m_000059_0
2015-04-13 19:02:56,607 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15037254, inMemoryMapOutputs.size() -> 15, commitMemory -> 189099779, usedMemory ->1087361083
2015-04-13 19:02:56,607 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,607 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0324.stratus.lvs.ebay.com:13562 freed by fetcher#35 in 1111ms
2015-04-13 19:02:56,607 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12290211 bytes from map-output for attempt_1426279437401_714565_m_000179_0
2015-04-13 19:02:56,607 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14459411 bytes from map-output for attempt_1426279437401_714565_m_000049_0
2015-04-13 19:02:56,608 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12290211, inMemoryMapOutputs.size() -> 16, commitMemory -> 204137033, usedMemory ->1087361083
2015-04-13 19:02:56,608 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14459411, inMemoryMapOutputs.size() -> 17, commitMemory -> 216427244, usedMemory ->1087361083
2015-04-13 19:02:56,608 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#12 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,608 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0516.stratus.lvs.ebay.com:13562 freed by fetcher#5 in 1115ms
2015-04-13 19:02:56,608 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0387.stratus.lvs.ebay.com:13562 freed by fetcher#12 in 1117ms
2015-04-13 19:02:56,618 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 20059040 bytes from map-output for attempt_1426279437401_714565_m_000013_0
2015-04-13 19:02:56,618 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 20059040, inMemoryMapOutputs.size() -> 18, commitMemory -> 230886655, usedMemory ->1087361083
2015-04-13 19:02:56,618 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0349.stratus.lvs.ebay.com:13562 freed by fetcher#24 in 1129ms
2015-04-13 19:02:56,627 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13863048 bytes from map-output for attempt_1426279437401_714565_m_000232_0
2015-04-13 19:02:56,627 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13863048, inMemoryMapOutputs.size() -> 19, commitMemory -> 250945695, usedMemory ->1087361083
2015-04-13 19:02:56,628 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,628 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0226.stratus.lvs.ebay.com:13562 freed by fetcher#7 in 1135ms
2015-04-13 19:02:56,630 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13773826 bytes from map-output for attempt_1426279437401_714565_m_000133_0
2015-04-13 19:02:56,630 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13773826, inMemoryMapOutputs.size() -> 20, commitMemory -> 264808743, usedMemory ->1087361083
2015-04-13 19:02:56,630 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0618.stratus.lvs.ebay.com:13562 freed by fetcher#15 in 1142ms
2015-04-13 19:02:56,641 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 16287786 bytes from map-output for attempt_1426279437401_714565_m_000176_0
2015-04-13 19:02:56,642 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 16287786, inMemoryMapOutputs.size() -> 21, commitMemory -> 278582569, usedMemory ->1087361083
2015-04-13 19:02:56,642 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,642 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0470.stratus.lvs.ebay.com:13562 freed by fetcher#18 in 1154ms
2015-04-13 19:02:56,665 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 19070037 bytes from map-output for attempt_1426279437401_714565_m_000097_0
2015-04-13 19:02:56,665 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 19070037, inMemoryMapOutputs.size() -> 22, commitMemory -> 294870355, usedMemory ->1087361083
2015-04-13 19:02:56,665 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0727.stratus.lvs.ebay.com:13562 freed by fetcher#34 in 1175ms
2015-04-13 19:02:56,692 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 27931429 bytes from map-output for attempt_1426279437401_714565_m_000012_0
2015-04-13 19:02:56,693 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 27931429, inMemoryMapOutputs.size() -> 23, commitMemory -> 313940392, usedMemory ->1087361083
2015-04-13 19:02:56,693 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0458.stratus.lvs.ebay.com:13562 freed by fetcher#19 in 1204ms
2015-04-13 19:02:56,818 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13905956 bytes from map-output for attempt_1426279437401_714565_m_000122_0
2015-04-13 19:02:56,818 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13905956, inMemoryMapOutputs.size() -> 24, commitMemory -> 341871821, usedMemory ->1087361083
2015-04-13 19:02:56,818 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 - MergeManager returned status WAIT ...
2015-04-13 19:02:56,818 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0230.stratus.lvs.ebay.com:13562 freed by fetcher#23 in 1329ms
2015-04-13 19:02:58,302 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12221208 bytes from map-output for attempt_1426279437401_714565_m_000322_0
2015-04-13 19:02:58,302 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12221208, inMemoryMapOutputs.size() -> 25, commitMemory -> 355777777, usedMemory ->1087361083
2015-04-13 19:02:58,303 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#9 - MergeManager returned status WAIT ...
2015-04-13 19:02:58,303 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0121.stratus.lvs.ebay.com:13562 freed by fetcher#9 in 2811ms
2015-04-13 19:03:07,223 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: attempt_1426279437401_714565_r_000318_0 Merge of the 56 files in-memory complete. Local file is /hadoop/3/scratch/local/usercache/b_pulsar_coe/appcache/application_1426279437401_714565/output/attempt_1426279437401_714565_r_000318_0/map_518.out.merged of size 223982594
2015-04-13 19:03:07,224 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0473.stratus.lvs.ebay.com:13562 with 3 to fetcher#9
2015-04-13 19:03:07,224 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0158.stratus.lvs.ebay.com:13562 with 1 to fetcher#15
2015-04-13 19:03:07,224 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0704.stratus.lvs.ebay.com:13562 with 1 to fetcher#18
2015-04-13 19:03:07,224 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0751.stratus.lvs.ebay.com:13562 with 3 to fetcher#22
2015-04-13 19:03:07,224 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0431.stratus.lvs.ebay.com:13562 with 5 to fetcher#6
2015-04-13 19:03:07,224 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0107.stratus.lvs.ebay.com:13562 with 1 to fetcher#11
2015-04-13 19:03:07,224 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0107.stratus.lvs.ebay.com:13562 to fetcher#11
2015-04-13 19:03:07,224 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0254.stratus.lvs.ebay.com:13562 with 2 to fetcher#32
2015-04-13 19:03:07,224 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0254.stratus.lvs.ebay.com:13562 to fetcher#32
2015-04-13 19:03:07,225 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0685.stratus.lvs.ebay.com:13562 with 2 to fetcher#34
2015-04-13 19:03:07,225 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0685.stratus.lvs.ebay.com:13562 to fetcher#34
2015-04-13 19:03:07,225 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0038.stratus.lvs.ebay.com:13562 with 1 to fetcher#19
2015-04-13 19:03:07,225 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0038.stratus.lvs.ebay.com:13562 to fetcher#19
2015-04-13 19:03:07,226 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0186.stratus.lvs.ebay.com:13562 with 1 to fetcher#23
2015-04-13 19:03:07,226 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0186.stratus.lvs.ebay.com:13562 to fetcher#23
2015-04-13 19:03:07,226 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0470.stratus.lvs.ebay.com:13562 with 1 to fetcher#17
2015-04-13 19:03:07,226 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0470.stratus.lvs.ebay.com:13562 to fetcher#17
2015-04-13 19:03:07,226 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0043.stratus.lvs.ebay.com:13562 with 5 to fetcher#29
2015-04-13 19:03:07,226 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0043.stratus.lvs.ebay.com:13562 to fetcher#29
2015-04-13 19:03:07,226 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0350.stratus.lvs.ebay.com:13562 with 2 to fetcher#28
2015-04-13 19:03:07,226 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0350.stratus.lvs.ebay.com:13562 to fetcher#28
2015-04-13 19:03:07,226 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0565.stratus.lvs.ebay.com:13562 with 3 to fetcher#33
2015-04-13 19:03:07,227 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0565.stratus.lvs.ebay.com:13562 to fetcher#33
2015-04-13 19:03:07,227 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0197.stratus.lvs.ebay.com:13562 with 4 to fetcher#30
2015-04-13 19:03:07,227 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0197.stratus.lvs.ebay.com:13562 to fetcher#30
2015-04-13 19:03:07,227 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000036_0 sent hash and received reply
2015-04-13 19:03:07,227 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0115.stratus.lvs.ebay.com:13562 with 4 to fetcher#26
2015-04-13 19:03:07,227 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0115.stratus.lvs.ebay.com:13562 to fetcher#26
2015-04-13 19:03:07,227 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0534.stratus.lvs.ebay.com:13562 with 1 to fetcher#21
2015-04-13 19:03:07,228 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0534.stratus.lvs.ebay.com:13562 to fetcher#21
2015-04-13 19:03:07,228 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0079.stratus.lvs.ebay.com:13562 with 3 to fetcher#8
2015-04-13 19:03:07,228 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0079.stratus.lvs.ebay.com:13562 to fetcher#8
2015-04-13 19:03:07,228 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0008.stratus.lvs.ebay.com:13562 with 1 to fetcher#3
2015-04-13 19:03:07,228 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0008.stratus.lvs.ebay.com:13562 to fetcher#3
2015-04-13 19:03:07,231 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000211_0 sent hash and received reply
2015-04-13 19:03:07,231 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000237_0 sent hash and received reply
2015-04-13 19:03:07,231 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000371_0,attempt_1426279437401_714565_m_000134_0 sent hash and received reply
2015-04-13 19:03:07,232 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000545_0,attempt_1426279437401_714565_m_000032_0,attempt_1426279437401_714565_m_000075_0 sent hash and received reply
2015-04-13 19:03:07,232 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000128_0,attempt_1426279437401_714565_m_000070_0,attempt_1426279437401_714565_m_000009_0,attempt_1426279437401_714565_m_000056_0 sent hash and received reply
2015-04-13 19:03:07,233 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000443_0,attempt_1426279437401_714565_m_000535_0,attempt_1426279437401_714565_m_000513_0,attempt_1426279437401_714565_m_000497_0 sent hash and received reply
2015-04-13 19:03:07,233 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000463_0 sent hash and received reply
2015-04-13 19:03:07,233 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000386_0,attempt_1426279437401_714565_m_000391_0,attempt_1426279437401_714565_m_000383_0 sent hash and received reply
2015-04-13 19:03:07,233 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#11 about to shuffle output of map attempt_1426279437401_714565_m_000036_0 decomp: 21087269 len: 7728537 to MEMORY
2015-04-13 19:03:07,234 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000054_0 sent hash and received reply
2015-04-13 19:03:07,234 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000264_0 sent hash and received reply
2015-04-13 19:03:07,236 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 about to shuffle output of map attempt_1426279437401_714565_m_000386_0 decomp: 8858012 len: 3413323 to MEMORY
2015-04-13 19:03:07,238 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000007_0,attempt_1426279437401_714565_m_000268_0,attempt_1426279437401_714565_m_000327_0,attempt_1426279437401_714565_m_000042_0,attempt_1426279437401_714565_m_000469_0 sent hash and received reply
2015-04-13 19:03:07,238 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 about to shuffle output of map attempt_1426279437401_714565_m_000463_0 decomp: 8038183 len: 2602759 to MEMORY
2015-04-13 19:03:07,240 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0604.stratus.lvs.ebay.com:13562 with 2 to fetcher#13
2015-04-13 19:03:07,240 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0604.stratus.lvs.ebay.com:13562 to fetcher#13
2015-04-13 19:03:07,242 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000324_0,attempt_1426279437401_714565_m_000073_0 sent hash and received reply
2015-04-13 19:03:07,242 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000274_0,attempt_1426279437401_714565_m_000147_0 sent hash and received reply
2015-04-13 19:03:07,244 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0710.stratus.lvs.ebay.com:13562 with 1 to fetcher#4
2015-04-13 19:03:07,244 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0710.stratus.lvs.ebay.com:13562 to fetcher#4
2015-04-13 19:03:07,245 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000311_0,attempt_1426279437401_714565_m_000342_0 sent hash and received reply
2015-04-13 19:03:07,246 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0195.stratus.lvs.ebay.com:13562 with 1 to fetcher#20
2015-04-13 19:03:07,246 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0195.stratus.lvs.ebay.com:13562 to fetcher#20
2015-04-13 19:03:07,246 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0748.stratus.lvs.ebay.com:13562 with 5 to fetcher#36
2015-04-13 19:03:07,246 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0748.stratus.lvs.ebay.com:13562 to fetcher#36
2015-04-13 19:03:07,246 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0431.stratus.lvs.ebay.com:13562 to fetcher#6
2015-04-13 19:03:07,246 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0324.stratus.lvs.ebay.com:13562 with 1 to fetcher#2
2015-04-13 19:03:07,247 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0324.stratus.lvs.ebay.com:13562 to fetcher#2
2015-04-13 19:03:07,247 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 about to shuffle output of map attempt_1426279437401_714565_m_000443_0 decomp: 9085235 len: 3113365 to MEMORY
2015-04-13 19:03:07,247 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0214.stratus.lvs.ebay.com:13562 with 4 to fetcher#25
2015-04-13 19:03:07,247 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0214.stratus.lvs.ebay.com:13562 to fetcher#25
2015-04-13 19:03:07,247 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0300.stratus.lvs.ebay.com:13562 with 1 to fetcher#16
2015-04-13 19:03:07,247 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0300.stratus.lvs.ebay.com:13562 to fetcher#16
2015-04-13 19:03:07,247 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0387.stratus.lvs.ebay.com:13562 with 1 to fetcher#31
2015-04-13 19:03:07,247 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0387.stratus.lvs.ebay.com:13562 to fetcher#31
2015-04-13 19:03:07,248 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0468.stratus.lvs.ebay.com:13562 with 1 to fetcher#27
2015-04-13 19:03:07,248 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0468.stratus.lvs.ebay.com:13562 to fetcher#27
2015-04-13 19:03:07,248 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0142.stratus.lvs.ebay.com:13562 with 2 to fetcher#14
2015-04-13 19:03:07,248 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0142.stratus.lvs.ebay.com:13562 to fetcher#14
2015-04-13 19:03:07,249 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0751.stratus.lvs.ebay.com:13562 to fetcher#22
2015-04-13 19:03:07,250 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0713.stratus.lvs.ebay.com:13562 with 1 to fetcher#10
2015-04-13 19:03:07,250 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0713.stratus.lvs.ebay.com:13562 to fetcher#10
2015-04-13 19:03:07,250 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000170_0 sent hash and received reply
2015-04-13 19:03:07,252 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000006_0 sent hash and received reply
2015-04-13 19:03:07,252 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 about to shuffle output of map attempt_1426279437401_714565_m_000128_0 decomp: 13072757 len: 4428925 to MEMORY
2015-04-13 19:03:07,252 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000363_0 sent hash and received reply
2015-04-13 19:03:07,252 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0162.stratus.lvs.ebay.com:13562 with 2 to fetcher#1
2015-04-13 19:03:07,252 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0162.stratus.lvs.ebay.com:13562 to fetcher#1
2015-04-13 19:03:07,252 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0704.stratus.lvs.ebay.com:13562 to fetcher#18
2015-04-13 19:03:07,252 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0425.stratus.lvs.ebay.com:13562 with 1 to fetcher#35
2015-04-13 19:03:07,253 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0425.stratus.lvs.ebay.com:13562 to fetcher#35
2015-04-13 19:03:07,253 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000215_0,attempt_1426279437401_714565_m_000276_0,attempt_1426279437401_714565_m_000261_0 sent hash and received reply
2015-04-13 19:03:07,253 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0701.stratus.lvs.ebay.com:13562 with 5 to fetcher#5
2015-04-13 19:03:07,253 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000144_0 sent hash and received reply
2015-04-13 19:03:07,253 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000021_0 sent hash and received reply
2015-04-13 19:03:07,254 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 about to shuffle output of map attempt_1426279437401_714565_m_000545_0 decomp: 7159239 len: 2572062 to MEMORY
2015-04-13 19:03:07,254 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000127_0 sent hash and received reply
2015-04-13 19:03:07,254 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000529_0,attempt_1426279437401_714565_m_000196_0,attempt_1426279437401_714565_m_000199_0,attempt_1426279437401_714565_m_000193_0 sent hash and received reply
2015-04-13 19:03:07,255 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000345_0,attempt_1426279437401_714565_m_000398_0 sent hash and received reply
2015-04-13 19:03:07,255 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000099_0 sent hash and received reply
2015-04-13 19:03:07,256 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000495_0 sent hash and received reply
2015-04-13 19:03:07,256 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 about to shuffle output of map attempt_1426279437401_714565_m_000371_0 decomp: 10079600 len: 3414964 to MEMORY
2015-04-13 19:03:07,259 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000008_0,attempt_1426279437401_714565_m_000403_0 sent hash and received reply
2015-04-13 19:03:07,260 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000237_0 decomp: 12731339 len: 4475318 to MEMORY
2015-04-13 19:03:07,244 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 about to shuffle output of map attempt_1426279437401_714565_m_000007_0 decomp: 25476543 len: 8759761 to MEMORY
2015-04-13 19:03:07,254 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000414_0,attempt_1426279437401_714565_m_000367_0,attempt_1426279437401_714565_m_000291_0,attempt_1426279437401_714565_m_000373_0,attempt_1426279437401_714565_m_000317_0 sent hash and received reply
2015-04-13 19:03:07,253 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0701.stratus.lvs.ebay.com:13562 to fetcher#5
2015-04-13 19:03:07,252 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000488_0,attempt_1426279437401_714565_m_000450_0,attempt_1426279437401_714565_m_000501_0,attempt_1426279437401_714565_m_000111_0,attempt_1426279437401_714565_m_000449_0 sent hash and received reply
2015-04-13 19:03:07,263 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0664.stratus.lvs.ebay.com:13562 with 2 to fetcher#12
2015-04-13 19:03:07,263 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0664.stratus.lvs.ebay.com:13562 to fetcher#12
2015-04-13 19:03:07,264 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 about to shuffle output of map attempt_1426279437401_714565_m_000211_0 decomp: 13502832 len: 4266386 to MEMORY
2015-04-13 19:03:07,264 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0158.stratus.lvs.ebay.com:13562 to fetcher#15
2015-04-13 19:03:07,265 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0026.stratus.lvs.ebay.com:13562 with 5 to fetcher#24
2015-04-13 19:03:07,265 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0026.stratus.lvs.ebay.com:13562 to fetcher#24
2015-04-13 19:03:07,266 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#36 about to shuffle output of map attempt_1426279437401_714565_m_000488_0 decomp: 10569982 len: 3291871 to MEMORY
2015-04-13 19:03:07,268 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0473.stratus.lvs.ebay.com:13562 to fetcher#9
2015-04-13 19:03:07,268 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0503.stratus.lvs.ebay.com:13562 with 8 to fetcher#7
2015-04-13 19:03:07,268 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 8 of 8 to lvsdpehdc25dn0503.stratus.lvs.ebay.com:13562 to fetcher#7
2015-04-13 19:03:07,268 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000035_0,attempt_1426279437401_714565_m_000290_0 sent hash and received reply
2015-04-13 19:03:07,268 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000494_0 sent hash and received reply
2015-04-13 19:03:07,268 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#6 about to shuffle output of map attempt_1426279437401_714565_m_000414_0 decomp: 6991125 len: 2037757 to MEMORY
2015-04-13 19:03:07,268 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000278_0,attempt_1426279437401_714565_m_000252_0,attempt_1426279437401_714565_m_000282_0,attempt_1426279437401_714565_m_000063_0,attempt_1426279437401_714565_m_000033_0 sent hash and received reply
2015-04-13 19:03:07,271 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000078_0,attempt_1426279437401_714565_m_000067_0,attempt_1426279437401_714565_m_000002_0,attempt_1426279437401_714565_m_000412_0,attempt_1426279437401_714565_m_000275_0 sent hash and received reply
2015-04-13 19:03:07,274 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000293_0,attempt_1426279437401_714565_m_000303_0,attempt_1426279437401_714565_m_000191_0 sent hash and received reply
2015-04-13 19:03:07,275 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle output of map attempt_1426279437401_714565_m_000008_0 decomp: 26730165 len: 9147347 to MEMORY
2015-04-13 19:03:07,278 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 about to shuffle output of map attempt_1426279437401_714565_m_000495_0 decomp: 10020343 len: 3061428 to MEMORY
2015-04-13 19:03:07,282 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 about to shuffle output of map attempt_1426279437401_714565_m_000099_0 decomp: 14447351 len: 4347070 to MEMORY
2015-04-13 19:03:07,282 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000195_0,attempt_1426279437401_714565_m_000243_0,attempt_1426279437401_714565_m_000253_0,attempt_1426279437401_714565_m_000277_0,attempt_1426279437401_714565_m_000476_0,attempt_1426279437401_714565_m_000269_0,attempt_1426279437401_714565_m_000086_0,attempt_1426279437401_714565_m_000201_0 sent hash and received reply
2015-04-13 19:03:07,284 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 about to shuffle output of map attempt_1426279437401_714565_m_000345_0 decomp: 9153791 len: 2555992 to MEMORY
2015-04-13 19:03:07,466 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 about to shuffle output of map attempt_1426279437401_714565_m_000529_0 decomp: 5273273 len: 1969238 to MEMORY
2015-04-13 19:03:07,470 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 about to shuffle output of map attempt_1426279437401_714565_m_000127_0 decomp: 13308747 len: 4061688 to MEMORY
2015-04-13 19:03:07,479 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 about to shuffle output of map attempt_1426279437401_714565_m_000144_0 decomp: 13530846 len: 4703712 to MEMORY
2015-04-13 19:03:07,480 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#4 about to shuffle output of map attempt_1426279437401_714565_m_000021_0 decomp: 19288789 len: 5698536 to MEMORY
2015-04-13 19:03:07,482 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#22 about to shuffle output of map attempt_1426279437401_714565_m_000215_0 decomp: 10517901 len: 3467838 to MEMORY
2015-04-13 19:03:07,487 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#10 about to shuffle output of map attempt_1426279437401_714565_m_000363_0 decomp: 10368264 len: 3533842 to MEMORY
2015-04-13 19:03:07,489 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000091_0 sent hash and received reply
2015-04-13 19:03:07,490 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7159239 bytes from map-output for attempt_1426279437401_714565_m_000545_0
2015-04-13 19:03:07,498 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8858012 bytes from map-output for attempt_1426279437401_714565_m_000386_0
2015-04-13 19:03:07,503 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 about to shuffle output of map attempt_1426279437401_714565_m_000006_0 decomp: 23680340 len: 8369779 to MEMORY
2015-04-13 19:03:07,507 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 about to shuffle output of map attempt_1426279437401_714565_m_000170_0 decomp: 12379523 len: 4008436 to MEMORY
2015-04-13 19:03:07,507 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8038183 bytes from map-output for attempt_1426279437401_714565_m_000463_0
2015-04-13 19:03:07,510 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 about to shuffle output of map attempt_1426279437401_714565_m_000311_0 decomp: 11083020 len: 3588276 to MEMORY
2015-04-13 19:03:07,513 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 about to shuffle output of map attempt_1426279437401_714565_m_000274_0 decomp: 13451469 len: 3975686 to MEMORY
2015-04-13 19:03:07,517 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#32 about to shuffle output of map attempt_1426279437401_714565_m_000324_0 decomp: 10182395 len: 3559985 to MEMORY
2015-04-13 19:03:07,520 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000264_0 decomp: 11298125 len: 3550164 to MEMORY
2015-04-13 19:03:07,523 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9085235 bytes from map-output for attempt_1426279437401_714565_m_000443_0
2015-04-13 19:03:07,526 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 about to shuffle output of map attempt_1426279437401_714565_m_000054_0 decomp: 17088482 len: 5809395 to MEMORY
2015-04-13 19:03:07,528 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7159239, inMemoryMapOutputs.size() -> 26, commitMemory -> 367998985, usedMemory ->746453925
2015-04-13 19:03:07,533 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6991125 bytes from map-output for attempt_1426279437401_714565_m_000414_0
2015-04-13 19:03:07,537 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10020343 bytes from map-output for attempt_1426279437401_714565_m_000495_0
2015-04-13 19:03:07,537 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 about to shuffle output of map attempt_1426279437401_714565_m_000195_0 decomp: 12063510 len: 4365681 to MEMORY
2015-04-13 19:03:07,539 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 about to shuffle output of map attempt_1426279437401_714565_m_000091_0 decomp: 17205294 len: 5583975 to MEMORY
2015-04-13 19:03:07,540 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#9 about to shuffle output of map attempt_1426279437401_714565_m_000293_0 decomp: 10365728 len: 3063185 to MEMORY
2015-04-13 19:03:07,543 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10079600 bytes from map-output for attempt_1426279437401_714565_m_000371_0
2015-04-13 19:03:07,544 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12731339 bytes from map-output for attempt_1426279437401_714565_m_000237_0
2015-04-13 19:03:07,545 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 about to shuffle output of map attempt_1426279437401_714565_m_000078_0 decomp: 17980565 len: 6511085 to MEMORY
2015-04-13 19:03:07,547 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 about to shuffle output of map attempt_1426279437401_714565_m_000278_0 decomp: 10455937 len: 2996558 to MEMORY
2015-04-13 19:03:07,551 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#15 about to shuffle output of map attempt_1426279437401_714565_m_000494_0 decomp: 9679001 len: 3350108 to MEMORY
2015-04-13 19:03:07,557 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#12 about to shuffle output of map attempt_1426279437401_714565_m_000035_0 decomp: 19351529 len: 6290976 to MEMORY
2015-04-13 19:03:07,561 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9085235, inMemoryMapOutputs.size() -> 27, commitMemory -> 375158224, usedMemory ->860733616
2015-04-13 19:03:07,561 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8038183, inMemoryMapOutputs.size() -> 28, commitMemory -> 384243459, usedMemory ->860733616
2015-04-13 19:03:07,563 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8858012, inMemoryMapOutputs.size() -> 29, commitMemory -> 392281642, usedMemory ->866390313
2015-04-13 19:03:07,563 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0008.stratus.lvs.ebay.com:13562 freed by fetcher#3 in 335ms
2015-04-13 19:03:07,564 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0469.stratus.lvs.ebay.com:13562 with 1 to fetcher#3
2015-04-13 19:03:07,564 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0469.stratus.lvs.ebay.com:13562 to fetcher#3
2015-04-13 19:03:07,566 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 about to shuffle output of map attempt_1426279437401_714565_m_000391_0 decomp: 9948215 len: 3656968 to MEMORY
2015-04-13 19:03:07,567 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000435_0 sent hash and received reply
2015-04-13 19:03:07,561 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 about to shuffle output of map attempt_1426279437401_714565_m_000032_0 decomp: 17178127 len: 5941050 to MEMORY
2015-04-13 19:03:07,563 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 about to shuffle output of map attempt_1426279437401_714565_m_000535_0 decomp: 5656697 len: 1944195 to MEMORY
2015-04-13 19:03:07,569 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 5273273 bytes from map-output for attempt_1426279437401_714565_m_000529_0
2015-04-13 19:03:07,571 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 about to shuffle output of map attempt_1426279437401_714565_m_000435_0 decomp: 9722000 len: 2881851 to MEMORY
2015-04-13 19:03:07,574 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10569982 bytes from map-output for attempt_1426279437401_714565_m_000488_0
2015-04-13 19:03:07,585 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13502832 bytes from map-output for attempt_1426279437401_714565_m_000211_0
2015-04-13 19:03:07,585 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 5273273, inMemoryMapOutputs.size() -> 30, commitMemory -> 401139654, usedMemory ->886060528
2015-04-13 19:03:07,586 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9153791 bytes from map-output for attempt_1426279437401_714565_m_000345_0
2015-04-13 19:03:07,587 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9153791, inMemoryMapOutputs.size() -> 31, commitMemory -> 406412927, usedMemory ->886060528
2015-04-13 19:03:07,591 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 about to shuffle output of map attempt_1426279437401_714565_m_000398_0 decomp: 12660298 len: 4509566 to MEMORY
2015-04-13 19:03:07,594 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13072757 bytes from map-output for attempt_1426279437401_714565_m_000128_0
2015-04-13 19:03:07,594 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12731339, inMemoryMapOutputs.size() -> 32, commitMemory -> 415566718, usedMemory ->911111838
2015-04-13 19:03:07,595 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0534.stratus.lvs.ebay.com:13562 freed by fetcher#21 in 367ms
2015-04-13 19:03:07,595 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0219.stratus.lvs.ebay.com:13562 with 1 to fetcher#21
2015-04-13 19:03:07,595 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0219.stratus.lvs.ebay.com:13562 to fetcher#21
2015-04-13 19:03:07,596 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10079600, inMemoryMapOutputs.size() -> 33, commitMemory -> 428298057, usedMemory ->911111838
2015-04-13 19:03:07,596 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10020343, inMemoryMapOutputs.size() -> 34, commitMemory -> 438377657, usedMemory ->911111838
2015-04-13 19:03:07,597 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0425.stratus.lvs.ebay.com:13562 freed by fetcher#35 in 344ms
2015-04-13 19:03:07,597 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0429.stratus.lvs.ebay.com:13562 with 4 to fetcher#35
2015-04-13 19:03:07,597 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0429.stratus.lvs.ebay.com:13562 to fetcher#35
2015-04-13 19:03:07,602 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000169_0 sent hash and received reply
2015-04-13 19:03:07,602 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 about to shuffle output of map attempt_1426279437401_714565_m_000134_0 decomp: 16691374 len: 5803421 to MEMORY
2015-04-13 19:03:07,607 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000165_0,attempt_1426279437401_714565_m_000244_0,attempt_1426279437401_714565_m_000259_0,attempt_1426279437401_714565_m_000411_0 sent hash and received reply
2015-04-13 19:03:07,608 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 about to shuffle output of map attempt_1426279437401_714565_m_000196_0 decomp: 12391012 len: 3958384 to MEMORY
2015-04-13 19:03:07,613 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 5656697 bytes from map-output for attempt_1426279437401_714565_m_000535_0
2015-04-13 19:03:07,618 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 about to shuffle output of map attempt_1426279437401_714565_m_000165_0 decomp: 17743365 len: 5644347 to MEMORY
2015-04-13 19:03:07,621 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6991125, inMemoryMapOutputs.size() -> 35, commitMemory -> 448398000, usedMemory ->956331739
2015-04-13 19:03:07,625 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#6 about to shuffle output of map attempt_1426279437401_714565_m_000367_0 decomp: 10459984 len: 3006366 to MEMORY
2015-04-13 19:03:07,626 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14447351 bytes from map-output for attempt_1426279437401_714565_m_000099_0
2015-04-13 19:03:07,626 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000169_0 decomp: 10785162 len: 3628752 to MEMORY
2015-04-13 19:03:07,628 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14447351, inMemoryMapOutputs.size() -> 36, commitMemory -> 455389125, usedMemory ->966791723
2015-04-13 19:03:07,629 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0387.stratus.lvs.ebay.com:13562 freed by fetcher#31 in 382ms
2015-04-13 19:03:07,629 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0452.stratus.lvs.ebay.com:13562 with 1 to fetcher#31
2015-04-13 19:03:07,629 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0452.stratus.lvs.ebay.com:13562 to fetcher#31
2015-04-13 19:03:07,629 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 21087269 bytes from map-output for attempt_1426279437401_714565_m_000036_0
2015-04-13 19:03:07,629 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 21087269, inMemoryMapOutputs.size() -> 37, commitMemory -> 469836476, usedMemory ->966791723
2015-04-13 19:03:07,629 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0107.stratus.lvs.ebay.com:13562 freed by fetcher#11 in 405ms
2015-04-13 19:03:07,629 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0073.stratus.lvs.ebay.com:13562 with 2 to fetcher#11
2015-04-13 19:03:07,630 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0073.stratus.lvs.ebay.com:13562 to fetcher#11
2015-04-13 19:03:07,632 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 5656697, inMemoryMapOutputs.size() -> 38, commitMemory -> 490923745, usedMemory ->966791723
2015-04-13 19:03:07,632 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13072757, inMemoryMapOutputs.size() -> 39, commitMemory -> 496580442, usedMemory ->966791723
2015-04-13 19:03:07,633 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13502832, inMemoryMapOutputs.size() -> 40, commitMemory -> 509653199, usedMemory ->966791723
2015-04-13 19:03:07,636 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000087_0 sent hash and received reply
2015-04-13 19:03:07,638 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 about to shuffle output of map attempt_1426279437401_714565_m_000070_0 decomp: 17549359 len: 6216096 to MEMORY
2015-04-13 19:03:07,642 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10569982, inMemoryMapOutputs.size() -> 41, commitMemory -> 523156031, usedMemory ->984341082
2015-04-13 19:03:07,642 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0470.stratus.lvs.ebay.com:13562 freed by fetcher#17 in 416ms
2015-04-13 19:03:07,642 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0464.stratus.lvs.ebay.com:13562 with 1 to fetcher#17
2015-04-13 19:03:07,642 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0464.stratus.lvs.ebay.com:13562 to fetcher#17
2015-04-13 19:03:07,645 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#36 about to shuffle output of map attempt_1426279437401_714565_m_000450_0 decomp: 8241237 len: 2635923 to MEMORY
2015-04-13 19:03:07,645 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13530846 bytes from map-output for attempt_1426279437401_714565_m_000144_0
2015-04-13 19:03:07,645 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000064_0,attempt_1426279437401_714565_m_000005_0 sent hash and received reply
2015-04-13 19:03:07,645 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13530846, inMemoryMapOutputs.size() -> 42, commitMemory -> 533726013, usedMemory ->992582319
2015-04-13 19:03:07,646 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000022_0 sent hash and received reply
2015-04-13 19:03:07,646 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0195.stratus.lvs.ebay.com:13562 freed by fetcher#20 in 400ms
2015-04-13 19:03:07,646 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0303.stratus.lvs.ebay.com:13562 with 2 to fetcher#20
2015-04-13 19:03:07,646 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0303.stratus.lvs.ebay.com:13562 to fetcher#20
2015-04-13 19:03:07,646 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10368264 bytes from map-output for attempt_1426279437401_714565_m_000363_0
2015-04-13 19:03:07,649 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9679001 bytes from map-output for attempt_1426279437401_714565_m_000494_0
2015-04-13 19:03:07,646 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9948215 bytes from map-output for attempt_1426279437401_714565_m_000391_0
2015-04-13 19:03:07,650 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#11 about to shuffle output of map attempt_1426279437401_714565_m_000064_0 decomp: 14475479 len: 4146160 to MEMORY
2015-04-13 19:03:07,651 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10182395 bytes from map-output for attempt_1426279437401_714565_m_000324_0
2015-04-13 19:03:07,654 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000131_0,attempt_1426279437401_714565_m_000208_0 sent hash and received reply
2015-04-13 19:03:07,657 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12379523 bytes from map-output for attempt_1426279437401_714565_m_000170_0
2015-04-13 19:03:07,660 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11083020 bytes from map-output for attempt_1426279437401_714565_m_000311_0
2015-04-13 19:03:07,662 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13308747 bytes from map-output for attempt_1426279437401_714565_m_000127_0
2015-04-13 19:03:07,663 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10517901 bytes from map-output for attempt_1426279437401_714565_m_000215_0
2015-04-13 19:03:07,664 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 about to shuffle output of map attempt_1426279437401_714565_m_000513_0 decomp: 4309746 len: 1360976 to MEMORY
2015-04-13 19:03:07,667 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10365728 bytes from map-output for attempt_1426279437401_714565_m_000293_0
2015-04-13 19:03:07,668 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 about to shuffle output of map attempt_1426279437401_714565_m_000087_0 decomp: 15816707 len: 5091972 to MEMORY
2015-04-13 19:03:08,274 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10455937 bytes from map-output for attempt_1426279437401_714565_m_000278_0
2015-04-13 19:03:08,267 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 4309746 bytes from map-output for attempt_1426279437401_714565_m_000513_0
2015-04-13 19:03:08,285 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 19351529 bytes from map-output for attempt_1426279437401_714565_m_000035_0
2015-04-13 19:03:08,286 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12660298 bytes from map-output for attempt_1426279437401_714565_m_000398_0
2015-04-13 19:03:08,287 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 19288789 bytes from map-output for attempt_1426279437401_714565_m_000021_0
2015-04-13 19:03:08,291 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 26730165 bytes from map-output for attempt_1426279437401_714565_m_000008_0
2015-04-13 19:03:08,256 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13451469 bytes from map-output for attempt_1426279437401_714565_m_000274_0
2015-04-13 19:03:08,254 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12063510 bytes from map-output for attempt_1426279437401_714565_m_000195_0
2015-04-13 19:03:08,250 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 17980565 bytes from map-output for attempt_1426279437401_714565_m_000078_0
2015-04-13 19:03:08,245 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9722000 bytes from map-output for attempt_1426279437401_714565_m_000435_0
2015-04-13 19:03:08,245 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 about to shuffle output of map attempt_1426279437401_714565_m_000131_0 decomp: 14366932 len: 4575857 to MEMORY
2015-04-13 19:03:08,302 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11298125 bytes from map-output for attempt_1426279437401_714565_m_000264_0
2015-04-13 19:03:08,245 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10368264, inMemoryMapOutputs.size() -> 43, commitMemory -> 547256859, usedMemory ->1041551183
2015-04-13 19:03:08,303 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0713.stratus.lvs.ebay.com:13562 freed by fetcher#10 in 1053ms
2015-04-13 19:03:08,303 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0030.stratus.lvs.ebay.com:13562 with 2 to fetcher#10
2015-04-13 19:03:08,303 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0030.stratus.lvs.ebay.com:13562 to fetcher#10
2015-04-13 19:03:08,307 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 about to shuffle output of map attempt_1426279437401_714565_m_000022_0 decomp: 16280451 len: 4911638 to MEMORY
2015-04-13 19:03:08,307 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11298125, inMemoryMapOutputs.size() -> 44, commitMemory -> 557625123, usedMemory ->1057831634
2015-04-13 19:03:08,308 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9722000, inMemoryMapOutputs.size() -> 45, commitMemory -> 568923248, usedMemory ->1057831634
2015-04-13 19:03:08,308 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 17980565, inMemoryMapOutputs.size() -> 46, commitMemory -> 578645248, usedMemory ->1057831634
2015-04-13 19:03:08,308 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12063510, inMemoryMapOutputs.size() -> 47, commitMemory -> 596625813, usedMemory ->1057831634
2015-04-13 19:03:08,308 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000362_0,attempt_1426279437401_714565_m_000071_0 sent hash and received reply
2015-04-13 19:03:08,297 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10459984 bytes from map-output for attempt_1426279437401_714565_m_000367_0
2015-04-13 19:03:08,312 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13451469, inMemoryMapOutputs.size() -> 48, commitMemory -> 608689323, usedMemory ->1072766821
2015-04-13 19:03:08,315 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#10 about to shuffle output of map attempt_1426279437401_714565_m_000362_0 decomp: 11050084 len: 4166197 to MEMORY
2015-04-13 19:03:08,294 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8241237 bytes from map-output for attempt_1426279437401_714565_m_000450_0
2015-04-13 19:03:08,315 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 26730165, inMemoryMapOutputs.size() -> 49, commitMemory -> 622140792, usedMemory ->1083816905
2015-04-13 19:03:08,315 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 19288789, inMemoryMapOutputs.size() -> 50, commitMemory -> 648870957, usedMemory ->1083816905
2015-04-13 19:03:08,315 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,312 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 about to shuffle output of map attempt_1426279437401_714565_m_000067_0 decomp: 14935187 len: 4959924 to MEMORY
2015-04-13 19:03:08,316 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0710.stratus.lvs.ebay.com:13562 freed by fetcher#4 in 1072ms
2015-04-13 19:03:08,316 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,316 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0758.stratus.lvs.ebay.com:13562 with 2 to fetcher#4
2015-04-13 19:03:08,316 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0758.stratus.lvs.ebay.com:13562 to fetcher#4
2015-04-13 19:03:08,316 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0685.stratus.lvs.ebay.com:13562 freed by fetcher#34 in 1091ms
2015-04-13 19:03:08,316 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0699.stratus.lvs.ebay.com:13562 with 2 to fetcher#34
2015-04-13 19:03:08,316 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0699.stratus.lvs.ebay.com:13562 to fetcher#34
2015-04-13 19:03:08,316 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12660298, inMemoryMapOutputs.size() -> 51, commitMemory -> 668159746, usedMemory ->1083816905
2015-04-13 19:03:08,316 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,316 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 19351529, inMemoryMapOutputs.size() -> 52, commitMemory -> 680820044, usedMemory ->1083816905
2015-04-13 19:03:08,317 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#12 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,317 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 4309746, inMemoryMapOutputs.size() -> 53, commitMemory -> 700171573, usedMemory ->1083816905
2015-04-13 19:03:08,317 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10455937, inMemoryMapOutputs.size() -> 54, commitMemory -> 704481319, usedMemory ->1083816905
2015-04-13 19:03:08,317 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Starting inMemoryMerger's merge since commitMemory=714937256 > mergeThreshold=708669632. Current usedMemory=1083816905
2015-04-13 19:03:08,317 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeThread: InMemoryMerger - Thread to merge in-memory shuffled map-outputs: Starting merge with 54 segments, while ignoring 0 segments
2015-04-13 19:03:08,317 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,318 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,318 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0197.stratus.lvs.ebay.com:13562 freed by fetcher#30 in 1091ms
2015-04-13 19:03:08,318 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10365728, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->1083816905
2015-04-13 19:03:08,318 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10517901, inMemoryMapOutputs.size() -> 2, commitMemory -> 10365728, usedMemory ->1083816905
2015-04-13 19:03:08,318 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#9 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,318 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#22 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,318 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0473.stratus.lvs.ebay.com:13562 freed by fetcher#9 in 1094ms
2015-04-13 19:03:08,318 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0751.stratus.lvs.ebay.com:13562 freed by fetcher#22 in 1094ms
2015-04-13 19:03:08,318 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13308747, inMemoryMapOutputs.size() -> 3, commitMemory -> 20883629, usedMemory ->1083816905
2015-04-13 19:03:08,318 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000034_0,attempt_1426279437401_714565_m_000045_0 sent hash and received reply
2015-04-13 19:03:08,319 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0704.stratus.lvs.ebay.com:13562 freed by fetcher#18 in 1095ms
2015-04-13 19:03:08,318 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000011_0,attempt_1426279437401_714565_m_000549_0 sent hash and received reply
2015-04-13 19:03:08,319 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,319 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#4 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,319 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11083020, inMemoryMapOutputs.size() -> 4, commitMemory -> 34192376, usedMemory ->1083816905
2015-04-13 19:03:08,319 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,319 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0604.stratus.lvs.ebay.com:13562 freed by fetcher#13 in 1079ms
2015-04-13 19:03:08,319 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12379523, inMemoryMapOutputs.size() -> 5, commitMemory -> 45275396, usedMemory ->1083816905
2015-04-13 19:03:08,320 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10182395, inMemoryMapOutputs.size() -> 6, commitMemory -> 57654919, usedMemory ->1083816905
2015-04-13 19:03:08,320 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9948215, inMemoryMapOutputs.size() -> 7, commitMemory -> 67837314, usedMemory ->1083816905
2015-04-13 19:03:08,320 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,320 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#32 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,320 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0079.stratus.lvs.ebay.com:13562 freed by fetcher#8 in 1092ms
2015-04-13 19:03:08,341 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10785162 bytes from map-output for attempt_1426279437401_714565_m_000169_0
2015-04-13 19:03:08,342 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Initiating in-memory merge with 54 segments...
2015-04-13 19:03:08,342 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapred.Merger: Merging 54 sorted segments
2015-04-13 19:03:08,343 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 54 segments left of total size: 714935312 bytes
2015-04-13 19:03:08,350 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 17743365 bytes from map-output for attempt_1426279437401_714565_m_000165_0
2015-04-13 19:03:08,364 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 17088482 bytes from map-output for attempt_1426279437401_714565_m_000054_0
2015-04-13 19:03:08,365 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12391012 bytes from map-output for attempt_1426279437401_714565_m_000196_0
2015-04-13 19:03:08,321 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9679001, inMemoryMapOutputs.size() -> 8, commitMemory -> 77785529, usedMemory ->1083816905
2015-04-13 19:03:08,365 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0158.stratus.lvs.ebay.com:13562 freed by fetcher#15 in 1141ms
2015-04-13 19:03:08,365 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12391012, inMemoryMapOutputs.size() -> 9, commitMemory -> 87464530, usedMemory ->1083816905
2015-04-13 19:03:08,365 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,365 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 17088482, inMemoryMapOutputs.size() -> 10, commitMemory -> 99855542, usedMemory ->1083816905
2015-04-13 19:03:08,366 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0254.stratus.lvs.ebay.com:13562 freed by fetcher#32 in 1142ms
2015-04-13 19:03:08,366 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 17743365, inMemoryMapOutputs.size() -> 11, commitMemory -> 116944024, usedMemory ->1083816905
2015-04-13 19:03:08,366 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10785162, inMemoryMapOutputs.size() -> 12, commitMemory -> 134687389, usedMemory ->1083816905
2015-04-13 19:03:08,366 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,366 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0219.stratus.lvs.ebay.com:13562 freed by fetcher#21 in 771ms
2015-04-13 19:03:08,366 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0429.stratus.lvs.ebay.com:13562 freed by fetcher#35 in 769ms
2015-04-13 19:03:08,366 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0324.stratus.lvs.ebay.com:13562 freed by fetcher#2 in 1119ms
2015-04-13 19:03:08,366 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0758.stratus.lvs.ebay.com:13562 freed by fetcher#4 in 50ms
2015-04-13 19:03:08,366 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0699.stratus.lvs.ebay.com:13562 freed by fetcher#34 in 50ms
2015-04-13 19:03:08,366 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0701.stratus.lvs.ebay.com:13562 freed by fetcher#5 in 1113ms
2015-04-13 19:03:08,367 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0664.stratus.lvs.ebay.com:13562 freed by fetcher#12 in 1104ms
2015-04-13 19:03:08,367 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0162.stratus.lvs.ebay.com:13562 freed by fetcher#1 in 1115ms
2015-04-13 19:03:08,367 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0142.stratus.lvs.ebay.com:13562 freed by fetcher#14 in 1119ms
2015-04-13 19:03:08,367 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0503.stratus.lvs.ebay.com:13562 freed by fetcher#7 in 1099ms
2015-04-13 19:03:08,367 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8241237, inMemoryMapOutputs.size() -> 13, commitMemory -> 145472551, usedMemory ->1083816905
2015-04-13 19:03:08,367 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10459984, inMemoryMapOutputs.size() -> 14, commitMemory -> 153713788, usedMemory ->1083816905
2015-04-13 19:03:08,367 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#36 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,367 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0469.stratus.lvs.ebay.com:13562 freed by fetcher#3 in 803ms
2015-04-13 19:03:08,367 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#6 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,367 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0186.stratus.lvs.ebay.com:13562 freed by fetcher#23 in 1141ms
2015-04-13 19:03:08,372 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0748.stratus.lvs.ebay.com:13562 freed by fetcher#36 in 1126ms
2015-04-13 19:03:08,372 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0038.stratus.lvs.ebay.com:13562 freed by fetcher#19 in 1147ms
2015-04-13 19:03:08,372 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0214.stratus.lvs.ebay.com:13562 freed by fetcher#25 in 1125ms
2015-04-13 19:03:08,372 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0431.stratus.lvs.ebay.com:13562 freed by fetcher#6 in 1148ms
2015-04-13 19:03:08,373 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 17178127 bytes from map-output for attempt_1426279437401_714565_m_000032_0
2015-04-13 19:03:08,373 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 17178127, inMemoryMapOutputs.size() -> 15, commitMemory -> 164173772, usedMemory ->1083816905
2015-04-13 19:03:08,374 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,374 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0565.stratus.lvs.ebay.com:13562 freed by fetcher#33 in 1147ms
2015-04-13 19:03:08,380 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14475479 bytes from map-output for attempt_1426279437401_714565_m_000064_0
2015-04-13 19:03:08,381 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14475479, inMemoryMapOutputs.size() -> 16, commitMemory -> 181351899, usedMemory ->1083816905
2015-04-13 19:03:08,381 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#11 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,381 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0073.stratus.lvs.ebay.com:13562 freed by fetcher#11 in 752ms
2015-04-13 19:03:08,383 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 17549359 bytes from map-output for attempt_1426279437401_714565_m_000070_0
2015-04-13 19:03:08,383 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 17549359, inMemoryMapOutputs.size() -> 17, commitMemory -> 195827378, usedMemory ->1083816905
2015-04-13 19:03:08,383 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,383 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0115.stratus.lvs.ebay.com:13562 freed by fetcher#26 in 1156ms
2015-04-13 19:03:08,385 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 16691374 bytes from map-output for attempt_1426279437401_714565_m_000134_0
2015-04-13 19:03:08,385 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 16691374, inMemoryMapOutputs.size() -> 18, commitMemory -> 213376737, usedMemory ->1083816905
2015-04-13 19:03:08,385 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0350.stratus.lvs.ebay.com:13562 freed by fetcher#28 in 1159ms
2015-04-13 19:03:08,392 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 23680340 bytes from map-output for attempt_1426279437401_714565_m_000006_0
2015-04-13 19:03:08,392 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 23680340, inMemoryMapOutputs.size() -> 19, commitMemory -> 230068111, usedMemory ->1083816905
2015-04-13 19:03:08,392 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0300.stratus.lvs.ebay.com:13562 freed by fetcher#16 in 1145ms
2015-04-13 19:03:08,405 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14366932 bytes from map-output for attempt_1426279437401_714565_m_000131_0
2015-04-13 19:03:08,405 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11050084 bytes from map-output for attempt_1426279437401_714565_m_000362_0
2015-04-13 19:03:08,405 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14366932, inMemoryMapOutputs.size() -> 20, commitMemory -> 253748451, usedMemory ->1083816905
2015-04-13 19:03:08,405 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,405 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0303.stratus.lvs.ebay.com:13562 freed by fetcher#20 in 759ms
2015-04-13 19:03:08,415 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11050084, inMemoryMapOutputs.size() -> 21, commitMemory -> 268115383, usedMemory ->1083816905
2015-04-13 19:03:08,415 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#10 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,416 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0030.stratus.lvs.ebay.com:13562 freed by fetcher#10 in 113ms
2015-04-13 19:03:08,419 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15816707 bytes from map-output for attempt_1426279437401_714565_m_000087_0
2015-04-13 19:03:08,419 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15816707, inMemoryMapOutputs.size() -> 22, commitMemory -> 279165467, usedMemory ->1083816905
2015-04-13 19:03:08,419 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0452.stratus.lvs.ebay.com:13562 freed by fetcher#31 in 790ms
2015-04-13 19:03:08,433 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 25476543 bytes from map-output for attempt_1426279437401_714565_m_000007_0
2015-04-13 19:03:08,433 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 25476543, inMemoryMapOutputs.size() -> 23, commitMemory -> 294982174, usedMemory ->1083816905
2015-04-13 19:03:08,434 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,434 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0043.stratus.lvs.ebay.com:13562 freed by fetcher#29 in 1208ms
2015-04-13 19:03:08,442 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14935187 bytes from map-output for attempt_1426279437401_714565_m_000067_0
2015-04-13 19:03:08,442 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14935187, inMemoryMapOutputs.size() -> 24, commitMemory -> 320458717, usedMemory ->1083816905
2015-04-13 19:03:08,442 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 - MergeManager returned status WAIT ...
2015-04-13 19:03:08,443 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0026.stratus.lvs.ebay.com:13562 freed by fetcher#24 in 1178ms
2015-04-13 19:03:08,462 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 16280451 bytes from map-output for attempt_1426279437401_714565_m_000022_0
2015-04-13 19:03:08,463 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 16280451, inMemoryMapOutputs.size() -> 25, commitMemory -> 335393904, usedMemory ->1083816905
2015-04-13 19:03:08,463 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0464.stratus.lvs.ebay.com:13562 freed by fetcher#17 in 821ms
2015-04-13 19:03:09,114 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 17205294 bytes from map-output for attempt_1426279437401_714565_m_000091_0
2015-04-13 19:03:09,114 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 17205294, inMemoryMapOutputs.size() -> 26, commitMemory -> 351674355, usedMemory ->1083816905
2015-04-13 19:03:09,114 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0468.stratus.lvs.ebay.com:13562 freed by fetcher#27 in 1866ms
2015-04-13 19:03:16,363 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: attempt_1426279437401_714565_r_000318_0 Merge of the 54 files in-memory complete. Local file is /hadoop/4/scratch/local/usercache/b_pulsar_coe/appcache/application_1426279437401_714565/output/attempt_1426279437401_714565_r_000318_0/map_513.out.merged of size 224000808
2015-04-13 19:03:16,364 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0748.stratus.lvs.ebay.com:13562 with 3 to fetcher#27
2015-04-13 19:03:16,364 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0565.stratus.lvs.ebay.com:13562 with 1 to fetcher#29
2015-04-13 19:03:16,364 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0751.stratus.lvs.ebay.com:13562 with 2 to fetcher#28
2015-04-13 19:03:16,364 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0751.stratus.lvs.ebay.com:13562 to fetcher#28
2015-04-13 19:03:16,364 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0596.stratus.lvs.ebay.com:13562 with 2 to fetcher#6
2015-04-13 19:03:16,364 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0596.stratus.lvs.ebay.com:13562 to fetcher#6
2015-04-13 19:03:16,364 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 with 7 to fetcher#19
2015-04-13 19:03:16,364 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 7 of 7 to lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 to fetcher#19
2015-04-13 19:03:16,365 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0089.stratus.lvs.ebay.com:13562 with 5 to fetcher#36
2015-04-13 19:03:16,365 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0089.stratus.lvs.ebay.com:13562 to fetcher#36
2015-04-13 19:03:16,365 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0446.stratus.lvs.ebay.com:13562 with 2 to fetcher#34
2015-04-13 19:03:16,365 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0446.stratus.lvs.ebay.com:13562 to fetcher#34
2015-04-13 19:03:16,366 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0094.stratus.lvs.ebay.com:13562 with 2 to fetcher#35
2015-04-13 19:03:16,366 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0094.stratus.lvs.ebay.com:13562 to fetcher#35
2015-04-13 19:03:16,366 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0490.stratus.lvs.ebay.com:13562 with 1 to fetcher#32
2015-04-13 19:03:16,366 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0265.stratus.lvs.ebay.com:13562 with 1 to fetcher#22
2015-04-13 19:03:16,366 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0265.stratus.lvs.ebay.com:13562 to fetcher#22
2015-04-13 19:03:16,366 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0026.stratus.lvs.ebay.com:13562 with 3 to fetcher#24
2015-04-13 19:03:16,366 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0026.stratus.lvs.ebay.com:13562 to fetcher#24
2015-04-13 19:03:16,366 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0599.stratus.lvs.ebay.com:13562 with 1 to fetcher#17
2015-04-13 19:03:16,366 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0599.stratus.lvs.ebay.com:13562 to fetcher#17
2015-04-13 19:03:16,366 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0490.stratus.lvs.ebay.com:13562 to fetcher#32
2015-04-13 19:03:16,366 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0440.stratus.lvs.ebay.com:13562 with 1 to fetcher#18
2015-04-13 19:03:16,367 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0440.stratus.lvs.ebay.com:13562 to fetcher#18
2015-04-13 19:03:16,367 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0146.stratus.lvs.ebay.com:13562 with 4 to fetcher#13
2015-04-13 19:03:16,367 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0146.stratus.lvs.ebay.com:13562 to fetcher#13
2015-04-13 19:03:16,367 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0044.stratus.lvs.ebay.com:13562 with 2 to fetcher#8
2015-04-13 19:03:16,367 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0044.stratus.lvs.ebay.com:13562 to fetcher#8
2015-04-13 19:03:16,367 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0227.stratus.lvs.ebay.com:13562 with 6 to fetcher#15
2015-04-13 19:03:16,367 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 6 of 6 to lvsdpehdc25dn0227.stratus.lvs.ebay.com:13562 to fetcher#15
2015-04-13 19:03:16,368 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0699.stratus.lvs.ebay.com:13562 with 2 to fetcher#21
2015-04-13 19:03:16,368 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0699.stratus.lvs.ebay.com:13562 to fetcher#21
2015-04-13 19:03:16,368 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0030.stratus.lvs.ebay.com:13562 with 1 to fetcher#2
2015-04-13 19:03:16,368 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0030.stratus.lvs.ebay.com:13562 to fetcher#2
2015-04-13 19:03:16,368 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000156_0,attempt_1426279437401_714565_m_000231_0 sent hash and received reply
2015-04-13 19:03:16,368 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000510_0,attempt_1426279437401_714565_m_000502_0 sent hash and received reply
2015-04-13 19:03:16,368 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0319.stratus.lvs.ebay.com:13562 with 3 to fetcher#4
2015-04-13 19:03:16,369 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000197_0 sent hash and received reply
2015-04-13 19:03:16,369 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0319.stratus.lvs.ebay.com:13562 to fetcher#4
2015-04-13 19:03:16,370 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000433_0 sent hash and received reply
2015-04-13 19:03:16,370 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000261_0,attempt_1426279437401_714565_m_000276_0 sent hash and received reply
2015-04-13 19:03:16,371 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000034_0,attempt_1426279437401_714565_m_000045_0 sent hash and received reply
2015-04-13 19:03:16,371 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000071_0 sent hash and received reply
2015-04-13 19:03:16,372 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 about to shuffle output of map attempt_1426279437401_714565_m_000156_0 decomp: 11474247 len: 4309470 to MEMORY
2015-04-13 19:03:16,372 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000399_0 sent hash and received reply
2015-04-13 19:03:16,372 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000002_0,attempt_1426279437401_714565_m_000412_0,attempt_1426279437401_714565_m_000275_0 sent hash and received reply
2015-04-13 19:03:16,372 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0604.stratus.lvs.ebay.com:13562 with 1 to fetcher#5
2015-04-13 19:03:16,372 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0604.stratus.lvs.ebay.com:13562 to fetcher#5
2015-04-13 19:03:16,373 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000198_0,attempt_1426279437401_714565_m_000102_0 sent hash and received reply
2015-04-13 19:03:16,374 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000516_0,attempt_1426279437401_714565_m_000413_0,attempt_1426279437401_714565_m_000286_0,attempt_1426279437401_714565_m_000103_0,attempt_1426279437401_714565_m_000353_0 sent hash and received reply
2015-04-13 19:03:16,374 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000567_0,attempt_1426279437401_714565_m_000551_0,attempt_1426279437401_714565_m_000334_0,attempt_1426279437401_714565_m_000025_0 sent hash and received reply
2015-04-13 19:03:16,374 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000342_0 sent hash and received reply
2015-04-13 19:03:16,376 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000034_0 decomp: 17696156 len: 5127883 to MEMORY
2015-04-13 19:03:16,377 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0345.stratus.lvs.ebay.com:13562 with 2 to fetcher#12
2015-04-13 19:03:16,377 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0345.stratus.lvs.ebay.com:13562 to fetcher#12
2015-04-13 19:03:16,377 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0463.stratus.lvs.ebay.com:13562 with 2 to fetcher#1
2015-04-13 19:03:16,377 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0463.stratus.lvs.ebay.com:13562 to fetcher#1
2015-04-13 19:03:16,379 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0214.stratus.lvs.ebay.com:13562 with 2 to fetcher#14
2015-04-13 19:03:16,379 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0214.stratus.lvs.ebay.com:13562 to fetcher#14
2015-04-13 19:03:16,379 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0591.stratus.lvs.ebay.com:13562 with 1 to fetcher#7
2015-04-13 19:03:16,379 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0591.stratus.lvs.ebay.com:13562 to fetcher#7
2015-04-13 19:03:16,379 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000385_0,attempt_1426279437401_714565_m_000331_0,attempt_1426279437401_714565_m_000364_0,attempt_1426279437401_714565_m_000166_0,attempt_1426279437401_714565_m_000184_0,attempt_1426279437401_714565_m_000153_0 sent hash and received reply
2015-04-13 19:03:16,380 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 about to shuffle output of map attempt_1426279437401_714565_m_000261_0 decomp: 12538626 len: 3763783 to MEMORY
2015-04-13 19:03:16,380 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0121.stratus.lvs.ebay.com:13562 with 3 to fetcher#3
2015-04-13 19:03:16,380 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0121.stratus.lvs.ebay.com:13562 to fetcher#3
2015-04-13 19:03:16,381 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0633.stratus.lvs.ebay.com:13562 with 1 to fetcher#23
2015-04-13 19:03:16,381 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0633.stratus.lvs.ebay.com:13562 to fetcher#23
2015-04-13 19:03:16,381 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0189.stratus.lvs.ebay.com:13562 with 1 to fetcher#25
2015-04-13 19:03:16,381 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0189.stratus.lvs.ebay.com:13562 to fetcher#25
2015-04-13 19:03:16,381 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0353.stratus.lvs.ebay.com:13562 with 2 to fetcher#33
2015-04-13 19:03:16,381 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000325_0,attempt_1426279437401_714565_m_000000_0,attempt_1426279437401_714565_m_000100_0,attempt_1426279437401_714565_m_000248_0,attempt_1426279437401_714565_m_000272_0,attempt_1426279437401_714565_m_000431_0,attempt_1426279437401_714565_m_000180_0 sent hash and received reply
2015-04-13 19:03:16,381 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0353.stratus.lvs.ebay.com:13562 to fetcher#33
2015-04-13 19:03:16,381 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0149.stratus.lvs.ebay.com:13562 with 5 to fetcher#11
2015-04-13 19:03:16,381 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0149.stratus.lvs.ebay.com:13562 to fetcher#11
2015-04-13 19:03:16,381 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0164.stratus.lvs.ebay.com:13562 with 1 to fetcher#26
2015-04-13 19:03:16,382 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0164.stratus.lvs.ebay.com:13562 to fetcher#26
2015-04-13 19:03:16,382 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000161_0,attempt_1426279437401_714565_m_000337_0,attempt_1426279437401_714565_m_000239_0 sent hash and received reply
2015-04-13 19:03:16,382 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0565.stratus.lvs.ebay.com:13562 to fetcher#29
2015-04-13 19:03:16,382 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0453.stratus.lvs.ebay.com:13562 with 2 to fetcher#16
2015-04-13 19:03:16,382 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0453.stratus.lvs.ebay.com:13562 to fetcher#16
2015-04-13 19:03:16,382 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 about to shuffle output of map attempt_1426279437401_714565_m_000433_0 decomp: 8984446 len: 2866204 to MEMORY
2015-04-13 19:03:16,382 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0584.stratus.lvs.ebay.com:13562 with 1 to fetcher#20
2015-04-13 19:03:16,382 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0584.stratus.lvs.ebay.com:13562 to fetcher#20
2015-04-13 19:03:16,382 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0328.stratus.lvs.ebay.com:13562 with 1 to fetcher#10
2015-04-13 19:03:16,382 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0328.stratus.lvs.ebay.com:13562 to fetcher#10
2015-04-13 19:03:16,383 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0461.stratus.lvs.ebay.com:13562 with 3 to fetcher#31
2015-04-13 19:03:16,383 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0461.stratus.lvs.ebay.com:13562 to fetcher#31
2015-04-13 19:03:16,383 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0748.stratus.lvs.ebay.com:13562 to fetcher#27
2015-04-13 19:03:16,383 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000454_0,attempt_1426279437401_714565_m_000093_0 sent hash and received reply
2015-04-13 19:03:16,384 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000355_0 sent hash and received reply
2015-04-13 19:03:16,384 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000047_0,attempt_1426279437401_714565_m_000186_0,attempt_1426279437401_714565_m_000202_0 sent hash and received reply
2015-04-13 19:03:16,385 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000521_0 sent hash and received reply
2015-04-13 19:03:16,385 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000193_0,attempt_1426279437401_714565_m_000199_0 sent hash and received reply
2015-04-13 19:03:16,385 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000321_0 sent hash and received reply
2015-04-13 19:03:16,386 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#22 about to shuffle output of map attempt_1426279437401_714565_m_000197_0 decomp: 11832768 len: 4133839 to MEMORY
2015-04-13 19:03:16,386 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000020_0 sent hash and received reply
2015-04-13 19:03:16,386 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000374_0,attempt_1426279437401_714565_m_000001_0 sent hash and received reply
2015-04-13 19:03:16,386 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0754.stratus.lvs.ebay.com:13562 with 3 to fetcher#30
2015-04-13 19:03:16,386 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000501_0,attempt_1426279437401_714565_m_000449_0,attempt_1426279437401_714565_m_000111_0 sent hash and received reply
2015-04-13 19:03:16,386 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000075_0 sent hash and received reply
2015-04-13 19:03:16,387 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000514_0 sent hash and received reply
2015-04-13 19:03:16,386 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0754.stratus.lvs.ebay.com:13562 to fetcher#30
2015-04-13 19:03:16,387 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000003_0,attempt_1426279437401_714565_m_000065_0 sent hash and received reply
2015-04-13 19:03:16,387 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0685.stratus.lvs.ebay.com:13562 with 1 to fetcher#9
2015-04-13 19:03:16,387 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#6 about to shuffle output of map attempt_1426279437401_714565_m_000510_0 decomp: 6114069 len: 1862222 to MEMORY
2015-04-13 19:03:16,387 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0685.stratus.lvs.ebay.com:13562 to fetcher#9
2015-04-13 19:03:16,388 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000483_0,attempt_1426279437401_714565_m_000437_0,attempt_1426279437401_714565_m_000434_0,attempt_1426279437401_714565_m_000130_0,attempt_1426279437401_714565_m_000162_0 sent hash and received reply
2015-04-13 19:03:16,389 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000326_0 sent hash and received reply
2015-04-13 19:03:16,389 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000147_0 sent hash and received reply
2015-04-13 19:03:16,390 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000163_0,attempt_1426279437401_714565_m_000125_0 sent hash and received reply
2015-04-13 19:03:16,390 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000210_0,attempt_1426279437401_714565_m_000046_0,attempt_1426279437401_714565_m_000194_0 sent hash and received reply
2015-04-13 19:03:16,391 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000279_0,attempt_1426279437401_714565_m_000157_0,attempt_1426279437401_714565_m_000018_0 sent hash and received reply
2015-04-13 19:03:16,393 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 about to shuffle output of map attempt_1426279437401_714565_m_000003_0 decomp: 19116687 len: 5645402 to MEMORY
2015-04-13 19:03:16,394 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 about to shuffle output of map attempt_1426279437401_714565_m_000514_0 decomp: 5539967 len: 1570719 to MEMORY
2015-04-13 19:03:16,398 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 about to shuffle output of map attempt_1426279437401_714565_m_000075_0 decomp: 12308926 len: 4282130 to MEMORY
2015-04-13 19:03:16,400 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 about to shuffle output of map attempt_1426279437401_714565_m_000501_0 decomp: 9153094 len: 2704056 to MEMORY
2015-04-13 19:03:16,403 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle output of map attempt_1426279437401_714565_m_000374_0 decomp: 10183076 len: 3048030 to MEMORY
2015-04-13 19:03:16,409 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 about to shuffle output of map attempt_1426279437401_714565_m_000020_0 decomp: 18916584 len: 6272420 to MEMORY
2015-04-13 19:03:16,412 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 about to shuffle output of map attempt_1426279437401_714565_m_000321_0 decomp: 11226151 len: 3845614 to MEMORY
2015-04-13 19:03:16,416 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 about to shuffle output of map attempt_1426279437401_714565_m_000193_0 decomp: 12536311 len: 3395815 to MEMORY
2015-04-13 19:03:16,418 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 about to shuffle output of map attempt_1426279437401_714565_m_000521_0 decomp: 7319324 len: 2382203 to MEMORY
2015-04-13 19:03:16,608 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000098_0,attempt_1426279437401_714565_m_000358_0 sent hash and received reply
2015-04-13 19:03:16,608 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000369_0 sent hash and received reply
2015-04-13 19:03:16,616 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000355_0 decomp: 8513375 len: 2316166 to MEMORY
2015-04-13 19:03:16,617 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 about to shuffle output of map attempt_1426279437401_714565_m_000047_0 decomp: 19440915 len: 7114700 to MEMORY
2015-04-13 19:03:16,619 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#12 about to shuffle output of map attempt_1426279437401_714565_m_000454_0 decomp: 9309198 len: 3182659 to MEMORY
2015-04-13 19:03:16,622 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#4 about to shuffle output of map attempt_1426279437401_714565_m_000161_0 decomp: 13022020 len: 4005612 to MEMORY
2015-04-13 19:03:16,625 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 5539967 bytes from map-output for attempt_1426279437401_714565_m_000514_0
2015-04-13 19:03:16,626 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 about to shuffle output of map attempt_1426279437401_714565_m_000325_0 decomp: 10672625 len: 3884935 to MEMORY
2015-04-13 19:03:16,639 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#15 about to shuffle output of map attempt_1426279437401_714565_m_000385_0 decomp: 12141568 len: 4143700 to MEMORY
2015-04-13 19:03:16,640 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6114069 bytes from map-output for attempt_1426279437401_714565_m_000510_0
2015-04-13 19:03:16,654 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 about to shuffle output of map attempt_1426279437401_714565_m_000342_0 decomp: 12263354 len: 3967143 to MEMORY
2015-04-13 19:03:16,654 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 about to shuffle output of map attempt_1426279437401_714565_m_000567_0 decomp: 137312 len: 24807 to MEMORY
2015-04-13 19:03:16,655 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11832768 bytes from map-output for attempt_1426279437401_714565_m_000197_0
2015-04-13 19:03:16,655 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 137312 bytes from map-output for attempt_1426279437401_714565_m_000567_0
2015-04-13 19:03:16,655 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 about to shuffle output of map attempt_1426279437401_714565_m_000071_0 decomp: 17557184 len: 6028494 to MEMORY
2015-04-13 19:03:16,657 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#36 about to shuffle output of map attempt_1426279437401_714565_m_000516_0 decomp: 8003502 len: 2739480 to MEMORY
2015-04-13 19:03:16,661 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 about to shuffle output of map attempt_1426279437401_714565_m_000198_0 decomp: 12174512 len: 3685022 to MEMORY
2015-04-13 19:03:16,669 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 about to shuffle output of map attempt_1426279437401_714565_m_000002_0 decomp: 24772870 len: 8362607 to MEMORY
2015-04-13 19:03:16,674 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#32 about to shuffle output of map attempt_1426279437401_714565_m_000399_0 decomp: 12171358 len: 4120404 to MEMORY
2015-04-13 19:03:16,675 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 5539967, inMemoryMapOutputs.size() -> 27, commitMemory -> 368879649, usedMemory ->703999874
2015-04-13 19:03:16,675 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 137312, inMemoryMapOutputs.size() -> 28, commitMemory -> 374419616, usedMemory ->703999874
2015-04-13 19:03:16,678 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 about to shuffle output of map attempt_1426279437401_714565_m_000369_0 decomp: 10038680 len: 3122741 to MEMORY
2015-04-13 19:03:16,682 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 about to shuffle output of map attempt_1426279437401_714565_m_000098_0 decomp: 13909621 len: 4984499 to MEMORY
2015-04-13 19:03:16,684 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11474247 bytes from map-output for attempt_1426279437401_714565_m_000156_0
2015-04-13 19:03:16,684 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 about to shuffle output of map attempt_1426279437401_714565_m_000279_0 decomp: 8830115 len: 2519489 to MEMORY
2015-04-13 19:03:16,687 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7319324 bytes from map-output for attempt_1426279437401_714565_m_000521_0
2015-04-13 19:03:16,687 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8984446 bytes from map-output for attempt_1426279437401_714565_m_000433_0
2015-04-13 19:03:16,688 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 about to shuffle output of map attempt_1426279437401_714565_m_000210_0 decomp: 12312108 len: 3773458 to MEMORY
2015-04-13 19:03:16,691 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 about to shuffle output of map attempt_1426279437401_714565_m_000163_0 decomp: 12572831 len: 4463416 to MEMORY
2015-04-13 19:03:16,695 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#9 about to shuffle output of map attempt_1426279437401_714565_m_000147_0 decomp: 13411603 len: 4581320 to MEMORY
2015-04-13 19:03:16,698 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#10 about to shuffle output of map attempt_1426279437401_714565_m_000326_0 decomp: 9868213 len: 3320385 to MEMORY
2015-04-13 19:03:16,699 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12263354 bytes from map-output for attempt_1426279437401_714565_m_000342_0
2015-04-13 19:03:16,700 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#11 about to shuffle output of map attempt_1426279437401_714565_m_000483_0 decomp: 8144953 len: 2813046 to MEMORY
2015-04-13 19:03:16,702 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 about to shuffle output of map attempt_1426279437401_714565_m_000551_0 decomp: 3993695 len: 1328303 to MEMORY
2015-04-13 19:03:16,702 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11832768, inMemoryMapOutputs.size() -> 29, commitMemory -> 374556928, usedMemory ->797081693
2015-04-13 19:03:16,702 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6114069, inMemoryMapOutputs.size() -> 30, commitMemory -> 386389696, usedMemory ->797081693
2015-04-13 19:03:16,703 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0265.stratus.lvs.ebay.com:13562 freed by fetcher#22 in 337ms
2015-04-13 19:03:16,703 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0532.stratus.lvs.ebay.com:13562 with 2 to fetcher#22
2015-04-13 19:03:16,703 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0532.stratus.lvs.ebay.com:13562 to fetcher#22
2015-04-13 19:03:16,705 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#6 about to shuffle output of map attempt_1426279437401_714565_m_000502_0 decomp: 6385925 len: 1884298 to MEMORY
2015-04-13 19:03:16,705 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12263354, inMemoryMapOutputs.size() -> 31, commitMemory -> 392503765, usedMemory ->803467618
2015-04-13 19:03:16,705 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0604.stratus.lvs.ebay.com:13562 freed by fetcher#5 in 333ms
2015-04-13 19:03:16,705 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0416.stratus.lvs.ebay.com:13562 with 2 to fetcher#5
2015-04-13 19:03:16,705 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0416.stratus.lvs.ebay.com:13562 to fetcher#5
2015-04-13 19:03:16,706 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8984446, inMemoryMapOutputs.size() -> 32, commitMemory -> 404767119, usedMemory ->803467618
2015-04-13 19:03:16,707 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0599.stratus.lvs.ebay.com:13562 freed by fetcher#17 in 341ms
2015-04-13 19:03:16,707 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0135.stratus.lvs.ebay.com:13562 with 3 to fetcher#17
2015-04-13 19:03:16,707 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0135.stratus.lvs.ebay.com:13562 to fetcher#17
2015-04-13 19:03:16,708 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7319324, inMemoryMapOutputs.size() -> 33, commitMemory -> 413751565, usedMemory ->803467618
2015-04-13 19:03:16,708 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11474247, inMemoryMapOutputs.size() -> 34, commitMemory -> 421070889, usedMemory ->803467618
2015-04-13 19:03:16,708 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0584.stratus.lvs.ebay.com:13562 freed by fetcher#20 in 326ms
2015-04-13 19:03:16,708 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0202.stratus.lvs.ebay.com:13562 with 9 to fetcher#20
2015-04-13 19:03:16,709 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 9 of 9 to lvsdpehdc25dn0202.stratus.lvs.ebay.com:13562 to fetcher#20
2015-04-13 19:03:16,710 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000116_0,attempt_1426279437401_714565_m_000023_0 sent hash and received reply
2015-04-13 19:03:16,711 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000030_0,attempt_1426279437401_714565_m_000110_0,attempt_1426279437401_714565_m_000015_0 sent hash and received reply
2015-04-13 19:03:16,711 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000089_0,attempt_1426279437401_714565_m_000060_0 sent hash and received reply
2015-04-13 19:03:16,712 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 about to shuffle output of map attempt_1426279437401_714565_m_000231_0 decomp: 13581348 len: 4788833 to MEMORY
2015-04-13 19:03:16,713 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0591.stratus.lvs.ebay.com:13562 freed by fetcher#7 in 334ms
2015-04-13 19:03:16,713 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0234.stratus.lvs.ebay.com:13562 with 6 to fetcher#7
2015-04-13 19:03:16,713 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 6 of 6 to lvsdpehdc25dn0234.stratus.lvs.ebay.com:13562 to fetcher#7
2015-04-13 19:03:16,714 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10672625 bytes from map-output for attempt_1426279437401_714565_m_000325_0
2015-04-13 19:03:16,718 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 3993695 bytes from map-output for attempt_1426279437401_714565_m_000551_0
2015-04-13 19:03:16,722 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9153094 bytes from map-output for attempt_1426279437401_714565_m_000501_0
2015-04-13 19:03:16,723 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 about to shuffle output of map attempt_1426279437401_714565_m_000089_0 decomp: 15005738 len: 4244009 to MEMORY
2015-04-13 19:03:16,714 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11226151 bytes from map-output for attempt_1426279437401_714565_m_000321_0
2015-04-13 19:03:16,727 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#22 about to shuffle output of map attempt_1426279437401_714565_m_000116_0 decomp: 15772903 len: 5257187 to MEMORY
2015-04-13 19:03:16,728 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000505_0,attempt_1426279437401_714565_m_000464_0,attempt_1426279437401_714565_m_000465_0,attempt_1426279437401_714565_m_000468_0,attempt_1426279437401_714565_m_000540_0,attempt_1426279437401_714565_m_000481_0,attempt_1426279437401_714565_m_000479_0,attempt_1426279437401_714565_m_000471_0,attempt_1426279437401_714565_m_000114_0 sent hash and received reply
2015-04-13 19:03:16,729 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12538626 bytes from map-output for attempt_1426279437401_714565_m_000261_0
2015-04-13 19:03:16,730 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 about to shuffle output of map attempt_1426279437401_714565_m_000505_0 decomp: 5835200 len: 1771420 to MEMORY
2015-04-13 19:03:16,752 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000534_0,attempt_1426279437401_714565_m_000528_0,attempt_1426279437401_714565_m_000444_0,attempt_1426279437401_714565_m_000351_0,attempt_1426279437401_714565_m_000271_0,attempt_1426279437401_714565_m_000234_0 sent hash and received reply
2015-04-13 19:03:16,729 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12536311 bytes from map-output for attempt_1426279437401_714565_m_000193_0
2015-04-13 19:03:16,752 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 about to shuffle output of map attempt_1426279437401_714565_m_000030_0 decomp: 22036652 len: 7597171 to MEMORY
2015-04-13 19:03:16,754 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10183076 bytes from map-output for attempt_1426279437401_714565_m_000374_0
2015-04-13 19:03:16,774 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9309198 bytes from map-output for attempt_1426279437401_714565_m_000454_0
2015-04-13 19:03:16,784 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 5835200 bytes from map-output for attempt_1426279437401_714565_m_000505_0
2015-04-13 19:03:16,784 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 17696156 bytes from map-output for attempt_1426279437401_714565_m_000034_0
2015-04-13 19:03:16,788 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8513375 bytes from map-output for attempt_1426279437401_714565_m_000355_0
2015-04-13 19:03:16,790 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10672625, inMemoryMapOutputs.size() -> 35, commitMemory -> 432545136, usedMemory ->875699459
2015-04-13 19:03:16,792 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13022020 bytes from map-output for attempt_1426279437401_714565_m_000161_0
2015-04-13 19:03:16,792 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 about to shuffle output of map attempt_1426279437401_714565_m_000534_0 decomp: 7516621 len: 2797860 to MEMORY
2015-04-13 19:03:16,792 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13022020, inMemoryMapOutputs.size() -> 36, commitMemory -> 443217761, usedMemory ->883216080
2015-04-13 19:03:16,794 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9868213 bytes from map-output for attempt_1426279437401_714565_m_000326_0
2015-04-13 19:03:16,796 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#4 about to shuffle output of map attempt_1426279437401_714565_m_000337_0 decomp: 11403014 len: 3767080 to MEMORY
2015-04-13 19:03:16,797 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12308926 bytes from map-output for attempt_1426279437401_714565_m_000075_0
2015-04-13 19:03:16,806 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12174512 bytes from map-output for attempt_1426279437401_714565_m_000198_0
2015-04-13 19:03:16,810 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12141568 bytes from map-output for attempt_1426279437401_714565_m_000385_0
2015-04-13 19:03:16,806 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8830115 bytes from map-output for attempt_1426279437401_714565_m_000279_0
2015-04-13 19:03:16,815 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8003502 bytes from map-output for attempt_1426279437401_714565_m_000516_0
2015-04-13 19:03:16,816 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8144953 bytes from map-output for attempt_1426279437401_714565_m_000483_0
2015-04-13 19:03:16,816 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 19116687 bytes from map-output for attempt_1426279437401_714565_m_000003_0
2015-04-13 19:03:16,825 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 18916584 bytes from map-output for attempt_1426279437401_714565_m_000020_0
2015-04-13 19:03:16,826 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 about to shuffle output of map attempt_1426279437401_714565_m_000000_0 decomp: 48211308 len: 16445821 to MEMORY
2015-04-13 19:03:16,826 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9868213, inMemoryMapOutputs.size() -> 37, commitMemory -> 456239781, usedMemory ->942830402
2015-04-13 19:03:16,826 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8513375, inMemoryMapOutputs.size() -> 38, commitMemory -> 466107994, usedMemory ->942830402
2015-04-13 19:03:16,827 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0633.stratus.lvs.ebay.com:13562 freed by fetcher#23 in 446ms
2015-04-13 19:03:16,827 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0222.stratus.lvs.ebay.com:13562 with 2 to fetcher#23
2015-04-13 19:03:16,827 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0222.stratus.lvs.ebay.com:13562 to fetcher#23
2015-04-13 19:03:16,827 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 17557184 bytes from map-output for attempt_1426279437401_714565_m_000071_0
2015-04-13 19:03:16,827 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 17557184, inMemoryMapOutputs.size() -> 39, commitMemory -> 474621369, usedMemory ->942830402
2015-04-13 19:03:16,828 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0030.stratus.lvs.ebay.com:13562 freed by fetcher#2 in 460ms
2015-04-13 19:03:16,828 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0466.stratus.lvs.ebay.com:13562 with 2 to fetcher#2
2015-04-13 19:03:16,828 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0466.stratus.lvs.ebay.com:13562 to fetcher#2
2015-04-13 19:03:16,828 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 17696156, inMemoryMapOutputs.size() -> 40, commitMemory -> 492178553, usedMemory ->942830402
2015-04-13 19:03:16,831 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13411603 bytes from map-output for attempt_1426279437401_714565_m_000147_0
2015-04-13 19:03:16,832 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000045_0 decomp: 14006995 len: 4379511 to MEMORY
2015-04-13 19:03:16,832 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10038680 bytes from map-output for attempt_1426279437401_714565_m_000369_0
2015-04-13 19:03:16,834 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13909621 bytes from map-output for attempt_1426279437401_714565_m_000098_0
2015-04-13 19:03:16,835 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000504_0,attempt_1426279437401_714565_m_000508_0 sent hash and received reply
2015-04-13 19:03:16,837 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000415_0,attempt_1426279437401_714565_m_000406_0 sent hash and received reply
2015-04-13 19:03:16,838 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000504_0 decomp: 7875083 len: 2701697 to MEMORY
2015-04-13 19:03:16,842 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6385925 bytes from map-output for attempt_1426279437401_714565_m_000502_0
2015-04-13 19:03:16,845 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13411603, inMemoryMapOutputs.size() -> 41, commitMemory -> 509874709, usedMemory ->964712480
2015-04-13 19:03:16,845 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0685.stratus.lvs.ebay.com:13562 freed by fetcher#9 in 458ms
2015-04-13 19:03:16,846 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0340.stratus.lvs.ebay.com:13562 with 4 to fetcher#9
2015-04-13 19:03:16,846 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0340.stratus.lvs.ebay.com:13562 to fetcher#9
2015-04-13 19:03:16,848 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 about to shuffle output of map attempt_1426279437401_714565_m_000415_0 decomp: 7953611 len: 2354253 to MEMORY
2015-04-13 19:03:16,852 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12572831 bytes from map-output for attempt_1426279437401_714565_m_000163_0
2015-04-13 19:03:16,852 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000183_0,attempt_1426279437401_714565_m_000217_0,attempt_1426279437401_714565_m_000017_0,attempt_1426279437401_714565_m_000117_0 sent hash and received reply
2015-04-13 19:03:16,855 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#9 about to shuffle output of map attempt_1426279437401_714565_m_000183_0 decomp: 10364680 len: 3235150 to MEMORY
2015-04-13 19:03:16,859 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12171358 bytes from map-output for attempt_1426279437401_714565_m_000399_0
2015-04-13 19:03:16,860 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12171358, inMemoryMapOutputs.size() -> 42, commitMemory -> 523286312, usedMemory ->983030771
2015-04-13 19:03:16,860 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0490.stratus.lvs.ebay.com:13562 freed by fetcher#32 in 494ms
2015-04-13 19:03:16,860 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0198.stratus.lvs.ebay.com:13562 with 1 to fetcher#32
2015-04-13 19:03:16,860 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0198.stratus.lvs.ebay.com:13562 to fetcher#32
2015-04-13 19:03:16,862 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 5835200, inMemoryMapOutputs.size() -> 43, commitMemory -> 535457670, usedMemory ->983030771
2015-04-13 19:03:16,862 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9309198, inMemoryMapOutputs.size() -> 44, commitMemory -> 541292870, usedMemory ->983030771
2015-04-13 19:03:16,864 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12312108 bytes from map-output for attempt_1426279437401_714565_m_000210_0
2015-04-13 19:03:16,864 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10183076, inMemoryMapOutputs.size() -> 45, commitMemory -> 550602068, usedMemory ->990074187
2015-04-13 19:03:16,864 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 about to shuffle output of map attempt_1426279437401_714565_m_000464_0 decomp: 7043416 len: 2404150 to MEMORY
2015-04-13 19:03:17,487 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11403014 bytes from map-output for attempt_1426279437401_714565_m_000337_0
2015-04-13 19:03:17,496 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000416_0 sent hash and received reply
2015-04-13 19:03:17,496 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#12 about to shuffle output of map attempt_1426279437401_714565_m_000093_0 decomp: 15407586 len: 5622069 to MEMORY
2015-04-13 19:03:17,499 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12536311, inMemoryMapOutputs.size() -> 46, commitMemory -> 560785144, usedMemory ->1046118441
2015-04-13 19:03:17,499 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#32 about to shuffle output of map attempt_1426279437401_714565_m_000416_0 decomp: 9842495 len: 3110303 to MEMORY
2015-04-13 19:03:17,500 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12538626, inMemoryMapOutputs.size() -> 47, commitMemory -> 573321455, usedMemory ->1046118441
2015-04-13 19:03:17,503 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 about to shuffle output of map attempt_1426279437401_714565_m_000199_0 decomp: 12978494 len: 4361628 to MEMORY
2015-04-13 19:03:17,505 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7953611 bytes from map-output for attempt_1426279437401_714565_m_000415_0
2015-04-13 19:03:17,507 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11226151, inMemoryMapOutputs.size() -> 48, commitMemory -> 585860081, usedMemory ->1073755175
2015-04-13 19:03:17,507 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 about to shuffle output of map attempt_1426279437401_714565_m_000276_0 decomp: 14658240 len: 3700118 to MEMORY
2015-04-13 19:03:17,507 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9153094, inMemoryMapOutputs.size() -> 49, commitMemory -> 597086232, usedMemory ->1073755175
2015-04-13 19:03:17,508 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 3993695, inMemoryMapOutputs.size() -> 50, commitMemory -> 606239326, usedMemory ->1073755175
2015-04-13 19:03:17,508 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,508 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0189.stratus.lvs.ebay.com:13562 freed by fetcher#25 in 1127ms
2015-04-13 19:03:17,508 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0282.stratus.lvs.ebay.com:13562 with 8 to fetcher#25
2015-04-13 19:03:17,508 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,508 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 8 of 8 to lvsdpehdc25dn0282.stratus.lvs.ebay.com:13562 to fetcher#25
2015-04-13 19:03:17,508 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0146.stratus.lvs.ebay.com:13562 freed by fetcher#13 in 1141ms
2015-04-13 19:03:17,508 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0254.stratus.lvs.ebay.com:13562 with 1 to fetcher#13
2015-04-13 19:03:17,508 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7875083 bytes from map-output for attempt_1426279437401_714565_m_000504_0
2015-04-13 19:03:17,508 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0254.stratus.lvs.ebay.com:13562 to fetcher#13
2015-04-13 19:03:17,508 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7875083, inMemoryMapOutputs.size() -> 51, commitMemory -> 610233021, usedMemory ->1073755175
2015-04-13 19:03:17,509 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,509 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0222.stratus.lvs.ebay.com:13562 freed by fetcher#23 in 682ms
2015-04-13 19:03:17,509 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0226.stratus.lvs.ebay.com:13562 with 1 to fetcher#23
2015-04-13 19:03:17,509 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0226.stratus.lvs.ebay.com:13562 to fetcher#23
2015-04-13 19:03:17,510 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7516621 bytes from map-output for attempt_1426279437401_714565_m_000534_0
2015-04-13 19:03:17,510 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7516621, inMemoryMapOutputs.size() -> 52, commitMemory -> 618108104, usedMemory ->1073755175
2015-04-13 19:03:17,510 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,511 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0234.stratus.lvs.ebay.com:13562 freed by fetcher#7 in 798ms
2015-04-13 19:03:17,511 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0100.stratus.lvs.ebay.com:13562 with 4 to fetcher#7
2015-04-13 19:03:17,511 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0100.stratus.lvs.ebay.com:13562 to fetcher#7
2015-04-13 19:03:17,511 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000073_0 sent hash and received reply
2015-04-13 19:03:17,511 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,512 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0254.stratus.lvs.ebay.com:13562 freed by fetcher#13 in 4ms
2015-04-13 19:03:17,512 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0669.stratus.lvs.ebay.com:13562 with 1 to fetcher#13
2015-04-13 19:03:17,512 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0669.stratus.lvs.ebay.com:13562 to fetcher#13
2015-04-13 19:03:17,512 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle output of map attempt_1426279437401_714565_m_000001_0 decomp: 30794173 len: 8992573 to MEMORY
2015-04-13 19:03:17,513 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000377_0 sent hash and received reply
2015-04-13 19:03:17,514 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,514 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0669.stratus.lvs.ebay.com:13562 freed by fetcher#13 in 2ms
2015-04-13 19:03:17,514 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0503.stratus.lvs.ebay.com:13562 with 7 to fetcher#13
2015-04-13 19:03:17,514 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 7 of 7 to lvsdpehdc25dn0503.stratus.lvs.ebay.com:13562 to fetcher#13
2015-04-13 19:03:17,515 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 19440915 bytes from map-output for attempt_1426279437401_714565_m_000047_0
2015-04-13 19:03:17,515 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 19440915, inMemoryMapOutputs.size() -> 53, commitMemory -> 625624725, usedMemory ->1073755175
2015-04-13 19:03:17,515 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,515 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0121.stratus.lvs.ebay.com:13562 freed by fetcher#3 in 1135ms
2015-04-13 19:03:17,515 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0146.stratus.lvs.ebay.com:13562 with 2 to fetcher#3
2015-04-13 19:03:17,515 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0146.stratus.lvs.ebay.com:13562 to fetcher#3
2015-04-13 19:03:17,517 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7953611, inMemoryMapOutputs.size() -> 54, commitMemory -> 645065640, usedMemory ->1073755175
2015-04-13 19:03:17,517 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11403014, inMemoryMapOutputs.size() -> 55, commitMemory -> 653019251, usedMemory ->1073755175
2015-04-13 19:03:17,517 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12572831, inMemoryMapOutputs.size() -> 56, commitMemory -> 664422265, usedMemory ->1073755175
2015-04-13 19:03:17,517 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12312108, inMemoryMapOutputs.size() -> 57, commitMemory -> 676995096, usedMemory ->1073755175
2015-04-13 19:03:17,517 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6385925, inMemoryMapOutputs.size() -> 58, commitMemory -> 689307204, usedMemory ->1073755175
2015-04-13 19:03:17,518 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13909621, inMemoryMapOutputs.size() -> 59, commitMemory -> 695693129, usedMemory ->1073755175
2015-04-13 19:03:17,518 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Starting inMemoryMerger's merge since commitMemory=709602750 > mergeThreshold=708669632. Current usedMemory=1073755175
2015-04-13 19:03:17,518 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeThread: InMemoryMerger - Thread to merge in-memory shuffled map-outputs: Starting merge with 59 segments, while ignoring 0 segments
2015-04-13 19:03:17,518 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10038680, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->1073755175
2015-04-13 19:03:17,518 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,518 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0440.stratus.lvs.ebay.com:13562 freed by fetcher#18 in 1151ms
2015-04-13 19:03:17,518 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0328.stratus.lvs.ebay.com:13562 freed by fetcher#10 in 1136ms
2015-04-13 19:03:17,518 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,518 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 18916584, inMemoryMapOutputs.size() -> 2, commitMemory -> 10038680, usedMemory ->1073755175
2015-04-13 19:03:17,519 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,519 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,519 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#4 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,519 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 19116687, inMemoryMapOutputs.size() -> 3, commitMemory -> 28955264, usedMemory ->1073755175
2015-04-13 19:03:17,519 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000053_0 sent hash and received reply
2015-04-13 19:03:17,519 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8144953, inMemoryMapOutputs.size() -> 4, commitMemory -> 48071951, usedMemory ->1073755175
2015-04-13 19:03:17,519 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,519 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0226.stratus.lvs.ebay.com:13562 freed by fetcher#23 in 10ms
2015-04-13 19:03:17,519 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#11 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,519 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,519 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0149.stratus.lvs.ebay.com:13562 freed by fetcher#11 in 1138ms
2015-04-13 19:03:17,520 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0353.stratus.lvs.ebay.com:13562 freed by fetcher#33 in 1139ms
2015-04-13 19:03:17,521 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13581348 bytes from map-output for attempt_1426279437401_714565_m_000231_0
2015-04-13 19:03:17,521 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13581348, inMemoryMapOutputs.size() -> 5, commitMemory -> 56216904, usedMemory ->1073755175
2015-04-13 19:03:17,521 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0094.stratus.lvs.ebay.com:13562 freed by fetcher#35 in 1155ms
2015-04-13 19:03:17,521 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000050_0,attempt_1426279437401_714565_m_000148_0,attempt_1426279437401_714565_m_000300_0,attempt_1426279437401_714565_m_000048_0 sent hash and received reply
2015-04-13 19:03:17,522 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,522 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0100.stratus.lvs.ebay.com:13562 freed by fetcher#7 in 11ms
2015-04-13 19:03:17,522 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8003502, inMemoryMapOutputs.size() -> 6, commitMemory -> 69798252, usedMemory ->1073755175
2015-04-13 19:03:17,522 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8830115, inMemoryMapOutputs.size() -> 7, commitMemory -> 77801754, usedMemory ->1073755175
2015-04-13 19:03:17,522 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000295_0,attempt_1426279437401_714565_m_000427_0,attempt_1426279437401_714565_m_000520_0,attempt_1426279437401_714565_m_000149_0,attempt_1426279437401_714565_m_000394_0,attempt_1426279437401_714565_m_000245_0,attempt_1426279437401_714565_m_000387_0,attempt_1426279437401_714565_m_000181_0 sent hash and received reply
2015-04-13 19:03:17,522 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12141568, inMemoryMapOutputs.size() -> 8, commitMemory -> 86631869, usedMemory ->1073755175
2015-04-13 19:03:17,522 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#36 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,523 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,523 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#15 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,523 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0282.stratus.lvs.ebay.com:13562 freed by fetcher#25 in 15ms
2015-04-13 19:03:17,523 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,523 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0227.stratus.lvs.ebay.com:13562 freed by fetcher#15 in 1156ms
2015-04-13 19:03:17,523 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12174512, inMemoryMapOutputs.size() -> 9, commitMemory -> 98773437, usedMemory ->1073755175
2015-04-13 19:03:17,523 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,523 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Initiating in-memory merge with 59 segments...
2015-04-13 19:03:17,523 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0446.stratus.lvs.ebay.com:13562 freed by fetcher#34 in 1158ms
2015-04-13 19:03:17,524 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12308926, inMemoryMapOutputs.size() -> 10, commitMemory -> 110947949, usedMemory ->1073755175
2015-04-13 19:03:17,524 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapred.Merger: Merging 59 sorted segments
2015-04-13 19:03:17,524 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0461.stratus.lvs.ebay.com:13562 freed by fetcher#31 in 1141ms
2015-04-13 19:03:17,524 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0089.stratus.lvs.ebay.com:13562 freed by fetcher#36 in 1159ms
2015-04-13 19:03:17,524 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0453.stratus.lvs.ebay.com:13562 freed by fetcher#16 in 1142ms
2015-04-13 19:03:17,524 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0319.stratus.lvs.ebay.com:13562 freed by fetcher#4 in 1155ms
2015-04-13 19:03:17,524 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 59 segments left of total size: 709600626 bytes
2015-04-13 19:03:17,524 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0754.stratus.lvs.ebay.com:13562 freed by fetcher#30 in 1138ms
2015-04-13 19:03:17,524 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0164.stratus.lvs.ebay.com:13562 freed by fetcher#26 in 1143ms
2015-04-13 19:03:17,524 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0044.stratus.lvs.ebay.com:13562 freed by fetcher#8 in 1157ms
2015-04-13 19:03:17,524 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000243_0,attempt_1426279437401_714565_m_000253_0,attempt_1426279437401_714565_m_000277_0,attempt_1426279437401_714565_m_000476_0,attempt_1426279437401_714565_m_000269_0,attempt_1426279437401_714565_m_000086_0,attempt_1426279437401_714565_m_000201_0 sent hash and received reply
2015-04-13 19:03:17,524 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0466.stratus.lvs.ebay.com:13562 freed by fetcher#2 in 696ms
2015-04-13 19:03:17,525 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,525 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0503.stratus.lvs.ebay.com:13562 freed by fetcher#13 in 11ms
2015-04-13 19:03:17,525 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0596.stratus.lvs.ebay.com:13562 freed by fetcher#6 in 1161ms
2015-04-13 19:03:17,525 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0748.stratus.lvs.ebay.com:13562 freed by fetcher#27 in 1161ms
2015-04-13 19:03:17,525 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0565.stratus.lvs.ebay.com:13562 freed by fetcher#29 in 1161ms
2015-04-13 19:03:17,527 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000334_0,attempt_1426279437401_714565_m_000025_0 sent hash and received reply
2015-04-13 19:03:17,528 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15005738 bytes from map-output for attempt_1426279437401_714565_m_000089_0
2015-04-13 19:03:17,528 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15005738, inMemoryMapOutputs.size() -> 11, commitMemory -> 123256875, usedMemory ->1073755175
2015-04-13 19:03:17,528 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,528 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0416.stratus.lvs.ebay.com:13562 freed by fetcher#5 in 823ms
2015-04-13 19:03:17,528 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,534 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0146.stratus.lvs.ebay.com:13562 freed by fetcher#3 in 19ms
2015-04-13 19:03:17,543 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 24772870 bytes from map-output for attempt_1426279437401_714565_m_000002_0
2015-04-13 19:03:17,544 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 24772870, inMemoryMapOutputs.size() -> 12, commitMemory -> 138262613, usedMemory ->1073755175
2015-04-13 19:03:17,544 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,544 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0026.stratus.lvs.ebay.com:13562 freed by fetcher#24 in 1178ms
2015-04-13 19:03:17,548 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7043416 bytes from map-output for attempt_1426279437401_714565_m_000464_0
2015-04-13 19:03:17,548 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7043416, inMemoryMapOutputs.size() -> 13, commitMemory -> 163035483, usedMemory ->1073755175
2015-04-13 19:03:17,549 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,549 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0202.stratus.lvs.ebay.com:13562 freed by fetcher#20 in 841ms
2015-04-13 19:03:17,550 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15772903 bytes from map-output for attempt_1426279437401_714565_m_000116_0
2015-04-13 19:03:17,550 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15772903, inMemoryMapOutputs.size() -> 14, commitMemory -> 170078899, usedMemory ->1073755175
2015-04-13 19:03:17,551 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#22 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,551 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0532.stratus.lvs.ebay.com:13562 freed by fetcher#22 in 848ms
2015-04-13 19:03:17,556 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10364680 bytes from map-output for attempt_1426279437401_714565_m_000183_0
2015-04-13 19:03:17,556 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10364680, inMemoryMapOutputs.size() -> 15, commitMemory -> 185851802, usedMemory ->1073755175
2015-04-13 19:03:17,557 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#9 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,557 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0340.stratus.lvs.ebay.com:13562 freed by fetcher#9 in 711ms
2015-04-13 19:03:17,559 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14006995 bytes from map-output for attempt_1426279437401_714565_m_000045_0
2015-04-13 19:03:17,559 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14006995, inMemoryMapOutputs.size() -> 16, commitMemory -> 196216482, usedMemory ->1073755175
2015-04-13 19:03:17,560 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0699.stratus.lvs.ebay.com:13562 freed by fetcher#21 in 1192ms
2015-04-13 19:03:17,579 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9842495 bytes from map-output for attempt_1426279437401_714565_m_000416_0
2015-04-13 19:03:17,580 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9842495, inMemoryMapOutputs.size() -> 17, commitMemory -> 210223477, usedMemory ->1073755175
2015-04-13 19:03:17,580 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0198.stratus.lvs.ebay.com:13562 freed by fetcher#32 in 720ms
2015-04-13 19:03:17,607 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14658240 bytes from map-output for attempt_1426279437401_714565_m_000276_0
2015-04-13 19:03:17,608 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14658240, inMemoryMapOutputs.size() -> 18, commitMemory -> 220065972, usedMemory ->1073755175
2015-04-13 19:03:17,608 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0751.stratus.lvs.ebay.com:13562 freed by fetcher#28 in 1244ms
2015-04-13 19:03:17,615 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 22036652 bytes from map-output for attempt_1426279437401_714565_m_000030_0
2015-04-13 19:03:17,616 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 22036652, inMemoryMapOutputs.size() -> 19, commitMemory -> 234724212, usedMemory ->1073755175
2015-04-13 19:03:17,616 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,616 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0135.stratus.lvs.ebay.com:13562 freed by fetcher#17 in 909ms
2015-04-13 19:03:17,624 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12978494 bytes from map-output for attempt_1426279437401_714565_m_000199_0
2015-04-13 19:03:17,625 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12978494, inMemoryMapOutputs.size() -> 20, commitMemory -> 256760864, usedMemory ->1073755175
2015-04-13 19:03:17,625 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0214.stratus.lvs.ebay.com:13562 freed by fetcher#14 in 1246ms
2015-04-13 19:03:17,624 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15407586 bytes from map-output for attempt_1426279437401_714565_m_000093_0
2015-04-13 19:03:17,635 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15407586, inMemoryMapOutputs.size() -> 21, commitMemory -> 269739358, usedMemory ->1073755175
2015-04-13 19:03:17,635 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0345.stratus.lvs.ebay.com:13562 freed by fetcher#12 in 1258ms
2015-04-13 19:03:17,776 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 30794173 bytes from map-output for attempt_1426279437401_714565_m_000001_0
2015-04-13 19:03:17,776 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 30794173, inMemoryMapOutputs.size() -> 22, commitMemory -> 285146944, usedMemory ->1073755175
2015-04-13 19:03:17,776 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0463.stratus.lvs.ebay.com:13562 freed by fetcher#1 in 1399ms
2015-04-13 19:03:17,867 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 48211308 bytes from map-output for attempt_1426279437401_714565_m_000000_0
2015-04-13 19:03:17,868 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 48211308, inMemoryMapOutputs.size() -> 23, commitMemory -> 315941117, usedMemory ->1073755175
2015-04-13 19:03:17,868 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 - MergeManager returned status WAIT ...
2015-04-13 19:03:17,868 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 freed by fetcher#19 in 1504ms
2015-04-13 19:03:26,505 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: attempt_1426279437401_714565_r_000318_0 Merge of the 59 files in-memory complete. Local file is /hadoop/5/scratch/local/usercache/b_pulsar_coe/appcache/application_1426279437401_714565/output/attempt_1426279437401_714565_r_000318_0/map_567.out.merged of size 222721472
2015-04-13 19:03:26,505 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0442.stratus.lvs.ebay.com:13562 with 2 to fetcher#19
2015-04-13 19:03:26,505 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0442.stratus.lvs.ebay.com:13562 to fetcher#19
2015-04-13 19:03:26,505 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0280.stratus.lvs.ebay.com:13562 with 5 to fetcher#1
2015-04-13 19:03:26,505 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0280.stratus.lvs.ebay.com:13562 to fetcher#1
2015-04-13 19:03:26,506 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0395.stratus.lvs.ebay.com:13562 with 1 to fetcher#12
2015-04-13 19:03:26,507 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0395.stratus.lvs.ebay.com:13562 to fetcher#12
2015-04-13 19:03:26,507 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 with 5 to fetcher#14
2015-04-13 19:03:26,507 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0698.stratus.lvs.ebay.com:13562 with 1 to fetcher#9
2015-04-13 19:03:26,507 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0431.stratus.lvs.ebay.com:13562 with 3 to fetcher#3
2015-04-13 19:03:26,507 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0748.stratus.lvs.ebay.com:13562 with 2 to fetcher#6
2015-04-13 19:03:26,507 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0748.stratus.lvs.ebay.com:13562 to fetcher#6
2015-04-13 19:03:26,507 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0391.stratus.lvs.ebay.com:13562 with 2 to fetcher#21
2015-04-13 19:03:26,507 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0391.stratus.lvs.ebay.com:13562 to fetcher#21
2015-04-13 19:03:26,507 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0535.stratus.lvs.ebay.com:13562 with 3 to fetcher#32
2015-04-13 19:03:26,507 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0535.stratus.lvs.ebay.com:13562 to fetcher#32
2015-04-13 19:03:26,507 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0313.stratus.lvs.ebay.com:13562 with 1 to fetcher#28
2015-04-13 19:03:26,507 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0313.stratus.lvs.ebay.com:13562 to fetcher#28
2015-04-13 19:03:26,508 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0088.stratus.lvs.ebay.com:13562 with 2 to fetcher#17
2015-04-13 19:03:26,508 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0088.stratus.lvs.ebay.com:13562 to fetcher#17
2015-04-13 19:03:26,508 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0310.stratus.lvs.ebay.com:13562 with 1 to fetcher#4
2015-04-13 19:03:26,508 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0310.stratus.lvs.ebay.com:13562 to fetcher#4
2015-04-13 19:03:26,508 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0159.stratus.lvs.ebay.com:13562 with 1 to fetcher#30
2015-04-13 19:03:26,508 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0159.stratus.lvs.ebay.com:13562 to fetcher#30
2015-04-13 19:03:26,508 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0408.stratus.lvs.ebay.com:13562 with 4 to fetcher#25
2015-04-13 19:03:26,508 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0408.stratus.lvs.ebay.com:13562 to fetcher#25
2015-04-13 19:03:26,508 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0754.stratus.lvs.ebay.com:13562 with 2 to fetcher#26
2015-04-13 19:03:26,509 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0754.stratus.lvs.ebay.com:13562 to fetcher#26
2015-04-13 19:03:26,509 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0340.stratus.lvs.ebay.com:13562 with 3 to fetcher#8
2015-04-13 19:03:26,509 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0340.stratus.lvs.ebay.com:13562 to fetcher#8
2015-04-13 19:03:26,509 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000111_0,attempt_1426279437401_714565_m_000449_0 sent hash and received reply
2015-04-13 19:03:26,510 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000316_0,attempt_1426279437401_714565_m_000038_0 sent hash and received reply
2015-04-13 19:03:26,510 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000292_0,attempt_1426279437401_714565_m_000236_0 sent hash and received reply
2015-04-13 19:03:26,511 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000014_0 sent hash and received reply
2015-04-13 19:03:26,512 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000137_0 sent hash and received reply
2015-04-13 19:03:26,513 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000217_0,attempt_1426279437401_714565_m_000017_0,attempt_1426279437401_714565_m_000117_0 sent hash and received reply
2015-04-13 19:03:26,513 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0183.stratus.lvs.ebay.com:13562 with 3 to fetcher#2
2015-04-13 19:03:26,513 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000203_0,attempt_1426279437401_714565_m_000160_0,attempt_1426279437401_714565_m_000090_0 sent hash and received reply
2015-04-13 19:03:26,513 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0183.stratus.lvs.ebay.com:13562 to fetcher#2
2015-04-13 19:03:26,513 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0592.stratus.lvs.ebay.com:13562 with 1 to fetcher#13
2015-04-13 19:03:26,513 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0592.stratus.lvs.ebay.com:13562 to fetcher#13
2015-04-13 19:03:26,513 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000138_0,attempt_1426279437401_714565_m_000159_0,attempt_1426279437401_714565_m_000429_0,attempt_1426279437401_714565_m_000082_0,attempt_1426279437401_714565_m_000233_0 sent hash and received reply
2015-04-13 19:03:26,514 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0431.stratus.lvs.ebay.com:13562 to fetcher#3
2015-04-13 19:03:26,514 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0079.stratus.lvs.ebay.com:13562 with 1 to fetcher#27
2015-04-13 19:03:26,514 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0079.stratus.lvs.ebay.com:13562 to fetcher#27
2015-04-13 19:03:26,513 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#6 about to shuffle output of map attempt_1426279437401_714565_m_000111_0 decomp: 14167966 len: 4537503 to MEMORY
2015-04-13 19:03:26,514 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000559_0,attempt_1426279437401_714565_m_000168_0 sent hash and received reply
2015-04-13 19:03:26,515 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0026.stratus.lvs.ebay.com:13562 with 2 to fetcher#29
2015-04-13 19:03:26,515 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0026.stratus.lvs.ebay.com:13562 to fetcher#29
2015-04-13 19:03:26,515 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0149.stratus.lvs.ebay.com:13562 with 4 to fetcher#5
2015-04-13 19:03:26,515 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0149.stratus.lvs.ebay.com:13562 to fetcher#5
2015-04-13 19:03:26,515 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0698.stratus.lvs.ebay.com:13562 to fetcher#9
2015-04-13 19:03:26,515 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0121.stratus.lvs.ebay.com:13562 with 2 to fetcher#24
2015-04-13 19:03:26,515 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0121.stratus.lvs.ebay.com:13562 to fetcher#24
2015-04-13 19:03:26,515 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0568.stratus.lvs.ebay.com:13562 with 3 to fetcher#20
2015-04-13 19:03:26,515 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0568.stratus.lvs.ebay.com:13562 to fetcher#20
2015-04-13 19:03:26,515 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0045.stratus.lvs.ebay.com:13562 with 3 to fetcher#22
2015-04-13 19:03:26,515 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0045.stratus.lvs.ebay.com:13562 to fetcher#22
2015-04-13 19:03:26,515 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 to fetcher#14
2015-04-13 19:03:26,516 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0416.stratus.lvs.ebay.com:13562 with 1 to fetcher#18
2015-04-13 19:03:26,516 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000106_0 sent hash and received reply
2015-04-13 19:03:26,516 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0416.stratus.lvs.ebay.com:13562 to fetcher#18
2015-04-13 19:03:26,517 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#32 about to shuffle output of map attempt_1426279437401_714565_m_000203_0 decomp: 12011736 len: 3726153 to MEMORY
2015-04-13 19:03:26,517 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0394.stratus.lvs.ebay.com:13562 with 1 to fetcher#10
2015-04-13 19:03:26,517 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0394.stratus.lvs.ebay.com:13562 to fetcher#10
2015-04-13 19:03:26,517 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0202.stratus.lvs.ebay.com:13562 with 7 to fetcher#23
2015-04-13 19:03:26,517 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 7 of 7 to lvsdpehdc25dn0202.stratus.lvs.ebay.com:13562 to fetcher#23
2015-04-13 19:03:26,517 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0429.stratus.lvs.ebay.com:13562 with 3 to fetcher#11
2015-04-13 19:03:26,517 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0429.stratus.lvs.ebay.com:13562 to fetcher#11
2015-04-13 19:03:26,517 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0230.stratus.lvs.ebay.com:13562 with 3 to fetcher#33
2015-04-13 19:03:26,517 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0230.stratus.lvs.ebay.com:13562 to fetcher#33
2015-04-13 19:03:26,518 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0461.stratus.lvs.ebay.com:13562 with 2 to fetcher#35
2015-04-13 19:03:26,518 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0461.stratus.lvs.ebay.com:13562 to fetcher#35
2015-04-13 19:03:26,518 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000354_0,attempt_1426279437401_714565_m_000152_0,attempt_1426279437401_714565_m_000096_0 sent hash and received reply
2015-04-13 19:03:26,518 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0254.stratus.lvs.ebay.com:13562 with 1 to fetcher#7
2015-04-13 19:03:26,518 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0254.stratus.lvs.ebay.com:13562 to fetcher#7
2015-04-13 19:03:26,518 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000383_0 sent hash and received reply
2015-04-13 19:03:26,519 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0227.stratus.lvs.ebay.com:13562 with 5 to fetcher#15
2015-04-13 19:03:26,519 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0227.stratus.lvs.ebay.com:13562 to fetcher#15
2015-04-13 19:03:26,519 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000060_0 sent hash and received reply
2015-04-13 19:03:26,519 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000558_0,attempt_1426279437401_714565_m_000229_0,attempt_1426279437401_714565_m_000171_0,attempt_1426279437401_714565_m_000028_0 sent hash and received reply
2015-04-13 19:03:26,519 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0010.stratus.lvs.ebay.com:13562 with 2 to fetcher#34
2015-04-13 19:03:26,519 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0010.stratus.lvs.ebay.com:13562 to fetcher#34
2015-04-13 19:03:26,520 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000101_0 sent hash and received reply
2015-04-13 19:03:26,520 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000162_0,attempt_1426279437401_714565_m_000437_0,attempt_1426279437401_714565_m_000130_0,attempt_1426279437401_714565_m_000434_0 sent hash and received reply
2015-04-13 19:03:26,520 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0466.stratus.lvs.ebay.com:13562 with 1 to fetcher#31
2015-04-13 19:03:26,520 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0466.stratus.lvs.ebay.com:13562 to fetcher#31
2015-04-13 19:03:26,520 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0197.stratus.lvs.ebay.com:13562 with 1 to fetcher#36
2015-04-13 19:03:26,520 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0197.stratus.lvs.ebay.com:13562 to fetcher#36
2015-04-13 19:03:26,520 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000299_0,attempt_1426279437401_714565_m_000132_0,attempt_1426279437401_714565_m_000142_0 sent hash and received reply
2015-04-13 19:03:26,521 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 about to shuffle output of map attempt_1426279437401_714565_m_000106_0 decomp: 14411400 len: 4653779 to MEMORY
2015-04-13 19:03:26,521 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000412_0,attempt_1426279437401_714565_m_000275_0 sent hash and received reply
2015-04-13 19:03:26,521 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000460_0,attempt_1426279437401_714565_m_000328_0,attempt_1426279437401_714565_m_000530_0 sent hash and received reply
2015-04-13 19:03:26,521 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000046_0,attempt_1426279437401_714565_m_000194_0 sent hash and received reply
2015-04-13 19:03:26,520 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000291_0,attempt_1426279437401_714565_m_000317_0,attempt_1426279437401_714565_m_000373_0 sent hash and received reply
2015-04-13 19:03:26,521 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0532.stratus.lvs.ebay.com:13562 with 1 to fetcher#16
2015-04-13 19:03:26,522 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 about to shuffle output of map attempt_1426279437401_714565_m_000559_0 decomp: 3417257 len: 1228050 to MEMORY
2015-04-13 19:03:26,522 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0532.stratus.lvs.ebay.com:13562 to fetcher#16
2015-04-13 19:03:26,522 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000186_0,attempt_1426279437401_714565_m_000202_0 sent hash and received reply
2015-04-13 19:03:26,522 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000018_0,attempt_1426279437401_714565_m_000157_0 sent hash and received reply
2015-04-13 19:03:26,522 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000026_0 sent hash and received reply
2015-04-13 19:03:26,523 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000406_0 sent hash and received reply
2015-04-13 19:03:26,523 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000497_0 sent hash and received reply
2015-04-13 19:03:26,523 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000244_0,attempt_1426279437401_714565_m_000259_0,attempt_1426279437401_714565_m_000411_0 sent hash and received reply
2015-04-13 19:03:26,525 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000331_0,attempt_1426279437401_714565_m_000364_0,attempt_1426279437401_714565_m_000166_0,attempt_1426279437401_714565_m_000184_0,attempt_1426279437401_714565_m_000153_0 sent hash and received reply
2015-04-13 19:03:26,526 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000100_0,attempt_1426279437401_714565_m_000272_0,attempt_1426279437401_714565_m_000248_0,attempt_1426279437401_714565_m_000180_0,attempt_1426279437401_714565_m_000431_0 sent hash and received reply
2015-04-13 19:03:26,526 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000481_0,attempt_1426279437401_714565_m_000471_0,attempt_1426279437401_714565_m_000468_0,attempt_1426279437401_714565_m_000465_0,attempt_1426279437401_714565_m_000540_0,attempt_1426279437401_714565_m_000479_0,attempt_1426279437401_714565_m_000114_0 sent hash and received reply
2015-04-13 19:03:26,527 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000073_0 sent hash and received reply
2015-04-13 19:03:26,527 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle output of map attempt_1426279437401_714565_m_000138_0 decomp: 18511329 len: 5472909 to MEMORY
2015-04-13 19:03:26,527 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000023_0 sent hash and received reply
2015-04-13 19:03:26,528 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000247_0 sent hash and received reply
2015-04-13 19:03:26,528 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000222_0,attempt_1426279437401_714565_m_000135_0,attempt_1426279437401_714565_m_000306_0 sent hash and received reply
2015-04-13 19:03:26,531 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 about to shuffle output of map attempt_1426279437401_714565_m_000137_0 decomp: 13713875 len: 5202227 to MEMORY
2015-04-13 19:03:26,531 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000297_0,attempt_1426279437401_714565_m_000212_0 sent hash and received reply
2015-04-13 19:03:26,540 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 about to shuffle output of map attempt_1426279437401_714565_m_000297_0 decomp: 14135772 len: 4915808 to MEMORY
2015-04-13 19:03:26,545 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 about to shuffle output of map attempt_1426279437401_714565_m_000316_0 decomp: 10296413 len: 3204081 to MEMORY
2015-04-13 19:03:26,548 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000292_0 decomp: 10111678 len: 3129270 to MEMORY
2015-04-13 19:03:26,551 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 about to shuffle output of map attempt_1426279437401_714565_m_000222_0 decomp: 11896460 len: 4119796 to MEMORY
2015-04-13 19:03:26,706 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000080_0 sent hash and received reply
2015-04-13 19:03:26,710 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 about to shuffle output of map attempt_1426279437401_714565_m_000247_0 decomp: 11423002 len: 4021363 to MEMORY
2015-04-13 19:03:26,715 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 about to shuffle output of map attempt_1426279437401_714565_m_000023_0 decomp: 18881970 len: 6384304 to MEMORY
2015-04-13 19:03:26,715 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#12 about to shuffle output of map attempt_1426279437401_714565_m_000014_0 decomp: 22923616 len: 7086251 to MEMORY
2015-04-13 19:03:26,724 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 3417257 bytes from map-output for attempt_1426279437401_714565_m_000559_0
2015-04-13 19:03:26,724 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 3417257, inMemoryMapOutputs.size() -> 24, commitMemory -> 364152425, usedMemory ->556182372
2015-04-13 19:03:26,726 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 about to shuffle output of map attempt_1426279437401_714565_m_000073_0 decomp: 16127473 len: 5737155 to MEMORY
2015-04-13 19:03:26,728 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 about to shuffle output of map attempt_1426279437401_714565_m_000168_0 decomp: 14480187 len: 5046913 to MEMORY
2015-04-13 19:03:26,731 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000481_0 decomp: 8184808 len: 3100990 to MEMORY
2015-04-13 19:03:26,734 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 about to shuffle output of map attempt_1426279437401_714565_m_000100_0 decomp: 12398709 len: 4158319 to MEMORY
2015-04-13 19:03:26,736 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12011736 bytes from map-output for attempt_1426279437401_714565_m_000203_0
2015-04-13 19:03:26,737 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#15 about to shuffle output of map attempt_1426279437401_714565_m_000331_0 decomp: 11114427 len: 4094208 to MEMORY
2015-04-13 19:03:26,740 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#11 about to shuffle output of map attempt_1426279437401_714565_m_000244_0 decomp: 11922730 len: 3717327 to MEMORY
2015-04-13 19:03:26,743 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#36 about to shuffle output of map attempt_1426279437401_714565_m_000497_0 decomp: 7394384 len: 2786450 to MEMORY
2015-04-13 19:03:26,753 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 about to shuffle output of map attempt_1426279437401_714565_m_000018_0 decomp: 18091546 len: 5478975 to MEMORY
2015-04-13 19:03:26,757 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 about to shuffle output of map attempt_1426279437401_714565_m_000406_0 decomp: 10475136 len: 3694144 to MEMORY
2015-04-13 19:03:26,766 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#10 about to shuffle output of map attempt_1426279437401_714565_m_000026_0 decomp: 19906221 len: 6817236 to MEMORY
2015-04-13 19:03:26,769 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 about to shuffle output of map attempt_1426279437401_714565_m_000186_0 decomp: 12735875 len: 4777870 to MEMORY
2015-04-13 19:03:26,772 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 about to shuffle output of map attempt_1426279437401_714565_m_000291_0 decomp: 10125699 len: 2982687 to MEMORY
2015-04-13 19:03:26,776 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14411400 bytes from map-output for attempt_1426279437401_714565_m_000106_0
2015-04-13 19:03:26,789 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#22 about to shuffle output of map attempt_1426279437401_714565_m_000460_0 decomp: 9080464 len: 3230242 to MEMORY
2015-04-13 19:03:26,790 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 about to shuffle output of map attempt_1426279437401_714565_m_000046_0 decomp: 19627194 len: 6591125 to MEMORY
2015-04-13 19:03:26,792 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 about to shuffle output of map attempt_1426279437401_714565_m_000412_0 decomp: 9342488 len: 2934755 to MEMORY
2015-04-13 19:03:26,793 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14480187 bytes from map-output for attempt_1426279437401_714565_m_000168_0
2015-04-13 19:03:26,795 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 about to shuffle output of map attempt_1426279437401_714565_m_000299_0 decomp: 10331211 len: 2984835 to MEMORY
2015-04-13 19:03:26,799 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 about to shuffle output of map attempt_1426279437401_714565_m_000162_0 decomp: 14688031 len: 4682768 to MEMORY
2015-04-13 19:03:26,804 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#9 about to shuffle output of map attempt_1426279437401_714565_m_000101_0 decomp: 13691324 len: 4176477 to MEMORY
2015-04-13 19:03:26,805 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 about to shuffle output of map attempt_1426279437401_714565_m_000558_0 decomp: 3819274 len: 1147809 to MEMORY
2015-04-13 19:03:26,810 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 18511329 bytes from map-output for attempt_1426279437401_714565_m_000138_0
2015-04-13 19:03:26,811 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10296413 bytes from map-output for attempt_1426279437401_714565_m_000316_0
2015-04-13 19:03:26,813 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12398709 bytes from map-output for attempt_1426279437401_714565_m_000100_0
2015-04-13 19:03:26,814 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 about to shuffle output of map attempt_1426279437401_714565_m_000383_0 decomp: 11567324 len: 3981747 to MEMORY
2015-04-13 19:03:26,814 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 about to shuffle output of map attempt_1426279437401_714565_m_000060_0 decomp: 15521286 len: 5172635 to MEMORY
2015-04-13 19:03:26,817 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 about to shuffle output of map attempt_1426279437401_714565_m_000354_0 decomp: 10350141 len: 3491749 to MEMORY
2015-04-13 19:03:26,821 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12011736, inMemoryMapOutputs.size() -> 25, commitMemory -> 367569682, usedMemory ->820974438
2015-04-13 19:03:26,821 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 about to shuffle output of map attempt_1426279437401_714565_m_000217_0 decomp: 9943607 len: 3128242 to MEMORY
2015-04-13 19:03:26,821 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12398709, inMemoryMapOutputs.size() -> 26, commitMemory -> 379581418, usedMemory ->820974438
2015-04-13 19:03:26,825 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#32 about to shuffle output of map attempt_1426279437401_714565_m_000160_0 decomp: 12129671 len: 4143692 to MEMORY
2015-04-13 19:03:26,830 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10296413, inMemoryMapOutputs.size() -> 27, commitMemory -> 391980127, usedMemory ->846154169
2015-04-13 19:03:26,830 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#4 about to shuffle output of map attempt_1426279437401_714565_m_000080_0 decomp: 13050060 len: 4392248 to MEMORY
2015-04-13 19:03:26,838 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 3819274 bytes from map-output for attempt_1426279437401_714565_m_000558_0
2015-04-13 19:03:26,840 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 18511329, inMemoryMapOutputs.size() -> 28, commitMemory -> 402276540, usedMemory ->874975460
2015-04-13 19:03:26,844 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 about to shuffle output of map attempt_1426279437401_714565_m_000272_0 decomp: 13517595 len: 4925537 to MEMORY
2015-04-13 19:03:26,853 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle output of map attempt_1426279437401_714565_m_000159_0 decomp: 14461510 len: 4543026 to MEMORY
2015-04-13 19:03:26,857 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14480187, inMemoryMapOutputs.size() -> 29, commitMemory -> 420787869, usedMemory ->889436970
2015-04-13 19:03:26,857 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14411400, inMemoryMapOutputs.size() -> 30, commitMemory -> 435268056, usedMemory ->889436970
2015-04-13 19:03:26,857 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 about to shuffle output of map attempt_1426279437401_714565_m_000038_0 decomp: 15303696 len: 5145218 to MEMORY
2015-04-13 19:03:26,858 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0313.stratus.lvs.ebay.com:13562 freed by fetcher#28 in 351ms
2015-04-13 19:03:26,858 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0669.stratus.lvs.ebay.com:13562 with 1 to fetcher#28
2015-04-13 19:03:26,858 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0669.stratus.lvs.ebay.com:13562 to fetcher#28
2015-04-13 19:03:26,853 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7394384 bytes from map-output for attempt_1426279437401_714565_m_000497_0
2015-04-13 19:03:26,858 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7394384, inMemoryMapOutputs.size() -> 31, commitMemory -> 449679456, usedMemory ->889436970
2015-04-13 19:03:26,858 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0197.stratus.lvs.ebay.com:13562 freed by fetcher#36 in 338ms
2015-04-13 19:03:26,858 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0226.stratus.lvs.ebay.com:13562 with 1 to fetcher#36
2015-04-13 19:03:26,858 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0226.stratus.lvs.ebay.com:13562 to fetcher#36
2015-04-13 19:03:26,860 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000377_0 sent hash and received reply
2015-04-13 19:03:26,862 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0088.stratus.lvs.ebay.com:13562 freed by fetcher#17 in 354ms
2015-04-13 19:03:26,862 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0108.stratus.lvs.ebay.com:13562 with 4 to fetcher#17
2015-04-13 19:03:26,862 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0108.stratus.lvs.ebay.com:13562 to fetcher#17
2015-04-13 19:03:26,864 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 about to shuffle output of map attempt_1426279437401_714565_m_000377_0 decomp: 11834612 len: 3982601 to MEMORY
2015-04-13 19:03:26,867 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8184808 bytes from map-output for attempt_1426279437401_714565_m_000481_0
2015-04-13 19:03:26,864 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 3819274, inMemoryMapOutputs.size() -> 32, commitMemory -> 457073840, usedMemory ->901271582
2015-04-13 19:03:26,871 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 about to shuffle output of map attempt_1426279437401_714565_m_000229_0 decomp: 9498429 len: 2675102 to MEMORY
2015-04-13 19:03:26,872 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14167966 bytes from map-output for attempt_1426279437401_714565_m_000111_0
2015-04-13 19:03:26,872 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14167966, inMemoryMapOutputs.size() -> 33, commitMemory -> 460893114, usedMemory ->910770011
2015-04-13 19:03:26,872 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8184808, inMemoryMapOutputs.size() -> 34, commitMemory -> 475061080, usedMemory ->910770011
2015-04-13 19:03:26,874 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000471_0 decomp: 7057663 len: 2242923 to MEMORY
2015-04-13 19:03:26,877 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000016_0,attempt_1426279437401_714565_m_000304_0,attempt_1426279437401_714565_m_000349_0,attempt_1426279437401_714565_m_000401_0 sent hash and received reply
2015-04-13 19:03:26,879 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000053_0 sent hash and received reply
2015-04-13 19:03:26,888 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10111678 bytes from map-output for attempt_1426279437401_714565_m_000292_0
2015-04-13 19:03:26,892 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 about to shuffle output of map attempt_1426279437401_714565_m_000016_0 decomp: 19256070 len: 6252907 to MEMORY
2015-04-13 19:03:26,896 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#6 about to shuffle output of map attempt_1426279437401_714565_m_000449_0 decomp: 10389186 len: 3242033 to MEMORY
2015-04-13 19:03:26,897 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10111678, inMemoryMapOutputs.size() -> 35, commitMemory -> 483245888, usedMemory ->947472930
2015-04-13 19:03:26,898 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11114427 bytes from map-output for attempt_1426279437401_714565_m_000331_0
2015-04-13 19:03:26,900 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11896460 bytes from map-output for attempt_1426279437401_714565_m_000222_0
2015-04-13 19:03:26,902 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#36 about to shuffle output of map attempt_1426279437401_714565_m_000053_0 decomp: 16713205 len: 5665940 to MEMORY
2015-04-13 19:03:27,184 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11114427, inMemoryMapOutputs.size() -> 36, commitMemory -> 493357566, usedMemory ->976548874
2015-04-13 19:03:27,184 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000236_0 decomp: 12362739 len: 3729806 to MEMORY
2015-04-13 19:03:27,186 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10475136 bytes from map-output for attempt_1426279437401_714565_m_000406_0
2015-04-13 19:03:27,186 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#15 about to shuffle output of map attempt_1426279437401_714565_m_000364_0 decomp: 8529717 len: 2391854 to MEMORY
2015-04-13 19:03:27,187 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9080464 bytes from map-output for attempt_1426279437401_714565_m_000460_0
2015-04-13 19:03:27,196 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10331211 bytes from map-output for attempt_1426279437401_714565_m_000299_0
2015-04-13 19:03:27,199 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12735875 bytes from map-output for attempt_1426279437401_714565_m_000186_0
2015-04-13 19:03:27,203 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9342488 bytes from map-output for attempt_1426279437401_714565_m_000412_0
2015-04-13 19:03:27,208 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14135772 bytes from map-output for attempt_1426279437401_714565_m_000297_0
2015-04-13 19:03:27,208 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10475136, inMemoryMapOutputs.size() -> 37, commitMemory -> 504471993, usedMemory ->985078591
2015-04-13 19:03:27,208 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11896460, inMemoryMapOutputs.size() -> 38, commitMemory -> 514947129, usedMemory ->985078591
2015-04-13 19:03:27,209 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10350141 bytes from map-output for attempt_1426279437401_714565_m_000354_0
2015-04-13 19:03:27,213 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 about to shuffle output of map attempt_1426279437401_714565_m_000135_0 decomp: 16530394 len: 5912101 to MEMORY
2015-04-13 19:03:27,214 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10350141, inMemoryMapOutputs.size() -> 39, commitMemory -> 526843589, usedMemory ->1001608985
2015-04-13 19:03:27,217 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0466.stratus.lvs.ebay.com:13562 freed by fetcher#31 in 697ms
2015-04-13 19:03:27,217 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0100.stratus.lvs.ebay.com:13562 with 4 to fetcher#31
2015-04-13 19:03:27,218 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0100.stratus.lvs.ebay.com:13562 to fetcher#31
2015-04-13 19:03:27,220 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13713875 bytes from map-output for attempt_1426279437401_714565_m_000137_0
2015-04-13 19:03:27,221 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11922730 bytes from map-output for attempt_1426279437401_714565_m_000244_0
2015-04-13 19:03:27,222 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 about to shuffle output of map attempt_1426279437401_714565_m_000152_0 decomp: 12017333 len: 3886165 to MEMORY
2015-04-13 19:03:27,226 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13713875, inMemoryMapOutputs.size() -> 40, commitMemory -> 537193730, usedMemory ->1013626318
2015-04-13 19:03:27,226 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0159.stratus.lvs.ebay.com:13562 freed by fetcher#30 in 718ms
2015-04-13 19:03:27,226 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0234.stratus.lvs.ebay.com:13562 with 5 to fetcher#30
2015-04-13 19:03:27,227 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 5 of 5 to lvsdpehdc25dn0234.stratus.lvs.ebay.com:13562 to fetcher#30
2015-04-13 19:03:27,227 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11567324 bytes from map-output for attempt_1426279437401_714565_m_000383_0
2015-04-13 19:03:27,227 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11567324, inMemoryMapOutputs.size() -> 41, commitMemory -> 550907605, usedMemory ->1013626318
2015-04-13 19:03:27,227 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0079.stratus.lvs.ebay.com:13562 freed by fetcher#27 in 713ms
2015-04-13 19:03:27,227 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0433.stratus.lvs.ebay.com:13562 with 1 to fetcher#27
2015-04-13 19:03:27,227 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0433.stratus.lvs.ebay.com:13562 to fetcher#27
2015-04-13 19:03:27,230 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 18881970 bytes from map-output for attempt_1426279437401_714565_m_000023_0
2015-04-13 19:03:27,230 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 18881970, inMemoryMapOutputs.size() -> 42, commitMemory -> 562474929, usedMemory ->1013626318
2015-04-13 19:03:27,230 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0532.stratus.lvs.ebay.com:13562 freed by fetcher#16 in 708ms
2015-04-13 19:03:27,230 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0758.stratus.lvs.ebay.com:13562 with 2 to fetcher#16
2015-04-13 19:03:27,231 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0758.stratus.lvs.ebay.com:13562 to fetcher#16
2015-04-13 19:03:27,233 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7057663 bytes from map-output for attempt_1426279437401_714565_m_000471_0
2015-04-13 19:03:27,233 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7057663, inMemoryMapOutputs.size() -> 43, commitMemory -> 581356899, usedMemory ->1013626318
2015-04-13 19:03:27,233 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9943607 bytes from map-output for attempt_1426279437401_714565_m_000217_0
2015-04-13 19:03:27,236 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 16127473 bytes from map-output for attempt_1426279437401_714565_m_000073_0
2015-04-13 19:03:27,237 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11423002 bytes from map-output for attempt_1426279437401_714565_m_000247_0
2015-04-13 19:03:27,237 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000050_0,attempt_1426279437401_714565_m_000148_0,attempt_1426279437401_714565_m_000300_0,attempt_1426279437401_714565_m_000048_0 sent hash and received reply
2015-04-13 19:03:27,238 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000468_0 decomp: 6430738 len: 2017193 to MEMORY
2015-04-13 19:03:27,239 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9943607, inMemoryMapOutputs.size() -> 44, commitMemory -> 588414562, usedMemory ->1020057056
2015-04-13 19:03:27,241 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10125699 bytes from map-output for attempt_1426279437401_714565_m_000291_0
2015-04-13 19:03:27,243 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000271_0,attempt_1426279437401_714565_m_000528_0,attempt_1426279437401_714565_m_000234_0,attempt_1426279437401_714565_m_000351_0,attempt_1426279437401_714565_m_000444_0 sent hash and received reply
2015-04-13 19:03:27,244 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 about to shuffle output of map attempt_1426279437401_714565_m_000050_0 decomp: 18389537 len: 6161676 to MEMORY
2015-04-13 19:03:27,248 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10125699, inMemoryMapOutputs.size() -> 45, commitMemory -> 598358169, usedMemory ->1051831336
2015-04-13 19:03:27,248 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 about to shuffle output of map attempt_1426279437401_714565_m_000271_0 decomp: 13384743 len: 4725413 to MEMORY
2015-04-13 19:03:27,247 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11834612 bytes from map-output for attempt_1426279437401_714565_m_000377_0
2015-04-13 19:03:27,245 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13691324 bytes from map-output for attempt_1426279437401_714565_m_000101_0
2015-04-13 19:03:27,259 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8529717 bytes from map-output for attempt_1426279437401_714565_m_000364_0
2015-04-13 19:03:27,260 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15521286 bytes from map-output for attempt_1426279437401_714565_m_000060_0
2015-04-13 19:03:27,260 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 about to shuffle output of map attempt_1426279437401_714565_m_000017_0 decomp: 22538204 len: 7793539 to MEMORY
2015-04-13 19:03:27,260 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,260 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11834612, inMemoryMapOutputs.size() -> 46, commitMemory -> 608483868, usedMemory ->1074369540
2015-04-13 19:03:27,261 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0431.stratus.lvs.ebay.com:13562 freed by fetcher#3 in 754ms
2015-04-13 19:03:27,261 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14135772, inMemoryMapOutputs.size() -> 47, commitMemory -> 620318480, usedMemory ->1074369540
2015-04-13 19:03:27,261 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9342488, inMemoryMapOutputs.size() -> 48, commitMemory -> 634454252, usedMemory ->1074369540
2015-04-13 19:03:27,261 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,261 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12735875, inMemoryMapOutputs.size() -> 49, commitMemory -> 643796740, usedMemory ->1074369540
2015-04-13 19:03:27,261 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,261 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10331211, inMemoryMapOutputs.size() -> 50, commitMemory -> 656532615, usedMemory ->1074369540
2015-04-13 19:03:27,261 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,261 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0010.stratus.lvs.ebay.com:13562 freed by fetcher#34 in 742ms
2015-04-13 19:03:27,261 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,265 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14688031 bytes from map-output for attempt_1426279437401_714565_m_000162_0
2015-04-13 19:03:27,261 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9498429 bytes from map-output for attempt_1426279437401_714565_m_000229_0
2015-04-13 19:03:27,261 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0664.stratus.lvs.ebay.com:13562 with 1 to fetcher#34
2015-04-13 19:03:27,268 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0664.stratus.lvs.ebay.com:13562 to fetcher#34
2015-04-13 19:03:27,268 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9080464, inMemoryMapOutputs.size() -> 51, commitMemory -> 666863826, usedMemory ->1074369540
2015-04-13 19:03:27,269 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000527_0 sent hash and received reply
2015-04-13 19:03:27,269 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#22 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,269 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,269 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0433.stratus.lvs.ebay.com:13562 freed by fetcher#27 in 42ms
2015-04-13 19:03:27,269 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0473.stratus.lvs.ebay.com:13562 with 2 to fetcher#27
2015-04-13 19:03:27,269 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0473.stratus.lvs.ebay.com:13562 to fetcher#27
2015-04-13 19:03:27,270 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12129671 bytes from map-output for attempt_1426279437401_714565_m_000160_0
2015-04-13 19:03:27,270 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12129671, inMemoryMapOutputs.size() -> 52, commitMemory -> 675944290, usedMemory ->1074369540
2015-04-13 19:03:27,270 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#32 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,270 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0535.stratus.lvs.ebay.com:13562 freed by fetcher#32 in 763ms
2015-04-13 19:03:27,270 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0453.stratus.lvs.ebay.com:13562 with 1 to fetcher#32
2015-04-13 19:03:27,270 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0453.stratus.lvs.ebay.com:13562 to fetcher#32
2015-04-13 19:03:27,272 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000290_0 sent hash and received reply
2015-04-13 19:03:27,272 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,272 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0664.stratus.lvs.ebay.com:13562 freed by fetcher#34 in 4ms
2015-04-13 19:03:27,272 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0595.stratus.lvs.ebay.com:13562 with 2 to fetcher#34
2015-04-13 19:03:27,272 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0595.stratus.lvs.ebay.com:13562 to fetcher#34
2015-04-13 19:03:27,273 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9498429, inMemoryMapOutputs.size() -> 53, commitMemory -> 688073961, usedMemory ->1074369540
2015-04-13 19:03:27,273 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14688031, inMemoryMapOutputs.size() -> 54, commitMemory -> 697572390, usedMemory ->1074369540
2015-04-13 19:03:27,273 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Starting inMemoryMerger's merge since commitMemory=712260421 > mergeThreshold=708669632. Current usedMemory=1074369540
2015-04-13 19:03:27,274 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeThread: InMemoryMerger - Thread to merge in-memory shuffled map-outputs: Starting merge with 54 segments, while ignoring 0 segments
2015-04-13 19:03:27,274 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0568.stratus.lvs.ebay.com:13562 freed by fetcher#20 in 759ms
2015-04-13 19:03:27,274 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0121.stratus.lvs.ebay.com:13562 freed by fetcher#24 in 759ms
2015-04-13 19:03:27,274 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,274 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0149.stratus.lvs.ebay.com:13562 freed by fetcher#5 in 759ms
2015-04-13 19:03:27,274 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,274 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0408.stratus.lvs.ebay.com:13562 freed by fetcher#25 in 766ms
2015-04-13 19:03:27,278 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Initiating in-memory merge with 54 segments...
2015-04-13 19:03:27,278 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapred.Merger: Merging 54 sorted segments
2015-04-13 19:03:27,278 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0026.stratus.lvs.ebay.com:13562 freed by fetcher#29 in 763ms
2015-04-13 19:03:27,278 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0535.stratus.lvs.ebay.com:13562 with 1 to fetcher#3
2015-04-13 19:03:27,278 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0535.stratus.lvs.ebay.com:13562 to fetcher#3
2015-04-13 19:03:27,278 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0669.stratus.lvs.ebay.com:13562 freed by fetcher#28 in 420ms
2015-04-13 19:03:27,278 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15521286, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->1074369540
2015-04-13 19:03:27,279 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8529717, inMemoryMapOutputs.size() -> 2, commitMemory -> 15521286, usedMemory ->1074369540
2015-04-13 19:03:27,279 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13691324, inMemoryMapOutputs.size() -> 3, commitMemory -> 24051003, usedMemory ->1074369540
2015-04-13 19:03:27,279 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#15 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,279 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11423002, inMemoryMapOutputs.size() -> 4, commitMemory -> 37742327, usedMemory ->1074369540
2015-04-13 19:03:27,279 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 54 segments left of total size: 712258477 bytes
2015-04-13 19:03:27,279 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 16127473, inMemoryMapOutputs.size() -> 5, commitMemory -> 49165329, usedMemory ->1074369540
2015-04-13 19:03:27,279 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11922730, inMemoryMapOutputs.size() -> 6, commitMemory -> 65292802, usedMemory ->1074369540
2015-04-13 19:03:27,279 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0254.stratus.lvs.ebay.com:13562 freed by fetcher#7 in 761ms
2015-04-13 19:03:27,279 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0592.stratus.lvs.ebay.com:13562 freed by fetcher#13 in 766ms
2015-04-13 19:03:27,279 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#11 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,280 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0429.stratus.lvs.ebay.com:13562 freed by fetcher#11 in 763ms
2015-04-13 19:03:27,280 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000090_0 sent hash and received reply
2015-04-13 19:03:27,280 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000011_0,attempt_1426279437401_714565_m_000549_0 sent hash and received reply
2015-04-13 19:03:27,281 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,281 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,281 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0535.stratus.lvs.ebay.com:13562 freed by fetcher#3 in 3ms
2015-04-13 19:03:27,283 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0227.stratus.lvs.ebay.com:13562 freed by fetcher#15 in 764ms
2015-04-13 19:03:27,283 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0698.stratus.lvs.ebay.com:13562 freed by fetcher#9 in 776ms
2015-04-13 19:03:27,283 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0416.stratus.lvs.ebay.com:13562 freed by fetcher#18 in 767ms
2015-04-13 19:03:27,283 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0045.stratus.lvs.ebay.com:13562 freed by fetcher#22 in 768ms
2015-04-13 19:03:27,283 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0758.stratus.lvs.ebay.com:13562 freed by fetcher#16 in 52ms
2015-04-13 19:03:27,288 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000125_0 sent hash and received reply
2015-04-13 19:03:27,289 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#32 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,289 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0453.stratus.lvs.ebay.com:13562 freed by fetcher#32 in 19ms
2015-04-13 19:03:27,290 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 18091546 bytes from map-output for attempt_1426279437401_714565_m_000018_0
2015-04-13 19:03:27,290 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 18091546, inMemoryMapOutputs.size() -> 7, commitMemory -> 77215532, usedMemory ->1074369540
2015-04-13 19:03:27,290 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,290 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0461.stratus.lvs.ebay.com:13562 freed by fetcher#35 in 772ms
2015-04-13 19:03:27,297 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6430738 bytes from map-output for attempt_1426279437401_714565_m_000468_0
2015-04-13 19:03:27,297 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6430738, inMemoryMapOutputs.size() -> 8, commitMemory -> 95307078, usedMemory ->1074369540
2015-04-13 19:03:27,297 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,297 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0202.stratus.lvs.ebay.com:13562 freed by fetcher#23 in 780ms
2015-04-13 19:03:27,298 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 19906221 bytes from map-output for attempt_1426279437401_714565_m_000026_0
2015-04-13 19:03:27,298 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 19906221, inMemoryMapOutputs.size() -> 9, commitMemory -> 101737816, usedMemory ->1074369540
2015-04-13 19:03:27,298 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0394.stratus.lvs.ebay.com:13562 freed by fetcher#10 in 781ms
2015-04-13 19:03:27,302 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15303696 bytes from map-output for attempt_1426279437401_714565_m_000038_0
2015-04-13 19:03:27,302 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15303696, inMemoryMapOutputs.size() -> 10, commitMemory -> 121644037, usedMemory ->1074369540
2015-04-13 19:03:27,302 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0442.stratus.lvs.ebay.com:13562 freed by fetcher#19 in 797ms
2015-04-13 19:03:27,313 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 19627194 bytes from map-output for attempt_1426279437401_714565_m_000046_0
2015-04-13 19:03:27,314 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 19627194, inMemoryMapOutputs.size() -> 11, commitMemory -> 136947733, usedMemory ->1074369540
2015-04-13 19:03:27,314 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,314 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0754.stratus.lvs.ebay.com:13562 freed by fetcher#26 in 805ms
2015-04-13 19:03:27,324 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000303_0,attempt_1426279437401_714565_m_000191_0 sent hash and received reply
2015-04-13 19:03:27,324 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,324 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0473.stratus.lvs.ebay.com:13562 freed by fetcher#27 in 55ms
2015-04-13 19:03:27,327 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10389186 bytes from map-output for attempt_1426279437401_714565_m_000449_0
2015-04-13 19:03:27,327 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10389186, inMemoryMapOutputs.size() -> 12, commitMemory -> 156574927, usedMemory ->1074369540
2015-04-13 19:03:27,327 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0748.stratus.lvs.ebay.com:13562 freed by fetcher#6 in 820ms
2015-04-13 19:03:27,331 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12362739 bytes from map-output for attempt_1426279437401_714565_m_000236_0
2015-04-13 19:03:27,331 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12362739, inMemoryMapOutputs.size() -> 13, commitMemory -> 166964113, usedMemory ->1074369540
2015-04-13 19:03:27,332 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0391.stratus.lvs.ebay.com:13562 freed by fetcher#21 in 825ms
2015-04-13 19:03:27,332 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14461510 bytes from map-output for attempt_1426279437401_714565_m_000159_0
2015-04-13 19:03:27,332 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14461510, inMemoryMapOutputs.size() -> 14, commitMemory -> 179326852, usedMemory ->1074369540
2015-04-13 19:03:27,332 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,332 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0280.stratus.lvs.ebay.com:13562 freed by fetcher#1 in 827ms
2015-04-13 19:03:27,337 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13517595 bytes from map-output for attempt_1426279437401_714565_m_000272_0
2015-04-13 19:03:27,337 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13517595, inMemoryMapOutputs.size() -> 15, commitMemory -> 193788362, usedMemory ->1074369540
2015-04-13 19:03:27,337 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,337 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 freed by fetcher#14 in 830ms
2015-04-13 19:03:27,341 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000206_0,attempt_1426279437401_714565_m_000218_0 sent hash and received reply
2015-04-13 19:03:27,341 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,342 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0595.stratus.lvs.ebay.com:13562 freed by fetcher#34 in 70ms
2015-04-13 19:03:27,344 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 22923616 bytes from map-output for attempt_1426279437401_714565_m_000014_0
2015-04-13 19:03:27,344 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 22923616, inMemoryMapOutputs.size() -> 16, commitMemory -> 207305957, usedMemory ->1074369540
2015-04-13 19:03:27,345 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0395.stratus.lvs.ebay.com:13562 freed by fetcher#12 in 838ms
2015-04-13 19:03:27,354 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12017333 bytes from map-output for attempt_1426279437401_714565_m_000152_0
2015-04-13 19:03:27,355 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12017333, inMemoryMapOutputs.size() -> 17, commitMemory -> 230229573, usedMemory ->1074369540
2015-04-13 19:03:27,357 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,361 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0183.stratus.lvs.ebay.com:13562 freed by fetcher#2 in 848ms
2015-04-13 19:03:27,366 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 16713205 bytes from map-output for attempt_1426279437401_714565_m_000053_0
2015-04-13 19:03:27,366 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 16713205, inMemoryMapOutputs.size() -> 18, commitMemory -> 242246906, usedMemory ->1074369540
2015-04-13 19:03:27,367 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0226.stratus.lvs.ebay.com:13562 freed by fetcher#36 in 509ms
2015-04-13 19:03:27,395 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 19256070 bytes from map-output for attempt_1426279437401_714565_m_000016_0
2015-04-13 19:03:27,395 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 19256070, inMemoryMapOutputs.size() -> 19, commitMemory -> 258960111, usedMemory ->1074369540
2015-04-13 19:03:27,395 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,395 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0108.stratus.lvs.ebay.com:13562 freed by fetcher#17 in 533ms
2015-04-13 19:03:27,409 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 16530394 bytes from map-output for attempt_1426279437401_714565_m_000135_0
2015-04-13 19:03:27,409 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 16530394, inMemoryMapOutputs.size() -> 20, commitMemory -> 278216181, usedMemory ->1074369540
2015-04-13 19:03:27,410 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,410 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0230.stratus.lvs.ebay.com:13562 freed by fetcher#33 in 893ms
2015-04-13 19:03:27,437 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 18389537 bytes from map-output for attempt_1426279437401_714565_m_000050_0
2015-04-13 19:03:27,438 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 18389537, inMemoryMapOutputs.size() -> 21, commitMemory -> 294746575, usedMemory ->1074369540
2015-04-13 19:03:27,438 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,438 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0100.stratus.lvs.ebay.com:13562 freed by fetcher#31 in 221ms
2015-04-13 19:03:27,439 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13384743 bytes from map-output for attempt_1426279437401_714565_m_000271_0
2015-04-13 19:03:27,439 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13384743, inMemoryMapOutputs.size() -> 22, commitMemory -> 313136112, usedMemory ->1074369540
2015-04-13 19:03:27,439 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,439 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0234.stratus.lvs.ebay.com:13562 freed by fetcher#30 in 212ms
2015-04-13 19:03:27,468 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 22538204 bytes from map-output for attempt_1426279437401_714565_m_000017_0
2015-04-13 19:03:27,479 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 22538204, inMemoryMapOutputs.size() -> 23, commitMemory -> 326520855, usedMemory ->1074369540
2015-04-13 19:03:27,479 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 - MergeManager returned status WAIT ...
2015-04-13 19:03:27,480 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0340.stratus.lvs.ebay.com:13562 freed by fetcher#8 in 971ms
2015-04-13 19:03:28,534 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13050060 bytes from map-output for attempt_1426279437401_714565_m_000080_0
2015-04-13 19:03:28,534 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13050060, inMemoryMapOutputs.size() -> 24, commitMemory -> 349059059, usedMemory ->1074369540
2015-04-13 19:03:28,535 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0310.stratus.lvs.ebay.com:13562 freed by fetcher#4 in 2027ms
2015-04-13 19:03:36,891 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: attempt_1426279437401_714565_r_000318_0 Merge of the 54 files in-memory complete. Local file is /hadoop/6/scratch/local/usercache/b_pulsar_coe/appcache/application_1426279437401_714565/output/attempt_1426279437401_714565_r_000318_0/map_559.out.merged of size 221286020
2015-04-13 19:03:36,891 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0149.stratus.lvs.ebay.com:13562 with 3 to fetcher#4
2015-04-13 19:03:36,891 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0149.stratus.lvs.ebay.com:13562 to fetcher#4
2015-04-13 19:03:36,892 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0408.stratus.lvs.ebay.com:13562 with 2 to fetcher#8
2015-04-13 19:03:36,892 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0222.stratus.lvs.ebay.com:13562 with 1 to fetcher#17
2015-04-13 19:03:36,892 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0222.stratus.lvs.ebay.com:13562 to fetcher#17
2015-04-13 19:03:36,892 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0070.stratus.lvs.ebay.com:13562 with 1 to fetcher#33
2015-04-13 19:03:36,892 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0070.stratus.lvs.ebay.com:13562 to fetcher#33
2015-04-13 19:03:36,893 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0100.stratus.lvs.ebay.com:13562 with 3 to fetcher#2
2015-04-13 19:03:36,893 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0100.stratus.lvs.ebay.com:13562 to fetcher#2
2015-04-13 19:03:36,893 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0353.stratus.lvs.ebay.com:13562 with 1 to fetcher#6
2015-04-13 19:03:36,893 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0353.stratus.lvs.ebay.com:13562 to fetcher#6
2015-04-13 19:03:36,893 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0183.stratus.lvs.ebay.com:13562 with 1 to fetcher#30
2015-04-13 19:03:36,893 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0183.stratus.lvs.ebay.com:13562 to fetcher#30
2015-04-13 19:03:36,893 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0202.stratus.lvs.ebay.com:13562 with 4 to fetcher#10
2015-04-13 19:03:36,893 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0202.stratus.lvs.ebay.com:13562 to fetcher#10
2015-04-13 19:03:36,894 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0010.stratus.lvs.ebay.com:13562 with 1 to fetcher#31
2015-04-13 19:03:36,894 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0010.stratus.lvs.ebay.com:13562 to fetcher#31
2015-04-13 19:03:36,894 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0162.stratus.lvs.ebay.com:13562 with 1 to fetcher#32
2015-04-13 19:03:36,894 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0162.stratus.lvs.ebay.com:13562 to fetcher#32
2015-04-13 19:03:36,894 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0754.stratus.lvs.ebay.com:13562 with 1 to fetcher#15
2015-04-13 19:03:36,894 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0754.stratus.lvs.ebay.com:13562 to fetcher#15
2015-04-13 19:03:36,894 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0135.stratus.lvs.ebay.com:13562 with 2 to fetcher#24
2015-04-13 19:03:36,894 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0135.stratus.lvs.ebay.com:13562 to fetcher#24
2015-04-13 19:03:36,894 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000508_0 sent hash and received reply
2015-04-13 19:03:36,894 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0234.stratus.lvs.ebay.com:13562 with 4 to fetcher#35
2015-04-13 19:03:36,895 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0234.stratus.lvs.ebay.com:13562 to fetcher#35
2015-04-13 19:03:36,895 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0133.stratus.lvs.ebay.com:13562 with 1 to fetcher#19
2015-04-13 19:03:36,895 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0133.stratus.lvs.ebay.com:13562 to fetcher#19
2015-04-13 19:03:36,895 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0282.stratus.lvs.ebay.com:13562 with 8 to fetcher#23
2015-04-13 19:03:36,895 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 8 of 8 to lvsdpehdc25dn0282.stratus.lvs.ebay.com:13562 to fetcher#23
2015-04-13 19:03:36,895 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0701.stratus.lvs.ebay.com:13562 with 4 to fetcher#26
2015-04-13 19:03:36,895 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0701.stratus.lvs.ebay.com:13562 to fetcher#26
2015-04-13 19:03:36,895 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0043.stratus.lvs.ebay.com:13562 with 4 to fetcher#27
2015-04-13 19:03:36,895 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0043.stratus.lvs.ebay.com:13562 to fetcher#27
2015-04-13 19:03:36,896 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0319.stratus.lvs.ebay.com:13562 with 1 to fetcher#21
2015-04-13 19:03:36,896 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000065_0 sent hash and received reply
2015-04-13 19:03:36,896 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0319.stratus.lvs.ebay.com:13562 to fetcher#21
2015-04-13 19:03:36,896 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0044.stratus.lvs.ebay.com:13562 with 1 to fetcher#1
2015-04-13 19:03:36,896 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0044.stratus.lvs.ebay.com:13562 to fetcher#1
2015-04-13 19:03:36,896 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000403_0 sent hash and received reply
2015-04-13 19:03:36,897 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000194_0 sent hash and received reply
2015-04-13 19:03:36,897 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 about to shuffle output of map attempt_1426279437401_714565_m_000508_0 decomp: 8840921 len: 2982866 to MEMORY
2015-04-13 19:03:36,897 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0146.stratus.lvs.ebay.com:13562 with 2 to fetcher#14
2015-04-13 19:03:36,898 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0146.stratus.lvs.ebay.com:13562 to fetcher#14
2015-04-13 19:03:36,898 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0602.stratus.lvs.ebay.com:13562 with 2 to fetcher#34
2015-04-13 19:03:36,898 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0602.stratus.lvs.ebay.com:13562 to fetcher#34
2015-04-13 19:03:36,898 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0073.stratus.lvs.ebay.com:13562 with 1 to fetcher#12
2015-04-13 19:03:36,898 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0073.stratus.lvs.ebay.com:13562 to fetcher#12
2015-04-13 19:03:36,898 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0004.stratus.lvs.ebay.com:13562 with 2 to fetcher#36
2015-04-13 19:03:36,898 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000148_0,attempt_1426279437401_714565_m_000300_0,attempt_1426279437401_714565_m_000048_0 sent hash and received reply
2015-04-13 19:03:36,898 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000358_0 sent hash and received reply
2015-04-13 19:03:36,898 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000437_0,attempt_1426279437401_714565_m_000130_0,attempt_1426279437401_714565_m_000434_0 sent hash and received reply
2015-04-13 19:03:36,898 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000096_0 sent hash and received reply
2015-04-13 19:03:36,898 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0004.stratus.lvs.ebay.com:13562 to fetcher#36
2015-04-13 19:03:36,899 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000154_0 sent hash and received reply
2015-04-13 19:03:36,900 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000465_0,attempt_1426279437401_714565_m_000540_0,attempt_1426279437401_714565_m_000479_0,attempt_1426279437401_714565_m_000114_0 sent hash and received reply
2015-04-13 19:03:36,900 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000282_0,attempt_1426279437401_714565_m_000252_0,attempt_1426279437401_714565_m_000063_0,attempt_1426279437401_714565_m_000033_0 sent hash and received reply
2015-04-13 19:03:36,900 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0408.stratus.lvs.ebay.com:13562 to fetcher#8
2015-04-13 19:03:36,900 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000110_0,attempt_1426279437401_714565_m_000015_0 sent hash and received reply
2015-04-13 19:03:36,900 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0433.stratus.lvs.ebay.com:13562 with 1 to fetcher#20
2015-04-13 19:03:36,900 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0433.stratus.lvs.ebay.com:13562 to fetcher#20
2015-04-13 19:03:36,901 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 with 3 to fetcher#5
2015-04-13 19:03:36,901 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 to fetcher#5
2015-04-13 19:03:36,901 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#15 about to shuffle output of map attempt_1426279437401_714565_m_000194_0 decomp: 14423458 len: 4579049 to MEMORY
2015-04-13 19:03:36,901 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000005_0 sent hash and received reply
2015-04-13 19:03:36,901 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0429.stratus.lvs.ebay.com:13562 with 2 to fetcher#25
2015-04-13 19:03:36,901 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0429.stratus.lvs.ebay.com:13562 to fetcher#25
2015-04-13 19:03:36,902 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0535.stratus.lvs.ebay.com:13562 with 1 to fetcher#29
2015-04-13 19:03:36,902 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0535.stratus.lvs.ebay.com:13562 to fetcher#29
2015-04-13 19:03:36,902 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0453.stratus.lvs.ebay.com:13562 with 1 to fetcher#28
2015-04-13 19:03:36,902 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0453.stratus.lvs.ebay.com:13562 to fetcher#28
2015-04-13 19:03:36,902 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0108.stratus.lvs.ebay.com:13562 with 3 to fetcher#7
2015-04-13 19:03:36,902 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000212_0 sent hash and received reply
2015-04-13 19:03:36,902 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0108.stratus.lvs.ebay.com:13562 to fetcher#7
2015-04-13 19:03:36,902 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000088_0 sent hash and received reply
2015-04-13 19:03:36,902 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000239_0 sent hash and received reply
2015-04-13 19:03:36,902 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0280.stratus.lvs.ebay.com:13562 with 3 to fetcher#13
2015-04-13 19:03:36,902 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0280.stratus.lvs.ebay.com:13562 to fetcher#13
2015-04-13 19:03:36,902 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0725.stratus.lvs.ebay.com:13562 with 2 to fetcher#11
2015-04-13 19:03:36,902 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0725.stratus.lvs.ebay.com:13562 to fetcher#11
2015-04-13 19:03:36,902 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000528_0,attempt_1426279437401_714565_m_000444_0,attempt_1426279437401_714565_m_000351_0,attempt_1426279437401_714565_m_000234_0 sent hash and received reply
2015-04-13 19:03:36,903 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0503.stratus.lvs.ebay.com:13562 with 7 to fetcher#3
2015-04-13 19:03:36,903 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 7 of 7 to lvsdpehdc25dn0503.stratus.lvs.ebay.com:13562 to fetcher#3
2015-04-13 19:03:36,903 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000334_0,attempt_1426279437401_714565_m_000025_0 sent hash and received reply
2015-04-13 19:03:36,903 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#32 about to shuffle output of map attempt_1426279437401_714565_m_000403_0 decomp: 9627345 len: 3263109 to MEMORY
2015-04-13 19:03:36,903 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0026.stratus.lvs.ebay.com:13562 with 1 to fetcher#9
2015-04-13 19:03:36,904 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0026.stratus.lvs.ebay.com:13562 to fetcher#9
2015-04-13 19:03:36,904 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0340.stratus.lvs.ebay.com:13562 with 1 to fetcher#18
2015-04-13 19:03:36,904 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0340.stratus.lvs.ebay.com:13562 to fetcher#18
2015-04-13 19:03:36,904 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000090_0 sent hash and received reply
2015-04-13 19:03:36,904 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0473.stratus.lvs.ebay.com:13562 with 2 to fetcher#22
2015-04-13 19:03:36,904 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0473.stratus.lvs.ebay.com:13562 to fetcher#22
2015-04-13 19:03:36,904 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0448.stratus.lvs.ebay.com:13562 with 1 to fetcher#16
2015-04-13 19:03:36,904 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0448.stratus.lvs.ebay.com:13562 to fetcher#16
2015-04-13 19:03:36,904 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000125_0 sent hash and received reply
2015-04-13 19:03:36,904 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000424_0,attempt_1426279437401_714565_m_000432_0 sent hash and received reply
2015-04-13 19:03:36,904 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000171_0,attempt_1426279437401_714565_m_000028_0 sent hash and received reply
2015-04-13 19:03:36,905 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000515_0,attempt_1426279437401_714565_m_000121_0 sent hash and received reply
2015-04-13 19:03:36,906 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000402_0,attempt_1426279437401_714565_m_000561_0 sent hash and received reply
2015-04-13 19:03:36,906 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000117_0 sent hash and received reply
2015-04-13 19:03:36,908 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#6 about to shuffle output of map attempt_1426279437401_714565_m_000065_0 decomp: 15960564 len: 5382108 to MEMORY
2015-04-13 19:03:36,908 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000275_0 sent hash and received reply
2015-04-13 19:03:36,908 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000057_0 sent hash and received reply
2015-04-13 19:03:36,908 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000429_0,attempt_1426279437401_714565_m_000082_0,attempt_1426279437401_714565_m_000233_0 sent hash and received reply
2015-04-13 19:03:36,908 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000303_0,attempt_1426279437401_714565_m_000191_0 sent hash and received reply
2015-04-13 19:03:36,909 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000304_0,attempt_1426279437401_714565_m_000349_0,attempt_1426279437401_714565_m_000401_0 sent hash and received reply
2015-04-13 19:03:36,909 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000248_0,attempt_1426279437401_714565_m_000431_0,attempt_1426279437401_714565_m_000180_0 sent hash and received reply
2015-04-13 19:03:36,911 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000268_0,attempt_1426279437401_714565_m_000327_0,attempt_1426279437401_714565_m_000469_0,attempt_1426279437401_714565_m_000042_0 sent hash and received reply
2015-04-13 19:03:36,912 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 about to shuffle output of map attempt_1426279437401_714565_m_000117_0 decomp: 15628472 len: 4631573 to MEMORY
2015-04-13 19:03:36,912 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000243_0,attempt_1426279437401_714565_m_000253_0,attempt_1426279437401_714565_m_000277_0,attempt_1426279437401_714565_m_000476_0,attempt_1426279437401_714565_m_000269_0,attempt_1426279437401_714565_m_000086_0,attempt_1426279437401_714565_m_000201_0 sent hash and received reply
2015-04-13 19:03:36,914 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 about to shuffle output of map attempt_1426279437401_714565_m_000402_0 decomp: 9593256 len: 3056958 to MEMORY
2015-04-13 19:03:36,916 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#11 about to shuffle output of map attempt_1426279437401_714565_m_000515_0 decomp: 6337389 len: 1892483 to MEMORY
2015-04-13 19:03:36,921 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 about to shuffle output of map attempt_1426279437401_714565_m_000171_0 decomp: 12808987 len: 4035230 to MEMORY
2015-04-13 19:03:36,922 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000295_0,attempt_1426279437401_714565_m_000520_0,attempt_1426279437401_714565_m_000427_0,attempt_1426279437401_714565_m_000149_0,attempt_1426279437401_714565_m_000394_0,attempt_1426279437401_714565_m_000387_0,attempt_1426279437401_714565_m_000245_0,attempt_1426279437401_714565_m_000181_0 sent hash and received reply
2015-04-13 19:03:36,923 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#36 about to shuffle output of map attempt_1426279437401_714565_m_000424_0 decomp: 7652209 len: 2587594 to MEMORY
2015-04-13 19:03:36,927 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 about to shuffle output of map attempt_1426279437401_714565_m_000125_0 decomp: 15815527 len: 5008216 to MEMORY
2015-04-13 19:03:37,367 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000239_0 decomp: 11510472 len: 3940208 to MEMORY
2015-04-13 19:03:37,376 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 about to shuffle output of map attempt_1426279437401_714565_m_000212_0 decomp: 12610206 len: 4292670 to MEMORY
2015-04-13 19:03:37,377 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 about to shuffle output of map attempt_1426279437401_714565_m_000088_0 decomp: 19733454 len: 5878778 to MEMORY
2015-04-13 19:03:37,364 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 about to shuffle output of map attempt_1426279437401_714565_m_000528_0 decomp: 6996065 len: 2460263 to MEMORY
2015-04-13 19:03:37,362 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 about to shuffle output of map attempt_1426279437401_714565_m_000334_0 decomp: 10612941 len: 3775833 to MEMORY
2015-04-13 19:03:37,359 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000527_0 sent hash and received reply
2015-04-13 19:03:37,379 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9627345 bytes from map-output for attempt_1426279437401_714565_m_000403_0
2015-04-13 19:03:37,359 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 about to shuffle output of map attempt_1426279437401_714565_m_000090_0 decomp: 14659411 len: 5105981 to MEMORY
2015-04-13 19:03:37,386 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 about to shuffle output of map attempt_1426279437401_714565_m_000110_0 decomp: 12584455 len: 4140715 to MEMORY
2015-04-13 19:03:37,389 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 about to shuffle output of map attempt_1426279437401_714565_m_000282_0 decomp: 12064107 len: 4340906 to MEMORY
2015-04-13 19:03:37,383 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#12 about to shuffle output of map attempt_1426279437401_714565_m_000005_0 decomp: 25967193 len: 8466771 to MEMORY
2015-04-13 19:03:37,378 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8840921 bytes from map-output for attempt_1426279437401_714565_m_000508_0
2015-04-13 19:03:37,392 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#10 about to shuffle output of map attempt_1426279437401_714565_m_000465_0 decomp: 7419640 len: 2602088 to MEMORY
2015-04-13 19:03:37,395 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 about to shuffle output of map attempt_1426279437401_714565_m_000154_0 decomp: 14622461 len: 4834153 to MEMORY
2015-04-13 19:03:37,400 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 about to shuffle output of map attempt_1426279437401_714565_m_000148_0 decomp: 14573532 len: 4811861 to MEMORY
2015-04-13 19:03:37,404 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 about to shuffle output of map attempt_1426279437401_714565_m_000096_0 decomp: 15102633 len: 5549209 to MEMORY
2015-04-13 19:03:37,407 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#4 about to shuffle output of map attempt_1426279437401_714565_m_000437_0 decomp: 12511355 len: 4346291 to MEMORY
2015-04-13 19:03:37,410 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle output of map attempt_1426279437401_714565_m_000358_0 decomp: 11578087 len: 4129715 to MEMORY
2015-04-13 19:03:37,412 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9627345, inMemoryMapOutputs.size() -> 25, commitMemory -> 362109119, usedMemory ->681343259
2015-04-13 19:03:37,414 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 about to shuffle output of map attempt_1426279437401_714565_m_000527_0 decomp: 7168822 len: 2122452 to MEMORY
2015-04-13 19:03:37,415 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6337389 bytes from map-output for attempt_1426279437401_714565_m_000515_0
2015-04-13 19:03:37,416 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0162.stratus.lvs.ebay.com:13562 freed by fetcher#32 in 522ms
2015-04-13 19:03:37,416 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0758.stratus.lvs.ebay.com:13562 with 2 to fetcher#32
2015-04-13 19:03:37,416 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0758.stratus.lvs.ebay.com:13562 to fetcher#32
2015-04-13 19:03:37,417 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000295_0 decomp: 11873070 len: 4035960 to MEMORY
2015-04-13 19:03:37,420 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9593256 bytes from map-output for attempt_1426279437401_714565_m_000402_0
2015-04-13 19:03:37,420 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 about to shuffle output of map attempt_1426279437401_714565_m_000243_0 decomp: 12795507 len: 4563008 to MEMORY
2015-04-13 19:03:37,425 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000011_0,attempt_1426279437401_714565_m_000549_0 sent hash and received reply
2015-04-13 19:03:37,420 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9593256, inMemoryMapOutputs.size() -> 26, commitMemory -> 371736464, usedMemory ->713180658
2015-04-13 19:03:37,438 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 about to shuffle output of map attempt_1426279437401_714565_m_000268_0 decomp: 11572089 len: 4152502 to MEMORY
2015-04-13 19:03:37,441 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 about to shuffle output of map attempt_1426279437401_714565_m_000248_0 decomp: 9088474 len: 2915174 to MEMORY
2015-04-13 19:03:37,444 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 about to shuffle output of map attempt_1426279437401_714565_m_000304_0 decomp: 11253165 len: 3950609 to MEMORY
2015-04-13 19:03:37,447 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#22 about to shuffle output of map attempt_1426279437401_714565_m_000303_0 decomp: 11654829 len: 3610792 to MEMORY
2015-04-13 19:03:37,449 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 about to shuffle output of map attempt_1426279437401_714565_m_000429_0 decomp: 8268402 len: 2804016 to MEMORY
2015-04-13 19:03:37,453 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#16 about to shuffle output of map attempt_1426279437401_714565_m_000057_0 decomp: 16226157 len: 5161413 to MEMORY
2015-04-13 19:03:37,456 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#9 about to shuffle output of map attempt_1426279437401_714565_m_000275_0 decomp: 11189053 len: 3656922 to MEMORY
2015-04-13 19:03:37,457 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 about to shuffle output of map attempt_1426279437401_714565_m_000561_0 decomp: 3882825 len: 1252468 to MEMORY
2015-04-13 19:03:37,457 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6337389, inMemoryMapOutputs.size() -> 27, commitMemory -> 381329720, usedMemory ->796315652
2015-04-13 19:03:37,457 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8840921, inMemoryMapOutputs.size() -> 28, commitMemory -> 387667109, usedMemory ->796315652
2015-04-13 19:03:37,458 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0222.stratus.lvs.ebay.com:13562 freed by fetcher#17 in 566ms
2015-04-13 19:03:37,458 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0045.stratus.lvs.ebay.com:13562 with 2 to fetcher#17
2015-04-13 19:03:37,458 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0045.stratus.lvs.ebay.com:13562 to fetcher#17
2015-04-13 19:03:37,462 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#11 about to shuffle output of map attempt_1426279437401_714565_m_000121_0 decomp: 14870729 len: 5110315 to MEMORY
2015-04-13 19:03:37,463 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7419640 bytes from map-output for attempt_1426279437401_714565_m_000465_0
2015-04-13 19:03:37,463 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7419640, inMemoryMapOutputs.size() -> 29, commitMemory -> 396508030, usedMemory ->811186381
2015-04-13 19:03:37,468 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6996065 bytes from map-output for attempt_1426279437401_714565_m_000528_0
2015-04-13 19:03:37,478 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7652209 bytes from map-output for attempt_1426279437401_714565_m_000424_0
2015-04-13 19:03:37,480 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10612941 bytes from map-output for attempt_1426279437401_714565_m_000334_0
2015-04-13 19:03:37,481 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#10 about to shuffle output of map attempt_1426279437401_714565_m_000540_0 decomp: 7700668 len: 2829874 to MEMORY
2015-04-13 19:03:37,482 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 3882825 bytes from map-output for attempt_1426279437401_714565_m_000561_0
2015-04-13 19:03:37,484 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000328_0,attempt_1426279437401_714565_m_000530_0 sent hash and received reply
2015-04-13 19:03:37,492 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#32 about to shuffle output of map attempt_1426279437401_714565_m_000011_0 decomp: 24227801 len: 8485967 to MEMORY
2015-04-13 19:03:37,495 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6996065, inMemoryMapOutputs.size() -> 30, commitMemory -> 403927670, usedMemory ->853873479
2015-04-13 19:03:37,495 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 about to shuffle output of map attempt_1426279437401_714565_m_000328_0 decomp: 10758629 len: 4087669 to MEMORY
2015-04-13 19:03:37,496 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 3882825, inMemoryMapOutputs.size() -> 31, commitMemory -> 410923735, usedMemory ->853873479
2015-04-13 19:03:37,499 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10612941, inMemoryMapOutputs.size() -> 32, commitMemory -> 414806560, usedMemory ->865243693
2015-04-13 19:03:37,499 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7652209, inMemoryMapOutputs.size() -> 33, commitMemory -> 425419501, usedMemory ->865243693
2015-04-13 19:03:37,500 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0602.stratus.lvs.ebay.com:13562 freed by fetcher#34 in 602ms
2015-04-13 19:03:37,500 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0568.stratus.lvs.ebay.com:13562 with 2 to fetcher#34
2015-04-13 19:03:37,500 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0568.stratus.lvs.ebay.com:13562 to fetcher#34
2015-04-13 19:03:37,500 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000259_0,attempt_1426279437401_714565_m_000411_0 sent hash and received reply
2015-04-13 19:03:37,504 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15628472 bytes from map-output for attempt_1426279437401_714565_m_000117_0
2015-04-13 19:03:37,505 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#14 about to shuffle output of map attempt_1426279437401_714565_m_000025_0 decomp: 18185801 len: 6115647 to MEMORY
2015-04-13 19:03:37,507 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000132_0,attempt_1426279437401_714565_m_000142_0 sent hash and received reply
2015-04-13 19:03:37,499 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 about to shuffle output of map attempt_1426279437401_714565_m_000444_0 decomp: 11370214 len: 3865801 to MEMORY
2015-04-13 19:03:37,511 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 about to shuffle output of map attempt_1426279437401_714565_m_000132_0 decomp: 12875677 len: 4772164 to MEMORY
2015-04-13 19:03:37,514 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14423458 bytes from map-output for attempt_1426279437401_714565_m_000194_0
2015-04-13 19:03:37,522 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7168822 bytes from map-output for attempt_1426279437401_714565_m_000527_0
2015-04-13 19:03:37,529 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15628472, inMemoryMapOutputs.size() -> 34, commitMemory -> 433071710, usedMemory ->896305171
2015-04-13 19:03:37,529 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0340.stratus.lvs.ebay.com:13562 freed by fetcher#18 in 625ms
2015-04-13 19:03:37,530 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0303.stratus.lvs.ebay.com:13562 with 1 to fetcher#18
2015-04-13 19:03:37,530 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0303.stratus.lvs.ebay.com:13562 to fetcher#18
2015-04-13 19:03:37,532 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15960564 bytes from map-output for attempt_1426279437401_714565_m_000065_0
2015-04-13 19:03:37,532 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 about to shuffle output of map attempt_1426279437401_714565_m_000259_0 decomp: 10019061 len: 3067675 to MEMORY
2015-04-13 19:03:37,535 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#36 about to shuffle output of map attempt_1426279437401_714565_m_000432_0 decomp: 8759587 len: 3058323 to MEMORY
2015-04-13 19:03:37,536 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7168822, inMemoryMapOutputs.size() -> 35, commitMemory -> 448700182, usedMemory ->915083819
2015-04-13 19:03:37,537 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0433.stratus.lvs.ebay.com:13562 freed by fetcher#20 in 637ms
2015-04-13 19:03:37,537 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0657.stratus.lvs.ebay.com:13562 with 3 to fetcher#20
2015-04-13 19:03:37,537 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0657.stratus.lvs.ebay.com:13562 to fetcher#20
2015-04-13 19:03:37,538 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12808987 bytes from map-output for attempt_1426279437401_714565_m_000171_0
2015-04-13 19:03:37,538 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12808987, inMemoryMapOutputs.size() -> 36, commitMemory -> 455869004, usedMemory ->915083819
2015-04-13 19:03:37,540 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15815527 bytes from map-output for attempt_1426279437401_714565_m_000125_0
2015-04-13 19:03:37,544 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000378_0,attempt_1426279437401_714565_m_000283_0,attempt_1426279437401_714565_m_000452_0 sent hash and received reply
2015-04-13 19:03:37,551 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11510472 bytes from map-output for attempt_1426279437401_714565_m_000239_0
2015-04-13 19:03:37,553 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8268402 bytes from map-output for attempt_1426279437401_714565_m_000429_0
2015-04-13 19:03:37,558 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11578087 bytes from map-output for attempt_1426279437401_714565_m_000358_0
2015-04-13 19:03:37,561 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12584455 bytes from map-output for attempt_1426279437401_714565_m_000110_0
2015-04-13 19:03:37,561 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15102633 bytes from map-output for attempt_1426279437401_714565_m_000096_0
2015-04-13 19:03:37,562 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 about to shuffle output of map attempt_1426279437401_714565_m_000028_0 decomp: 20869623 len: 6721663 to MEMORY
2015-04-13 19:03:37,776 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12064107 bytes from map-output for attempt_1426279437401_714565_m_000282_0
2015-04-13 19:03:37,776 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14423458, inMemoryMapOutputs.size() -> 37, commitMemory -> 468677991, usedMemory ->946268082
2015-04-13 19:03:37,776 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0754.stratus.lvs.ebay.com:13562 freed by fetcher#15 in 882ms
2015-04-13 19:03:37,776 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0230.stratus.lvs.ebay.com:13562 with 1 to fetcher#15
2015-04-13 19:03:37,776 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0230.stratus.lvs.ebay.com:13562 to fetcher#15
2015-04-13 19:03:37,778 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12064107, inMemoryMapOutputs.size() -> 38, commitMemory -> 483101449, usedMemory ->946268082
2015-04-13 19:03:37,778 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15102633, inMemoryMapOutputs.size() -> 39, commitMemory -> 495165556, usedMemory ->946268082
2015-04-13 19:03:37,778 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0183.stratus.lvs.ebay.com:13562 freed by fetcher#30 in 885ms
2015-04-13 19:03:37,778 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14573532 bytes from map-output for attempt_1426279437401_714565_m_000148_0
2015-04-13 19:03:37,781 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14622461 bytes from map-output for attempt_1426279437401_714565_m_000154_0
2015-04-13 19:03:37,769 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9088474 bytes from map-output for attempt_1426279437401_714565_m_000248_0
2015-04-13 19:03:37,782 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 about to shuffle output of map attempt_1426279437401_714565_m_000252_0 decomp: 10941795 len: 3392764 to MEMORY
2015-04-13 19:03:37,783 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12610206 bytes from map-output for attempt_1426279437401_714565_m_000212_0
2015-04-13 19:03:37,775 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11654829 bytes from map-output for attempt_1426279437401_714565_m_000303_0
2015-04-13 19:03:37,784 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7700668 bytes from map-output for attempt_1426279437401_714565_m_000540_0
2015-04-13 19:03:37,771 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 about to shuffle output of map attempt_1426279437401_714565_m_000378_0 decomp: 10314640 len: 3171891 to MEMORY
2015-04-13 19:03:37,778 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0431.stratus.lvs.ebay.com:13562 with 2 to fetcher#30
2015-04-13 19:03:37,785 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0431.stratus.lvs.ebay.com:13562 to fetcher#30
2015-04-13 19:03:37,785 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000306_0 sent hash and received reply
2015-04-13 19:03:37,788 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12584455, inMemoryMapOutputs.size() -> 40, commitMemory -> 510268189, usedMemory ->965760426
2015-04-13 19:03:37,788 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11578087, inMemoryMapOutputs.size() -> 41, commitMemory -> 522852644, usedMemory ->965760426
2015-04-13 19:03:37,788 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#15 about to shuffle output of map attempt_1426279437401_714565_m_000306_0 decomp: 8550549 len: 2744184 to MEMORY
2015-04-13 19:03:37,788 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0044.stratus.lvs.ebay.com:13562 freed by fetcher#1 in 892ms
2015-04-13 19:03:37,788 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0121.stratus.lvs.ebay.com:13562 with 1 to fetcher#1
2015-04-13 19:03:37,788 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0121.stratus.lvs.ebay.com:13562 to fetcher#1
2015-04-13 19:03:37,793 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000202_0 sent hash and received reply
2015-04-13 19:03:37,793 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000373_0,attempt_1426279437401_714565_m_000317_0 sent hash and received reply
2015-04-13 19:03:37,797 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 about to shuffle output of map attempt_1426279437401_714565_m_000373_0 decomp: 11072706 len: 3252746 to MEMORY
2015-04-13 19:03:37,797 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 about to shuffle output of map attempt_1426279437401_714565_m_000015_0 decomp: 19399112 len: 6305266 to MEMORY
2015-04-13 19:03:37,800 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#1 about to shuffle output of map attempt_1426279437401_714565_m_000202_0 decomp: 12989359 len: 4299331 to MEMORY
2015-04-13 19:03:37,801 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8268402, inMemoryMapOutputs.size() -> 42, commitMemory -> 534430731, usedMemory ->1009221603
2015-04-13 19:03:37,801 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11510472, inMemoryMapOutputs.size() -> 43, commitMemory -> 542699133, usedMemory ->1009221603
2015-04-13 19:03:37,801 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0319.stratus.lvs.ebay.com:13562 freed by fetcher#21 in 905ms
2015-04-13 19:03:37,801 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0115.stratus.lvs.ebay.com:13562 with 2 to fetcher#21
2015-04-13 19:03:37,801 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0115.stratus.lvs.ebay.com:13562 to fetcher#21
2015-04-13 19:03:37,805 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11189053 bytes from map-output for attempt_1426279437401_714565_m_000275_0
2015-04-13 19:03:37,806 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 about to shuffle output of map attempt_1426279437401_714565_m_000082_0 decomp: 18661309 len: 5768485 to MEMORY
2015-04-13 19:03:37,806 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000056_0,attempt_1426279437401_714565_m_000009_0 sent hash and received reply
2015-04-13 19:03:37,806 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15815527, inMemoryMapOutputs.size() -> 44, commitMemory -> 554209605, usedMemory ->1027882912
2015-04-13 19:03:37,806 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0453.stratus.lvs.ebay.com:13562 freed by fetcher#28 in 904ms
2015-04-13 19:03:37,806 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0595.stratus.lvs.ebay.com:13562 with 2 to fetcher#28
2015-04-13 19:03:37,806 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0595.stratus.lvs.ebay.com:13562 to fetcher#28
2015-04-13 19:03:37,807 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11873070 bytes from map-output for attempt_1426279437401_714565_m_000295_0
2015-04-13 19:03:37,807 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11873070, inMemoryMapOutputs.size() -> 45, commitMemory -> 570025132, usedMemory ->1027882912
2015-04-13 19:03:37,813 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12795507 bytes from map-output for attempt_1426279437401_714565_m_000243_0
2015-04-13 19:03:37,813 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000056_0 decomp: 14484271 len: 5072760 to MEMORY
2015-04-13 19:03:37,813 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000206_0,attempt_1426279437401_714565_m_000218_0 sent hash and received reply
2015-04-13 19:03:37,813 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15960564, inMemoryMapOutputs.size() -> 46, commitMemory -> 581898202, usedMemory ->1049229970
2015-04-13 19:03:37,814 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0353.stratus.lvs.ebay.com:13562 freed by fetcher#6 in 921ms
2015-04-13 19:03:37,814 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0664.stratus.lvs.ebay.com:13562 with 1 to fetcher#6
2015-04-13 19:03:37,814 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0664.stratus.lvs.ebay.com:13562 to fetcher#6
2015-04-13 19:03:37,814 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000208_0 sent hash and received reply
2015-04-13 19:03:37,815 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14659411 bytes from map-output for attempt_1426279437401_714565_m_000090_0
2015-04-13 19:03:37,815 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000520_0 decomp: 6862787 len: 2410540 to MEMORY
2015-04-13 19:03:37,817 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000290_0 sent hash and received reply
2015-04-13 19:03:37,818 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 about to shuffle output of map attempt_1426279437401_714565_m_000208_0 decomp: 12253614 len: 4039534 to MEMORY
2015-04-13 19:03:37,821 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 about to shuffle output of map attempt_1426279437401_714565_m_000206_0 decomp: 11936073 len: 4228460 to MEMORY
2015-04-13 19:03:37,821 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11572089 bytes from map-output for attempt_1426279437401_714565_m_000268_0
2015-04-13 19:03:37,825 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#6 about to shuffle output of map attempt_1426279437401_714565_m_000290_0 decomp: 11285265 len: 3465010 to MEMORY
2015-04-13 19:03:37,825 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14659411, inMemoryMapOutputs.size() -> 47, commitMemory -> 597858766, usedMemory ->1084704922
2015-04-13 19:03:37,825 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0535.stratus.lvs.ebay.com:13562 freed by fetcher#29 in 923ms
2015-04-13 19:03:37,826 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0504.stratus.lvs.ebay.com:13562 with 2 to fetcher#29
2015-04-13 19:03:37,826 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0504.stratus.lvs.ebay.com:13562 to fetcher#29
2015-04-13 19:03:37,826 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12511355 bytes from map-output for attempt_1426279437401_714565_m_000437_0
2015-04-13 19:03:37,826 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12511355, inMemoryMapOutputs.size() -> 48, commitMemory -> 612518177, usedMemory ->1084704922
2015-04-13 19:03:37,827 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#4 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,827 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0149.stratus.lvs.ebay.com:13562 freed by fetcher#4 in 936ms
2015-04-13 19:03:37,827 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0089.stratus.lvs.ebay.com:13562 with 4 to fetcher#4
2015-04-13 19:03:37,827 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0089.stratus.lvs.ebay.com:13562 to fetcher#4
2015-04-13 19:03:37,834 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12795507, inMemoryMapOutputs.size() -> 49, commitMemory -> 625029532, usedMemory ->1084704922
2015-04-13 19:03:37,834 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11189053, inMemoryMapOutputs.size() -> 50, commitMemory -> 637825039, usedMemory ->1084704922
2015-04-13 19:03:37,835 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,835 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7700668, inMemoryMapOutputs.size() -> 51, commitMemory -> 649014092, usedMemory ->1084704922
2015-04-13 19:03:37,835 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0503.stratus.lvs.ebay.com:13562 freed by fetcher#3 in 932ms
2015-04-13 19:03:37,835 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#10 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,836 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11370214 bytes from map-output for attempt_1426279437401_714565_m_000444_0
2015-04-13 19:03:37,835 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0446.stratus.lvs.ebay.com:13562 with 1 to fetcher#3
2015-04-13 19:03:37,839 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0446.stratus.lvs.ebay.com:13562 to fetcher#3
2015-04-13 19:03:37,839 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11654829, inMemoryMapOutputs.size() -> 52, commitMemory -> 656714760, usedMemory ->1084704922
2015-04-13 19:03:37,839 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#22 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,840 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0473.stratus.lvs.ebay.com:13562 freed by fetcher#22 in 936ms
2015-04-13 19:03:37,840 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0149.stratus.lvs.ebay.com:13562 with 2 to fetcher#22
2015-04-13 19:03:37,840 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0149.stratus.lvs.ebay.com:13562 to fetcher#22
2015-04-13 19:03:37,840 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12610206, inMemoryMapOutputs.size() -> 53, commitMemory -> 668369589, usedMemory ->1084704922
2015-04-13 19:03:37,840 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0010.stratus.lvs.ebay.com:13562 freed by fetcher#31 in 946ms
2015-04-13 19:03:37,840 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0503.stratus.lvs.ebay.com:13562 with 6 to fetcher#31
2015-04-13 19:03:37,841 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 6 of 6 to lvsdpehdc25dn0503.stratus.lvs.ebay.com:13562 to fetcher#31
2015-04-13 19:03:37,841 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9088474, inMemoryMapOutputs.size() -> 54, commitMemory -> 680979795, usedMemory ->1084704922
2015-04-13 19:03:37,841 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14622461, inMemoryMapOutputs.size() -> 55, commitMemory -> 690068269, usedMemory ->1084704922
2015-04-13 19:03:37,841 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0133.stratus.lvs.ebay.com:13562 freed by fetcher#19 in 946ms
2015-04-13 19:03:37,841 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0473.stratus.lvs.ebay.com:13562 with 1 to fetcher#19
2015-04-13 19:03:37,841 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0473.stratus.lvs.ebay.com:13562 to fetcher#19
2015-04-13 19:03:37,842 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000413_0,attempt_1426279437401_714565_m_000286_0,attempt_1426279437401_714565_m_000103_0,attempt_1426279437401_714565_m_000353_0 sent hash and received reply
2015-04-13 19:03:37,842 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#4 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,842 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0089.stratus.lvs.ebay.com:13562 freed by fetcher#4 in 15ms
2015-04-13 19:03:37,842 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0461.stratus.lvs.ebay.com:13562 with 1 to fetcher#4
2015-04-13 19:03:37,842 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0461.stratus.lvs.ebay.com:13562 to fetcher#4
2015-04-13 19:03:37,842 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14573532, inMemoryMapOutputs.size() -> 56, commitMemory -> 704690730, usedMemory ->1084704922
2015-04-13 19:03:37,842 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Starting inMemoryMerger's merge since commitMemory=719264262 > mergeThreshold=708669632. Current usedMemory=1084704922
2015-04-13 19:03:37,843 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.MergeThread: InMemoryMerger - Thread to merge in-memory shuffled map-outputs: Starting merge with 56 segments, while ignoring 0 segments
2015-04-13 19:03:37,843 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,843 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0100.stratus.lvs.ebay.com:13562 freed by fetcher#2 in 950ms
2015-04-13 19:03:37,843 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,844 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 freed by fetcher#5 in 943ms
2015-04-13 19:03:37,844 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11370214, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->1084704922
2015-04-13 19:03:37,844 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,844 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000130_0,attempt_1426279437401_714565_m_000434_0 sent hash and received reply
2015-04-13 19:03:37,844 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0234.stratus.lvs.ebay.com:13562 freed by fetcher#35 in 949ms
2015-04-13 19:03:37,844 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#22 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,844 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0149.stratus.lvs.ebay.com:13562 freed by fetcher#22 in 4ms
2015-04-13 19:03:37,844 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0202.stratus.lvs.ebay.com:13562 freed by fetcher#10 in 951ms
2015-04-13 19:03:37,844 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0026.stratus.lvs.ebay.com:13562 freed by fetcher#9 in 940ms
2015-04-13 19:03:37,846 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000191_0 sent hash and received reply
2015-04-13 19:03:37,846 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,846 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11572089, inMemoryMapOutputs.size() -> 2, commitMemory -> 11370214, usedMemory ->1084704922
2015-04-13 19:03:37,846 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,847 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0043.stratus.lvs.ebay.com:13562 freed by fetcher#27 in 952ms
2015-04-13 19:03:37,847 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0473.stratus.lvs.ebay.com:13562 freed by fetcher#19 in 6ms
2015-04-13 19:03:37,847 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Initiating in-memory merge with 56 segments...
2015-04-13 19:03:37,847 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapred.Merger: Merging 56 sorted segments
2015-04-13 19:03:37,847 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 56 segments left of total size: 719262246 bytes
2015-04-13 19:03:37,848 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8759587 bytes from map-output for attempt_1426279437401_714565_m_000432_0
2015-04-13 19:03:37,848 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8759587, inMemoryMapOutputs.size() -> 3, commitMemory -> 22942303, usedMemory ->1084704922
2015-04-13 19:03:37,848 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0004.stratus.lvs.ebay.com:13562 freed by fetcher#36 in 950ms
2015-04-13 19:03:37,859 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000102_0 sent hash and received reply
2015-04-13 19:03:37,855 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12875677 bytes from map-output for attempt_1426279437401_714565_m_000132_0
2015-04-13 19:03:37,853 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000157_0 sent hash and received reply
2015-04-13 19:03:37,850 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000253_0,attempt_1426279437401_714565_m_000277_0,attempt_1426279437401_714565_m_000476_0,attempt_1426279437401_714565_m_000269_0,attempt_1426279437401_714565_m_000086_0,attempt_1426279437401_714565_m_000201_0 sent hash and received reply
2015-04-13 19:03:37,849 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11253165 bytes from map-output for attempt_1426279437401_714565_m_000304_0
2015-04-13 19:03:37,860 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12875677, inMemoryMapOutputs.size() -> 4, commitMemory -> 31701890, usedMemory ->1084704922
2015-04-13 19:03:37,860 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,861 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#4 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,861 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,861 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0503.stratus.lvs.ebay.com:13562 freed by fetcher#31 in 21ms
2015-04-13 19:03:37,861 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0568.stratus.lvs.ebay.com:13562 freed by fetcher#34 in 361ms
2015-04-13 19:03:37,862 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11253165, inMemoryMapOutputs.size() -> 5, commitMemory -> 44577567, usedMemory ->1084704922
2015-04-13 19:03:37,862 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0461.stratus.lvs.ebay.com:13562 freed by fetcher#4 in 20ms
2015-04-13 19:03:37,861 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,862 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,862 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0446.stratus.lvs.ebay.com:13562 freed by fetcher#3 in 23ms
2015-04-13 19:03:37,862 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0108.stratus.lvs.ebay.com:13562 freed by fetcher#7 in 960ms
2015-04-13 19:03:37,875 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 6862787 bytes from map-output for attempt_1426279437401_714565_m_000520_0
2015-04-13 19:03:37,876 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 6862787, inMemoryMapOutputs.size() -> 6, commitMemory -> 55830732, usedMemory ->1084704922
2015-04-13 19:03:37,876 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,876 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0282.stratus.lvs.ebay.com:13562 freed by fetcher#23 in 981ms
2015-04-13 19:03:37,878 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000219_0,attempt_1426279437401_714565_m_000105_0 sent hash and received reply
2015-04-13 19:03:37,879 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,879 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0504.stratus.lvs.ebay.com:13562 freed by fetcher#29 in 53ms
2015-04-13 19:03:37,883 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 19733454 bytes from map-output for attempt_1426279437401_714565_m_000088_0
2015-04-13 19:03:37,883 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 19733454, inMemoryMapOutputs.size() -> 7, commitMemory -> 62693519, usedMemory ->1084704922
2015-04-13 19:03:37,883 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0070.stratus.lvs.ebay.com:13562 freed by fetcher#33 in 991ms
2015-04-13 19:03:37,890 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14870729 bytes from map-output for attempt_1426279437401_714565_m_000121_0
2015-04-13 19:03:37,890 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8550549 bytes from map-output for attempt_1426279437401_714565_m_000306_0
2015-04-13 19:03:37,890 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8550549, inMemoryMapOutputs.size() -> 8, commitMemory -> 82426973, usedMemory ->1084704922
2015-04-13 19:03:37,890 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0230.stratus.lvs.ebay.com:13562 freed by fetcher#15 in 114ms
2015-04-13 19:03:37,890 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10314640 bytes from map-output for attempt_1426279437401_714565_m_000378_0
2015-04-13 19:03:37,897 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10314640, inMemoryMapOutputs.size() -> 9, commitMemory -> 90977522, usedMemory ->1084704922
2015-04-13 19:03:37,898 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#20 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,898 INFO [fetcher#20] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0657.stratus.lvs.ebay.com:13562 freed by fetcher#20 in 361ms
2015-04-13 19:03:37,909 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14870729, inMemoryMapOutputs.size() -> 10, commitMemory -> 101292162, usedMemory ->1084704922
2015-04-13 19:03:37,909 INFO [fetcher#11] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0725.stratus.lvs.ebay.com:13562 freed by fetcher#11 in 1007ms
2015-04-13 19:03:37,913 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 16226157 bytes from map-output for attempt_1426279437401_714565_m_000057_0
2015-04-13 19:03:37,914 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 16226157, inMemoryMapOutputs.size() -> 11, commitMemory -> 116162891, usedMemory ->1084704922
2015-04-13 19:03:37,914 INFO [fetcher#16] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0448.stratus.lvs.ebay.com:13562 freed by fetcher#16 in 1010ms
2015-04-13 19:03:37,919 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 25967193 bytes from map-output for attempt_1426279437401_714565_m_000005_0
2015-04-13 19:03:37,919 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 25967193, inMemoryMapOutputs.size() -> 12, commitMemory -> 132389048, usedMemory ->1084704922
2015-04-13 19:03:37,919 INFO [fetcher#12] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0073.stratus.lvs.ebay.com:13562 freed by fetcher#12 in 1021ms
2015-04-13 19:03:37,923 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11072706 bytes from map-output for attempt_1426279437401_714565_m_000373_0
2015-04-13 19:03:37,924 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11072706, inMemoryMapOutputs.size() -> 13, commitMemory -> 158356241, usedMemory ->1084704922
2015-04-13 19:03:37,924 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#30 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,924 INFO [fetcher#30] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0431.stratus.lvs.ebay.com:13562 freed by fetcher#30 in 139ms
2015-04-13 19:03:37,924 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11285265 bytes from map-output for attempt_1426279437401_714565_m_000290_0
2015-04-13 19:03:37,925 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11285265, inMemoryMapOutputs.size() -> 14, commitMemory -> 169428947, usedMemory ->1084704922
2015-04-13 19:03:37,925 INFO [fetcher#6] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0664.stratus.lvs.ebay.com:13562 freed by fetcher#6 in 111ms
2015-04-13 19:03:37,943 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10941795 bytes from map-output for attempt_1426279437401_714565_m_000252_0
2015-04-13 19:03:37,943 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10941795, inMemoryMapOutputs.size() -> 15, commitMemory -> 180714212, usedMemory ->1084704922
2015-04-13 19:03:37,944 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12989359 bytes from map-output for attempt_1426279437401_714565_m_000202_0
2015-04-13 19:03:37,944 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,944 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12989359, inMemoryMapOutputs.size() -> 16, commitMemory -> 191656007, usedMemory ->1084704922
2015-04-13 19:03:37,944 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0701.stratus.lvs.ebay.com:13562 freed by fetcher#26 in 1049ms
2015-04-13 19:03:37,949 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11936073 bytes from map-output for attempt_1426279437401_714565_m_000206_0
2015-04-13 19:03:37,949 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11936073, inMemoryMapOutputs.size() -> 17, commitMemory -> 204645366, usedMemory ->1084704922
2015-04-13 19:03:37,950 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#28 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,950 INFO [fetcher#28] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0595.stratus.lvs.ebay.com:13562 freed by fetcher#28 in 144ms
2015-04-13 19:03:37,951 INFO [fetcher#1] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0121.stratus.lvs.ebay.com:13562 freed by fetcher#1 in 163ms
2015-04-13 19:03:37,950 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 18185801 bytes from map-output for attempt_1426279437401_714565_m_000025_0
2015-04-13 19:03:37,953 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 18185801, inMemoryMapOutputs.size() -> 18, commitMemory -> 216581439, usedMemory ->1084704922
2015-04-13 19:03:37,953 INFO [fetcher#14] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0146.stratus.lvs.ebay.com:13562 freed by fetcher#14 in 1055ms
2015-04-13 19:03:37,971 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 24227801 bytes from map-output for attempt_1426279437401_714565_m_000011_0
2015-04-13 19:03:37,971 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 24227801, inMemoryMapOutputs.size() -> 19, commitMemory -> 234767240, usedMemory ->1084704922
2015-04-13 19:03:37,971 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#32 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,971 INFO [fetcher#32] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0758.stratus.lvs.ebay.com:13562 freed by fetcher#32 in 555ms
2015-04-13 19:03:37,975 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14484271 bytes from map-output for attempt_1426279437401_714565_m_000056_0
2015-04-13 19:03:37,975 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14484271, inMemoryMapOutputs.size() -> 20, commitMemory -> 258995041, usedMemory ->1084704922
2015-04-13 19:03:37,975 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 - MergeManager returned status WAIT ...
2015-04-13 19:03:37,975 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0115.stratus.lvs.ebay.com:13562 freed by fetcher#21 in 174ms
2015-04-13 19:03:37,994 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 20869623 bytes from map-output for attempt_1426279437401_714565_m_000028_0
2015-04-13 19:03:37,994 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 20869623, inMemoryMapOutputs.size() -> 21, commitMemory -> 273479312, usedMemory ->1084704922
2015-04-13 19:03:37,994 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0408.stratus.lvs.ebay.com:13562 freed by fetcher#8 in 1102ms
2015-04-13 19:03:38,012 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 19399112 bytes from map-output for attempt_1426279437401_714565_m_000015_0
2015-04-13 19:03:38,012 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 19399112, inMemoryMapOutputs.size() -> 22, commitMemory -> 294348935, usedMemory ->1084704922
2015-04-13 19:03:38,012 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0135.stratus.lvs.ebay.com:13562 freed by fetcher#24 in 1118ms
2015-04-13 19:03:38,014 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 18661309 bytes from map-output for attempt_1426279437401_714565_m_000082_0
2015-04-13 19:03:38,014 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 18661309, inMemoryMapOutputs.size() -> 23, commitMemory -> 313748047, usedMemory ->1084704922
2015-04-13 19:03:38,014 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 - MergeManager returned status WAIT ...
2015-04-13 19:03:38,014 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0280.stratus.lvs.ebay.com:13562 freed by fetcher#13 in 1112ms
2015-04-13 19:03:38,156 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12253614 bytes from map-output for attempt_1426279437401_714565_m_000208_0
2015-04-13 19:03:38,156 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12253614, inMemoryMapOutputs.size() -> 24, commitMemory -> 332409356, usedMemory ->1084704922
2015-04-13 19:03:38,156 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0303.stratus.lvs.ebay.com:13562 freed by fetcher#18 in 626ms
2015-04-13 19:03:38,178 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10758629 bytes from map-output for attempt_1426279437401_714565_m_000328_0
2015-04-13 19:03:38,178 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10758629, inMemoryMapOutputs.size() -> 25, commitMemory -> 344662970, usedMemory ->1084704922
2015-04-13 19:03:38,178 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 - MergeManager returned status WAIT ...
2015-04-13 19:03:38,179 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0045.stratus.lvs.ebay.com:13562 freed by fetcher#17 in 721ms
2015-04-13 19:03:39,452 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10019061 bytes from map-output for attempt_1426279437401_714565_m_000259_0
2015-04-13 19:03:39,452 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10019061, inMemoryMapOutputs.size() -> 26, commitMemory -> 355421599, usedMemory ->1084704922
2015-04-13 19:03:39,452 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 - MergeManager returned status WAIT ...
2015-04-13 19:03:39,452 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0429.stratus.lvs.ebay.com:13562 freed by fetcher#25 in 2551ms
2015-04-13 19:03:48,693 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: attempt_1426279437401_714565_r_000318_0 Merge of the 56 files in-memory complete. Local file is /hadoop/7/scratch/local/usercache/b_pulsar_coe/appcache/application_1426279437401_714565/output/attempt_1426279437401_714565_r_000318_0/map_561.out.merged of size 228289076
2015-04-13 19:03:48,693 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0100.stratus.lvs.ebay.com:13562 with 2 to fetcher#25
2015-04-13 19:03:48,693 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0089.stratus.lvs.ebay.com:13562 with 4 to fetcher#21
2015-04-13 19:03:48,693 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0149.stratus.lvs.ebay.com:13562 with 2 to fetcher#26
2015-04-13 19:03:48,693 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0149.stratus.lvs.ebay.com:13562 to fetcher#26
2015-04-13 19:03:48,694 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0504.stratus.lvs.ebay.com:13562 with 2 to fetcher#15
2015-04-13 19:03:48,694 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0504.stratus.lvs.ebay.com:13562 to fetcher#15
2015-04-13 19:03:48,694 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0431.stratus.lvs.ebay.com:13562 with 1 to fetcher#33
2015-04-13 19:03:48,694 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0431.stratus.lvs.ebay.com:13562 to fetcher#33
2015-04-13 19:03:48,694 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0574.stratus.lvs.ebay.com:13562 with 1 to fetcher#31
2015-04-13 19:03:48,694 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0574.stratus.lvs.ebay.com:13562 to fetcher#31
2015-04-13 19:03:48,695 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0234.stratus.lvs.ebay.com:13562 with 2 to fetcher#10
2015-04-13 19:03:48,695 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0234.stratus.lvs.ebay.com:13562 to fetcher#10
2015-04-13 19:03:48,695 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0282.stratus.lvs.ebay.com:13562 with 6 to fetcher#8
2015-04-13 19:03:48,695 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 6 of 6 to lvsdpehdc25dn0282.stratus.lvs.ebay.com:13562 to fetcher#8
2015-04-13 19:03:48,695 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0446.stratus.lvs.ebay.com:13562 with 1 to fetcher#22
2015-04-13 19:03:48,695 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 with 2 to fetcher#5
2015-04-13 19:03:48,695 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 to fetcher#5
2015-04-13 19:03:48,695 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0595.stratus.lvs.ebay.com:13562 with 1 to fetcher#2
2015-04-13 19:03:48,695 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0595.stratus.lvs.ebay.com:13562 to fetcher#2
2015-04-13 19:03:48,696 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0568.stratus.lvs.ebay.com:13562 with 1 to fetcher#24
2015-04-13 19:03:48,696 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0568.stratus.lvs.ebay.com:13562 to fetcher#24
2015-04-13 19:03:48,696 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0227.stratus.lvs.ebay.com:13562 with 3 to fetcher#13
2015-04-13 19:03:48,696 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0227.stratus.lvs.ebay.com:13562 to fetcher#13
2015-04-13 19:03:48,696 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0461.stratus.lvs.ebay.com:13562 with 1 to fetcher#18
2015-04-13 19:03:48,696 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0461.stratus.lvs.ebay.com:13562 to fetcher#18
2015-04-13 19:03:48,697 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0280.stratus.lvs.ebay.com:13562 with 1 to fetcher#17
2015-04-13 19:03:48,697 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0280.stratus.lvs.ebay.com:13562 to fetcher#17
2015-04-13 19:03:48,697 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0446.stratus.lvs.ebay.com:13562 to fetcher#22
2015-04-13 19:03:48,697 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0115.stratus.lvs.ebay.com:13562 with 1 to fetcher#35
2015-04-13 19:03:48,697 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0115.stratus.lvs.ebay.com:13562 to fetcher#35
2015-04-13 19:03:48,697 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0701.stratus.lvs.ebay.com:13562 with 2 to fetcher#9
2015-04-13 19:03:48,697 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0701.stratus.lvs.ebay.com:13562 to fetcher#9
2015-04-13 19:03:48,697 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0045.stratus.lvs.ebay.com:13562 with 1 to fetcher#27
2015-04-13 19:03:48,697 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0045.stratus.lvs.ebay.com:13562 to fetcher#27
2015-04-13 19:03:48,698 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0108.stratus.lvs.ebay.com:13562 with 2 to fetcher#19
2015-04-13 19:03:48,698 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0108.stratus.lvs.ebay.com:13562 to fetcher#19
2015-04-13 19:03:48,698 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0473.stratus.lvs.ebay.com:13562 with 1 to fetcher#36
2015-04-13 19:03:48,698 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0473.stratus.lvs.ebay.com:13562 to fetcher#36
2015-04-13 19:03:48,698 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0202.stratus.lvs.ebay.com:13562 with 2 to fetcher#34
2015-04-13 19:03:48,698 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0202.stratus.lvs.ebay.com:13562 to fetcher#34
2015-04-13 19:03:48,698 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0758.stratus.lvs.ebay.com:13562 with 1 to fetcher#4
2015-04-13 19:03:48,698 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0758.stratus.lvs.ebay.com:13562 to fetcher#4
2015-04-13 19:03:48,699 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000130_0,attempt_1426279437401_714565_m_000434_0 sent hash and received reply
2015-04-13 19:03:48,699 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000219_0,attempt_1426279437401_714565_m_000105_0 sent hash and received reply
2015-04-13 19:03:48,699 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0429.stratus.lvs.ebay.com:13562 with 1 to fetcher#3
2015-04-13 19:03:48,699 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0043.stratus.lvs.ebay.com:13562 with 3 to fetcher#7
2015-04-13 19:03:48,699 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 3 of 3 to lvsdpehdc25dn0043.stratus.lvs.ebay.com:13562 to fetcher#7
2015-04-13 19:03:48,699 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000102_0 sent hash and received reply
2015-04-13 19:03:48,699 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0503.stratus.lvs.ebay.com:13562 with 6 to fetcher#23
2015-04-13 19:03:48,699 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 6 of 6 to lvsdpehdc25dn0503.stratus.lvs.ebay.com:13562 to fetcher#23
2015-04-13 19:03:48,700 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000233_0 sent hash and received reply
2015-04-13 19:03:48,700 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000234_0,attempt_1426279437401_714565_m_000351_0 sent hash and received reply
2015-04-13 19:03:48,700 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000549_0 sent hash and received reply
2015-04-13 19:03:48,700 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000218_0 sent hash and received reply
2015-04-13 19:03:48,700 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: Assigning lvsdpehdc25dn0657.stratus.lvs.ebay.com:13562 with 2 to fetcher#29
2015-04-13 19:03:48,700 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000055_0 sent hash and received reply
2015-04-13 19:03:48,701 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0657.stratus.lvs.ebay.com:13562 to fetcher#29
2015-04-13 19:03:48,701 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000009_0 sent hash and received reply
2015-04-13 19:03:48,701 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000063_0,attempt_1426279437401_714565_m_000033_0 sent hash and received reply
2015-04-13 19:03:48,701 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000530_0 sent hash and received reply
2015-04-13 19:03:48,701 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 4 of 4 to lvsdpehdc25dn0089.stratus.lvs.ebay.com:13562 to fetcher#21
2015-04-13 19:03:48,702 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000157_0 sent hash and received reply
2015-04-13 19:03:48,702 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 about to shuffle output of map attempt_1426279437401_714565_m_000130_0 decomp: 12684619 len: 4001561 to MEMORY
2015-04-13 19:03:48,703 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000142_0 sent hash and received reply
2015-04-13 19:03:48,704 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000191_0 sent hash and received reply
2015-04-13 19:03:48,704 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000349_0,attempt_1426279437401_714565_m_000401_0 sent hash and received reply
2015-04-13 19:03:48,704 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000317_0 sent hash and received reply
2015-04-13 19:03:48,705 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000327_0,attempt_1426279437401_714565_m_000042_0,attempt_1426279437401_714565_m_000469_0 sent hash and received reply
2015-04-13 19:03:48,705 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#18 about to shuffle output of map attempt_1426279437401_714565_m_000157_0 decomp: 11685704 len: 3836120 to MEMORY
2015-04-13 19:03:48,706 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000283_0,attempt_1426279437401_714565_m_000452_0 sent hash and received reply
2015-04-13 19:03:48,707 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000479_0,attempt_1426279437401_714565_m_000114_0 sent hash and received reply
2015-04-13 19:03:48,707 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#27 about to shuffle output of map attempt_1426279437401_714565_m_000530_0 decomp: 5167168 len: 1940312 to MEMORY
2015-04-13 19:03:48,707 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 2 of 2 to lvsdpehdc25dn0100.stratus.lvs.ebay.com:13562 to fetcher#25
2015-04-13 19:03:48,707 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000427_0,attempt_1426279437401_714565_m_000149_0,attempt_1426279437401_714565_m_000394_0,attempt_1426279437401_714565_m_000245_0,attempt_1426279437401_714565_m_000387_0,attempt_1426279437401_714565_m_000181_0 sent hash and received reply
2015-04-13 19:03:48,708 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: assigned 1 of 1 to lvsdpehdc25dn0429.stratus.lvs.ebay.com:13562 to fetcher#3
2015-04-13 19:03:48,708 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000253_0,attempt_1426279437401_714565_m_000277_0,attempt_1426279437401_714565_m_000476_0,attempt_1426279437401_714565_m_000269_0,attempt_1426279437401_714565_m_000086_0,attempt_1426279437401_714565_m_000201_0 sent hash and received reply
2015-04-13 19:03:48,708 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000413_0,attempt_1426279437401_714565_m_000286_0,attempt_1426279437401_714565_m_000103_0,attempt_1426279437401_714565_m_000353_0 sent hash and received reply
2015-04-13 19:03:48,712 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#9 about to shuffle output of map attempt_1426279437401_714565_m_000063_0 decomp: 17458290 len: 5635996 to MEMORY
2015-04-13 19:03:48,717 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000300_0,attempt_1426279437401_714565_m_000048_0 sent hash and received reply
2015-04-13 19:03:48,719 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000180_0,attempt_1426279437401_714565_m_000431_0 sent hash and received reply
2015-04-13 19:03:48,723 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#31 about to shuffle output of map attempt_1426279437401_714565_m_000055_0 decomp: 15380339 len: 4796386 to MEMORY
2015-04-13 19:03:48,886 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#35 about to shuffle output of map attempt_1426279437401_714565_m_000009_0 decomp: 26453497 len: 9059103 to MEMORY
2015-04-13 19:03:48,887 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#4 about to shuffle output of map attempt_1426279437401_714565_m_000549_0 decomp: 4272526 len: 1202160 to MEMORY
2015-04-13 19:03:48,885 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#2 about to shuffle output of map attempt_1426279437401_714565_m_000218_0 decomp: 11653078 len: 3369505 to MEMORY
2015-04-13 19:03:48,881 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000166_0,attempt_1426279437401_714565_m_000184_0,attempt_1426279437401_714565_m_000153_0 sent hash and received reply
2015-04-13 19:03:48,893 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 about to shuffle output of map attempt_1426279437401_714565_m_000166_0 decomp: 17351846 len: 6103594 to MEMORY
2015-04-13 19:03:48,894 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 5167168 bytes from map-output for attempt_1426279437401_714565_m_000530_0
2015-04-13 19:03:48,903 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#17 about to shuffle output of map attempt_1426279437401_714565_m_000233_0 decomp: 12260404 len: 3967027 to MEMORY
2015-04-13 19:03:48,904 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#10 about to shuffle output of map attempt_1426279437401_714565_m_000234_0 decomp: 15583127 len: 5326465 to MEMORY
2015-04-13 19:03:48,905 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 4272526 bytes from map-output for attempt_1426279437401_714565_m_000549_0
2015-04-13 19:03:48,907 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#22 about to shuffle output of map attempt_1426279437401_714565_m_000102_0 decomp: 13829480 len: 4305111 to MEMORY
2015-04-13 19:03:48,910 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#15 about to shuffle output of map attempt_1426279437401_714565_m_000219_0 decomp: 11793619 len: 3913227 to MEMORY
2015-04-13 19:03:48,920 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 4272526, inMemoryMapOutputs.size() -> 27, commitMemory -> 365440660, usedMemory ->541014357
2015-04-13 19:03:48,920 INFO [fetcher#4] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0758.stratus.lvs.ebay.com:13562 freed by fetcher#4 in 222ms
2015-04-13 19:03:48,924 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 about to shuffle output of map attempt_1426279437401_714565_m_000180_0 decomp: 15218576 len: 5098795 to MEMORY
2015-04-13 19:03:48,928 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 about to shuffle output of map attempt_1426279437401_714565_m_000300_0 decomp: 12262804 len: 4102031 to MEMORY
2015-04-13 19:03:48,931 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000413_0 decomp: 12029927 len: 4183611 to MEMORY
2015-04-13 19:03:48,934 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000253_0 decomp: 11264804 len: 4245725 to MEMORY
2015-04-13 19:03:48,937 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 about to shuffle output of map attempt_1426279437401_714565_m_000427_0 decomp: 8936263 len: 3328760 to MEMORY
2015-04-13 19:03:48,939 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 about to shuffle output of map attempt_1426279437401_714565_m_000479_0 decomp: 7710511 len: 2605746 to MEMORY
2015-04-13 19:03:48,943 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 about to shuffle output of map attempt_1426279437401_714565_m_000283_0 decomp: 10880786 len: 3341903 to MEMORY
2015-04-13 19:03:48,945 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 about to shuffle output of map attempt_1426279437401_714565_m_000327_0 decomp: 8452886 len: 2294337 to MEMORY
2015-04-13 19:03:48,948 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#33 about to shuffle output of map attempt_1426279437401_714565_m_000317_0 decomp: 11292392 len: 3438618 to MEMORY
2015-04-13 19:03:48,951 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 about to shuffle output of map attempt_1426279437401_714565_m_000349_0 decomp: 11056051 len: 3801531 to MEMORY
2015-04-13 19:03:48,953 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: for url=13562/mapOutput?job=job_1426279437401_714565&reduce=318&map=attempt_1426279437401_714565_m_000411_0 sent hash and received reply
2015-04-13 19:03:48,955 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#36 about to shuffle output of map attempt_1426279437401_714565_m_000191_0 decomp: 10979891 len: 3328206 to MEMORY
2015-04-13 19:03:48,959 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#24 about to shuffle output of map attempt_1426279437401_714565_m_000142_0 decomp: 14704434 len: 5123053 to MEMORY
2015-04-13 19:03:48,961 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 5167168, inMemoryMapOutputs.size() -> 28, commitMemory -> 369713186, usedMemory ->685162638
2015-04-13 19:03:48,962 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#3 about to shuffle output of map attempt_1426279437401_714565_m_000411_0 decomp: 9358956 len: 3077560 to MEMORY
2015-04-13 19:03:48,962 INFO [fetcher#27] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0045.stratus.lvs.ebay.com:13562 freed by fetcher#27 in 265ms
2015-04-13 19:03:48,965 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12684619 bytes from map-output for attempt_1426279437401_714565_m_000130_0
2015-04-13 19:03:48,966 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12684619, inMemoryMapOutputs.size() -> 29, commitMemory -> 374880354, usedMemory ->685162638
2015-04-13 19:03:48,984 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#26 about to shuffle output of map attempt_1426279437401_714565_m_000434_0 decomp: 11059158 len: 3105783 to MEMORY
2015-04-13 19:03:48,991 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15380339 bytes from map-output for attempt_1426279437401_714565_m_000055_0
2015-04-13 19:03:48,991 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15380339, inMemoryMapOutputs.size() -> 30, commitMemory -> 387564973, usedMemory ->696221796
2015-04-13 19:03:48,991 INFO [fetcher#31] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0574.stratus.lvs.ebay.com:13562 freed by fetcher#31 in 297ms
2015-04-13 19:03:49,004 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 17458290 bytes from map-output for attempt_1426279437401_714565_m_000063_0
2015-04-13 19:03:49,004 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 17458290, inMemoryMapOutputs.size() -> 31, commitMemory -> 402945312, usedMemory ->696221796
2015-04-13 19:03:49,009 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11653078 bytes from map-output for attempt_1426279437401_714565_m_000218_0
2015-04-13 19:03:49,015 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11653078, inMemoryMapOutputs.size() -> 32, commitMemory -> 420403602, usedMemory ->714662780
2015-04-13 19:03:49,015 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0595.stratus.lvs.ebay.com:13562 freed by fetcher#2 in 320ms
2015-04-13 19:03:49,015 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#9 about to shuffle output of map attempt_1426279437401_714565_m_000033_0 decomp: 18440984 len: 5767029 to MEMORY
2015-04-13 19:03:49,020 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8452886 bytes from map-output for attempt_1426279437401_714565_m_000327_0
2015-04-13 19:03:49,021 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8452886, inMemoryMapOutputs.size() -> 33, commitMemory -> 432056680, usedMemory ->714662780
2015-04-13 19:03:49,026 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11685704 bytes from map-output for attempt_1426279437401_714565_m_000157_0
2015-04-13 19:03:49,028 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12029927 bytes from map-output for attempt_1426279437401_714565_m_000413_0
2015-04-13 19:03:49,031 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12260404 bytes from map-output for attempt_1426279437401_714565_m_000233_0
2015-04-13 19:03:49,031 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 7710511 bytes from map-output for attempt_1426279437401_714565_m_000479_0
2015-04-13 19:03:49,032 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11685704, inMemoryMapOutputs.size() -> 34, commitMemory -> 440509566, usedMemory ->733446168
2015-04-13 19:03:49,032 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 about to shuffle output of map attempt_1426279437401_714565_m_000042_0 decomp: 18783388 len: 6545666 to MEMORY
2015-04-13 19:03:49,032 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 7710511, inMemoryMapOutputs.size() -> 35, commitMemory -> 452195270, usedMemory ->733446168
2015-04-13 19:03:49,032 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12260404, inMemoryMapOutputs.size() -> 36, commitMemory -> 459905781, usedMemory ->733446168
2015-04-13 19:03:49,033 INFO [fetcher#17] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0280.stratus.lvs.ebay.com:13562 freed by fetcher#17 in 336ms
2015-04-13 19:03:49,033 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12262804 bytes from map-output for attempt_1426279437401_714565_m_000300_0
2015-04-13 19:03:49,036 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#34 about to shuffle output of map attempt_1426279437401_714565_m_000114_0 decomp: 14528636 len: 5214090 to MEMORY
2015-04-13 19:03:49,038 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11292392 bytes from map-output for attempt_1426279437401_714565_m_000317_0
2015-04-13 19:03:49,042 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12262804, inMemoryMapOutputs.size() -> 37, commitMemory -> 472166185, usedMemory ->747974804
2015-04-13 19:03:49,042 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12029927, inMemoryMapOutputs.size() -> 38, commitMemory -> 484428989, usedMemory ->747974804
2015-04-13 19:03:49,047 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#25 about to shuffle output of map attempt_1426279437401_714565_m_000048_0 decomp: 17768142 len: 6076650 to MEMORY
2015-04-13 19:03:49,050 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11292392, inMemoryMapOutputs.size() -> 39, commitMemory -> 496458916, usedMemory ->775604210
2015-04-13 19:03:49,050 INFO [fetcher#18] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0461.stratus.lvs.ebay.com:13562 freed by fetcher#18 in 354ms
2015-04-13 19:03:49,050 INFO [fetcher#33] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0431.stratus.lvs.ebay.com:13562 freed by fetcher#33 in 356ms
2015-04-13 19:03:49,050 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000286_0 decomp: 9861264 len: 3684560 to MEMORY
2015-04-13 19:03:49,050 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11793619 bytes from map-output for attempt_1426279437401_714565_m_000219_0
2015-04-13 19:03:49,056 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11793619, inMemoryMapOutputs.size() -> 40, commitMemory -> 507751308, usedMemory ->775604210
2015-04-13 19:03:49,057 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8936263 bytes from map-output for attempt_1426279437401_714565_m_000427_0
2015-04-13 19:03:49,060 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#15 about to shuffle output of map attempt_1426279437401_714565_m_000105_0 decomp: 13919331 len: 4705495 to MEMORY
2015-04-13 19:03:49,069 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13829480 bytes from map-output for attempt_1426279437401_714565_m_000102_0
2015-04-13 19:03:49,077 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8936263, inMemoryMapOutputs.size() -> 41, commitMemory -> 519544927, usedMemory ->789523541
2015-04-13 19:03:49,080 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10979891 bytes from map-output for attempt_1426279437401_714565_m_000191_0
2015-04-13 19:03:49,081 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 about to shuffle output of map attempt_1426279437401_714565_m_000149_0 decomp: 13595669 len: 4543778 to MEMORY
2015-04-13 19:03:49,081 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15583127 bytes from map-output for attempt_1426279437401_714565_m_000234_0
2015-04-13 19:03:49,081 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10979891, inMemoryMapOutputs.size() -> 42, commitMemory -> 528481190, usedMemory ->803119210
2015-04-13 19:03:49,082 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13829480, inMemoryMapOutputs.size() -> 43, commitMemory -> 539461081, usedMemory ->803119210
2015-04-13 19:03:49,082 INFO [fetcher#36] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0473.stratus.lvs.ebay.com:13562 freed by fetcher#36 in 384ms
2015-04-13 19:03:49,083 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11056051 bytes from map-output for attempt_1426279437401_714565_m_000349_0
2015-04-13 19:03:49,083 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11056051, inMemoryMapOutputs.size() -> 44, commitMemory -> 553290561, usedMemory ->803119210
2015-04-13 19:03:49,091 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10880786 bytes from map-output for attempt_1426279437401_714565_m_000283_0
2015-04-13 19:03:49,099 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15583127, inMemoryMapOutputs.size() -> 45, commitMemory -> 564346612, usedMemory ->812508814
2015-04-13 19:03:49,099 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10880786, inMemoryMapOutputs.size() -> 46, commitMemory -> 579929739, usedMemory ->812508814
2015-04-13 19:03:49,099 INFO [fetcher#22] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0446.stratus.lvs.ebay.com:13562 freed by fetcher#22 in 404ms
2015-04-13 19:03:49,102 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#10 about to shuffle output of map attempt_1426279437401_714565_m_000351_0 decomp: 12321405 len: 4398471 to MEMORY
2015-04-13 19:03:49,099 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#19 about to shuffle output of map attempt_1426279437401_714565_m_000401_0 decomp: 9389604 len: 3051358 to MEMORY
2015-04-13 19:03:49,105 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#29 about to shuffle output of map attempt_1426279437401_714565_m_000452_0 decomp: 10213919 len: 3066989 to MEMORY
2015-04-13 19:03:49,107 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14704434 bytes from map-output for attempt_1426279437401_714565_m_000142_0
2015-04-13 19:03:49,107 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14704434, inMemoryMapOutputs.size() -> 47, commitMemory -> 590810525, usedMemory ->835044138
2015-04-13 19:03:49,107 INFO [fetcher#24] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0568.stratus.lvs.ebay.com:13562 freed by fetcher#24 in 411ms
2015-04-13 19:03:49,121 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9861264 bytes from map-output for attempt_1426279437401_714565_m_000286_0
2015-04-13 19:03:49,121 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9861264, inMemoryMapOutputs.size() -> 48, commitMemory -> 605514959, usedMemory ->835044138
2015-04-13 19:03:49,124 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 17768142 bytes from map-output for attempt_1426279437401_714565_m_000048_0
2015-04-13 19:03:49,125 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11059158 bytes from map-output for attempt_1426279437401_714565_m_000434_0
2015-04-13 19:03:49,130 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 18440984 bytes from map-output for attempt_1426279437401_714565_m_000033_0
2015-04-13 19:03:49,132 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000103_0 decomp: 12252462 len: 4006110 to MEMORY
2015-04-13 19:03:49,133 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14528636 bytes from map-output for attempt_1426279437401_714565_m_000114_0
2015-04-13 19:03:49,134 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 17768142, inMemoryMapOutputs.size() -> 49, commitMemory -> 615376223, usedMemory ->847296600
2015-04-13 19:03:49,134 INFO [fetcher#25] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0100.stratus.lvs.ebay.com:13562 freed by fetcher#25 in 441ms
2015-04-13 19:03:49,143 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 17351846 bytes from map-output for attempt_1426279437401_714565_m_000166_0
2015-04-13 19:03:49,144 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 17351846, inMemoryMapOutputs.size() -> 50, commitMemory -> 633144365, usedMemory ->847296600
2015-04-13 19:03:49,144 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14528636, inMemoryMapOutputs.size() -> 51, commitMemory -> 650496211, usedMemory ->847296600
2015-04-13 19:03:49,148 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 18440984, inMemoryMapOutputs.size() -> 52, commitMemory -> 665024847, usedMemory ->861437785
2015-04-13 19:03:49,148 INFO [fetcher#9] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0701.stratus.lvs.ebay.com:13562 freed by fetcher#9 in 451ms
2015-04-13 19:03:49,148 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11059158, inMemoryMapOutputs.size() -> 53, commitMemory -> 683465831, usedMemory ->861437785
2015-04-13 19:03:49,148 INFO [fetcher#34] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0202.stratus.lvs.ebay.com:13562 freed by fetcher#34 in 450ms
2015-04-13 19:03:49,148 INFO [fetcher#26] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0149.stratus.lvs.ebay.com:13562 freed by fetcher#26 in 455ms
2015-04-13 19:03:49,154 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12321405 bytes from map-output for attempt_1426279437401_714565_m_000351_0
2015-04-13 19:03:49,154 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12321405, inMemoryMapOutputs.size() -> 54, commitMemory -> 694524989, usedMemory ->861437785
2015-04-13 19:03:49,154 INFO [fetcher#10] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0234.stratus.lvs.ebay.com:13562 freed by fetcher#10 in 459ms
2015-04-13 19:03:49,148 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 about to shuffle output of map attempt_1426279437401_714565_m_000184_0 decomp: 14141185 len: 5201229 to MEMORY
2015-04-13 19:03:49,154 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9389604 bytes from map-output for attempt_1426279437401_714565_m_000401_0
2015-04-13 19:03:49,156 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9389604, inMemoryMapOutputs.size() -> 55, commitMemory -> 706846394, usedMemory ->861437785
2015-04-13 19:03:49,156 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Starting inMemoryMerger's merge since commitMemory=716235998 > mergeThreshold=708669632. Current usedMemory=861437785
2015-04-13 19:03:49,156 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.MergeThread: InMemoryMerger - Thread to merge in-memory shuffled map-outputs: Starting merge with 55 segments, while ignoring 0 segments
2015-04-13 19:03:49,160 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Initiating in-memory merge with 55 segments...
2015-04-13 19:03:49,160 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapred.Merger: Merging 55 sorted segments
2015-04-13 19:03:49,160 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 55 segments left of total size: 716234018 bytes
2015-04-13 19:03:49,164 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13919331 bytes from map-output for attempt_1426279437401_714565_m_000105_0
2015-04-13 19:03:49,167 INFO [fetcher#19] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0108.stratus.lvs.ebay.com:13562 freed by fetcher#19 in 469ms
2015-04-13 19:03:49,171 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13919331, inMemoryMapOutputs.size() -> 1, commitMemory -> 0, usedMemory ->861437785
2015-04-13 19:03:49,171 INFO [fetcher#15] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0504.stratus.lvs.ebay.com:13562 freed by fetcher#15 in 477ms
2015-04-13 19:03:49,182 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11264804 bytes from map-output for attempt_1426279437401_714565_m_000253_0
2015-04-13 19:03:49,182 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11264804, inMemoryMapOutputs.size() -> 2, commitMemory -> 13919331, usedMemory ->861437785
2015-04-13 19:03:49,185 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000277_0 decomp: 9742966 len: 3055805 to MEMORY
2015-04-13 19:03:49,189 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10213919 bytes from map-output for attempt_1426279437401_714565_m_000452_0
2015-04-13 19:03:49,189 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10213919, inMemoryMapOutputs.size() -> 3, commitMemory -> 25184135, usedMemory ->871180751
2015-04-13 19:03:49,190 INFO [fetcher#29] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0657.stratus.lvs.ebay.com:13562 freed by fetcher#29 in 489ms
2015-04-13 19:03:49,194 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15218576 bytes from map-output for attempt_1426279437401_714565_m_000180_0
2015-04-13 19:03:49,194 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15218576, inMemoryMapOutputs.size() -> 4, commitMemory -> 35398054, usedMemory ->871180751
2015-04-13 19:03:49,195 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13595669 bytes from map-output for attempt_1426279437401_714565_m_000149_0
2015-04-13 19:03:49,200 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 18783388 bytes from map-output for attempt_1426279437401_714565_m_000042_0
2015-04-13 19:03:49,207 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 26453497 bytes from map-output for attempt_1426279437401_714565_m_000009_0
2015-04-13 19:03:49,209 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13595669, inMemoryMapOutputs.size() -> 5, commitMemory -> 50616630, usedMemory ->881420985
2015-04-13 19:03:49,210 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 12252462 bytes from map-output for attempt_1426279437401_714565_m_000103_0
2015-04-13 19:03:49,211 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 18783388, inMemoryMapOutputs.size() -> 6, commitMemory -> 64212299, usedMemory ->890673472
2015-04-13 19:03:49,209 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#5 about to shuffle output of map attempt_1426279437401_714565_m_000431_0 decomp: 10240234 len: 3636194 to MEMORY
2015-04-13 19:03:49,211 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 about to shuffle output of map attempt_1426279437401_714565_m_000394_0 decomp: 9252487 len: 3059222 to MEMORY
2015-04-13 19:03:49,703 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#7 about to shuffle output of map attempt_1426279437401_714565_m_000469_0 decomp: 8392095 len: 2862615 to MEMORY
2015-04-13 19:03:49,708 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 26453497, inMemoryMapOutputs.size() -> 7, commitMemory -> 82995687, usedMemory ->899065567
2015-04-13 19:03:49,708 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 12252462, inMemoryMapOutputs.size() -> 8, commitMemory -> 109449184, usedMemory ->899065567
2015-04-13 19:03:49,708 INFO [fetcher#35] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0115.stratus.lvs.ebay.com:13562 freed by fetcher#35 in 1011ms
2015-04-13 19:03:49,712 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#21 about to shuffle output of map attempt_1426279437401_714565_m_000353_0 decomp: 11655947 len: 4191472 to MEMORY
2015-04-13 19:03:49,737 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14141185 bytes from map-output for attempt_1426279437401_714565_m_000184_0
2015-04-13 19:03:49,737 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14141185, inMemoryMapOutputs.size() -> 9, commitMemory -> 121701646, usedMemory ->910721514
2015-04-13 19:03:49,748 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9742966 bytes from map-output for attempt_1426279437401_714565_m_000277_0
2015-04-13 19:03:49,751 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#13 about to shuffle output of map attempt_1426279437401_714565_m_000153_0 decomp: 15224660 len: 5434119 to MEMORY
2015-04-13 19:03:49,756 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9742966, inMemoryMapOutputs.size() -> 10, commitMemory -> 135842831, usedMemory ->925946174
2015-04-13 19:03:49,759 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000476_0 decomp: 9088944 len: 3246634 to MEMORY
2015-04-13 19:03:49,764 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9252487 bytes from map-output for attempt_1426279437401_714565_m_000394_0
2015-04-13 19:03:49,764 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9252487, inMemoryMapOutputs.size() -> 11, commitMemory -> 145585797, usedMemory ->935035118
2015-04-13 19:03:49,768 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 about to shuffle output of map attempt_1426279437401_714565_m_000245_0 decomp: 11246487 len: 4018110 to MEMORY
2015-04-13 19:03:49,776 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 10240234 bytes from map-output for attempt_1426279437401_714565_m_000431_0
2015-04-13 19:03:49,776 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 10240234, inMemoryMapOutputs.size() -> 12, commitMemory -> 154838284, usedMemory ->946281605
2015-04-13 19:03:49,776 INFO [fetcher#5] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0315.stratus.lvs.ebay.com:13562 freed by fetcher#5 in 1081ms
2015-04-13 19:03:49,782 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8392095 bytes from map-output for attempt_1426279437401_714565_m_000469_0
2015-04-13 19:03:49,782 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8392095, inMemoryMapOutputs.size() -> 13, commitMemory -> 165078518, usedMemory ->946281605
2015-04-13 19:03:49,782 INFO [fetcher#7] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0043.stratus.lvs.ebay.com:13562 freed by fetcher#7 in 1083ms
2015-04-13 19:03:49,787 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11655947 bytes from map-output for attempt_1426279437401_714565_m_000353_0
2015-04-13 19:03:49,787 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11655947, inMemoryMapOutputs.size() -> 14, commitMemory -> 173470613, usedMemory ->946281605
2015-04-13 19:03:49,787 INFO [fetcher#21] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0089.stratus.lvs.ebay.com:13562 freed by fetcher#21 in 1094ms
2015-04-13 19:03:49,802 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9088944 bytes from map-output for attempt_1426279437401_714565_m_000476_0
2015-04-13 19:03:49,813 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9088944, inMemoryMapOutputs.size() -> 15, commitMemory -> 185126560, usedMemory ->946281605
2015-04-13 19:03:49,816 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000269_0 decomp: 11315285 len: 4074306 to MEMORY
2015-04-13 19:03:49,849 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11246487 bytes from map-output for attempt_1426279437401_714565_m_000245_0
2015-04-13 19:03:49,850 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11246487, inMemoryMapOutputs.size() -> 16, commitMemory -> 194215504, usedMemory ->957596890
2015-04-13 19:03:49,852 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 about to shuffle output of map attempt_1426279437401_714565_m_000387_0 decomp: 8924576 len: 3089885 to MEMORY
2015-04-13 19:03:49,890 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 11315285 bytes from map-output for attempt_1426279437401_714565_m_000269_0
2015-04-13 19:03:49,890 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 11315285, inMemoryMapOutputs.size() -> 17, commitMemory -> 205461991, usedMemory ->966521466
2015-04-13 19:03:49,893 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 15224660 bytes from map-output for attempt_1426279437401_714565_m_000153_0
2015-04-13 19:03:49,893 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 15224660, inMemoryMapOutputs.size() -> 18, commitMemory -> 216777276, usedMemory ->966521466
2015-04-13 19:03:49,893 INFO [fetcher#13] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0227.stratus.lvs.ebay.com:13562 freed by fetcher#13 in 1197ms
2015-04-13 19:03:49,912 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 8924576 bytes from map-output for attempt_1426279437401_714565_m_000387_0
2015-04-13 19:03:49,912 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 8924576, inMemoryMapOutputs.size() -> 19, commitMemory -> 232001936, usedMemory ->966521466
2015-04-13 19:03:49,916 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#8 about to shuffle output of map attempt_1426279437401_714565_m_000181_0 decomp: 13907896 len: 5063352 to MEMORY
2015-04-13 19:03:49,921 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000086_0 decomp: 13358353 len: 4460579 to MEMORY
2015-04-13 19:03:50,015 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13358353 bytes from map-output for attempt_1426279437401_714565_m_000086_0
2015-04-13 19:03:50,015 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13358353, inMemoryMapOutputs.size() -> 20, commitMemory -> 240926512, usedMemory ->993787715
2015-04-13 19:03:50,019 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.Fetcher: fetcher#23 about to shuffle output of map attempt_1426279437401_714565_m_000201_0 decomp: 14012743 len: 5038081 to MEMORY
2015-04-13 19:03:50,027 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 13907896 bytes from map-output for attempt_1426279437401_714565_m_000181_0
2015-04-13 19:03:50,027 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 13907896, inMemoryMapOutputs.size() -> 21, commitMemory -> 254284865, usedMemory ->1007800458
2015-04-13 19:03:50,027 INFO [fetcher#8] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0282.stratus.lvs.ebay.com:13562 freed by fetcher#8 in 1332ms
2015-04-13 19:03:50,087 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 14012743 bytes from map-output for attempt_1426279437401_714565_m_000201_0
2015-04-13 19:03:50,088 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 14012743, inMemoryMapOutputs.size() -> 22, commitMemory -> 268192761, usedMemory ->1007800458
2015-04-13 19:03:50,088 INFO [fetcher#23] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0503.stratus.lvs.ebay.com:13562 freed by fetcher#23 in 1389ms
2015-04-13 19:03:50,398 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.InMemoryMapOutput: Read 9358956 bytes from map-output for attempt_1426279437401_714565_m_000411_0
2015-04-13 19:03:50,399 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: closeInMemoryFile -> map-output of size: 9358956, inMemoryMapOutputs.size() -> 23, commitMemory -> 282205504, usedMemory ->1007800458
2015-04-13 19:03:50,399 INFO [fetcher#3] org.apache.hadoop.mapreduce.task.reduce.ShuffleSchedulerImpl: lvsdpehdc25dn0429.stratus.lvs.ebay.com:13562 freed by fetcher#3 in 1700ms
2015-04-13 19:03:50,399 INFO [EventFetcher for fetching Map Completion Events] org.apache.hadoop.mapreduce.task.reduce.EventFetcher: EventFetcher is interrupted.. Returning
2015-04-13 19:04:00,138 INFO [InMemoryMerger - Thread to merge in-memory shuffled map-outputs] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: attempt_1426279437401_714565_r_000318_0 Merge of the 55 files in-memory complete. Local file is /hadoop/8/scratch/local/usercache/b_pulsar_coe/appcache/application_1426279437401_714565/output/attempt_1426279437401_714565_r_000318_0/map_549.out.merged of size 225984675
2015-04-13 19:04:00,139 INFO [main] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: finalMerge called with 23 in-memory map-outputs and 9 on-disk map-outputs
2015-04-13 19:04:00,141 INFO [main] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Merging 9 files, 2018830572 bytes from disk
2015-04-13 19:04:00,143 INFO [main] org.apache.hadoop.mapreduce.task.reduce.MergeManagerImpl: Merging 23 segments, 291564460 bytes from memory into reduce
2015-04-13 19:04:00,144 INFO [main] org.apache.hadoop.mapred.Merger: Merging 9 sorted segments
2015-04-13 19:04:00,171 INFO [main] org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 9 segments left of total size: 6436825723 bytes
2015-04-13 19:04:00,215 INFO [main] org.apache.hadoop.mapred.Merger: Merging 24 sorted segments
2015-04-13 19:04:00,216 INFO [main] org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 24 segments left of total size: 6729122681 bytes
2015-04-13 19:04:00,422 INFO [main] org.apache.hadoop.io.compress.zlib.ZlibFactory: Successfully loaded & initialized native-zlib library
2015-04-13 19:04:00,424 INFO [main] org.apache.hadoop.conf.Configuration.deprecation: mapred.skip.on is deprecated. Instead, use mapreduce.job.skiprecords
2015-04-13 19:04:00,816 INFO [main] org.hibernate.validator.internal.util.Version: HV000001: Hibernate Validator 5.0.1.Final
2015-04-13 19:04:03,275 INFO [main] io.druid.guice.JsonConfigurator: Loaded class[class io.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, coordinates=[], localRepository='/home/hadoop/.m2/repository', remoteRepositories=[http://repo1.maven.org/maven2/, https://metamx.artifactoryonline.com/metamx/pub-libs-releases-local]}]
2015-04-13 19:04:03,610 INFO [main] io.druid.initialization.Initialization: Adding local module[class io.druid.firehose.kafka.KafkaEightDruidModule]
2015-04-13 19:04:03,613 INFO [main] io.druid.initialization.Initialization: Adding local module[class io.druid.storage.hdfs.HdfsStorageDruidModule]
2015-04-13 19:04:04,706 INFO [main] io.druid.guice.JsonConfigurator: Loaded class[class com.metamx.emitter.core.LoggingEmitterConfig] from props[druid.emitter.logging.] as [LoggingEmitterConfig{loggerClass='com.metamx.emitter.core.LoggingEmitter', logLevel='info'}]
2015-04-13 19:04:04,963 INFO [main] io.druid.guice.JsonConfigurator: Loaded class[class io.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [io.druid.server.metrics.DruidMonitorSchedulerConfig@c30f829]
2015-04-13 19:04:04,994 INFO [main] io.druid.guice.JsonConfigurator: Loaded class[class io.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[]}]
2015-04-13 19:04:06,417 INFO [main] io.druid.indexer.HadoopDruidIndexerConfig: Running with config:
{
  "spec" : {
    "dataSchema" : {
      "dataSource" : "pulsar_event_merged",
      "parser" : {
        "type" : "string",
        "parseSpec" : {
          "format" : "json",
          "timestampSpec" : {
            "column" : "timestamp",
            "format" : "auto"
          },
          "dimensionsSpec" : {
            "dimensions" : [ ],
            "dimensionExclusions" : [ "guid", "uid", "timestamp" ],
            "spatialDimensions" : [ ]
          }
        }
      },
      "metricsSpec" : [ {
        "type" : "count",
        "name" : "count"
      }, {
        "type" : "hyperUnique",
        "name" : "guid_hll",
        "fieldName" : "guid"
      } ],
      "granularitySpec" : {
        "type" : "uniform",
        "segmentGranularity" : "HOUR",
        "queryGranularity" : {
          "type" : "none"
        },
        "intervals" : [ "2015-03-28T17:00:00.000-07:00/2015-03-30T17:00:00.000-07:00" ]
      }
    },
    "ioConfig" : {
      "type" : "hadoop",
      "inputSpec" : {
        "type" : "static",
        "paths" : "hdfs://artemis-nn.vip.ebay.com:8020/pulsar/raw_soj/20150330/00_00",
        "inputFormat" : "com.ebay.tracking.druid.avro.AvroInputFormat"
      },
      "metadataUpdateSpec" : null,
      "segmentOutputPath" : "hdfs://artemis-nn.vip.ebay.com:8020/tmp/Druid/pulsar_event_merged"
    },
    "tuningConfig" : {
      "type" : "hadoop",
      "workingPath" : "/tmp/druid-indexing",
      "version" : "2015-04-14T01:57:58.430Z",
      "partitionsSpec" : {
        "type" : "hashed",
        "targetPartitionSize" : -1,
        "maxPartitionSize" : -1,
        "assumeGrouped" : false,
        "numShards" : 10
      },
      "shardSpecs" : {
        "2015-03-28T17:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 0
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 1
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 2
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 3
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 4
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 5
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 6
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 7
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 8
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 9
        } ],
        "2015-03-28T18:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 10
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 11
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 12
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 13
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 14
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 15
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 16
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 17
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 18
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 19
        } ],
        "2015-03-28T19:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 20
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 21
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 22
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 23
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 24
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 25
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 26
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 27
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 28
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 29
        } ],
        "2015-03-28T20:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 30
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 31
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 32
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 33
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 34
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 35
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 36
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 37
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 38
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 39
        } ],
        "2015-03-28T21:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 40
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 41
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 42
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 43
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 44
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 45
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 46
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 47
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 48
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 49
        } ],
        "2015-03-28T22:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 50
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 51
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 52
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 53
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 54
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 55
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 56
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 57
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 58
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 59
        } ],
        "2015-03-28T23:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 60
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 61
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 62
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 63
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 64
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 65
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 66
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 67
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 68
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 69
        } ],
        "2015-03-29T00:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 70
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 71
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 72
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 73
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 74
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 75
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 76
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 77
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 78
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 79
        } ],
        "2015-03-29T01:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 80
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 81
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 82
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 83
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 84
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 85
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 86
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 87
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 88
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 89
        } ],
        "2015-03-29T02:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 90
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 91
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 92
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 93
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 94
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 95
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 96
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 97
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 98
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 99
        } ],
        "2015-03-29T03:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 100
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 101
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 102
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 103
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 104
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 105
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 106
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 107
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 108
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 109
        } ],
        "2015-03-29T04:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 110
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 111
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 112
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 113
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 114
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 115
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 116
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 117
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 118
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 119
        } ],
        "2015-03-29T05:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 120
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 121
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 122
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 123
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 124
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 125
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 126
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 127
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 128
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 129
        } ],
        "2015-03-29T06:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 130
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 131
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 132
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 133
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 134
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 135
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 136
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 137
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 138
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 139
        } ],
        "2015-03-29T07:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 140
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 141
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 142
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 143
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 144
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 145
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 146
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 147
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 148
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 149
        } ],
        "2015-03-29T08:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 150
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 151
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 152
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 153
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 154
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 155
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 156
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 157
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 158
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 159
        } ],
        "2015-03-29T09:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 160
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 161
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 162
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 163
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 164
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 165
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 166
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 167
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 168
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 169
        } ],
        "2015-03-29T10:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 170
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 171
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 172
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 173
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 174
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 175
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 176
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 177
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 178
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 179
        } ],
        "2015-03-29T11:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 180
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 181
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 182
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 183
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 184
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 185
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 186
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 187
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 188
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 189
        } ],
        "2015-03-29T12:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 190
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 191
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 192
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 193
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 194
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 195
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 196
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 197
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 198
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 199
        } ],
        "2015-03-29T13:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 200
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 201
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 202
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 203
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 204
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 205
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 206
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 207
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 208
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 209
        } ],
        "2015-03-29T14:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 210
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 211
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 212
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 213
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 214
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 215
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 216
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 217
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 218
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 219
        } ],
        "2015-03-29T15:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 220
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 221
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 222
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 223
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 224
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 225
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 226
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 227
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 228
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 229
        } ],
        "2015-03-29T16:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 230
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 231
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 232
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 233
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 234
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 235
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 236
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 237
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 238
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 239
        } ],
        "2015-03-29T17:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 240
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 241
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 242
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 243
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 244
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 245
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 246
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 247
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 248
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 249
        } ],
        "2015-03-29T18:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 250
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 251
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 252
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 253
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 254
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 255
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 256
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 257
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 258
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 259
        } ],
        "2015-03-29T19:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 260
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 261
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 262
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 263
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 264
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 265
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 266
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 267
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 268
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 269
        } ],
        "2015-03-29T20:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 270
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 271
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 272
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 273
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 274
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 275
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 276
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 277
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 278
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 279
        } ],
        "2015-03-29T21:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 280
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 281
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 282
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 283
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 284
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 285
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 286
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 287
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 288
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 289
        } ],
        "2015-03-29T22:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 290
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 291
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 292
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 293
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 294
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 295
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 296
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 297
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 298
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 299
        } ],
        "2015-03-29T23:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 300
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 301
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 302
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 303
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 304
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 305
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 306
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 307
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 308
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 309
        } ],
        "2015-03-30T00:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 310
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 311
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 312
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 313
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 314
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 315
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 316
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 317
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 318
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 319
        } ],
        "2015-03-30T01:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 320
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 321
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 322
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 323
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 324
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 325
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 326
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 327
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 328
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 329
        } ],
        "2015-03-30T02:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 330
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 331
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 332
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 333
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 334
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 335
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 336
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 337
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 338
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 339
        } ],
        "2015-03-30T03:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 340
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 341
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 342
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 343
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 344
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 345
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 346
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 347
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 348
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 349
        } ],
        "2015-03-30T04:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 350
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 351
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 352
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 353
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 354
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 355
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 356
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 357
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 358
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 359
        } ],
        "2015-03-30T05:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 360
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 361
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 362
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 363
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 364
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 365
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 366
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 367
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 368
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 369
        } ],
        "2015-03-30T06:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 370
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 371
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 372
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 373
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 374
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 375
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 376
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 377
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 378
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 379
        } ],
        "2015-03-30T07:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 380
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 381
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 382
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 383
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 384
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 385
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 386
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 387
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 388
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 389
        } ],
        "2015-03-30T08:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 390
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 391
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 392
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 393
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 394
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 395
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 396
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 397
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 398
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 399
        } ],
        "2015-03-30T09:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 400
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 401
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 402
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 403
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 404
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 405
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 406
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 407
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 408
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 409
        } ],
        "2015-03-30T10:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 410
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 411
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 412
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 413
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 414
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 415
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 416
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 417
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 418
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 419
        } ],
        "2015-03-30T11:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 420
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 421
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 422
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 423
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 424
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 425
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 426
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 427
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 428
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 429
        } ],
        "2015-03-30T12:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 430
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 431
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 432
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 433
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 434
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 435
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 436
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 437
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 438
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 439
        } ],
        "2015-03-30T13:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 440
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 441
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 442
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 443
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 444
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 445
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 446
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 447
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 448
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 449
        } ],
        "2015-03-30T14:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 450
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 451
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 452
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 453
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 454
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 455
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 456
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 457
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 458
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 459
        } ],
        "2015-03-30T15:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 460
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 461
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 462
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 463
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 464
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 465
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 466
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 467
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 468
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 469
        } ],
        "2015-03-30T16:00:00.000-07:00" : [ {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 0,
            "partitions" : 10
          },
          "shardNum" : 470
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 1,
            "partitions" : 10
          },
          "shardNum" : 471
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 2,
            "partitions" : 10
          },
          "shardNum" : 472
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 3,
            "partitions" : 10
          },
          "shardNum" : 473
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 4,
            "partitions" : 10
          },
          "shardNum" : 474
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 5,
            "partitions" : 10
          },
          "shardNum" : 475
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 6,
            "partitions" : 10
          },
          "shardNum" : 476
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 7,
            "partitions" : 10
          },
          "shardNum" : 477
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 8,
            "partitions" : 10
          },
          "shardNum" : 478
        }, {
          "actualSpec" : {
            "type" : "hashed",
            "partitionNum" : 9,
            "partitions" : 10
          },
          "shardNum" : 479
        } ]
      },
      "rowFlushBoundary" : 500000,
      "leaveIntermediate" : false,
      "cleanupOnFailure" : true,
      "overwriteFiles" : false,
      "ignoreInvalidRows" : true,
      "jobProperties" : {
        "mapreduce.input.fileinputformat.input.dir.recursive" : "true",
        "mapreduce.input.fileinputformat.list-status.num-threads" : "10"
      },
      "combineText" : false
    }
  }
}
2015-04-13 19:09:25,100 INFO [main] org.apache.hadoop.mapred.Task: Task:attempt_1426279437401_714565_r_000318_0 is done. And is in the process of committing
2015-04-13 19:09:25,231 INFO [main] org.apache.hadoop.mapred.Task: Task attempt_1426279437401_714565_r_000318_0 is allowed to commit now
2015-04-13 19:09:25,579 INFO [main] org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter: Saved output of task 'attempt_1426279437401_714565_r_000318_0' to hdfs://artemis-nn.vip.ebay.com:8020/tmp/druid-indexing/pulsar_event_merged/2015-04-14T015758.430Z/_temporary/1/task_1426279437401_714565_r_000318
2015-04-13 19:09:25,647 INFO [main] org.apache.hadoop.mapred.Task: Task 'attempt_1426279437401_714565_r_000318_0' done.