按照单节点集群上hadoop设置的文档,我安装了hadoop,然后当我尝试运行其中一个示例时,这个过程似乎陷入了 Map 0%在 running
状态下减少0% . 我的系统规格是1TB物理内存,8GB RAM,4核 .
mapred-site.xml
是:
<property>
<name>yarn.nodemanager.resource.memory-mb</name>
<value>2000</value>
</property>
<property>
<name>yarn.scheduler.minimum-allocation-mb</name>
<value>500</value>
</property>
<property>
<name>yarn.scheduler.maximum-allocation-mb</name>
<value>2500</value>
</property>
<property>
<name>yarn.scheduler.maximum-allocation-vcores</name>
<value>3</value>
<source>yarn-default.xml</source>
</property>
yarn-site.xml
<property>
<name>mapreduce.map.memory.mb</name>
<value>1000</value>
</property>
<property>
<name>mapreduce.reduce.memory.mb</name>
<value>1000</value>
</property>
<property>
<name>mapreduce.map.java.opts</name>
<value>-Xmx800m</value>
</property>
<property>
<name>mapreduce.reduce.java.opts</name>
<value>-Xmx800m</value>
</property>
控制台日志:
16/09/30 11:38:08 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
16/09/30 11:38:10 INFO input.FileInputFormat: Total input paths to process : 0
16/09/30 11:38:11 INFO mapreduce.JobSubmitter: number of splits:0
16/09/30 11:38:11 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1475215403708_0001
16/09/30 11:38:12 INFO impl.YarnClientImpl: Submitted application application_1475215403708_0001
16/09/30 11:38:12 INFO mapreduce.Job: The url to track the job: http://DeadSilence:8088/proxy/application_1475215403708_0001/
16/09/30 11:38:12 INFO mapreduce.Job: Running job: job_1475215403708_0001
16/09/30 11:38:23 INFO mapreduce.Job: Job job_1475215403708_0001 running in uber mode : false
16/09/30 11:38:23 INFO mapreduce.Job: map 0% reduce 0%