按照单节点集群上hadoop设置的文档,我安装了hadoop,然后当我尝试运行其中一个示例时,这个过程似乎陷入了 Map 0%在 running 状态下减少0% . 我的系统规格是1TB物理内存,8GB RAM,4核 .

mapred-site.xml 是:

<property>
 <name>yarn.nodemanager.resource.memory-mb</name>
 <value>2000</value>
</property>
<property>
 <name>yarn.scheduler.minimum-allocation-mb</name>
 <value>500</value>
</property>
<property>
 <name>yarn.scheduler.maximum-allocation-mb</name>
 <value>2500</value>
</property>
<property>
 <name>yarn.scheduler.maximum-allocation-vcores</name>
 <value>3</value>
 <source>yarn-default.xml</source>
</property>

yarn-site.xml

<property>
 <name>mapreduce.map.memory.mb</name>
 <value>1000</value>
</property>
<property>
 <name>mapreduce.reduce.memory.mb</name>
 <value>1000</value>
</property>
<property>
 <name>mapreduce.map.java.opts</name>
 <value>-Xmx800m</value>
</property>
<property>
 <name>mapreduce.reduce.java.opts</name>
 <value>-Xmx800m</value>
</property>

控制台日志:

16/09/30 11:38:08 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
16/09/30 11:38:10 INFO input.FileInputFormat: Total input paths to process : 0
16/09/30 11:38:11 INFO mapreduce.JobSubmitter: number of splits:0
16/09/30 11:38:11 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1475215403708_0001
16/09/30 11:38:12 INFO impl.YarnClientImpl: Submitted application application_1475215403708_0001
16/09/30 11:38:12 INFO mapreduce.Job: The url to track the job: http://DeadSilence:8088/proxy/application_1475215403708_0001/
16/09/30 11:38:12 INFO mapreduce.Job: Running job: job_1475215403708_0001 
16/09/30 11:38:23 INFO mapreduce.Job: Job job_1475215403708_0001 running in uber mode : false
16/09/30 11:38:23 INFO mapreduce.Job:  map 0% reduce 0%