hadoop1.2.1运行wordcount报错

2024-05-07 06:48

本文主要是介绍hadoop1.2.1运行wordcount报错,希望对大家解决编程问题提供一定的参考价值,需要的开发者们随着小编来一起学习吧!

安装步骤参见http://www.tuicool.com/articles/NBvMv2
根据上述网站中的步骤安装好hadoop1.2.1,安装过程中一定要细心,文件位置不要随意放。
我就是文件位置设置同上述网站不一样,导致后续执行wordcount不成功,放出日志如下:

Meta VERSION=”1” .
Job JOBID=”job_201511301937_0004” JOBNAME=”word count” USER=”root” SUBMIT_TIME=”1448884207054” JOBCONF=”hdfs://localhost:9000/user/root/home/paomo/tmp/mapred/staging/root/.staging/job_201511301937_0004/job.xml” VIEW_JOB=”” MODIFY_JOB=”” JOB_QUEUE=”default” WORKFLOW_ID=”” WORKFLOW_NAME=”” WORKFLOW_NODE_NAME=”” WORKFLOW_ADJACENCIES=”” WORKFLOW_TAGS=”” .
Job JOBID=”job_201511301937_0004” JOB_PRIORITY=”NORMAL” .
Job JOBID=”job_201511301937_0004” LAUNCH_TIME=”1448884207728” TOTAL_MAPS=”1” TOTAL_REDUCES=”1” JOB_STATUS=”PREP” .
Task TASKID=”task_201511301937_0004_m_000002” TASK_TYPE=”SETUP” START_TIME=”1448884207752” SPLITS=”” .
MapAttempt TASK_TYPE=”SETUP” TASKID=”task_201511301937_0004_m_000002” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000002_0” START_TIME=”0” TRACKER_NAME=”tracker_paomo:localhost/127.0.0.1:51068” HTTP_PORT=”50060” LOCALITY=”OFF_SWITCH” AVATAAR=”VIRGIN” .
MapAttempt TASK_TYPE=”SETUP” TASKID=”task_201511301937_0004_m_000002” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000002_0” TASK_STATUS=”FAILED” FINISH_TIME=”0” HOSTNAME=”paomo” ERROR=”Error initializing attempt_201511301937_0004_m_000002_0:
java.io.IOException: Exception reading file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:135)
at org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(TokenCache.java:178)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1289)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker 5.run(TaskTracker.java:2603)atjava.lang.Thread.run(Thread.java:745)Causedby:java.io.FileNotFoundException:Filefile:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job2015113019370004/jobTokendoesnotexist.atorg.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)atorg.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)atorg.apache.hadoop.fs.ChecksumFileSystem ChecksumFSInputChecker.(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:436)
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:129)
… 5 more
” .
MapAttempt TASK_TYPE=”SETUP” TASKID=”task_201511301937_0004_m_000002” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000002_1” START_TIME=”0” TRACKER_NAME=”tracker_paomo:localhost/127.0.0.1:51068” HTTP_PORT=”50060” LOCALITY=”OFF_SWITCH” AVATAAR=”VIRGIN” .
MapAttempt TASK_TYPE=”SETUP” TASKID=”task_201511301937_0004_m_000002” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000002_1” TASK_STATUS=”FAILED” FINISH_TIME=”0” HOSTNAME=”paomo” ERROR=”Error initializing attempt_201511301937_0004_m_000002_1:
java.io.IOException: Exception reading file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:135)
at org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(TokenCache.java:178)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1289)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker 5.run(TaskTracker.java:2603)atjava.lang.Thread.run(Thread.java:745)Causedby:java.io.FileNotFoundException:Filefile:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job2015113019370004/jobTokendoesnotexist.atorg.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)atorg.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)atorg.apache.hadoop.fs.ChecksumFileSystem ChecksumFSInputChecker.(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:436)
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:129)
… 5 more
” .
MapAttempt TASK_TYPE=”SETUP” TASKID=”task_201511301937_0004_m_000002” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000002_2” START_TIME=”0” TRACKER_NAME=”tracker_paomo:localhost/127.0.0.1:51068” HTTP_PORT=”50060” LOCALITY=”OFF_SWITCH” AVATAAR=”VIRGIN” .
MapAttempt TASK_TYPE=”SETUP” TASKID=”task_201511301937_0004_m_000002” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000002_2” TASK_STATUS=”FAILED” FINISH_TIME=”0” HOSTNAME=”paomo” ERROR=”Error initializing attempt_201511301937_0004_m_000002_2:
java.io.IOException: Exception reading file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:135)
at org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(TokenCache.java:178)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1289)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker 5.run(TaskTracker.java:2603)atjava.lang.Thread.run(Thread.java:745)Causedby:java.io.FileNotFoundException:Filefile:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job2015113019370004/jobTokendoesnotexist.atorg.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)atorg.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)atorg.apache.hadoop.fs.ChecksumFileSystem ChecksumFSInputChecker.(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:436)
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:129)
… 5 more
” .
MapAttempt TASK_TYPE=”SETUP” TASKID=”task_201511301937_0004_m_000002” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000002_3” START_TIME=”0” TRACKER_NAME=”tracker_paomo:localhost/127.0.0.1:51068” HTTP_PORT=”50060” LOCALITY=”OFF_SWITCH” AVATAAR=”VIRGIN” .
MapAttempt TASK_TYPE=”SETUP” TASKID=”task_201511301937_0004_m_000002” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000002_3” TASK_STATUS=”FAILED” FINISH_TIME=”0” HOSTNAME=”paomo” ERROR=”Error initializing attempt_201511301937_0004_m_000002_3:
java.io.IOException: Exception reading file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:135)
at org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(TokenCache.java:178)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1289)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker 5.run(TaskTracker.java:2603)atjava.lang.Thread.run(Thread.java:745)Causedby:java.io.FileNotFoundException:Filefile:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job2015113019370004/jobTokendoesnotexist.atorg.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)atorg.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)atorg.apache.hadoop.fs.ChecksumFileSystem ChecksumFSInputChecker.(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:436)
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:129)
… 5 more
” .
Task TASKID=”task_201511301937_0004_m_000002” TASK_TYPE=”SETUP” TASK_STATUS=”FAILED” FINISH_TIME=”0” ERROR=”Error initializing attempt_201511301937_0004_m_000002_3:
java.io.IOException: Exception reading file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:135)
at org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(TokenCache.java:178)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1289)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker 5.run(TaskTracker.java:2603)atjava.lang.Thread.run(Thread.java:745)Causedby:java.io.FileNotFoundException:Filefile:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job2015113019370004/jobTokendoesnotexist.atorg.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)atorg.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)atorg.apache.hadoop.fs.ChecksumFileSystem ChecksumFSInputChecker.(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:436)
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:129)
… 5 more
” TASK_ATTEMPT_ID=”” .
Task TASKID=”task_201511301937_0004_m_000001” TASK_TYPE=”CLEANUP” START_TIME=”1448884209118” SPLITS=”” .
MapAttempt TASK_TYPE=”CLEANUP” TASKID=”task_201511301937_0004_m_000001” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000001_0” START_TIME=”0” TRACKER_NAME=”tracker_paomo:localhost/127.0.0.1:51068” HTTP_PORT=”50060” LOCALITY=”OFF_SWITCH” AVATAAR=”VIRGIN” .
MapAttempt TASK_TYPE=”CLEANUP” TASKID=”task_201511301937_0004_m_000001” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000001_0” TASK_STATUS=”FAILED” FINISH_TIME=”0” HOSTNAME=”paomo” ERROR=”Error initializing attempt_201511301937_0004_m_000001_0:
java.io.IOException: Exception reading file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:135)
at org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(TokenCache.java:178)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1289)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker 5.run(TaskTracker.java:2603)atjava.lang.Thread.run(Thread.java:745)Causedby:java.io.FileNotFoundException:Filefile:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job2015113019370004/jobTokendoesnotexist.atorg.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)atorg.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)atorg.apache.hadoop.fs.ChecksumFileSystem ChecksumFSInputChecker.(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:436)
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:129)
… 5 more
” .
MapAttempt TASK_TYPE=”CLEANUP” TASKID=”task_201511301937_0004_m_000001” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000001_1” START_TIME=”0” TRACKER_NAME=”tracker_paomo:localhost/127.0.0.1:51068” HTTP_PORT=”50060” LOCALITY=”OFF_SWITCH” AVATAAR=”VIRGIN” .
MapAttempt TASK_TYPE=”CLEANUP” TASKID=”task_201511301937_0004_m_000001” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000001_1” TASK_STATUS=”FAILED” FINISH_TIME=”0” HOSTNAME=”paomo” ERROR=”Error initializing attempt_201511301937_0004_m_000001_1:
java.io.IOException: Exception reading file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:135)
at org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(TokenCache.java:178)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1289)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker 5.run(TaskTracker.java:2603)atjava.lang.Thread.run(Thread.java:745)Causedby:java.io.FileNotFoundException:Filefile:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job2015113019370004/jobTokendoesnotexist.atorg.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)atorg.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)atorg.apache.hadoop.fs.ChecksumFileSystem ChecksumFSInputChecker.(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:436)
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:129)
… 5 more
” .
MapAttempt TASK_TYPE=”CLEANUP” TASKID=”task_201511301937_0004_m_000001” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000001_2” START_TIME=”0” TRACKER_NAME=”tracker_paomo:localhost/127.0.0.1:51068” HTTP_PORT=”50060” LOCALITY=”OFF_SWITCH” AVATAAR=”VIRGIN” .
MapAttempt TASK_TYPE=”CLEANUP” TASKID=”task_201511301937_0004_m_000001” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000001_2” TASK_STATUS=”FAILED” FINISH_TIME=”0” HOSTNAME=”paomo” ERROR=”Error initializing attempt_201511301937_0004_m_000001_2:
java.io.IOException: Exception reading file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:135)
at org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(TokenCache.java:178)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1289)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker 5.run(TaskTracker.java:2603)atjava.lang.Thread.run(Thread.java:745)Causedby:java.io.FileNotFoundException:Filefile:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job2015113019370004/jobTokendoesnotexist.atorg.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)atorg.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)atorg.apache.hadoop.fs.ChecksumFileSystem ChecksumFSInputChecker.(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:436)
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:129)
… 5 more
” .
MapAttempt TASK_TYPE=”CLEANUP” TASKID=”task_201511301937_0004_m_000001” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000001_3” START_TIME=”0” TRACKER_NAME=”tracker_paomo:localhost/127.0.0.1:51068” HTTP_PORT=”50060” LOCALITY=”OFF_SWITCH” AVATAAR=”VIRGIN” .
MapAttempt TASK_TYPE=”CLEANUP” TASKID=”task_201511301937_0004_m_000001” TASK_ATTEMPT_ID=”attempt_201511301937_0004_m_000001_3” TASK_STATUS=”FAILED” FINISH_TIME=”0” HOSTNAME=”paomo” ERROR=”Error initializing attempt_201511301937_0004_m_000001_3:
java.io.IOException: Exception reading file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:135)
at org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(TokenCache.java:178)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1289)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker 5.run(TaskTracker.java:2603)atjava.lang.Thread.run(Thread.java:745)Causedby:java.io.FileNotFoundException:Filefile:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job2015113019370004/jobTokendoesnotexist.atorg.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)atorg.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)atorg.apache.hadoop.fs.ChecksumFileSystem ChecksumFSInputChecker.(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:436)
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:129)
… 5 more
” .
Task TASKID=”task_201511301937_0004_m_000001” TASK_TYPE=”CLEANUP” TASK_STATUS=”FAILED” FINISH_TIME=”0” ERROR=”Error initializing attempt_201511301937_0004_m_000001_3:
java.io.IOException: Exception reading file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:135)
at org.apache.hadoop.mapreduce.security.TokenCache.loadTokens(TokenCache.java:178)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1289)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1226)
at org.apache.hadoop.mapred.TaskTracker$5.run(TaskTracker.java:2603)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.FileNotFoundException: File file:/home/paomo/tmp/mapred/local/ttprivate/taskTracker/root/jobcache/job_201511301937_0004/jobToken does not exist.
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)
at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:125)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:436)
at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:129)
… 5 more
” TASK_ATTEMPT_ID=”” .
Job JOBID=”job_201511301937_0004” FINISH_TIME=”1448884210837” JOB_STATUS=”FAILED” FINISHED_MAPS=”0” FINISHED_REDUCES=”0” FAIL_REASON=”JobCleanup Task Failure, Task: task_201511301937_0004_m_000001” .

看到粗体字,仔细想就明白tmp文件没有找到。在网上查阅很多资料,
报错受以下博客的启发http://www.it165.net/pro/html/201501/31366.html
tmp路径的设置在hadoop-1.2.1/conf/core-site.xml文件中,
进到我的安装路径下查看,发现tmp在下列路径中:
tmp路径
而我在core-site.xml中设置为/home/paomo/tmp,后来改成了
core-site中tmp的设置
很明显位置不符合,难怪找不到tmp下生成的文件。因为在运行过程中Job会生成一些临时文件,执行过程中需要用到。一个方法是修改core-site.xml中hadoop.tmp.dir的值为tmp实际存放的位置,如下图:
tmp现在的设置
再重新运行就可以了。输入:bin/hadoop jar hadoop-examples-1.2.1.jar wordcount input output
运行结果如下:
运行结果
终于看到map 100% reduce 100%。
输入bin/hadoop dfs -cat output/part-r-00000,可以查看结果。

这篇关于hadoop1.2.1运行wordcount报错的文章就介绍到这儿,希望我们推荐的文章对编程师们有所帮助!



http://www.chinasem.cn/article/966625

相关文章

电脑找不到mfc90u.dll文件怎么办? 系统报错mfc90u.dll丢失修复的5种方案

《电脑找不到mfc90u.dll文件怎么办?系统报错mfc90u.dll丢失修复的5种方案》在我们日常使用电脑的过程中,可能会遇到一些软件或系统错误,其中之一就是mfc90u.dll丢失,那么,mf... 在大部分情况下出现我们运行或安装软件,游戏出现提示丢失某些DLL文件或OCX文件的原因可能是原始安装包

电脑显示mfc100u.dll丢失怎么办?系统报错mfc90u.dll丢失5种修复方案

《电脑显示mfc100u.dll丢失怎么办?系统报错mfc90u.dll丢失5种修复方案》最近有不少兄弟反映,电脑突然弹出“mfc100u.dll已加载,但找不到入口点”的错误提示,导致一些程序无法正... 在计算机使用过程中,我们经常会遇到一些错误提示,其中最常见的就是“找不到指定的模块”或“缺少某个DL

解决IDEA报错:编码GBK的不可映射字符问题

《解决IDEA报错:编码GBK的不可映射字符问题》:本文主要介绍解决IDEA报错:编码GBK的不可映射字符问题,具有很好的参考价值,希望对大家有所帮助,如有错误或未考虑完全的地方,望不吝赐教... 目录IDEA报错:编码GBK的不可映射字符终端软件问题描述原因分析解决方案方法1:将命令改为方法2:右下jav

MyBatis模糊查询报错:ParserException: not supported.pos 问题解决

《MyBatis模糊查询报错:ParserException:notsupported.pos问题解决》本文主要介绍了MyBatis模糊查询报错:ParserException:notsuppo... 目录问题描述问题根源错误SQL解析逻辑深层原因分析三种解决方案方案一:使用CONCAT函数(推荐)方案二:

Spring Boot中JSON数值溢出问题从报错到优雅解决办法

《SpringBoot中JSON数值溢出问题从报错到优雅解决办法》:本文主要介绍SpringBoot中JSON数值溢出问题从报错到优雅的解决办法,通过修改字段类型为Long、添加全局异常处理和... 目录一、问题背景:为什么我的接口突然报错了?二、为什么会发生这个错误?1. Java 数据类型的“容量”限制

SpringBoot项目中报错The field screenShot exceeds its maximum permitted size of 1048576 bytes.的问题及解决

《SpringBoot项目中报错ThefieldscreenShotexceedsitsmaximumpermittedsizeof1048576bytes.的问题及解决》这篇文章... 目录项目场景问题描述原因分析解决方案总结项目场景javascript提示:项目相关背景:项目场景:基于Spring

Python如何精准判断某个进程是否在运行

《Python如何精准判断某个进程是否在运行》这篇文章主要为大家详细介绍了Python如何精准判断某个进程是否在运行,本文为大家整理了3种方法并进行了对比,有需要的小伙伴可以跟随小编一起学习一下... 目录一、为什么需要判断进程是否存在二、方法1:用psutil库(推荐)三、方法2:用os.system调用

Python运行中频繁出现Restart提示的解决办法

《Python运行中频繁出现Restart提示的解决办法》在编程的世界里,遇到各种奇怪的问题是家常便饭,但是,当你的Python程序在运行过程中频繁出现“Restart”提示时,这可能不仅仅是令人头疼... 目录问题描述代码示例无限循环递归调用内存泄漏解决方案1. 检查代码逻辑无限循环递归调用内存泄漏2.

解决SpringBoot启动报错:Failed to load property source from location 'classpath:/application.yml'

《解决SpringBoot启动报错:Failedtoloadpropertysourcefromlocationclasspath:/application.yml问题》这篇文章主要介绍... 目录在启动SpringBoot项目时报如下错误原因可能是1.yml中语法错误2.yml文件格式是GBK总结在启动S

idea maven编译报错Java heap space的解决方法

《ideamaven编译报错Javaheapspace的解决方法》这篇文章主要为大家详细介绍了ideamaven编译报错Javaheapspace的相关解决方法,文中的示例代码讲解详细,感兴趣的... 目录1.增加 Maven 编译的堆内存2. 增加 IntelliJ IDEA 的堆内存3. 优化 Mave