免费注册 查看新帖 |

Chinaunix

  平台 论坛 博客 文库
最近访问板块 发新帖
查看: 2203 | 回复: 0
打印 上一主题 下一主题

[Hadoop&HBase] 云计算hadoop的安装测试 [复制链接]

论坛徽章:
0
跳转到指定楼层
1 [收藏(0)] [报告]
发表于 2011-12-23 02:32 |只看该作者 |倒序浏览
<div align="justify"><span style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Tahoma; font-style: normal; font-variant: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: medium; "><font color="#010101" face="宋体" size="4"><span style="font-size: 14pt;"><b>操作系统</b></span></font></span></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">操作系统使用</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">Ubuntu 11.04</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">桌面版。设置</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">root</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">密码:</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">sudo passwd root</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">下载</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">jdk,jdk-6u27-linux-i586.bin</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">下载</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">hadoop, hadoop-0.20.204.0.tar.gz</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;"><br></span></font></div><div align="justify"><font color="#010101" face="宋体" size="4"><span style="font-size: 14pt;"><b>安装</b></span></font><font color="#010101" face="Calibri" size="4"><span style="font-size: 14pt;"><b>JDK</b></span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">安装</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">java6,</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">将</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">JDK</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">复制到</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">/usr/local</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">目录下,使用下面命令安装</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">sudo sh jdk-6u27-linux-i586.bin</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">设置</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">JDK</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">环境变量</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">sudo gedit /etc/environment</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">增加</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">PATH</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">、增加</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">export JAVA_HOME</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">、增加</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">export CLASSPATH</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;"><br></span></font></div><div align="justify"><font color="#010101" face="宋体" size="4"><span style="font-size: 14pt;"><b>创建用户组及用户</b></span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">创建用户组</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">hadoop</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">,创建用户</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">hadoop</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">sudo addgroup hadoop</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">sudo adduser --ingroup hadoop hadoop</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;"><br></span></font></div><div align="justify"><font color="#010101" face="宋体" size="4"><span style="font-size: 14pt;"><b>配置</b></span></font><font color="#010101" face="Calibri" size="4"><span style="font-size: 14pt;"><b>SSH</b></span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">下载</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">SSH SERVER:sudo apt-get install openssh-server</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">生成</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">SSH</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">证书:</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">1.</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">转换到</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">hadoop</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">用户下:</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">su hadoop</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">2.</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">生成空密码的</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">SSH</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">证书:</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">ssh-keygen -t rsa -P ""</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">要求输入文件名时,直接回车</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">,</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">会生成</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">.ssh</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">文件</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">完成后,测试:</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">ssh localhost</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;"><br></span></font></div><div align="justify"><font color="#010101" face="宋体" size="4"><span style="font-size: 14pt;"><b>安装</b></span></font><font color="#010101" face="Calibri" size="4"><span style="font-size: 14pt;"><b>hadoop</b></span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">复制</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">hadoop</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">安装文件到</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">/usr/local</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">sudo cp hadoop-0.20.204.0.tar.gz /usr/local</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">解压</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">hadoop</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">文件</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">sudo tar xzf hadoop-0.20.204.0.tar.gz</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">解压后生成目录</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">hadoop-0.20.204.0</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">,更改目录名称为</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">hadoop</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">,方便使用</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">sudo mv hadoop-0.20.204.0 hadoop</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">给目录</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">hadoop</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">增加执行权限</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">sudo chown -R hadoop:hadoop hadoop</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;"><br></span></font></div><div align="justify"><font color="#010101" face="宋体" size="4"><span style="font-size: 14pt;"><b>配置</b></span></font><font color="#010101" face="Calibri" size="4"><span style="font-size: 14pt;"><b>hadoop</b></span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">打开</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">hadoop/conf/core-site.xml</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">sudo gedit core-site.xml</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">增加以下内容</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">:</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">1.</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">增加临时内容存放目录,最好建在</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">hadoop</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">用户下,如果在</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">/usr/local</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">下,执行</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">hadoop</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">时,会没有权限建立临时目录</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">,</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&lt;property&gt;</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&lt;name&gt;hadoop.tmp.dir&lt;/name&gt;</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&lt;value&gt;/home/hadoop/hadoop-datastore&lt;/value&gt;</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&lt;description&gt;A base for other temporary directories.&lt;/description&gt;</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&lt;/property&gt;</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">2.</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">增加</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">namenode</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">节点</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&lt;property&gt;</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&lt;name&gt;fs.default.name&lt;/name&gt;</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&lt;value&gt;hdfs:localhost:54310&lt;/value&gt;</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&lt;description&gt;The name of the default file system.&nbsp; A URI whose</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp; scheme and authority determine the FileSystem implementation.&nbsp; The</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp; uri's scheme determines the config property (fs.SCHEME.impl) naming</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp; the FileSystem implementation class.&nbsp; The uri's authority is used to</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp; determine the host, port, etc. for a filesystem.&lt;/description&gt;</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp; &lt;/property&gt;</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&lt;/property&gt;</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">打开</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">mapred-site.xml,</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">增加</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">MapReduce job tracker</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">运行的主机和端口</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&lt;property&gt;</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp; &lt;name&gt;mapred.job.tracker&lt;/name&gt;</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp; &lt;value&gt;localhost:54311&lt;/value&gt;</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp; &lt;description&gt;The host and port that the MapReduce job tracker runs</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp; at.&nbsp; If "local", then jobs are run in-process as a single map</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp; and reduce task.</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp; &lt;/description&gt;</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&lt;/property&gt;</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">打开</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">hdfs-site.xml</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&lt;property&gt;</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp; &lt;name&gt;dfs.replication&lt;/name&gt;</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp; &lt;value&gt;1&lt;/value&gt;</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp; &lt;description&gt;Default block replication.</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp; The actual number of replications can be specified when the file is created.</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp; The default is used if replication is not specified in create time.</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&nbsp; &lt;/description&gt;</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">&lt;/property&gt;</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">格式化命名节点</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">bin/hadoop namenode -format</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">启动</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">hdfs</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">和</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">MapReduce</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">:</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">bin/start-all.sh</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">停止服务</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">:bin/stop-all.sh</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">使用</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">jps</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">命令查看运行的</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">hadoop</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">进程</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">查看集群状态命令</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">:bin/hadoop dfsadmin -report</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">使用</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">web</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">方式查看:</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">1.hdfs</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">的</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">WEB</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">页面:</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">http://localhost:50070</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">2.MapReduce</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">的</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">WEB</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">页面:</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">http://localhost:50030</span></font></div><div align="justify"><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;"><br></span></font></div><div align="justify"><font color="#010101" face="宋体" size="4"><span style="font-size: 14pt;"><b>测试</b></span></font><font color="#010101" face="Calibri" size="4"><span style="font-size: 14pt;"><b>hadoop</b></span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">使用</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">hadoop</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">所附带的例程,测试文件中的单词重复数</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">可以在</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">/home/hadoop</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">中建立</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">input</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">目录,创建两个文本文档,内容是不同的单词,文件名为</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">file01.txt,file02.txt</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">如果已经在</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">hadoop</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">中执行过程序并创建了</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">input</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">和</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">output</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">目录,在执行前先删除,否则会失败。</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">在</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">hadoop</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">中建立</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">input</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">目录</span></font><span>&nbsp;</span><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">bin/hadoop fs -mkdir input</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">将本地的两个文件上传到</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">hadoop</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">中,</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">bin/hadoop fs -copyFromLocal /home/hadoop/input/file0*.txt input</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">执行例程</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">wordcount, bin/hadoop jar hadoop-examples-0.20.204.0.jar wordcount input output</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">执行完成后,可以查看下</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">hadoop</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">中</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">output</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">目录:</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">bin/hadoop fs -ls output</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">,可以看到有三个文档,</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">_SUCCESS, _logs</span></font><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">和</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">part-r-00000</span></font></div><div align="justify"><font color="#010101" face="宋体" size="2"><span style="font-size: 10pt;">说明例程执行成功了。查看执行的结果:</span></font><font color="#010101" face="Calibri" size="2"><span style="font-size: 10pt;">bin/hadoop fs -cat output/part-r-00000</span></font></div>
您需要登录后才可以回帖 登录 | 注册

本版积分规则 发表回复

  

北京盛拓优讯信息技术有限公司. 版权所有 京ICP备16024965号-6 北京市公安局海淀分局网监中心备案编号:11010802020122 niuxiaotong@pcpop.com 17352615567
未成年举报专区
中国互联网协会会员  联系我们:huangweiwei@itpub.net
感谢所有关心和支持过ChinaUnix的朋友们 转载本站内容请注明原作者名及出处

清除 Cookies - ChinaUnix - Archiver - WAP - TOP