日韩性视频-久久久蜜桃-www中文字幕-在线中文字幕av-亚洲欧美一区二区三区四区-撸久久-香蕉视频一区-久久无码精品丰满人妻-国产高潮av-激情福利社-日韩av网址大全-国产精品久久999-日本五十路在线-性欧美在线-久久99精品波多结衣一区-男女午夜免费视频-黑人极品ⅴideos精品欧美棵-人人妻人人澡人人爽精品欧美一区-日韩一区在线看-欧美a级在线免费观看

歡迎訪問 生活随笔!

生活随笔

當前位置: 首頁 > 编程资源 > 编程问答 >内容正文

编程问答

hadoop-1.1.2 在centos环境下的部署

發布時間:2024/9/30 编程问答 31 豆豆
生活随笔 收集整理的這篇文章主要介紹了 hadoop-1.1.2 在centos环境下的部署 小編覺得挺不錯的,現在分享給大家,幫大家做個參考.

環境:

虛擬機

CentOS6.4

Java:默認的? OpenJDK1.7.0.9

1:配置JAVA_HOME

http://blog.csdn.net/wind520/article/details/9308809

2:下載

hadoop1.1.2 ?http://download.csdn.net/detail/wind520/5693609?

3:解壓

tar zxf hadoop-1.1.2-bin.tar.gz

4:配置

hadoop1/conf下需要配置的文件:

1).hadoop-env.sh

2).core-site.xml

3).hdfs-site.xml

4).mapred-site.xml

如何修改請參考 http://blog.csdn.net/wind520/article/details/9225429


5:啟動Hadoop

第一步,在hadoop目錄下創建目錄logs,用于保存日志
第二步,Format a new distributed-filesystem: 格式化namenode,創建HDFS
執行命令: ./hadoop namenode -format


[jifeng@localhost bin]$ ./hadoop namenode -format 13/07/12 17:56:14 INFO namenode.NameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting NameNode STARTUP_MSG: host = localhost/127.0.0.1 STARTUP_MSG: args = [-format] STARTUP_MSG: version = 1.1.2 STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.1 -r 1440782; compiled by 'hortonfo' on Thu Jan 31 02:03:24 UTC 2013 ************************************************************/ 13/07/12 17:56:15 INFO util.GSet: VM type = 32-bit 13/07/12 17:56:15 INFO util.GSet: 2% max memory = 19.33375 MB 13/07/12 17:56:15 INFO util.GSet: capacity = 2^22 = 4194304 entries 13/07/12 17:56:15 INFO util.GSet: recommended=4194304, actual=4194304 13/07/12 17:56:15 INFO namenode.FSNamesystem: fsOwner=jifeng 13/07/12 17:56:15 INFO namenode.FSNamesystem: supergroup=supergroup 13/07/12 17:56:15 INFO namenode.FSNamesystem: isPermissionEnabled=true 13/07/12 17:56:15 INFO namenode.FSNamesystem: dfs.block.invalidate.limit=100 13/07/12 17:56:15 INFO namenode.FSNamesystem: isAccessTokenEnabled=false accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s) 13/07/12 17:56:15 INFO namenode.NameNode: Caching file names occuring more than 10 times 13/07/12 17:56:15 INFO common.Storage: Image file of size 112 saved in 0 seconds. 13/07/12 17:56:16 INFO namenode.FSEditLog: closing edit log: position=4, editlog=/tmp/hadoop-jifeng/dfs/name/current/edits 13/07/12 17:56:16 INFO namenode.FSEditLog: close success: truncate to 4, editlog=/tmp/hadoop-jifeng/dfs/name/current/edits 13/07/12 17:56:16 INFO common.Storage: Storage directory /tmp/hadoop-jifeng/dfs/name has been successfully formatted. 13/07/12 17:56:16 INFO namenode.NameNode: SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down NameNode at localhost/127.0.0.1 ************************************************************/ [jifeng@localhost bin]$ ./start-all.sh starting namenode, logging to /home/jifeng/down/hadoop/libexec/../logs/hadoop-jifeng-namenode-localhost.localdomain.out jifeng@localhost's password: localhost: starting datanode, logging to /home/jifeng/down/hadoop/libexec/../logs/hadoop-jifeng-datanode-localhost.out jifeng@localhost's password: localhost: secondarynamenode running as process 3118. Stop it first. jobtracker running as process 3190. Stop it first. jifeng@localhost's password: localhost: tasktracker running as process 4973. Stop it first. [jifeng@localhost bin]$

第三步,啟動Hadoop,執行命令: ./start-all.sh

需要輸入3次密碼.


hadoop默認的NameNode 和 JobTracker

<ul><li><span class="codefrag">NameNode</span>?-?<a target=_blank href="http://localhost:50070/"><span style="color:#336699;">http://localhost:50070/</span></a></li><li><span class="codefrag">JobTracker</span>?-?<a target=_blank href="http://localhost:50030/"><span style="color:#336699;">http://localhost:50030/</span></a></li></ul>

其他命令:

上傳本地文件到HDFS

[jifeng@localhost hadoop]$ bin/hadoop fs -copyFromLocal local/hadoop.tar.gz /user/zip/hadoop.tar.gz

查看運行:
[jifeng@localhost hadoop]$ jps
2822 DataNode
3198 TaskTracker
3510 Jps
3043 JobTracker
2704 NameNode
2960 SecondaryNameNode


總結

以上是生活随笔為你收集整理的hadoop-1.1.2 在centos环境下的部署的全部內容,希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯,歡迎將生活随笔推薦給好友。