日韩性视频-久久久蜜桃-www中文字幕-在线中文字幕av-亚洲欧美一区二区三区四区-撸久久-香蕉视频一区-久久无码精品丰满人妻-国产高潮av-激情福利社-日韩av网址大全-国产精品久久999-日本五十路在线-性欧美在线-久久99精品波多结衣一区-男女午夜免费视频-黑人极品ⅴideos精品欧美棵-人人妻人人澡人人爽精品欧美一区-日韩一区在线看-欧美a级在线免费观看

歡迎訪問 生活随笔!

生活随笔

當前位置: 首頁 > 运维知识 > windows >内容正文

windows

hadoop-1.1.2 在Windows环境下的部署

發布時間:2024/9/30 windows 25 豆豆
生活随笔 收集整理的這篇文章主要介紹了 hadoop-1.1.2 在Windows环境下的部署 小編覺得挺不錯的,現在分享給大家,幫大家做個參考.

1:先安裝Cygwin

? 參考http://blog.csdn.net/wind520/article/details/9223003

2:下載

?http://download.csdn.net/detail/wind520/5693609

3:解壓在C:\cygwin\hadoop1

4:配置

hadoop1/conf下需要配置的文件:

1).hadoop-env.sh

2).core-site.xml

3).hdfs-site.xml

4).mapred-site.xml

如何修改請參考 http://blog.csdn.net/wind520/article/details/9225429

5:啟動Hadoop

第一步,在hadoop1目錄下創建目錄logs,用于保存日志
第二步,Format a new distributed-filesystem: 格式化namenode,創建HDFS
執行命令: bin/hadoop namenode -format

? 開始沒有格式化,導致打不開

  • NameNode?-?http://localhost:50070/

    ?

    lenovo@lenovo-PC ~ $ cd ..lenovo@lenovo-PC /home $ cd hadoop1 -bash: cd: hadoop1: No such file or directorylenovo@lenovo-PC /home $ cd ../hadoop1lenovo@lenovo-PC /hadoop1 $ bin/hadoop namenode -format [INFO ][mgmnt ] Local JMX connector started 13/07/03 15:44:30 INFO namenode.NameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting NameNode STARTUP_MSG: host = lenovo-PC/10.6.3.180 STARTUP_MSG: args = [-format] STARTUP_MSG: version = 1.1.2 STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/b ranch-1.1 -r 1440782; compiled by 'hortonfo' on Thu Jan 31 02:03:24 UTC 2013 ************************************************************/ Re-format filesystem in \tmp\hadoop-lenovo\dfs\name ? (Y or N) Y 13/07/03 15:44:35 INFO util.GSet: VM type = 32-bit 13/07/03 15:44:35 INFO util.GSet: 2% max memory = 20.0 MB 13/07/03 15:44:35 INFO util.GSet: capacity = 2^22 = 4194304 entries 13/07/03 15:44:35 INFO util.GSet: recommended=4194304, actual=4194304 13/07/03 15:44:35 INFO namenode.FSNamesystem: fsOwner=lenovo 13/07/03 15:44:35 INFO namenode.FSNamesystem: supergroup=supergroup 13/07/03 15:44:35 INFO namenode.FSNamesystem: isPermissionEnabled=true 13/07/03 15:44:35 INFO namenode.FSNamesystem: dfs.block.invalidate.limit=100 13/07/03 15:44:35 INFO namenode.FSNamesystem: isAccessTokenEnabled=false accessK eyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s) 13/07/03 15:44:35 INFO namenode.NameNode: Caching file names occuring more than 10 times 13/07/03 15:44:36 INFO common.Storage: Image file of size 112 saved in 0 seconds . 13/07/03 15:44:36 INFO namenode.FSEditLog: closing edit log: position=4, editlog =\tmp\hadoop-lenovo\dfs\name\current\edits 13/07/03 15:44:36 INFO namenode.FSEditLog: close success: truncate to 4, editlog =\tmp\hadoop-lenovo\dfs\name\current\edits 13/07/03 15:44:36 INFO common.Storage: Storage directory \tmp\hadoop-lenovo\dfs\ name has been successfully formatted. 13/07/03 15:44:36 INFO namenode.NameNode: SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down NameNode at lenovo-PC/10.6.3.180 ************************************************************/

    第三步,啟動Hadoop,執行命令: bin/start-all.sh

    需要輸入3次密碼

    lenovo@lenovo-PC /hadoop1 $ bin/start-all.sh starting namenode, logging to /hadoop1/libexec/../logs/hadoop-lenovo-namenode-lenovo-PC.out lenovo@localhost's password: localhost: starting datanode, logging to /hadoop1/libexec/../logs/hadoop-lenovo-datanode-lenovo-PC.out lenovo@localhost's password: localhost: starting secondarynamenode, logging to /hadoop1/libexec/../logs/hadoop-lenovo-secondarynamenode-lenovo-PC.out starting jobtracker, logging to /hadoop1/libexec/../logs/hadoop-lenovo-jobtracker-lenovo-PC.out lenovo@localhost's password: localhost: starting tasktracker, logging to /hadoop1/libexec/../logs/hadoop-lenovo-tasktracker-lenovo-PC.outlenovo@lenovo-PC /hadoop1 $ psPID PPID PGID WINPID TTY UID STIME COMMAND59592 1 42744 60224 pty0 1000 15:45:31 /cygdrive/d/java/Tomcat6/jdk/bin/java58584 58340 58584 58612 pty0 1000 15:43:22 /usr/bin/bash62296 1 42744 63540 pty0 1000 15:45:48 /cygdrive/d/java/Tomcat6/jdk/bin/java58844 58584 58844 58936 pty0 1000 15:54:51 /usr/bin/ps62812 1 62208 63448 ? 1000 15:45:46 /cygdrive/d/java/Tomcat6/jdk/bin/java58340 1 58340 58340 ? 1000 15:43:22 /usr/bin/minttylenovo@lenovo-PC /hadoop1 $


    hadoop只運行3個JVM進程。


    ?hadoop默認的NameNode 和 JobTracker

    • NameNode?-?http://localhost:50070/
    • JobTracker?-?http://localhost:50030/

        ?

      總結

      以上是生活随笔為你收集整理的hadoop-1.1.2 在Windows环境下的部署的全部內容,希望文章能夠幫你解決所遇到的問題。

      如果覺得生活随笔網站內容還不錯,歡迎將生活随笔推薦給好友。