一、部署

可參考文檔：http://archive.cloudera.com/cdh5/cdh/5/oozie-4.0.0-cdh5.3.6/DG_QuickStart.html

1、解壓oozie

安裝包：oozie-4.0.0-cdh5.3.6-src.tar.gzext-2.2.zip##解壓 [root@hadoop-senior oozie]# tar zxf oozie-4.0.0-cdh5.3.6.tar.gz -C /opt/cdh-5.3.6/
##先停止hadoop集群[root@hadoop-senior hadoop-2.5.0-cdh5.3.6]# sbin/stop-dfs.sh[root@hadoop-senior hadoop-2.5.0-cdh5.3.6]# sbin/stop-yarn.sh[root@hadoop-senior hadoop-2.5.0-cdh5.3.6]# sbin/mr-jobhistory-daemon.sh stop historyserver

2、Oozie服務器架構

3、修改core-site.xml

##/opt/cdh-5.3.6/hadoop-2.5.0-cdh5.3.6/etc/hadoop/core-site.xml //添加以下內容<property><name>hadoop.proxyuser.root.hosts</name><value>hadoop-senior.ibeifeng.com</value></property><property><name>hadoop.proxyuser.root.groups</name><value>*</value></property>
##root //允許啟動oozie的用戶、組* //允許所有組

4、oozie-hadooplibs-4.0.0-cdh5.3.6.tar.gz

##oozie-hadooplibs-4.0.0-cdh5.3.6.tar.gz //此壓縮包是解壓oozie后出現的 [root@hadoop-senior oozie-4.0.0-cdh5.3.6]# pwd /opt/cdh-5.3.6/oozie-4.0.0-cdh5.3.6[root@hadoop-senior oozie-4.0.0-cdh5.3.6]# ls |grep hadooplibs oozie-hadooplibs-4.0.0-cdh5.3.6.tar.gz##解壓oozie-hadooplibs-4.0.0-cdh5.3.6.tar.gz [root@hadoop-senior oozie-4.0.0-cdh5.3.6]# tar zxf oozie-hadooplibs-4.0.0-cdh5.3.6.tar.gz //直接解壓到oozie安裝目錄中此時會多出一個oozie-4.0.0-cdh5.3.6目錄； [root@hadoop-senior oozie-4.0.0-cdh5.3.6]# ls oozie-4.0.0-cdh5.3.6/hadooplibs/ hadooplib-2.5.0-cdh5.3.6.oozie-4.0.0-cdh5.3.6 //支持yarn，用這個 hadooplib-2.5.0-mr1-cdh5.3.6.oozie-4.0.0-cdh5.3.6 //支持第一代MapReduce

5、創建libext目錄，cp jars

##創建libext目錄 [root@hadoop-senior oozie-4.0.0-cdh5.3.6]# pwd /opt/cdh-5.3.6/oozie-4.0.0-cdh5.3.6[root@hadoop-senior oozie-4.0.0-cdh5.3.6]# mkdir libext/##復制jar包 [root@hadoop-senior oozie-4.0.0-cdh5.3.6]# cp -r oozie-4.0.0-cdh5.3.6/hadooplibs/hadooplib-2.5.0-cdh5.3.6.oozie-4.0.0-cdh5.3.6/* libext/##復制ext-2.2.zip [root@hadoop-senior oozie-4.0.0-cdh5.3.6]# cp /opt/softwares/cdh/oozie/ext-2.2.zip libext/##為oozie創建war文件 [root@hadoop-senior oozie-4.0.0-cdh5.3.6]# bin/oozie-setup.sh prepare-war##啟動hdfs [root@hadoop-senior hadoop-2.5.0-cdh5.3.6]# sbin/hadoop-daemon.sh start namenode[root@hadoop-senior hadoop-2.5.0-cdh5.3.6]# sbin/hadoop-daemon.sh start datanode

6、sharelib

##將新的sharelib上傳到hdfs [root@hadoop-senior oozie-4.0.0-cdh5.3.6]# bin/oozie-setup.sh sharelib create -fs hdfs://hadoop-senior.ibeifeng.com:8020 -locallib oozie-sharelib-4.0.0-cdh5.3.6-yarn.tar.gz##各個目錄里都是各個組件需要的jar包 [root@hadoop-senior hadoop-2.5.0-cdh5.3.6]# bin/hdfs dfs -ls /user/root/share/lib/lib_20190510132826 Found 9 items drwxr-xr-x - root supergroup 0 2019-05-10 13:28 /user/root/share/lib/lib_20190510132826/distcp drwxr-xr-x - root supergroup 0 2019-05-10 13:28 /user/root/share/lib/lib_20190510132826/hcatalog drwxr-xr-x - root supergroup 0 2019-05-10 13:28 /user/root/share/lib/lib_20190510132826/hive drwxr-xr-x - root supergroup 0 2019-05-10 13:28 /user/root/share/lib/lib_20190510132826/hive2 drwxr-xr-x - root supergroup 0 2019-05-10 13:28 /user/root/share/lib/lib_20190510132826/mapreduce-streaming drwxr-xr-x - root supergroup 0 2019-05-10 13:28 /user/root/share/lib/lib_20190510132826/oozie drwxr-xr-x - root supergroup 0 2019-05-10 13:28 /user/root/share/lib/lib_20190510132826/pig -rw-r--r-- 3 root supergroup 1364 2019-05-10 13:28 /user/root/share/lib/lib_20190510132826/sharelib.properties drwxr-xr-x - root supergroup 0 2019-05-10 13:28 /user/root/share/lib/lib_20190510132826/sqoop

7、創建數據庫

##創建 [root@hadoop-senior oozie-4.0.0-cdh5.3.6]# bin/ooziedb.sh create -sqlfile oozie.sql -run DB Connection##復制mysql驅動 [root@hadoop-senior oozie-4.0.0-cdh5.3.6]# cp /opt/softwares/mysql-libs/mysql-connector-java-5.1.27/mysql-connector-java-5.1.27-bin.jar lib/[root@hadoop-senior oozie-4.0.0-cdh5.3.6]# ls lib/ |grep mysql mysql-connector-java-5.1.27-bin.jar

二、啟動oozie

##先配置oozie-site.xml //大概在200多行，配置hadoop的配置文件路徑 <property><name>oozie.service.HadoopAccessorService.hadoop.configurations</name><value>*=/opt/cdh-5.3.6/hadoop-2.5.0-cdh5.3.6/etc/hadoop</value><description>Comma separated AUTHORITY=HADOOP_CONF_DIR, where AUTHORITY is the HOST:PORT ofthe Hadoop service (JobTracker, HDFS). The wildcard '*' configuration isused when there is no exact match for an authority. The HADOOP_CONF_DIR containsthe relevant Hadoop *-site.xml files. If the path is relative is looked withinthe Oozie configuration directory; though the path can be absolute (i.e. to pointto Hadoop client conf/ directories in the local filesystem.</description></property>##啟動，其實就是一個tomcat，端口11000 bin/oozied.sh start##查看 [root@hadoop-senior oozie]# jps 21516 Jps 19651 DataNode 21419 Bootstrap //oozie 19542 NameNode[root@hadoop-senior oozie]# netstat -ntlp |grep 11000 tcp 0 0 :::11000 :::* LISTEN 21718/java ##訪問 在web中： http://hadoop-senior.ibeifeng.com:11000/oozie/

轉載于:https://www.cnblogs.com/weiyiming007/p/10844072.html

總結

以上是生活随笔為你收集整理的1.5-1.6 oozie部署的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。