當(dāng)前位置：首頁 > 运维知识 > Ubuntu >内容正文

Ubuntu

Cloudera Manager安装之Cloudera Manager安装前准备(Ubuntu14.04）（一）

發(fā)布時(shí)間：2024/8/26 Ubuntu 41 豆豆

生活随笔收集整理的這篇文章主要介紹了 Cloudera Manager安装之Cloudera Manager安装前准备(Ubuntu14.04）（一）小編覺得挺不錯(cuò)的,現(xiàn)在分享給大家,幫大家做個(gè)參考.

其實(shí)，基本思路跟如下差不多，我就不多詳細(xì)說了，貼出主要圖。

　　博主，我是直接借鑒下面這位博主，來進(jìn)行安裝的！（灰常感謝他們！）

在線和離線安裝Cloudera CDH 5.6.0

?Cloudera Manager 5和CDH5離線安裝

Ubuntu14.04用apt在線/離線安裝CDH5.1.2[Apache Hadoop 2.3.0

?https://www.zybuluo.com/ncepuwanghui/note/474966

?ClouderManager官網(wǎng)

https://www.cloudera.com/documentation/manager/5-1-x/Cloudera-Manager-Installation-Guide/cm5ig_mysql.html#id_trn_pps_xm_unique_1

?說在前面的話

　　我的機(jī)器是總共4臺(tái)，分別為ubuntucmbigdata1、ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4。

　　在ubuntucmbigdata1上執(zhí)行了

sudo apt-get install cloudera-manager-daemons cloudera-manager-server sudo apt-get install cloudera-manager-daemons cloudera-manager-agent

　　即，ubuntucmbigdata1是既做server，又做agent。

　　在ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4上執(zhí)行了

sudo apt-get install cloudera-manager-daemons cloudera-manager-agent

　　即，ubuntucmbigdata2、3、和4是只做agent。

　　在ubuntucmbigdata1、ubuntucmbigdata2、ubuntucmbigdata3、ubuntucmbigdata4上

新建文件sudo vi /etc/apt/sources.list.d/cloudera-manager.list，復(fù)制以下內(nèi)容到cloudera.list里

# Packages for Cloudera Manager, Version 5, on Ubuntu 14.04 x86_64 deb [arch=amd64] http://archive.cloudera.com/cm5/ubuntu/trusty/amd64/cm trusty-cm5 contrib deb-src http://archive.cloudera.com/cm5/ubuntu/trusty/amd64/cm trusty-cm5 contrib

　　并且在在ubuntucmbigdata1、ubuntucmbigdata2、ubuntucmbigdata3、ubuntucmbigdata4上

　　向apt添加cloudera源公鑰，在所有節(jié)點(diǎn)執(zhí)行如下命令：

curl -s http://archive.cloudera.com/cm5/ubuntu/trusty/amd64/cm/archive.key | sudo apt-key add -

然后，再

sudo apt-get update

　　具體在后面我會(huì)詳細(xì)教大家怎么安裝。

　　的確，我也跟這位博主一樣，也需要在實(shí)驗(yàn)室里部署。以及也是4臺(tái)機(jī)器。（至于原因，大家都懂得，中國高校研究生喜歡4、3、2、1來進(jìn)行加速比做實(shí)驗(yàn)論文）

? ? ?在實(shí)驗(yàn)室安裝過社區(qū)版的Hadoop，當(dāng)時(shí)用的是普通PC機(jī)，安裝的過程遇到了好多問題。當(dāng)解決了大部分的安裝問題之后由于實(shí)驗(yàn)室的需求，需要安裝一個(gè)商業(yè)發(fā)行版的hadoop?，我們就采用的Cloudera 公司發(fā)行的版本。首先要說明的是CDH對(duì)內(nèi)存要求比較高，當(dāng)我們采用原來的4G內(nèi)存的PC機(jī)，只要啟動(dòng)基本內(nèi)存就滿了，并且會(huì)拖慢整個(gè)集群的運(yùn)算速度。所以說安裝CDH對(duì)硬件的要求比較高。安裝CDH 有三種安裝方式：在線安裝、半離線安裝、離線安裝。在線安裝和離線安裝我都安裝過，雖然在線安裝貌似簡(jiǎn)單但是實(shí)際用起來還是沒有離線安裝方便，我還是建議大家采用離線安裝的方式。不過下面都會(huì)介紹在線安裝的方式和離線安裝的方式。希望對(duì)別人有所幫助

　　其它的，ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4。

　參考第一步：

Cloudera Manager安裝之Cloudera Manager安裝前準(zhǔn)備(CentOS6.5）（一）

Ubuntu14.04安裝之后的一些配置

參考

ubuntu 下 visudo的使用

　　在文件末尾（按快捷鍵，Shift + g）添加bigdata ?ALL=(ALL) NOPASSWD:ALL

ctrl+o 保存

ctrl+x 退出。

?　　最后，得到如下

　　我這里，僅拿ubuntucmbigdata1來說，其他的ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4是一樣的。

　　防火墻

?　　參考

hadoop-2.6.0.tar.gz + spark-1.5.2-bin-hadoop2.6.tgz的集群搭建（單節(jié)點(diǎn)）（Ubuntu系統(tǒng)）

?　　由此，表明Ubuntu14.04是默認(rèn)沒開啟防火墻的。?

　我這里，僅拿ubuntucmbigdata1來說，其他的ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4是一樣的。

Ubuntu14.04安裝之后的一些配置

　　打開sshd_config文件，在? /etc/ssh 目錄下。

# Authentication: LoginGraceTime 120 #PermitRootLogin without-password PermitRootLogin yes StrictModes yes

　　注釋掉 #PermitRootLogin without-password 行。

　　添加 PermitRootLogin yes 行

　　修改后，如下：

　我這里，僅拿ubuntucmbigdata1來說，其他的ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4是一樣的。

修改hosts文件

　　vi /etc/hosts

在里面添加主機(jī)名和IP之間的對(duì)應(yīng)關(guān)系

#127.0.1.1 ubuntucmbigdata1192.168.86.31 ubuntucmbigdata1 192.168.86.32 ubuntucmbigdata2 192.168.86.33 ubuntucmbigdata3 192.168.86.34 ubuntucmbigdata4

　 ?我這里，僅拿ubuntucmbigdata1來說，其他的ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4是一樣的。

　　主機(jī)名

bigdata@ubuntucmbigdata1:~$ sudo vim /etc/hostname bigdata@ubuntucmbigdata2:~$ sudo vim /etc/hostname
bigdata@ubuntucmbigdata3:~$ sudo vim /etc/hostname
bigdata@ubuntucmbigdata4:~$ sudo vim /etc/hostname

　　這里肯定是對(duì)的。

配置ssh免密碼登錄（對(duì)于這一步，其實(shí)可以不做，因?yàn)?#xff0c;在CM時(shí)會(huì)自動(dòng)安裝，大家可以跳過）

　　見

Cloudera Manager安裝之Cloudera Manager安裝前準(zhǔn)備(CentOS6.5）（一）

bigdata@ubuntucmbigdata1:~$ mkdir .ssh bigdata@ubuntucmbigdata1:~$ ssh-keygen -t rsa Generating public/private rsa key pair. Enter file in which to save the key (/home/bigdata/.ssh/id_rsa):（回車） Enter passphrase (empty for no passphrase):（回車） Enter same passphrase again: （回車） Your identification has been saved in /home/bigdata/.ssh/id_rsa. Your public key has been saved in /home/bigdata/.ssh/id_rsa.pub. The key fingerprint is: 58:c2:3f:25:cb:82:5b:d5:b4:b2:ea:54:ac:e2:ea:c8 bigdata@ubuntucmbigdata1 The key's randomart image is: +--[ RSA 2048]----+ | . | | . o . | | o = + | | . O * | | . + S | | o = . | | o + | |.. . + | |.Eo.. . | +-----------------+ bigdata@ubuntucmbigdata1:~$ cd .ssh bigdata@ubuntucmbigdata1:~/.ssh$ cat id_rsa.pub >> authorized_keys bigdata@ubuntucmbigdata1:~/.ssh$ cd .. bigdata@ubuntucmbigdata1:~$ chmod 700 .ssh bigdata@ubuntucmbigdata1:~$ chmod 600 .ssh/* bigdata@ubuntucmbigdata1:~$ ssh ubuntucmbigdata1 The authenticity of host 'ubuntucmbigdata1 (127.0.1.1)' can't be established. ECDSA key fingerprint is 1c:85:65:a1:d7:f0:fe:56:4d:86:0f:6e:25:e3:80:46. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'ubuntucmbigdata1' (ECDSA) to the list of known hosts. Welcome to Ubuntu 14.04.4 LTS (GNU/Linux 4.2.0-27-generic x86_64)* Documentation: https://help.ubuntu.com/New release '16.04.2 LTS' available. Run 'do-release-upgrade' to upgrade to it.Last login: Sun Jun 25 14:45:01 2017 from 192.168.86.1 bigdata@ubuntucmbigdata1:~$ exit; logout Connection to ubuntucmbigdata1 closed. bigdata@ubuntucmbigdata1:~$ ssh ubuntucmbigdata1 Welcome to Ubuntu 14.04.4 LTS (GNU/Linux 4.2.0-27-generic x86_64)* Documentation: https://help.ubuntu.com/New release '16.04.2 LTS' available. Run 'do-release-upgrade' to upgrade to it.Last login: Sun Jun 25 15:52:15 2017 from localhost bigdata@ubuntucmbigdata1:~$ exit;

　 ?我這里，僅拿ubuntucmbigdata1來說，其他的ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4是一樣的。

　　將所有節(jié)點(diǎn)（ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4）中的共鑰id_ras.pub拷貝到ubuntucmbigdata1中的authorized_keys文件中。

bigdata@ubuntucmbigdata2:~$ cat ~/.ssh/id_rsa.pub | ssh bigdata@ubuntucmbigdata1 'cat >> ~/.ssh/authorized_keys' The authenticity of host 'ubuntucmbigdata1 (192.168.86.31)' can't be established. ECDSA key fingerprint is 1c:85:65:a1:d7:f0:fe:56:4d:86:0f:6e:25:e3:80:46. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'ubuntucmbigdata1,192.168.86.31' (ECDSA) to the list of known hosts. bigdata@ubuntucmbigdata1's password: bigdata@ubuntucmbigdata2:~$

bigdata@ubuntucmbigdata3:~$ cat ~/.ssh/id_rsa.pub | ssh bigdata@ubuntucmbigdata1 'cat >> ~/.ssh/authorized_keys' The authenticity of host 'ubuntucmbigdata1 (192.168.86.31)' can't be established. ECDSA key fingerprint is 1c:85:65:a1:d7:f0:fe:56:4d:86:0f:6e:25:e3:80:46. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'ubuntucmbigdata1,192.168.86.31' (ECDSA) to the list of known hosts. bigdata@ubuntucmbigdata1's password: bigdata@ubuntucmbigdata3:~$

bigdata@ubuntucmbigdata4:~$ cat ~/.ssh/id_rsa.pub | ssh bigdata@ubuntucmbigdata1 'cat >> ~/.ssh/authorized_keys' The authenticity of host 'ubuntucmbigdata1 (192.168.86.31)' can't be established. ECDSA key fingerprint is 1c:85:65:a1:d7:f0:fe:56:4d:86:0f:6e:25:e3:80:46. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'ubuntucmbigdata1,192.168.86.31' (ECDSA) to the list of known hosts. bigdata@ubuntucmbigdata1's password: bigdata@ubuntucmbigdata4:~$

　　得到

bigdata@ubuntucmbigdata1:~$ cd .ssh bigdata@ubuntucmbigdata1:~/.ssh$ ls authorized_keys id_rsa id_rsa.pub known_hosts bigdata@ubuntucmbigdata1:~/.ssh$ cat authorized_keys ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCrEPrX5HHQCnwWoavXUoM8N+fINUckzZ7EcDjJqs1EYkrzltdmMrKQv9VeGGj2BPaGoxzmgit+DPFGuPmPgftBOPWQnLVoILqtQd+H5m0wrK67W7Y98cUpZ+0thCbnmUZRuAES1mt2xS/bL2ibw8AvRrd6HUHOhH17Tcd/2gok32ximn48kPzs6li5d2ay8rPqgqD3QQw3NlAhVmK7RVmpsvlHCTnhrQIoNCz8A+adtK5r1jSgH7uKmPAJTqMUP2Zgv02XQTf/kjW3eacNAWR96Khdh0HsktaK6HuC+FFC+8bXqAj4Hih25EX8RTMFMl3nhGT5FPMLyt7C0Z65QhKV bigdata@ubuntucmbigdata1 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDi7mZhUMzB1h7XjWPIZo3w/Tps0Oxr3mgOeKVfoD4pme/lzgTz61FpEmgggc2WB+mNLKSG/WiazTzuSXKUdBXnM5LNeCGV3ZcWBxFrwp2+wAYH6L5wOGqRq+oQzKUHIsvqEc7TBpN3JmaqZOw4zVCwRBBzQ4cg1B2SjSsjDFLBpjlfM+N8UDG+g9OaZDlEu1z5oUyz0KsKbBtvkkSott+sB+EX4zYSDz/cwUPmSf76RJLk89AI8aX4wGS+P4Eahs5/J2wfLOnAWBG2NQoYVPKyN4sXj7OWw+aErriUJXOqLayYV5xSM2yJjT9WuzbNOiR/D7HGZBlC4wXWG+11GdO5 bigdata@ubuntucmbigdata2 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZtE7Z4cXPjv/t0bC4Ozi3HuovI6XiNe+tJ7cQ6WKp/m44a8w/FqgB4HVZLLQusuXwQM/mEzHKiL1EdPsi5om/s7A7xyDakl2OSUOqki871+/TSjFVTUOOz/H/wwHvl2QzBkb8/dMZLphU1/E4odrFhhlhGGpjK5WUdY8cYH6yyli6W3oDPZ55UG+8EnM89T1AyhC1E81xmyMzGMCj4603oZFwckOeff5n2dqeXg0CRhXO9HhsF9kSZQnE2GmR5pLZlORMkitsCKIhaf5UOBzrGENeJylHGCV1F+KlYjQ0ND4ufTUq14aAnUwBOCqCMhB1tBOBGI4O3S0+j27xumwN bigdata@ubuntucmbigdata3 ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXPtqzCU+AmRi+l5lysCEG8gbFKPItYjczvSZIe6+arOfgE/3Ozu2cwr9MABTjgd80hk7ZG4YNRxBPxKvXKtcZxGAe6poe1G5UOrlKOMLeqv1mnUiwtRVsiWp0qnPFcmMt17mpCyN7XnCOLTsdTcl+BVl0c2S2i1xoC6vRKvqV1C/nneJUmuD3KRR1zmR3+a9Wj4yhRRahO6ro/LhgqdwrEaR+NOuT+/1d058fXANToaqyUMa72pz5M2kdxZprumzmHAJ5KlOYImlGrahdLk1wPFckA2m1BMKKycxZHFm1X1O9HeSFrD9N+pdtZY1CXdc6N9hmWKzjBDqw71rZgdUd bigdata@ubuntucmbigdata4 bigdata@ubuntucmbigdata1:~/.ssh$

　　說明成功！

　　然后將中ubuntucmbigdata1的authorized_keys文件分發(fā)到所有節(jié)點(diǎn)上面。

bigdata@ubuntucmbigdata1:~/.ssh$ scp -r authorized_keys bigdata@ubuntucmbigdata2:~/.ssh/ The authenticity of host 'ubuntucmbigdata2 (192.168.86.32)' can't be established. ECDSA key fingerprint is 17:a2:fb:1e:47:dc:79:d5:2d:5a:aa:79:9b:10:c2:eb. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'ubuntucmbigdata2,192.168.86.32' (ECDSA) to the list of known hosts. bigdata@ubuntucmbigdata2's password: authorized_keys 100% 1624 1.6KB/s 00:00 bigdata@ubuntucmbigdata1:~/.ssh$ scp -r authorized_keys bigdata@ubuntucmbigdata3:~/.ssh/ The authenticity of host 'ubuntucmbigdata3 (192.168.86.33)' can't be established. ECDSA key fingerprint is 6a:32:65:61:98:78:3f:ad:08:2c:f3:a1:bc:c6:c4:91. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'ubuntucmbigdata3,192.168.86.33' (ECDSA) to the list of known hosts. bigdata@ubuntucmbigdata3's password: authorized_keys 100% 1624 1.6KB/s 00:00 bigdata@ubuntucmbigdata1:~/.ssh$ scp -r authorized_keys bigdata@ubuntucmbigdata4:~/.ssh/ The authenticity of host 'ubuntucmbigdata4 (192.168.86.34)' can't be established. ECDSA key fingerprint is f4:d5:92:17:dc:b1:8f:95:61:11:95:cd:d3:fa:2e:57. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added 'ubuntucmbigdata4,192.168.86.34' (ECDSA) to the list of known hosts. bigdata@ubuntucmbigdata4's password: authorized_keys 100% 1624 1.6KB/s 00:00 bigdata@ubuntucmbigdata1:~/.ssh$

　　大家通過ssh 相互訪問，如果都能無密碼訪問，代表ssh配置成功。這里很簡(jiǎn)單，我就不多贅述了。

bigdata@ubuntucmbigdata1:~$ ssh ubuntucmbigdata1 Welcome to Ubuntu 14.04.4 LTS (GNU/Linux 4.2.0-27-generic x86_64)* Documentation: https://help.ubuntu.com/New release '16.04.2 LTS' available. Run 'do-release-upgrade' to upgrade to it.Last login: Sun Jun 25 15:52:23 2017 from localhost bigdata@ubuntucmbigdata1:~$ exit;Connection to ubuntucmbigdata1 closed. bigdata@ubuntucmbigdata1:~$ ssh ubuntucmbigdata2 Welcome to Ubuntu 14.04.4 LTS (GNU/Linux 4.2.0-27-generic x86_64)* Documentation: https://help.ubuntu.com/New release '16.04.2 LTS' available. Run 'do-release-upgrade' to upgrade to it.Last login: Sun Jun 25 15:56:00 2017 from localhost bigdata@ubuntucmbigdata2:~$ exit; logout Connection to ubuntucmbigdata2 closed. bigdata@ubuntucmbigdata1:~$ ssh ubuntucmbigdata3 Welcome to Ubuntu 14.04.4 LTS (GNU/Linux 4.2.0-27-generic x86_64)* Documentation: https://help.ubuntu.com/New release '16.04.2 LTS' available. Run 'do-release-upgrade' to upgrade to it.Last login: Sun Jun 25 15:56:14 2017 from localhost bigdata@ubuntucmbigdata3:~$ exit; logout Connection to ubuntucmbigdata3 closed. bigdata@ubuntucmbigdata1:~$ ssh ubuntucmbigdata4 Welcome to Ubuntu 14.04.4 LTS (GNU/Linux 4.2.0-27-generic x86_64)* Documentation: https://help.ubuntu.com/New release '16.04.2 LTS' available. Run 'do-release-upgrade' to upgrade to it.Last login: Sun Jun 25 15:56:27 2017 from localhost bigdata@ubuntucmbigdata4:~$ exit; logout Connection to ubuntucmbigdata4 closed. bigdata@ubuntucmbigdata1:~$

　　這樣，就說明是成功！

JDK的安裝（建議1.8）（對(duì)于這一步，其實(shí)可以不做，因?yàn)?#xff0c;在CM時(shí)會(huì)自動(dòng)安裝，大家可以跳過）（但是要先卸載linux系統(tǒng)自帶的openjdk，因?yàn)樽詣?dòng)也是安裝的是orcal公司的）

　　見

Cloudera Manager安裝之Cloudera Manager安裝前準(zhǔn)備(CentOS6.5）（一）

　　這里，因?yàn)槭莡buntu14.04版本，作為專業(yè)人員來說，

Ubuntu14.04下Neo4j圖數(shù)據(jù)庫官網(wǎng)安裝部署步驟（圖文詳解）（博主推薦）

bigdata@ubuntucmbigdata1:~$ sudo apt-get remove openjdk*

bigdata@ubuntucmbigdata1:/usr/local$ pwd /usr/local bigdata@ubuntucmbigdata1:/usr/local$ ll total 40 drwxr-xr-x 10 root root 4096 2月 18 2016 ./ drwxr-xr-x 10 root root 4096 2月 18 2016 ../ drwxr-xr-x 2 root root 4096 2月 18 2016 bin/ drwxr-xr-x 2 root root 4096 2月 18 2016 etc/ drwxr-xr-x 2 root root 4096 2月 18 2016 games/ drwxr-xr-x 2 root root 4096 2月 18 2016 include/ drwxr-xr-x 4 root root 4096 2月 18 2016 lib/ lrwxrwxrwx 1 root root 9 6月 24 15:00 man -> share/man/ drwxr-xr-x 2 root root 4096 2月 18 2016 sbin/ drwxr-xr-x 7 root root 4096 2月 18 2016 share/ drwxr-xr-x 2 root root 4096 2月 18 2016 src/ bigdata@ubuntucmbigdata1:/usr/local$ sudo mkdir jdk bigdata@ubuntucmbigdata1:/usr/local$ ll total 44 drwxr-xr-x 11 root root 4096 6月 25 16:08 ./ drwxr-xr-x 10 root root 4096 2月 18 2016 ../ drwxr-xr-x 2 root root 4096 2月 18 2016 bin/ drwxr-xr-x 2 root root 4096 2月 18 2016 etc/ drwxr-xr-x 2 root root 4096 2月 18 2016 games/ drwxr-xr-x 2 root root 4096 2月 18 2016 include/ drwxr-xr-x 2 root root 4096 6月 25 16:08 jdk/ drwxr-xr-x 4 root root 4096 2月 18 2016 lib/ lrwxrwxrwx 1 root root 9 6月 24 15:00 man -> share/man/ drwxr-xr-x 2 root root 4096 2月 18 2016 sbin/ drwxr-xr-x 7 root root 4096 2月 18 2016 share/ drwxr-xr-x 2 root root 4096 2月 18 2016 src/ bigdata@ubuntucmbigdata1:/usr/local$ sudo chown -R bigdata:bigdata jdk/ bigdata@ubuntucmbigdata1:/usr/local$ cd jdk/ bigdata@ubuntucmbigdata1:/usr/local/jdk$ pwd /usr/local/jdk bigdata@ubuntucmbigdata1:/usr/local/jdk$ sudo rz rz waiting to receive. bigdata@ubuntucmbigdata1:/usr/local/jdk$ ll total 177000 drwxr-xr-x 2 bigdata bigdata 4096 6月 25 16:09 ./ drwxr-xr-x 11 root root 4096 6月 25 16:08 ../ -rw-r--r-- 1 root root 181238643 9月 3 2016 jdk-8u60-linux-x64.tar.gz bigdata@ubuntucmbigdata1:/usr/local/jdk$ sudo tar -zxvf jdk-8u60-linux-x64.tar.gz

bigdata@ubuntucmbigdata1:/usr/local/jdk$ ll total 177004 drwxr-xr-x 3 bigdata bigdata 4096 6月 25 16:09 ./ drwxr-xr-x 11 root root 4096 6月 25 16:08 ../ drwxr-xr-x 8 uucp 143 4096 8月 5 2015 jdk1.8.0_60/ -rw-r--r-- 1 root root 181238643 9月 3 2016 jdk-8u60-linux-x64.tar.gz bigdata@ubuntucmbigdata1:/usr/local/jdk$ sudo rm jdk-8u60-linux-x64.tar.gz bigdata@ubuntucmbigdata1:/usr/local/jdk$ sudo chown -R bigdata:bigdata jdk1.8.0_60/ bigdata@ubuntucmbigdata1:/usr/local/jdk$ ll total 12 drwxr-xr-x 3 bigdata bigdata 4096 6月 25 16:10 ./ drwxr-xr-x 11 root root 4096 6月 25 16:08 ../ drwxr-xr-x 8 bigdata bigdata 4096 8月 5 2015 jdk1.8.0_60/ bigdata@ubuntucmbigdata1:/usr/local/jdk$ sudo vim /etc/profile bigdata@ubuntucmbigdata1:/usr/local/jdk$ sudo source /etc/profile sudo: source: command not found bigdata@ubuntucmbigdata1:/usr/local/jdk$ source /etc/profile bigdata@ubuntucmbigdata1:/usr/local/jdk$ java -version java version "1.8.0_60" Java(TM) SE Runtime Environment (build 1.8.0_60-b27) Java HotSpot(TM) 64-Bit Server VM (build 25.60-b23, mixed mode) bigdata@ubuntucmbigdata1:/usr/local/jdk$

　 ?我這里，僅拿ubuntucmbigdata1來說，其他的ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4是一樣的。

以及，我們還可以設(shè)置文件打開數(shù)量和用于最大進(jìn)程數(shù)

　　文件打開數(shù)量

　　參考

Cloudera Manager安裝之Cloudera Manager安裝前準(zhǔn)備(CentOS6.5）（一）

bigdata@ubuntucmbigdata1:~$ sudo vi /etc/security/limits.conf

* soft nofile 65535 * hard nofile 65535 * soft nproc 32000 * hard nproc 32000

　 ?我這里，僅拿ubuntucmbigdata1來說，其他的ubuntucmbigdata2、ubuntucmbigdata3和ubuntucmbigdata4是一樣的。

?　　ubuntu系統(tǒng)的root用戶開啟

　　參考

Ubuntu14.04安裝之后的一些配置

bigdata@ubuntucmbigdata1:~$ sudo -s root@ubuntucmbigdata1:~# pwd /home/bigdata root@ubuntucmbigdata1:~#

?MySQL的安裝（以下步驟僅僅在ubuntucmbigdata1這臺(tái)機(jī)器上做）

　　注意：Cloudera-Manages-Server 端需要安裝?MySQL，Cloudera-Manages-Agent 端可以不裝。

?　　即，在我這里就是，Cloudera-Manages-Server 是cmbigdata1。同時(shí)，我也是喜歡把oozie、hive等這些，都是安裝在cmbigdata1這臺(tái)機(jī)器上。

　　Cloudera-Manages-Agent，在我這里就是，cmbigdata2、cmbigdata3和cmbigdata4。

?　　參考

60分鐘內(nèi)從零起步駕馭Hive實(shí)戰(zhàn)學(xué)習(xí)筆記（Ubuntu里安裝mysql）

Ubuntu 14.04 MySQL 安裝配置 For Cloudera Manages 5

root@ubuntucmbigdata1:~# apt-get install mysql-server

。。。。。。 Setting up libdbd-mysql-perl (4.025-1ubuntu0.1) ... Setting up libterm-readkey-perl (2.31-1) ... Setting up mysql-client-5.5 (5.5.55-0ubuntu0.14.04.1) ... Setting up mysql-server-5.5 (5.5.55-0ubuntu0.14.04.1) ... 170625 16:28:33 [Warning] Using unique option prefix key_buffer instead of key_buffer_size is deprecated and will be removed in a future release. Please use the full name instead. 170625 16:28:33 [Note] Ignoring --secure-file-priv value as server is running with --bootstrap. 170625 16:28:33 [Note] /usr/sbin/mysqld (mysqld 5.5.55-0ubuntu0.14.04.1) starting as process 7930 ... mysql start/running, process 8062 Setting up libhtml-template-perl (2.95-1) ... Processing triggers for ureadahead (0.100.0-16) ... Setting up mysql-server (5.5.55-0ubuntu0.14.04.1) ... Processing triggers for libc-bin (2.19-0ubuntu6.7) ... root@ubuntucmbigdata1:~#

安裝成功!

　　啟動(dòng)mysql服務(wù)

安裝MySql成功后，mysql服務(wù)會(huì)自動(dòng)啟動(dòng)

root@ubuntucmbigdata1:~# service mysql start
或者
root@ubuntucmbigdata1:~# sudo /etc/init.d/mysql start

　　安裝mysql JDBC驅(qū)動(dòng)

root@ubuntucmbigdata1:~# apt-get install libmysql-java

?設(shè)置MySQL的root用戶設(shè)置密碼，這一步，就不需要做了，在CentOS版本里，需要做。在Ubuntu版本，在安裝時(shí)，就已經(jīng)設(shè)置了。

?　　跳過，就是

創(chuàng)建Cloudera-Manages-Server 需要用到的數(shù)據(jù)庫表 for MySql。

　　Creating Databases for Activity Monitor, Reports Manager,?Hive?Metastore Server, Sentry Server, Cloudera Navigator AuditServer, and Cloudera Navigator Metadata Server

root@ubuntucmbigdata1:~# mysql -root -p Enter password: （密碼為rootroot） Welcome to the MySQL monitor. Commands end with ; or \g. Your MySQL connection id is 42 Server version: 5.5.55-0ubuntu0.14.04.1 (Ubuntu)Copyright (c) 2000, 2017, Oracle and/or its affiliates. All rights reserved.Oracle is a registered trademark of Oracle Corporation and/or its affiliates. Other names may be trademarks of their respective owners.Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.mysql>

　　執(zhí)行創(chuàng)建數(shù)據(jù)庫腳本語句。

mysql> create database hive DEFAULT CHARACTER SET utf8; Ignoring query to other database mysql> grant all on hive.* TO 'hive'@'localhost' IDENTIFIED BY 'hive_password'; Ignoring query to other database mysql> grant all on *.* TO 'hive'@'ubuntucmbigdata1' IDENTIFIED BY 'hive_password'; Ignoring query to other database mysql> grant all on hive.* TO 'hive'@'%' IDENTIFIED BY 'hive_password'; Ignoring query to other database mysql> create database oozie DEFAULT CHARACTER SET utf8; Ignoring query to other database mysql> grant all on oozie.* TO 'oozie'@'localhost' IDENTIFIED BY 'oozie_password'; Ignoring query to other database mysql> grant all on *.* TO 'oozie'@'ubuntucmbigdata1' IDENTIFIED BY 'oozie_password'; Ignoring query to other database mysql> grant all on oozie.* TO 'oozie'@'%' IDENTIFIED BY 'oozie_password'; Ignoring query to other database mysql> create database amon DEFAULT CHARACTER SET utf8; Ignoring query to other database mysql> grant all on amon.* TO 'amon'@'localhost' IDENTIFIED BY 'amon_password'; Ignoring query to other database mysql> grant all on *.* TO 'amon'@'ubuntucmbigdata1' IDENTIFIED BY 'amon_password'; Ignoring query to other database mysql> grant all on amon.* TO 'amon'@'%' IDENTIFIED BY 'amon_password'; Ignoring query to other database mysql> create database smon DEFAULT CHARACTER SET utf8; Ignoring query to other database mysql> grant all on smon.* TO 'smon'@'localhost' IDENTIFIED BY 'smon_password'; Ignoring query to other database mysql> grant all on *.* TO 'smon'@'ubuntucmbigdata1' IDENTIFIED BY 'smon_password'; Ignoring query to other database mysql> grant all on smon.* TO 'smon'@'%' IDENTIFIED BY 'smon_password'; Ignoring query to other database mysql> create database rman DEFAULT CHARACTER SET utf8; Ignoring query to other database mysql> grant all on rman.* TO 'rman'@'localhost' IDENTIFIED BY 'rman_password'; Ignoring query to other database mysql> grant all on *.* TO 'rman'@'ubuntucmbigdata1' IDENTIFIED BY 'rman_password'; Ignoring query to other database mysql> grant all on rman.* TO 'rman'@'%' IDENTIFIED BY 'rman_password'; Ignoring query to other database mysql> create database hmon DEFAULT CHARACTER SET utf8; Ignoring query to other database mysql> grant all on hmon.* TO 'hmon'@'localhost' IDENTIFIED BY 'hmon_password'; Ignoring query to other database mysql> grant all on *.* TO 'hmon'@'ubuntucmbigdata1' IDENTIFIED BY 'hmon_password'; Ignoring query to other database mysql> grant all on hmon.* TO 'hmon'@'%' IDENTIFIED BY 'hmon_password'; Ignoring query to other database mysql> create database nav DEFAULT CHARACTER SET utf8; Ignoring query to other database mysql> grant all on nav.* TO 'nav'@'localhost' IDENTIFIED BY 'nav_password'; Ignoring query to other database mysql> grant all on *.* TO 'nav'@'ubuntucmbigdata1' IDENTIFIED BY 'nav_password'; Ignoring query to other database mysql> grant all on nav.* TO 'nav'@'%' IDENTIFIED BY 'nav_password'; Ignoring query to other database mysql>

歡迎大家，加入我的微信公眾號(hào)：大數(shù)據(jù)躺過的坑 ? ? 免費(fèi)給分享 ?

同時(shí)，大家可以關(guān)注我的個(gè)人博客：

???http://www.cnblogs.com/zlslch/?? 和 ?http://www.cnblogs.com/lchzls/?

　　人生苦短，我愿分享。本公眾號(hào)將秉持活到老學(xué)到老學(xué)習(xí)無休止的交流分享開源精神，匯聚于互聯(lián)網(wǎng)和個(gè)人學(xué)習(xí)工作的精華干貨知識(shí)，一切來于互聯(lián)網(wǎng)，反饋回互聯(lián)網(wǎng)。
　　目前研究領(lǐng)域：大數(shù)據(jù)、機(jī)器學(xué)習(xí)、深度學(xué)習(xí)、人工智能、數(shù)據(jù)挖掘、數(shù)據(jù)分析。語言涉及：Java、Scala、Python、Shell、Linux等。同時(shí)還涉及平常所使用的手機(jī)、電腦和互聯(lián)網(wǎng)上的使用技巧、問題和實(shí)用軟件。只要你一直關(guān)注和呆在群里，每天必須有收獲

? ? ? ?以及對(duì)應(yīng)本平臺(tái)的QQ群：161156071（大數(shù)據(jù)躺過的坑）

轉(zhuǎn)載于:https://www.cnblogs.com/zlslch/p/7078450.html

總結(jié)

以上是生活随笔為你收集整理的Cloudera Manager安装之Cloudera Manager安装前准备(Ubuntu14.04）（一）的全部內(nèi)容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網(wǎng)站內(nèi)容還不錯(cuò)，歡迎將生活随笔推薦給好友。

上一篇： python实现网页登录时的rsa加密流
下一篇： ubuntu18.04安装pycharm

Ubuntu

Cloudera Manager安装之Cloudera Manager安装前准备(Ubuntu14.04）（一）

Ubuntu14.04用apt在線/離線安裝CDH5.1.2[Apache Hadoop 2.3.0

Cloudera Manager安裝之Cloudera Manager安裝前準(zhǔn)備(CentOS6.5）（一）

Ubuntu14.04安裝之后的一些配置

ubuntu 下 visudo的使用

hadoop-2.6.0.tar.gz + spark-1.5.2-bin-hadoop2.6.tgz的集群搭建（單節(jié)點(diǎn)）（Ubuntu系統(tǒng)）

相關(guān)服務(wù)的安裝

Ubuntu14.04安裝之后的一些配置

修改hosts文件

配置ssh免密碼登錄 （對(duì)于這一步，其實(shí)可以不做，因?yàn)?#xff0c;在CM時(shí)會(huì)自動(dòng)安裝，大家可以跳過）

Cloudera Manager安裝之Cloudera Manager安裝前準(zhǔn)備(CentOS6.5）（一）

JDK的安裝（建議1.8）（對(duì)于這一步，其實(shí)可以不做，因?yàn)?#xff0c;在CM時(shí)會(huì)自動(dòng)安裝，大家可以跳過）（但是要先卸載linux系統(tǒng)自帶的openjdk，因?yàn)樽詣?dòng)也是安裝的是orcal公司的）

Cloudera Manager安裝之Cloudera Manager安裝前準(zhǔn)備(CentOS6.5）（一）

Ubuntu14.04下Neo4j圖數(shù)據(jù)庫官網(wǎng)安裝部署步驟（圖文詳解）（博主推薦）

Cloudera Manager安裝之Cloudera Manager安裝前準(zhǔn)備(CentOS6.5）（一）

Ubuntu14.04安裝之后的一些配置

60分鐘內(nèi)從零起步駕馭Hive實(shí)戰(zhàn)學(xué)習(xí)筆記（Ubuntu里安裝mysql）

啟動(dòng)mysql服務(wù)

安裝mysql JDBC驅(qū)動(dòng)

創(chuàng)建Cloudera-Manages-Server 需要用到的數(shù)據(jù)庫表 for MySql。

總結(jié)

配置ssh免密碼登錄（對(duì)于這一步，其實(shí)可以不做，因?yàn)?#xff0c;在CM時(shí)會(huì)自動(dòng)安裝，大家可以跳過）

　　啟動(dòng)mysql服務(wù)

　　安裝mysql JDBC驅(qū)動(dòng)