日韩性视频-久久久蜜桃-www中文字幕-在线中文字幕av-亚洲欧美一区二区三区四区-撸久久-香蕉视频一区-久久无码精品丰满人妻-国产高潮av-激情福利社-日韩av网址大全-国产精品久久999-日本五十路在线-性欧美在线-久久99精品波多结衣一区-男女午夜免费视频-黑人极品ⅴideos精品欧美棵-人人妻人人澡人人爽精品欧美一区-日韩一区在线看-欧美a级在线免费观看

歡迎訪問 生活随笔!

生活随笔

當前位置: 首頁 > 运维知识 > Ubuntu >内容正文

Ubuntu

虚拟机安装Ubuntu与Hadoop

發布時間:2023/12/20 Ubuntu 29 豆豆
生活随笔 收集整理的這篇文章主要介紹了 虚拟机安装Ubuntu与Hadoop 小編覺得挺不錯的,現在分享給大家,幫大家做個參考.

Hadoop 安裝 in Ubuntu 64bit on VMware station

  • 1. Install VMware pro 15 on Windows 10.
  • 2. Download Ubuntu 64 bit from official website
  • 3. 在虛擬機上安裝Ubuntu
  • 4. 安裝Hadoop
    • 4.1 Install hadoop on Ubuntu system (PDF)
    • 4.2 Installation JDK. Choose Oracle JDK, open JDK not working for me.
    • 4.3 Install Hadoop (PDF)
    • 4.4 Install eclipse on Ubuntu
    • 4.5 Install Hadoop-Eclipse-Plugin (PDF)
    • 4.6 Install Apache pig
    • 4.7 Run Apache Pig Script

1. Install VMware pro 15 on Windows 10.

可以在VMware官網下載,也可以用胡蘿卜周(很良心的軟件分享者)的網站下載,有注冊碼。

2. Download Ubuntu 64 bit from official website

直接去官網下載就可以了:https://ubuntu.com/

3. 在虛擬機上安裝Ubuntu

按照提示一步步操作就可以,要想在宿主機和虛擬機復制粘貼共享文件,可以設置共享文件夾,安裝vm tools,這一步問題很多,解決方法是打vmtools 補丁,如果mnt不了,參考這里:Ubuntu論壇

4. 安裝Hadoop

4.1 Install hadoop on Ubuntu system (PDF)

Download hadoop stable version:
http://apache.mirrors.spacedump.net/hadoop/common/stable/

Note: If VM cannot connect to Wi-Fi network, re-connect your Wi-Fi to make authorization. Change to Bridge connection not working for me.

4.2 Installation JDK. Choose Oracle JDK, open JDK not working for me.

http://www.cnblogs.com/a2211009/p/4265225.html

Use second way, go to official site download the latest version of JDK: http://www.oracle.com/technetwork/java/javase/downloads/index.html

sudo mkdir /usr/lib/jvm
sudo tar -zxvf jdk-9.0.1_linux-x64_bin.tar.gz -C /usr/lib/jvm
sudo vim ~/.bashrc (vim: press i to enter insert mode and press esc to return , :wp for save and exit the vim)

#set oracle jdk environment
export JAVA_HOME=/usr/lib/jvm/ jdk-9.0.1
source ~/.bashrc
java –version

4.3 Install Hadoop (PDF)

4.4 Install eclipse on Ubuntu

In the Ubuntu software, search Eclipse and install. Default directory is /usr/lib/eclipse

4.5 Install Hadoop-Eclipse-Plugin (PDF)

Note: Plugin version 2.6 also works for Hadoop 2.9.0 in this case.

4.6 Install Apache pig

https://www.w3cschool.cn/apache_pig/apache_pig_installation.html
Download a release: http://apache.mirrors.spacedump.net/pig/
Note: Restore environment variables:
Export PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin

4.7 Run Apache Pig Script

hadoop version
start-dfs.sh
cd /$Hadoop_Home/bin/
hdfs dfs -mkdir hdfs://localhost:9000/Pig_Data
cd $HADOOP_HOME/bin
hdfs dfs -put /home/Hadoop/Pig/Pig_Data/student_data.txt dfs://localhost:9000/pig_data/
pig -x local Sample_script.pig
pig -x mapreduce Sample_script.pig

Processing time: 10G ~ 15min (4G ram 2 Cores)

總結

以上是生活随笔為你收集整理的虚拟机安装Ubuntu与Hadoop的全部內容,希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯,歡迎將生活随笔推薦給好友。