ambari2.7.4 集成 hue4.6.0

HUE是一个开源的Apache Hadoop UI系统,最早由Cloudera Desktop演化而来,最后由Cloudera贡献给了开源社区,HUE是基于Python Web框架Django实现的。

通过使用HUE工具,可以使用浏览器控制台对Hadoop生态圈中的各个组件进行交互控制,例如操作HDFS上的数据、运行MapReduce任务、操作HBase、操作Hive等等。

版本信息

Ambari:2.7.4

HDP:3.1.4

HUE:4.6.0

ambari-hue-service 集成插件:https://github.com/lijufeng2016/ambari-hue-service 本人已把所有坑填完,插件已适配组新版ambari

下载后,将hue-4.2.0.tgz文件拷贝到本地yum源的hue目录下.此路径可以通过查看hdp源配置文件获取,例:

# 注: 有的ambari对应HDP.repo文件
 cat /etc/yum.repos.d/hdp.repo | grep baseurl
# 显示结果如下
baseurl=http://{hostname}/ambari/HDP/centos7/2.6.3.0-235
baseurl=http://{hostname}/ambari/HDP-UTILS

结果:

[root@homaybd01 centos7]# cat /etc/yum.repos.d/hdp.repo | grep baseurl
baseurl = http://homaybd01/HDP

所以,确定在集群 homaybd01 上进行安装。

环境准备

1.hue的master节点上执行,为编译环境做准备

yum install sqlite-devel  libxslt-devel.x86_64 python-devel openldap-devel asciidoc cyrus-sasl-gssapi  libxml2-devel.x86_64 mysql-devel gcc gcc-c++ kernel-devel openssl-devel gmp-devel libffi-devel
wget -O /etc/yum.repos.d/epel.repo http://mirrors.aliyun.com/repo/epel-7.repo
yum -y install python-pip
#安装新版的nodejs
curl --silent --location https://rpm.nodesource.com/setup_10.x | bash -
yum install -y nodejs

2.所有机器上创建用户和组

groupadd hue
useradd -g hue hue

3.提前在mysql创建好hue的库并授权

CREATE DATABASE hue;
GRANT ALL PRIVILEGES ON hue.* TO hue@'%' IDENTIFIED BY '123456';
FLUSH PRIVILEGES;

4.提前建好hue在hdfs的HOME目录

hadoop fs -mkdir /user/hue
sudo -u hdfs  hadoop fs -chown hue:hue /user/hue

5.下载插件源码

在ambari server节点执行

VERSION=`hdp-select status hadoop-client | sed 's/hadoop-client - \([0-9]\.[0-9]\).*/\1/'`
rm -rf /var/lib/ambari-server/resources/stacks/HDP/$VERSION/services/HUE  
# sudo git clone https://github.com/lijufeng2016/ambari-hue-service.git /var/lib/ambari-server/resources/stacks/HDP/$VERSION/services/HUE
sudo git clone https://github.com/corwien/ambari-hue-service.git  /var/lib/ambari-server/resources/stacks/HDP/$VERSION/services/HUE

6.hue的安装包并放到你的Apache服务器上

[root@homaybd03 hue]# cd /var/lib/ambari-server/resources/stacks/HDP/$VERSION/services/HUE
[root@homaybd03 HUE]# cd package/
[root@homaybd03 package]# ls -l
total 60
-rw-r--r--. 1 root root 59034 Nov  6 01:04 archive.zip
drwxr-xr-x. 2 root root    24 Nov  6 01:04 files
drwxr-xr-x. 2 root root   105 Nov  6 01:04 scripts

HUE:4.6.0 下载地址:https://cdn.gethue.com/downloads/hue-4.6.0.tgz ,将hue-4.6.0.tgz安装包放在hue目录下

mkdir  /var/www/html/HDP/centos7/3.1.0.0-78/hue/
cd /var/www/html/HDP/centos7/3.1.0.0-78/hue/
wget https://cdn.gethue.com/downloads/hue-4.6.0.tgz

6.修改代码和环境配置

cd /var/lib/ambari-server/resources/stacks/HDP/3.1/services/HUE/package/files

vim configs.sh

USERID="admin"

PASSWD="admin"

PORT=":8080"

params.py文件

vi /var/lib/ambari-server/resources/stacks/HDP/3.1/services/HUE/package/scripts/params.py

download_url :第五步中hue-4.6.0.tgz包的位置:

http://192.168.1.121/HDP/centos7/3.1.0.0-78/hue/hue-4.6.0.tgz

ambari_server_hostname : ambari_server的安装节点主机名

ambari_server_hostname = 'homaybd05'

修改sudo.py

vim /usr/lib/ambari-agent/lib/resource_management/core/sudo.py

file

7.重启ambari

在 homaybd05 节点重启 ambari

[root@homaybd05 ~]# ambari-server restart
Using python  /usr/bin/python
Restarting ambari-server
Waiting for server stop...
Ambari Server stopped
Ambari Server running with administrator privileges.
Organizing resource files at /var/lib/ambari-server/resources...
Ambari database consistency check started...
Server PID at: /var/run/ambari-server/ambari-server.pid
Server out at: /var/log/ambari-server/ambari-server.out
Server log at: /var/log/ambari-server/ambari-server.log
Waiting for server start.............

相关文章:
ambari 2.7.5集成安装hue 4.6
ambari2.7.4集成hue4.6.0
Hive 官方文档
Hue Docker官方文档
Hue官方文档
Ambari(七)-Ambari集成Hue4.2文档(亲测有效)
Docker 安装 Hue 4.10.0

为者常成,行者常至