hue安装手册

更新时间:2023-10-03 02:14:01 阅读量: 综合文库 文档下载

说明:文章内容仅供预览,部分内容可能不全。下载后的文档,内容与下面显示的完全一致。下载之前请确认下面内容是否您想要的,是否完整无缺。

安装手册HUE

本文档主要参考cloudera和hortonworks的安装文档,但这两

个文档主要是针对自己产品的安装,有些配置是产品特有的配置,特别是cloudera的安装文档,hortonwork的文档不错,本手册主要是参考hortonwork的安装文档而来,并增加了thrift的插件配置和安装。

以上是hue和hadoop组件的整体结构图:

1. 安装步骤:

安装前,最好先阅读下以上提到的两篇安装手册,本手册是安装中软国际的安装包中安装的hue,也可以把yum源地址配置成hortonworks的安装包,这里的说明的yum安装源是中软国际的安装包。

主节点:master.hadoop

jobtracker节点:node4.hadoop

本手册是把hue安装在主节点master.hadoop上

2. 配置hadoop(通过ambari界面更改如下配置文件)

1. hdfs-site.xml

dfs.webhdfs.enabled true

2. core-site.xml

hadoop.proxyuser.hue.hosts *

hadoop.proxyuser.hue.groups *

3. webhcat-site.xml

webhcat.proxyuser.hue.hosts *

webhcat.proxyuser.hue.groups *

4. oozie-site.xml

oozie.service.ProxyUserService.proxyuser.hue.hosts

*

oozie.service.ProxyUserService.proxyuser.hue.groups

*

5. 配置thrift插件

1.假如安装hue server和JobTracker在同一个节点上,不需要复制插件包,

该包已经在lib下了;

2.假如安装hue server和JobTracker不在同一个节点上复master.hadoop的 /usr/lib/hadoop/lib/hue-plugins-2.2.0-SNAPSHOT.jar 至jobtracker节点node4.hadoop的 /usr/lib/hadoop/lib下

scp /usr/lib/hadoop/lib root@node4.hadoop: /usr/lib/hadoop/lib

假如没有该包,yum install hue-plugins

3 .管理界面配置插件,修改mapred-site.xml

mapreduce.jobtracker.plugins

org.apache.hadoop.thriftfs.ThriftJobTrackerPlugin

jobtracker.thrift.address node4.hadoop:9290

配置以上信息后,重启服务。

3. 安装 Hue

yum install hue

4. 配置 Hue

需要

vi /etc/hue/conf.empty/hue.ini,根据当前集群的信息,配置如下信息:

5.1 配置Web Server

1. Hue HTTP Address.

# Webserver listens on this address and port http_host=0.0.0.0 http_port=8000 2. 指定Secret Key.

输入长度在30-60的字符串:值随便定义

secret_key=secretkeysecretkeysecretkeysecretkey

3. 配置Hue for SSL.(首先要安装openssl ,默认已经安装),配置后,访问hue需要使用

https://

Install pyOpenSSL in order to configure Hue to serve over HTTPS. To install pyOpenSSL, from the root of your Hue installation path, complete the following instructions: 生成key $cd /etc/hue/

### Create a key

$openssl genrsa 1024 > host.key ### Create a self-signed certificate

$openssl req -new -x509 -nodes -sha1 -key host.key > host.cert 把生成的的两个文件信息配置到如下属性: ssl_certificate=/etc/hue/host.cert ssl_private_key=/etc/hue/host.key

5.2. Configure Hadoop

1. 配置HDFS Cluster.

# Configuration for HDFS NameNode

# ------------------------------------------------------------------------ [[hdfs_clusters]]

[[[default]]]

# Enter the filesystem uri

fs_defaultfs=hdfs://master.hadoop:8020

# Use WebHdfs/HttpFs as the communication mechanism. To fallback to # using the Thrift plugin (used in Hue 1.x), this must be uncommented # and explicitly set to the empty value.

webhdfs_url=http://master.hadoop:50070/webhdfs/v1/

## security_enabled=true

# Settings about this HDFS cluster. If you install HDFS in a # different location, you need to set the following.

# Defaults to $HADOOP_HDFS_HOME or /usr/lib/hadoop-hdfs hadoop_hdfs_home=/usr/lib/hadoop/lib

# Defaults to $HADOOP_BIN or /usr/bin/hadoop hadoop_bin=/usr/bin/hadoop

# Defaults to $HADOOP_CONF_DIR or /etc/hadoop/conf hadoop_conf_dir=/etc/hadoop/conf

2. Configure YARN (MR2) Cluster.

# Configuration for MapReduce JobTracker

# ------------------------------------------------------------------------ [[mapred_clusters]]

[[[default]]]

# Enter the host on which you are running the Hadoop JobTracker jobtracker_host=node4.hadoop

# The port where the JobTracker IPC listens on jobtracker_port=9001

# Thrift plug-in port for the JobTracker thrift_port=9290

# Whether to submit jobs to this cluster submit_to=true

# Job tracker kerberos principal ## jt_kerberos_principal=jt

## security_enabled=true

# Settings about this MR1 cluster. If you install MR1 in a # different location, you need to set the following.

# Defaults to $HADOOP_MR1_HOME or /usr/lib/hadoop-0.20-mapreduce hadoop_mapred_home=/usr/lib/hadoop/lib

# Defaults to $HADOOP_BIN or /usr/bin/hadoop hadoop_bin=/usr/bin/hadoop

# Defaults to $HADOOP_CONF_DIR or /etc/hadoop/conf hadoop_conf_dir=/etc/hadoop/conf

4. 3. 配置Beeswax

beeswax_server_host=master.hadoop beeswax_server_port=8002

beeswax_meta_server_host=localhost beeswax_meta_server_port=8003

5. 4. Configure JobDesigner and Oozie

# The URL where the Oozie service runs on. This is required in order for # users to submit jobs.

oozie_url=http://master.hadoop:11000/oozie (master.hadoop为oozie安装节点) ## security_enabled=true

# Location on HDFS where the workflows/coordinator are deployed when submitted. ## remote_deployement_dir=/user/hue/oozie/deployments

6. 6. Configure WebHCat

templeton_url=\http://master.hadoop:50111/templeton/v1/\ (master.hadoop为WebHcat的安装节点)

5. 启动Hue

execute the following command on the Hue Server:

/etc/init.d/hue start

hue服务启动后,访问hue界面: https://192.168.1.80:8000/

用户名:hue 密码:hue

6. 假如要把hue的内置数据库SQLLite换成mysql,参考文档:

cloudrea文档:Hue Installtion --->Administering HUe 文档

本文来源:https://www.bwwdw.com/article/mkod.html

Top