EMC Greenplum安装手册_redhat

3.操作系统安装

服务器启动时根据提示使用ctrl+f键进入Raid卡设置，使用strip size 128KB, 启用读缓存, 启用写缓存, 将6块SAS划为一个磁盘组。

服务器重启后进入操作系统安装：

3.1.分区依据：

完毕使用xfs格式化如下：mkfs.xfs /dev/sda4

3.2.文件包依据：

?不要安装防火墙,selinux,LVM

?不要安装办公工具，例如office，浏览器，游戏，音视频工具

?必须安装开发工具，例如glibc

4.操作系统配置

修改内核调度/boot/grub/menu.lst文件kernal添加elevator=deadline

如下：

[root@localhost ~]# vi /boot/grub/menu.lst

default=0

timeout=5

splashimage=(hd0,0)/grub/splash.xpm.gz

hiddenmenu

title Red Hat Enterprise Linux Server (2.6.18-308.el5)

root (hd0,0)

kernel /vmlinuz-2.6.18-308.el5 ro root=LABEL=/ rhgb quiet elevator=deadline

initrd /initrd-2.6.18-308.el5.img

修改/etc/rc.d/rc.local文件中所有磁盘预读为16384（）NO

如下：

[root@localhost ~]#

blockdev --setra 16384 /dev/sd*

修改/etc/sysctl.conf添加如下内容：

net.ipv4.ip_forward = 0

net.ipv4.conf.default.accept_source_route = 0

kernel.sysrq = 0

kernel.core_uses_pid = 1

net.ipv4.tcp_syncookies = 1

kernel.msgmnb = 65536

kernel.msgmax = 65536

kernel.sem = 250 64000 100 2048 kernel.shmmax = 5000000000

kernel.shmmni = 40960

kernel.shmall = 40000000000

net.ipv4.tcp_tw_recycle=1

net.ipv4.tcp_max_syn_backlog=4096 7c3be08bdd3383c4bb4cd27adev_max_backlog=10000 vm.overcommit_memory=2

net.ipv4.conf.all.arp_filter = 1

修改/etc/security/limits.conf添加如下内容：* softnofile 1048576

* hardnofile 1048576

* softnproc 1048576

* hardnproc 1048576

修改/etc/sysconfig/network 文件中hostname

如下：

[root@localhost ~]# vi /etc/sysconfig/network NETWORKING=yes

NETWORKING_IPV6=no

HOSTNAME=crsz6sbidw01

修改所有服务器/etc/hosts建立集群通信（NO，与此不同）[root@localhost ~]# vi /etc/hosts

127.0.0.1 localhost

10.0.0.57 mdw-1 mdw crsz6sbidw01sdw1-1 sdw1

192.168.2.1 mdw-2 sdw1-2

192.168.3.1 mdw-3 sdw1-3

192.168.4.1 mdw-4 sdw1-4

10.0.0.58 smdw-1 smdw crsz6sbidw02 sdw2-1 sdw2

192.168.2.2 smdw-2 sdw2-2

192.168.3.2 smdw-3 sdw2-3

192.168.4.2 smdw-4 sdw2-4

修改/data挂载xfs设备（NO）

[root@localhost ~]# vi /etc/fstab

LABEL=/ / ext3 defaults 1 1 LABEL=/boot1 /boot ext3 defaults 1 2 tmpfs /dev/shmtmpfs defaults 0 0

devpts /dev/ptsdevptsgid=5,mode=620 0 0

sysfs /sys sysfs defaults 0 0

proc /procproc defaults 0 0

LABEL=SWAP-sda3 swap swap defaults 0 0

/dev/sda4 /data xfs rw,noatime,inode64,allocsize=16m 0 0 mount/data

修改/data目录权限完全给gpadmin

[root@localhost ~]# chown -R gpadmin:gpadmin /data

5.安装gpdb

执行安装程序，根据提示选择yes确认即可安装完毕

[root@ localhost ~]# bash greenplum-db-4.2.3.1-build-2-RHEL5-x86_64.bin

根据安装目录定义gpadmin环境变量

[gpadmin@crsz6sbidw01 ~]$ cat .bashrc

export LANG=

source /usr/local/greenplum-db/greenplum_path.sh

建立集群信任：

创建所有网口的列表文件如下：

[gpadmin@crsz6sbidw01 ~]$ cat /data/allhosts mdw

mdw-1

mdw-2

mdw-3

mdw-4

smdw

smdw-1

smdw-2

smdw-3

smdw-4

sdw1

sdw1-1

sdw1-2

sdw1-3

sdw1-4

sdw2

sdw2-1

sdw2-2

sdw2-3

sdw2-4

[gpadmin@crsz6sbidw01 ~]$ gpssh-exkeys -f /data/allhosts [STEP 1 of 5] create local ID and authorize on local host

[STEP 2 of 5] keyscan all hosts and update known_hosts file

[STEP 3 of 5] authorize current user on remote hosts

... send to mdw

... send to mdw-1

... send to mdw-2

... send to mdw-3

... send to mdw-4

... send to smdw

***

*** Enter password for smdw:

... send to smdw-1

... send to smdw-2

... send to smdw-3

... send to smdw-4

... send to sdw1

... send to sdw1-1

... send to sdw1-2

... send to sdw1-3

... send to sdw1-4

... send to sdw2

... send to sdw2-1

... send to sdw2-2

... send to sdw2-3

... send to sdw2-4

[STEP 4 of 5] determine common authentication file content

[STEP 5 of 5] copy authentication files to all remote hosts ... finished key exchange with mdw

... finished key exchange with mdw-1

... finished key exchange with mdw-2

... finished key exchange with mdw-3

... finished key exchange with mdw-4

... finished key exchange with smdw

... finished key exchange with smdw-1

... finished key exchange with smdw-2

... finished key exchange with smdw-3

... finished key exchange with smdw-4

... finished key exchange with sdw1

... finished key exchange with sdw1-1

... finished key exchange with sdw1-2

... finished key exchange with sdw1-3

... finished key exchange with sdw1-4

... finished key exchange with sdw2

... finished key exchange with sdw2-1

... finished key exchange with sdw2-2

... finished key exchange with sdw2-3

... finished key exchange with sdw2-4

[INFO] completed successfully

6.测试系统磁盘网络性能

6.1.磁盘性能测试结果：

nohupgpcheckperf -h mdw -h smdw -d /data/primary -d /data/mirror -r ds > gpcheckperfio2.log

[gpadmin@crsz6sbidw01 ~]$ cat gpcheckperfio2.log

/usr/local/greenplum-db/./bin/gpcheckperf -h mdw -h smdw -d

/data/primary -d /data/mirror -r ds

====================

disk write avg time (sec): 167.81

disk write tot bytes: 201875652608

disk write tot bandwidth (MB/s): 1147.25

disk write min bandwidth (MB/s): 571.69 [smdw]

disk write max bandwidth (MB/s): 575.56 [ mdw]

disk read avg time (sec): 123.12

disk read tot bytes: 201875652608

disk read tot bandwidth (MB/s): 1563.71

disk read min bandwidth (MB/s): 780.46 [ mdw] disk read max bandwidth (MB/s): 783.25 [smdw] stream tot bandwidth (MB/s): 16734.46 stream min bandwidth (MB/s): 8344.28 [smdw] stream max bandwidth (MB/s): 8390.18 [ mdw]

磁盘性能基本满足6块SAS盘正常水平。

6.2.网络性能测试结果：

创建4个子网IP的子文件，示例如下：[gpadmin@crsz6sbidw01 ~]$ vihostic1

mdw-1

smdw-1

[gpadmin@crsz6sbidw01 ~]$ nohupgpcheckperf -f hostic1 -r N -d /tmp> gpcheckperfnet1.log

[gpadmin@crsz6sbidw01 ~]$ cat gpcheckperfnet1.log

/usr/local/greenplum-db/./bin/gpcheckperf -f hostic1 -r N -d /tmp

-------------------

-- NETPERF TEST

-------------------

====================

== RESULT

====================

Netperf bisection bandwidth test

mdw-1 -> smdw-1 = 112.410000

smdw-1 -> mdw-1 = 112.400000

Summary:

sum = 224.81 MB/sec

min = 112.40 MB/sec

max = 112.41 MB/sec

avg = 112.41 MB/sec

median = 112.41 MB/sec

网络性能基本满足千兆网络正常水平。

7.初始化gpdb

创建初始化配置文件：

[gpadmin@crsz6sbidw01 ~]$ vigpinitsystem_config

ARRAY_NAME="EMC Greenplum DW"

SEG_PREFIX=gpseg

PORT_BASE=40000

declare -a DATA_DIRECTORY=(/data/primary /data/primary /data/primary /data/primary /data/primary /data/primary /data/primary /data/primary)

MASTER_HOSTNAME=mdw

MASTER_DIRECTORY=/data/master

MASTER_PORT=5432

TRUSTED_SHELL=ssh

CHECK_POINT_SEGMENTS=8

ENCODING=UNICODE

MIRROR_PORT_BASE=50000

REPLICATION_PORT_BASE=41000

MIRROR_REPLICATION_PORT_BASE=51000

declare -a MIRROR_DATA_DIRECTORY=(/data/mirror /data/mirror

/data/mirror /data/mirror /data/mirror /data/mirror /data/mirror

/data/mirror)

MACHINE_LIST_FILE=/home/gpadmin/hostfile_gpinitsystem

初始化系统：

[gpadmin@crsz6sbidw01 ~]$ gpinitsystem -c gpinitsystem_config -s smdw

20130117:22:47:34:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Checking configuration parameters, please wait...

20130117:22:47:34:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Reading Greenplum configuration file gpinitsystem_config

20130117:22:47:34:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Locale has not been set in gpinitsystem_config, will set to default value

20130117:22:47:34:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Locale set to en_US.utf8

20130117:22:47:34:015705 gpinitsystem:crsz6sbidw01:gpadmin-[WARN]:-Master hostname mdw does not match hostname output

20130117:22:47:34:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Checking to see if mdw can be resolved on this host

20130117:22:47:34:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Can resolve mdw to this host

20130117:22:47:34:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-No DATABASE_NAME set, will exit following template1 updates

20130117:22:47:34:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-MASTER_MAX_CONNECT not set, will set to default value 250

20130117:22:47:35:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Checking configuration parameters, Completed

20130117:22:47:35:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Commencing multi-home checks, please wait...

........

20130117:22:47:37:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Configuring build for multi-home array

20130117:22:47:37:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Commencing multi-home checks, Completed

20130117:22:47:37:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Building primary segment instance array, please wait...

........

20130117:22:47:41:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Building group mirror array type , please wait...

........

20130117:22:47:45:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Checking Master host

20130117:22:47:45:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Checking new segment hosts, please wait...

................

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Checking new segment hosts, Completed

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Greenplum Database Creation Parameters

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:---------------------------------------

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Master Configuration

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:---------------------------------------

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Master instance name = EMC Greenplum DW

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Master hostname = mdw

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Master port = 5432

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Master instance dir = /data/master/gpseg-1

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Master LOCALE = en_US.utf8

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Greenplum segment prefix = gpseg

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Master Database =

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Master connections = 250

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Master buffers = 128000kB

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Segment connections = 750

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Segment buffers = 128000kB

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Checkpoint segments = 8

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Encoding = UNICODE

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Postgresparam file = Off

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Initdb to be used = /usr/local/greenplum-db/./bin/initdb

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-GP_LIBRARY_PATH is = /usr/local/greenplum-db/./lib

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Ulimit check = Passed

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Array host connect type = Multi hostname per node

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Master IP address [1] = 10.0.0.57

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Master IP address [2] = 169.254.95.120

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Master IP address [3] = 192.168.2.1

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Master IP address [4] = 192.168.3.1

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Master IP address [5] = 192.168.4.1

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Standby Master = smdw

20130117:22:48:02:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Primary segment # = 4

20130117:22:48:03:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Standby IP address = 10.0.0.58

20130117:22:48:03:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Standby IP address = 169.254.95.120

20130117:22:48:03:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Standby IP address = 192.168.2.2

20130117:22:48:03:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Standby IP address = 192.168.3.2

20130117:22:48:03:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Standby IP address = 192.168.4.2

20130117:22:48:03:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Total Database segments = 8

20130117:22:48:03:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Trusted shell = ssh

20130117:22:48:03:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Number segment hosts = 8

20130117:22:48:03:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Mirror port base = 50000

20130117:22:48:03:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Replicaton port base = 41000

20130117:22:48:03:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Mirror replicaton port base= 51000

20130117:22:48:03:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Mirror segment # = 4

20130117:22:48:03:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Mirroring config = ON

20130117:22:48:03:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Mirroring type = Group

20130117:22:48:03:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:----------------------------------------

20130117:22:48:03:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-Greenplum Primary Segment Configuration

20130117:22:48:03:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:----------------------------------------

20130117:22:48:03:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-sdw1-1 /data/primary/gpseg0 40000 2 0 41000

20130117:22:48:03:015705 gpinitsystem:crsz6sbidw01:gpadmin-[INFO]:-sdw1-2 /data/primary/gpseg1 40001 3 1 41001

本文来源：https://www.bwwdw.com/article/vj3q.html