GPFS安装与设置

实验1 GPFS安装与设置

提示：在开始之前，请登录您所在组的AIX节点，每个节点打开至少一个窗口，以便后续操作。

目标

在本实验中将练习 如下内容

验证AIX 系统环境 安装GPFS介质 创建GPFS集群

定义NSD(Network Shared Disks) 创建GPFS文件系统

第一节：环境验证

A. AIX与GPFS版本验证

验证每个节点AIX版本

参考GPFS FAQ: http://publib.boulder.ibm.com/infocenter/clresctr/vxrx/index.jsp # oslevel

_______________________________________________________ 该AIX是否支持GPFS?

该AIX版本下对GPFS 是否有特定版本与patch要求?

________________________________________________________ AIX xlC版本？8.0以上 # lslpp -l |grep xlC|grep rte

___xlC.aix61.rte 10.1.0.2 COMMITTED XL C/C++ Runtime for AIX 6.1 xlC.rte 10.1.0.2 COMMITTED XL C/C++ Runtime

xlC.sup.aix50.rte 9.0.0.1 COMMITTED XL C/C++ Runtime for AIX _____________________________________________________ IBM JDK Version? Jdk 5 # cd /usr; ls java5

# /usr/java5/bin/java -version

__1.5_____________________________________________________

B. 网络配置验证

各节点的hostname？node1,node2,node3 PAlpar10 PAlpar11 PAlpar12

________________________________________________________ 各节点是否能相互ping 通？ # ping node1 # ping node2 # ping node3

C. 验证/etc/hosts文件，应包含组内给节点IP和hostname，如

192.168.1.11 node1 192.168.1.12 node2 192.168.1.13 node3

D. ssh安装、配置与通讯验证

#cd /home/soft/ssh; installp -agYXpd . all 先预览是否能正常安装，输出如下表示通过： SUCCESSES ---------

Filesets listed in this section passed pre-installation verification and will be installed.

Selected Filesets -----------------

openssh.base.client 5.0.0.5302 # Open Secure Shell Commands openssh.base.server 5.0.0.5302 # Open Secure Shell Server openssh.license 5.0.0.5302 # Open Secure Shell License

openssh.man.en_US 5.0.0.5302 # Open Secure Shell Documentat... openssl.base 0.9.8.840 # Open Secure Socket Layer openssl.license 0.9.8.840 # Open Secure Socket License openssl.man.en_US 0.9.8.840 # Open Secure Socket Layer

# installp -agYXd . all 安装后，如下表示正常：

openssl.man.en_US 0.9.8.840 USR APPLY SUCCESS openssl.license 0.9.8.840 USR APPLY SUCCESS openssl.base 0.9.8.840 USR APPLY SUCCESS openssl.base 0.9.8.840 ROOT APPLY SUCCESS openssh.license 5.0.0.5302 USR APPLY SUCCESS openssh.base.client 5.0.0.5302 USR APPLY SUCCESS openssh.base.server 5.0.0.5302 USR APPLY SUCCESS openssh.base.client 5.0.0.5302 ROOT APPLY SUCCESS openssh.base.server 5.0.0.5302 ROOT APPLY SUCCESS openssh.man.en_US 5.0.0.5302 USR APPLY SUCCESS

# ssh-keygen -t rsa

在每个AIX节点生成ssh-key如下： Generating public/private rsa key pair.

Enter file in which to save the key (//.ssh/id_rsa): 回车

Created directory '//.ssh'.

Enter passphrase (empty for no passphrase): 回车 Enter same passphrase again: 回车

Your identification has been saved in //.ssh/id_rsa. Your public key has been saved in //.ssh/id_rsa.pub. The key fingerprint is:

db:0b:23:aa:81:a9:b2:41:33:97:8b:6b:b7:24:fc:2c root@node1

在节点 node1 copy如下文件

# cp /.ssh/id_rsa.pub /.ssh/authorized_keys

从节点node2 copy /.ssh/id_rsa.pub 到节点１/tmp/id_rsa.pub2，需要输入节点2的root密码 从节点node3 copy /.ssh/id_rsa.pub 到节点１/tmp/id_rsa.pub3，需要输入节点3的root密码 # scp node2:/.ssh/id_rsa.pub /tmp/id_rsa.pub2 root@node2's password:

id_rsa.pub 100% 393 0.4KB/s 00:00 # scp node3:/.ssh/id_rsa.pub /tmp/id_rsa.pub3

在node1将/tmp/id_rsa.pub2; /tmp/id_rsa.pub3追加到/.ssh/authorized_keys中 #cat /tmp/id_rsa.pub2 >> /.ssh/authorized_keys #cat /tmp/id_rsa.pub3 >> /.ssh/authorized_keys

将node1上/.ssh/authorized_keys copy到node2,node3 #scp /.ssh/authorized_keys node2:/.ssh/authorized_keys #scp /.ssh/authorized_keys node3:/.ssh/authorized_keys

在node1,node2,node3节点touch 一个/.hushlogin文件，以屏蔽登录回显信息 # touch /.hushlogin

验证node1,node2,node3节点的ssh通讯,如能显示日期验证通过 on node1# ssh node2 date; ssh node3 date on node2# ssh node1 date; ssh node3 date on node3# ssh node1 date; ssh node2 date

E. rsh, dsh 配置

创建并编辑/.rhosts文件， node1 root node2 root node3 root

验证rsh通讯，如能显示日期验证通过 on node1# rsh node2 date; rsh node3 date on node2# rsh node1 date; rsh node3 date on node3# rsh node1 date; rsh node2 date 验证dsh通讯，如能显示日期验证通过 on node1# dsh -n node2 date; dsh -n node3 date

on node2# dsh -n node1 date; dsh -n node3 date on node3# dsh -n node1 date; dsh -n node2 date

F. 检查各AIX系统共享disks #lsdev –Cc disk #lspv

第二节：安装GPFS软件

A. 在node1,node2,node3上分别预览与安装GPFS软件及其PTF(Program Temporary Fix)

# dsh -n node1,node2,node3 \ # dsh -n node1,node2,node3 \

# dsh -n node1,node2,node3 \ # dsh -n node1,node2,node3 \

B. 在node1,node2,node3上分别验证GPFS软件

# dsh -n node1,node2,node3 \

Fileset Level State Type Description (Uninstaller) ---------------------------------------------------------------------------- gpfs.base 3.2.1.13 A F GPFS File Manager

gpfs.docs.data 3.2.1.1 A F GPFS Server Manpages and Documentation gpfs.gui 3.2.1.0 C F GPFS GUI

gpfs.msg.en_US 3.2.1.11 A F GPFS Server Messages - U.S. English

State codes: A -- Applied. B -- Broken. C -- Committed. E -- EFIX Locked.

O -- Obsolete. (partially migrated to newer version) ? -- Inconsistent State...Run lppchk -v.

Type codes:

F -- Installp Fileset P -- Product C -- Component T -- Feature

R -- RPM Package

C. 在node1,node2,node3上,将gpfs执行命令路径加入PATH环境变量

# echo export PATH=$PATH:/usr/lpp/mmfs/bin >>/etc/profile # . /etc/profile

D. 在node1,node2,node3上,确认gpfs PATH环境变量是否已正确

# env|grep PATH # mmlscluster

mmlscluster: 6027-1382 This node does not belong to a GPFS cluster.

mmlscluster: 6027-1639 Command failed. Examine previous error messages to determine cause.

第三节：创建一个双节点的GPFS集群

在本练习中，我们首先建一个单节点的GPFS CLUSTER。以node1为主配置服务器，并将其作为quorum与manager节点，分别以ssh,scp作为 Remote Shell和Remote File Copy命令。 Primary Configuration server (node1): ____________ Verify fully qualified path to ssh and scp: ssh path__/usr/bin/ssh___________ scp path__/usr/bin/scp___________

1) 在node1，使用mmcrcluster创建GPFS Cluster

# mmcrcluster -N node1:manager-quorum -p node1 -r /usr/bin/ssh -R /usr/bin/scp Thu Jan 7 14:36:35 BEIST 2010: 6027-1664 mmcrcluster: Processing node node1 mmcrcluster: Command successfully completed

2) 运行mmlscluster查看配置，如：

GPFS cluster information

======================== GPFS cluster name: node1

GPFS cluster id: 12398485736205447539 GPFS UID domain: node1

Remote shell command: /usr/bin/ssh Remote file copy command: /usr/bin/scp

GPFS cluster configuration servers: ----------------------------------- Primary server: node1 Secondary server: (none)

Node Daemon node name IP address Admin node name Designation ----------------------------------------------------------------------------------------------- 1 node1 172.16.69.22 node1 quorum-manager

3) 启动GPFS集群并验证状态

# mmstartup -a # mmgetstate -Lsa

Node number Node name Quorum Nodes up Total nodes GPFS state Remarks --------------------------------------------------------------------------------- 1 node1 1 1 1 active quorum node

本文来源：https://www.bwwdw.com/article/sqjp.html