Intel Hadoop 发行版REST API手册2.5.1 IDH-RESTAPIGuide_R2-5-1_CN

更新时间:2023-09-06 09:48:01 阅读量: 教育文库 文档下载

说明:文章内容仅供预览,部分内容可能不全。下载后的文档,内容与下面显示的完全一致。下载之前请确认下面内容是否您想要的,是否完整无缺。

Intel Hadoop 发行版REST API手册2.5.1,可部署于SkySAN存储设备

英特尔® Apache Hadoop*软件发行版REST API手册版本2.5.1

2013年9月

文档编号:328754-006CN

Intel Hadoop 发行版REST API手册2.5.1,可部署于SkySAN存储设备

免责声明和法律信息

本文件中包含关于英特尔产品的信息。本文件不构成对任何知识产权的授权,包括明示的、暗示的,也无论是基于禁止反言的原则或其他。除英特尔产品销售的条款和条件规定的责任外,英特尔不承担任何其他责任。英特尔在此作出免责声明:本文件不构成英特尔关于其产品的使用和/或销售的任何明示或暗示的保证,包括不就其产品的(i)对某一特定用途的适用性、(ii)适销性以及(iii)对任何专利、版权或其他知识产权的侵害的承担任何责任或作出任何担保。

除非经过英特尔的书面同意认可,英特尔的产品无意被设计用于或被用于以下应用:即在这样的应用中可因英特尔产品的故障而导致人身伤亡。 英特尔有权随时更改产品的规格和描述而毋需发出通知。设计者不应信赖任何英特产品所不具有的特性,设计者亦不应信赖任何标有“保留权利”或“未定义”说明或特性描述。对此,英特尔保留将来对其进行定义的权利,同时,英特尔不应为因其日后更改该等说明或特性描述而产生的冲突和不相容承担任何责任。此处提供的信息可随时改变而毋需通知。请勿根据本文件提供的信息完成一项产品设计。

本文件所描述的产品可能包含使其与宣称的规格不符的设计缺陷或失误。这些缺陷或失误已收录于勘误表中,可索取获得。

在发出订单之前,请联系当地的英特尔营业部或分销商以获取最新的产品规格。

索取本文件中或英特尔的其他材料中提的、包含订单号的文件的复印件,可拨打1-800-548-4725,或登陆英特尔网站。

英特尔处理器标号不是性能的指标。http://www.77cn.com.cn/products/processor_number处理器标号仅用于区分同属一个系列的处理器的特性,而不能够用于区分不同系列的处理器。详情敬请登陆:http://www.77cn.com.cn/products/processor_number

Performance tests and ratings are measured using specific computer systems and/or components and reflect the approximate performance of Intel products as measured by those tests.Any difference in system hardware or software design or configuration may affect actual performance.Buyers should consult other sources of information to evaluate the performance of systems or components they are

considering purchasing.For more information on performance tests and on the performance of Intel products, visit Intel Performance Benchmark Limitations.

结果基于模拟测算得出,仅作参考之用。结果通过系统模拟器或模型测算得出。任何系统硬件、软件的设计或配置的不同均可能影响实际性能。英特尔, 英特尔® Apache Hadoop*软件发行版, 英特尔® 发行版, Intel® Manager for Apache Hadoop* software, 和Intel® Manager是英特尔在美国和/或其他国家的商标。

* 其他的名称和品牌可能是其他所有者的资产。

英特尔公司2013版权所有。所有权保留。

Intel Hadoop 发行版REST API手册2.5.1,可部署于SkySAN存储设备

文档修订记录日期

2013年3月

2013年5月

2013年6月

2013年8月

2013年9月修订001002003004005描述英特尔® Apache Hadoop*软件发行版 v2.3文档第一版英特尔® Apache Hadoop*软件发行版 v2.4文档更新英特尔® Apache Hadoop*软件发行版 v2.4.1文档更新英特尔® Apache Hadoop*软件发行版 v2.5文档更新英特尔® Apache Hadoop*软件发行版 v2.5.1文档更新

Intel Hadoop 发行版REST API手册2.5.1,可部署于SkySAN存储设备

目录

1.0简介..........................................................................................................................12

1.1先决条件...........................................................................................................12

1.2API的句法、语义和结构.........................................................................................12

1.3验证.................................................................................................................12

1.4API支持哪些功能?..............................................................................................12

1.5理解示例...........................................................................................................13

Batch.........................................................................................................................14

2.1描述.................................................................................................................14

2.2路径.................................................................................................................14

2.3URL..................................................................................................................14

2.4支持的HTTP方法..................................................................................................15

2.5使用密码验证方式批量添加节点的POST方法.................................................................15

2.5.1消息请求的结构........................................................................................15

2.5.2Curl命令................................................................................................16

2.5.3消息请求示例...........................................................................................16

2.5.4消息响应示例...........................................................................................17

2.6使用公共秘钥验证方式批量添加节点的POST方法...........................................................17

2.6.1消息请求的结构........................................................................................18

2.6.2Curl命令................................................................................................19

2.6.3消息请求示例...........................................................................................19

2.6.4消息响应示例...........................................................................................20

Cluster......................................................................................................................21

3.1描述.................................................................................................................21

3.2路径.................................................................................................................21

3.3URL..................................................................................................................21

3.4支持的HTTP方法..................................................................................................21

3.5POST.................................................................................................................21

3.5.1消息请求的结构........................................................................................22

3.5.2Curl命令................................................................................................22

3.5.3消息请求示例...........................................................................................23

3.5.4消息响应示例...........................................................................................23

3.6GET..................................................................................................................23

3.6.1Curl命令................................................................................................23

3.6.2消息响应示例...........................................................................................23

confignodes................................................................................................................25

4.1描述.................................................................................................................25

4.2路径.................................................................................................................25

4.3URL..................................................................................................................25

4.4支持的HTTP方法..................................................................................................26

4.5POST.................................................................................................................26

4.5.1Curl命令................................................................................................26

4.5.2消息响应示例...........................................................................................26

Configuration..............................................................................................................27

5.1描述.................................................................................................................27

5.2路径.................................................................................................................27

5.3URL..................................................................................................................27

5.4支持的HTTP方法..................................................................................................28

5.5POST.................................................................................................................28

5.5.1消息请求的结构........................................................................................282.03.04.05.0

Intel Hadoop 发行版REST API手册2.5.1,可部署于SkySAN存储设备

5.6

5.75.5.2Curl命令................................................................................................295.5.3消息请求示例...........................................................................................305.5.4消息响应示例...........................................................................................30PUT..................................................................................................................315.6.1消息请求的结构........................................................................................315.6.2Curl命令................................................................................................325.6.3消息请求示例...........................................................................................335.6.4消息响应示例...........................................................................................33GET..................................................................................................................34

5.7.1Curl命令................................................................................................34

5.7.1.1获得所有组件和服务的属性。...........................................................345.7.1.2获得核心Apache Hadoop*的属性......................................................345.7.1.3获得HDFS的属性.........................................................................345.7.1.4获得MapReduce的属性..................................................................345.7.1.5获得ZooKeeper的属性..................................................................345.7.1.6获得HBase的属性........................................................................345.7.1.7获得Oozie的属性........................................................................35

6.0Datanodes Status.........................................................................................................36

6.1描述.................................................................................................................36

6.2路径.................................................................................................................36

6.3URL..................................................................................................................36

6.4支持的HTTP方法..................................................................................................36

6.5GET..................................................................................................................37

6.5.1Curl命令................................................................................................37

6.5.2消息响应示例...........................................................................................37

decommissionnodes........................................................................................................38

7.1描述.................................................................................................................38

7.2路径.................................................................................................................38

7.3URL..................................................................................................................38

7.4支持的HTTP方法..................................................................................................38

7.5POST.................................................................................................................39

7.5.1Curl命令................................................................................................39

7.5.2消息请求的结构........................................................................................39

7.5.3消息请求示例...........................................................................................40

7.5.4消息响应示例...........................................................................................40

Delete Service Property................................................................................................41

8.1描述.................................................................................................................41

8.2路径.................................................................................................................41

8.3URL..................................................................................................................41

8.4支持的HTTP方法..................................................................................................42

8.5DELETE..............................................................................................................42

8.5.1Curl命令................................................................................................42

8.5.2消息响应................................................................................................42

HBase Roles................................................................................................................43

9.1描述.................................................................................................................43

9.2路径.................................................................................................................43

9.3URL..................................................................................................................43

9.4支持的HTTP方法..................................................................................................43

9.5POST.................................................................................................................43

9.5.1消息请求的结构........................................................................................44

9.5.2Curl命令................................................................................................44

9.5.3消息请求示例...........................................................................................45

9.5.4消息响应示例...........................................................................................467.08.09.0

Intel Hadoop 发行版REST API手册2.5.1,可部署于SkySAN存储设备

10.0HBase {roleName}.........................................................................................................47

10.1描述.................................................................................................................47

10.2路径.................................................................................................................47

10.3URL..................................................................................................................47

10.4支持的HTTP方法..................................................................................................47

10.5GET..................................................................................................................48

10.5.1Curl命令................................................................................................48

10.5.2消息响应示例...........................................................................................48

11.0Hive Roles..................................................................................................................49

11.1描述.................................................................................................................49

11.2路径.................................................................................................................49

11.3URL..................................................................................................................49

11.4支持的HTTP方法..................................................................................................49

11.5POST.................................................................................................................49

11.5.1消息请求的结构........................................................................................50

11.5.2Curl命令................................................................................................50

11.5.3消息请求示例...........................................................................................51

11.5.4消息响应示例...........................................................................................51

12.0Hive {roleName}...........................................................................................................52

12.1描述.................................................................................................................52

12.2路径.................................................................................................................52

12.3URL..................................................................................................................52

12.4支持的HTTP方法..................................................................................................52

12.5GET..................................................................................................................52

12.5.1Curl命令................................................................................................52

12.5.2消息响应示例...........................................................................................53

13.0hdfsformat..................................................................................................................54

13.1描述.................................................................................................................54

13.2路径.................................................................................................................54

13.3URL..................................................................................................................54

13.4支持的HTTP方法..................................................................................................54

13.5POST.................................................................................................................55

13.5.1Curl命令................................................................................................55

13.5.2消息响应示例...........................................................................................55

14.0HDFS Roles..................................................................................................................56

14.1描述.................................................................................................................56

14.2路径.................................................................................................................56

14.3URL..................................................................................................................56

14.4支持的HTTP方法..................................................................................................56

14.5POST.................................................................................................................56

14.5.1消息请求的结构........................................................................................57

14.5.2Curl命令................................................................................................57

14.5.3消息请求示例...........................................................................................58

14.5.4消息响应示例...........................................................................................59

15.0HDFS {roleName}...........................................................................................................60

15.1描述.................................................................................................................60

15.2路径.................................................................................................................60

15.3URL..................................................................................................................60

15.4支持的HTTP方法..................................................................................................60

15.5GET..................................................................................................................61

15.5.1Curl命令................................................................................................61

15.5.2消息响应示例...........................................................................................61

Intel Hadoop 发行版REST API手册2.5.1,可部署于SkySAN存储设备

16.0installsoftware...........................................................................................................62

16.1描述.................................................................................................................62

16.2路径.................................................................................................................62

16.3URL..................................................................................................................62

16.4支持的HTTP方法..................................................................................................62

16.5POST.................................................................................................................62

16.5.1消息请求的结构........................................................................................63

16.5.2Curl命令................................................................................................63

16.5.3消息请求示例...........................................................................................64

16.5.4消息响应示例...........................................................................................64

17.0MapReduce {roleName}....................................................................................................65

17.1描述.................................................................................................................65

17.2路径.................................................................................................................65

17.3URL..................................................................................................................65

17.4支持的HTTP方法..................................................................................................65

17.5GET..................................................................................................................66

17.5.1Curl命令................................................................................................66

17.5.2消息响应示例...........................................................................................66

18.0MapReduce {roleName}....................................................................................................67

18.1描述.................................................................................................................67

18.2路径.................................................................................................................67

18.3URL..................................................................................................................67

18.4支持的HTTP方法..................................................................................................67

18.5GET..................................................................................................................68

18.5.1Curl命令................................................................................................68

18.5.2消息响应示例...........................................................................................68

19.0{nodeName}..................................................................................................................69

19.1描述.................................................................................................................69

19.2路径.................................................................................................................69

19.3URL..................................................................................................................69

19.4支持的HTTP方法..................................................................................................70

19.5GET..................................................................................................................70

19.5.1Curl命令................................................................................................70

19.5.2消息响应示例...........................................................................................70

19.6DELETE..............................................................................................................70

19.6.1Curl命令................................................................................................70

19.6.2消息响应................................................................................................71

20.0Nodes.........................................................................................................................72

20.1描述.................................................................................................................72

20.2路径.................................................................................................................72

20.3URL..................................................................................................................72

20.4支持的HTTP方法..................................................................................................72

20.5使用密码验证方式添加节点的POST方法......................................................................73

20.5.1消息请求的结构........................................................................................73

20.5.2Curl命令................................................................................................74

20.5.3消息请求示例...........................................................................................74

20.5.4消息响应示例...........................................................................................75

20.6使用公共秘钥验证方式添加节点的POST方法.................................................................75

20.6.1消息请求的结构........................................................................................75

20.6.2Curl命令................................................................................................76

20.6.3消息请求示例...........................................................................................77

20.6.4消息响应示例...........................................................................................78

Intel Hadoop 发行版REST API手册2.5.1,可部署于SkySAN存储设备

20.7GET..................................................................................................................78

20.7.1Curl命令................................................................................................78

20.7.2消息响应示例...........................................................................................79

21.0Oozie {roleName}.........................................................................................................80

21.1描述.................................................................................................................80

21.2路径.................................................................................................................80

21.3URL..................................................................................................................80

21.4支持的HTTP方法..................................................................................................80

21.5GET..................................................................................................................80

21.5.1Curl命令................................................................................................80

21.5.2消息响应示例...........................................................................................81

22.0Oozie Roles................................................................................................................82

22.1描述.................................................................................................................82

22.2路径.................................................................................................................82

22.3URL..................................................................................................................82

22.4支持的HTTP方法..................................................................................................82

22.5POST.................................................................................................................82

22.5.1消息请求的结构........................................................................................83

22.5.2Curl命令................................................................................................83

22.5.3消息请求示例...........................................................................................84

22.5.4消息响应示例...........................................................................................84

23.0Proxy.........................................................................................................................85

23.1描述.................................................................................................................85

23.2路径.................................................................................................................85

23.3URL..................................................................................................................85

23.4支持的HTTP方法..................................................................................................85

23.5PUT..................................................................................................................86

23.5.1消息请求的结构........................................................................................86

23.5.2Curl命令................................................................................................86

23.5.3消息请求示例...........................................................................................87

23.6DELETE..............................................................................................................87

23.6.1Curl命令................................................................................................87

24.0{rackName}..................................................................................................................88

24.1描述.................................................................................................................88

24.2路径.................................................................................................................88

24.3URL..................................................................................................................88

24.4支持的HTTP方法..................................................................................................88

24.5PUT..................................................................................................................89

24.5.1消息请求的结构........................................................................................89

24.5.2Curl命令................................................................................................89

24.5.3消息请求示例...........................................................................................89

24.5.4消息响应示例...........................................................................................89

24.6GET..................................................................................................................90

24.6.1Curl命令................................................................................................90

24.6.2消息响应示例...........................................................................................90

24.7DELETE..............................................................................................................90

24.7.1Curl命令................................................................................................90

24.7.2消息响应................................................................................................90

25.0Racks.........................................................................................................................91

25.1描述.................................................................................................................91

25.2路径.................................................................................................................91

25.3URL..................................................................................................................91

Intel Hadoop 发行版REST API手册2.5.1,可部署于SkySAN存储设备

25.4

25.5

25.6支持的HTTP方法..................................................................................................91POST.................................................................................................................9225.5.1消息请求的结构........................................................................................9225.5.2Curl命令................................................................................................9225.5.3消息请求示例...........................................................................................9225.5.4消息响应示例...........................................................................................93GET..................................................................................................................93

25.6.1Curl命令................................................................................................93

25.6.2消息响应示例...........................................................................................94

26.0recommissionnodes........................................................................................................95

26.1描述.................................................................................................................95

26.2路径.................................................................................................................95

26.3URL..................................................................................................................95

26.4支持的HTTP方法..................................................................................................95

26.5POST.................................................................................................................95

26.5.1Curl命令................................................................................................95

26.5.2消息请求的结构........................................................................................96

26.5.3消息请求示例...........................................................................................96

26.5.4消息响应示例...........................................................................................97

27.0{serviceName}..............................................................................................................98

27.1描述.................................................................................................................98

27.2路径.................................................................................................................98

27.3URL..................................................................................................................99

27.4支持的HTTP方法..................................................................................................99

27.5GET..................................................................................................................99

27.5.1Curl命令................................................................................................99

27.5.2消息响应示例...........................................................................................99

27.6DELETE............................................................................................................100

27.6.1Curl命令..............................................................................................100

27.6.2消息响应..............................................................................................100

28.0Services..................................................................................................................101

28.1描述...............................................................................................................10128.2路径...............................................................................................................10128.3URL................................................................................................................10128.4支持的HTTP方法................................................................................................10228.5POST...............................................................................................................102

28.5.1消息请求的结构......................................................................................102

28.5.2Curl命令..............................................................................................103

28.5.3消息请求示例.........................................................................................104

28.5.4消息响应示例.........................................................................................105

28.6GET................................................................................................................106

28.6.1Curl命令..............................................................................................106

28.6.2消息响应示例.........................................................................................107

29.0{sessionID}..............................................................................................................109

29.1描述...............................................................................................................10929.2路径...............................................................................................................10929.3URL................................................................................................................11029.4支持的HTTP方法................................................................................................11029.5GET................................................................................................................110

29.5.1Curl命令..............................................................................................110

29.5.2消息响应示例.........................................................................................111

30.0Start.......................................................................................................................112

Intel Hadoop 发行版REST API手册2.5.1,可部署于SkySAN存储设备

30.1

30.2

30.3

30.4

30.5描述...............................................................................................................112路径...............................................................................................................112URL................................................................................................................113支持的HTTP方法................................................................................................113POST...............................................................................................................113

30.5.1Curl命令..............................................................................................113

30.5.2消息响应..............................................................................................114

31.0Stop........................................................................................................................115

31.1描述...............................................................................................................11531.2路径...............................................................................................................11631.3URL................................................................................................................11631.4支持的HTTP方法................................................................................................11631.5POST...............................................................................................................116

31.5.1Curl命令..............................................................................................116

31.5.2消息响应..............................................................................................117

32.0Upload.....................................................................................................................118

32.1描述...............................................................................................................11832.2路径...............................................................................................................11832.3URL................................................................................................................11832.4支持的HTTP方法................................................................................................11832.5SSH密钥的POST方法...........................................................................................119

32.5.1Curl命令..............................................................................................119

32.5.2消息响应示例.........................................................................................119

32.6Keytab的POST方法............................................................................................119

32.6.1Curl命令..............................................................................................119

32.6.2消息响应示例.........................................................................................119

33.0{userName}................................................................................................................120

33.1描述...............................................................................................................12033.2路径...............................................................................................................12033.3URL................................................................................................................12033.4支持的HTTP方法................................................................................................12033.5更改用户角色的PUT............................................................................................121

33.5.1消息请求的结构......................................................................................121

33.5.2Curl命令..............................................................................................121

33.5.3消息请求示例.........................................................................................122

33.5.4消息响应示例.........................................................................................122

33.6更改用户密码的PUT............................................................................................123

33.6.1消息请求的结构......................................................................................123

33.6.2Curl命令..............................................................................................123

33.6.3消息请求示例.........................................................................................123

33.6.4消息响应示例.........................................................................................124

33.7GET................................................................................................................124

33.7.1Curl命令..............................................................................................124

33.7.2消息响应示例.........................................................................................124

33.8DELETE............................................................................................................124

33.8.1Curl命令..............................................................................................124

33.8.2消息响应..............................................................................................125

34.0ZooKeeper Roles.........................................................................................................126

34.1描述...............................................................................................................12634.2路径...............................................................................................................12634.3URL................................................................................................................12634.4支持的HTTP方法................................................................................................126

Intel Hadoop 发行版REST API手册2.5.1,可部署于SkySAN存储设备

34.5POST...............................................................................................................126

34.5.1消息请求的结构......................................................................................127

34.5.2Curl命令..............................................................................................127

34.5.3消息请求示例.........................................................................................128

34.5.4消息响应示例.........................................................................................128

35.0ZooKeeper {roleName}..................................................................................................129

35.1描述...............................................................................................................12935.2路径...............................................................................................................12935.3URL................................................................................................................12935.4支持的HTTP方法................................................................................................12935.5GET................................................................................................................129

35.5.1Curl命令..............................................................................................129

35.5.2消息响应示例.........................................................................................130

36.0Users.......................................................................................................................131

36.1描述...............................................................................................................13136.2路径...............................................................................................................13136.3URL................................................................................................................13136.4支持的HTTP方法................................................................................................13136.5POST...............................................................................................................132

36.5.1消息请求的结构......................................................................................132

36.5.2Curl命令..............................................................................................132

36.5.3消息请求示例.........................................................................................133

36.5.4消息响应示例.........................................................................................133

36.6GET................................................................................................................133

36.6.1Curl命令..............................................................................................133

36.6.2消息响应示例.........................................................................................134

Intel Hadoop 发行版REST API手册2.5.1,可部署于SkySAN存储设备

1.0简介

本文档主要介绍英特尔® Apache Hadoop*软件发行版REST API。API的目的在于简化手工创建和配置集群的步骤。通过使用REST API,你可以创建脚本,使Apache Hadoop*集群的部署和配置自动化,并省去人工执行日常配置和操作任务。

1.1先决条件

要使用REST API,你需要了解或操作以下事项:

对JavaScript Object Notation (JSON)有一个基本了解。

要发送REST API调用请求,你必须使用一个符合RFC 2616规范的HTTP客户端,比如curl。 所有的REST API调用请求必须发送到Intel® Manager网络服务器。

客户端必须通过SSL连接到Intel® Manager。

在SSL连接中,Intel® Manager发送自我签名证书。因此,客户端不必验证证书的信任链(chain-of-trust)。

1.2API的句法、语义和结构

所有请求和回应都以JSON的形式呈现。所有API定义的资源都遵循Create-Read-Update-Delete (CRUD)句法,其中HTTP请求路径定义了要执行的实体,

下表提供CRUD句法的示例:

DELETE

(delete)

N/A

删除用户resource r0/cluster/{clusterName}/nodes/users/{userName}GET (read)获得集群中的节点名单获得赋予用户的

角色POST (create)添加节点到集群中N/APUT (update)N/A更改赋予用户的

密码或角色

1.3验证

在回应某个API调用前,Intel® Manager要求客户端已被验证。要通过验证,客户端必须通过HTTP基本验证头部发送用户名和密码。验证方法接受和Intel® Manager一样的凭证和角色。

要从API获得信息,Intel® Manager登录凭证必须被赋予Administrator或Guest角色。要通过API执行PUT、POST或DELETE方法,Intel® Manager登录凭证必须被赋予Administrator角色。

1.4API支持哪些功能?

API提供以下功能:

以用户定义的名称创建集群。

从集群中添加或移除节点。

Intel Hadoop 发行版REST API手册2.5.1,可部署于SkySAN存储设备

从集群中安装和删除服务。

停止和启动Apache Hadoop*服务。比如,通过单个REST API调用你可以启动集群中每个节点的hadoop-tasktracker服务和hadoop-jobtracker服务。

分配服务角色给节点。比如,你可以指定哪个节点是DataNode。

添加和删除机架。

将一个或多个节点放入机架。

创建或删除用户定义的服务属性。你可以更新系统或用户定义的属性。

在集群中部署服务属性变化。

退役或激活DataNode。

格式化HDFS。

获得安装在集群中的节点名单、分配给节点的服务角色以及每个Apache Hadoop*服务的状态。

1.5理解示例

在本文档中,列出了每个资源的消息请求和回应的示例。以下描述解释了这些示例发生的场景。 curl*是用来发送HTTP请求的客户端。Red Hat Enterprise Linux 6.3上使用的curl版本是

7.19.7。

当执行curl命令时,选项k将被使用,curl会和带自我签名证书的服务器建立一个SSL连接。 Intel® Manager被赋予administrator角色的登录凭证存在。用户名为admin,密码为admin。 集群名称为IDH-Cluster。

在集群中,节点的主机名通过DNS被解析。

Intel® Manager的主机名和端口为hadoop1和9443。

当执行POST方法时,以下是上述场景中所执行的curl命令:curl -u admin:admin -k --data @{file} https://hadoop1:9443/restapi/intelcloud/api/v1/{resource_path}

Intel Hadoop 发行版REST API手册2.5.1,可部署于SkySAN存储设备

2.0

2.1Batch描述

batch资源可执行以下任务:

搜索IP地址范围内的节点并将这些节点一次性添加到Apache Hadoop*集群中。只有允许管理节点登录并获得root访问权限的节点才会被添加到集群中。

搜索特定IP地址的节点,并确认哪些节点可被添加到集群中。在此情形中,节点并没有被实际添加到集群中,而是返回节点列表,表示管理节点不能成功添加这些节点到集群中。

2.2路径

资源位于以下路径:

/restapi/intelcloud/api/v1/cluster/{clusterName}/nodes/nodes/batch/{add}在此路径中,有一个或多个参数需要由用户来定义。参见下表中每个参数的描述:

路径参数

{clusterName}描述集群的用户定义的名称。要获得集群名称,在Cluster资源上使用GET方法。

决定是否要将在IP地址范围中找到的节点添加到集群中。以下为可能的

值:

true

false

如果值为true,则IP地址范围中找到的节点将被添加到集群中。如果值

为false,则返回可被添加到集群的节点列表,但节点并未被添加到集群

中。{add}

2.3URL

如果集群名称为IDH-Cluster,且在IP地址范围中找到的节点会被添加到集群中,则资源的URL为:https://hadoop1:9443/restapi/intelcloud/api/v1/cluster/IDH-Cluster/nodes/batch/true

Intel Hadoop 发行版REST API手册2.5.1,可部署于SkySAN存储设备

如果集群名称为IDH-Cluster,且在IP地址范围中找到的节点不会被添加到集群中,则资源的URL为:

https://hadoop1:9443/restapi/intelcloud/api/v1/cluster/IDH-Cluster/nodes/batch/false2.4支持的HTTP方法

资源支持以下HTTP方法:

POST

2.5使用密码验证方式批量添加节点的POST方法

发送POST方法到资源可将用户定义的IP地址范围内的所有节点添加到集群,其中管理节点使用SSH密码登录每个节点。要POST到本资源,HTTP消息请求必须包含一个JSON对象,其中定义了要搜索的IP地址范围和用于登录每个节点的登录认证信息。

JSON对象只能包含一组登录认证信息。因此,IP地址范围中的节点必须认可这些登录认证信息,以成功添加到集群中。如果集群为异构集群,多个节点有各自的SSH登录认证信息,则发送POST方法到Nodes资源,而不是本资源。关于使用Nodes资源的更多信息,参见章节20.5 使用密码验证方式添加节点的POST方法。

2.5.1消息请求的结构

JSON对象中的结构描述如下:

{

"method": "${authentication method}",

"nodeinfo":{

"beginip": "{start of IP address range}",

"endip": "{end of IP address range}",

"hostname": "{hostname",

"password": "{password}",

"rackName": "{rack}", "username": "{username}"

}

}

JSON对象中的Name-Value Pair(NVP)描述如下:名称描述

管理节点通过SSH登录到远程节点所使用

的SSH验证方法。

IP地址搜索范围中的起始IP地址。

IP地址搜索范围中的终止IP地址。 值name-value pair的二个有效值: useusernamepasswd useauthzkeyfile一个有效的IPv4地址。一个有效的IPv4地址。methodbeginipendip

Intel Hadoop 发行版REST API手册2.5.1,可部署于SkySAN存储设备

名称

hostname描述将要加入集群的节点的FQDN。

管理节点通过SSH登录到远程节点所使用

的Unix帐户名称。

如果Unix帐户名为非root用户,则远程

节点必须允许该帐户通过执行sudo bash

命令成为root用户。

管理节点通过SSH登录到远程节点所使用

的密码。密码必须为用户名name-value

pair中指定的Unix帐户密码。

要添加节点的机架名称。机架必须已经存

在于集群中。

要获得集群中的机架名单,在Racks资源

上使用GET方法。要在集群中创建一个机

架,在Racks上使用POST方法。值符合RFC 1035的域名。username任意有效的UTF-8编码字符串。password任意有效的UTF-8编码字符串。 rackName任意有效的UTF-8编码字符串。 字符串中的第一个字符必须是/。

2.5.2Curl命令

参考以下情形:

所有节点将被添加到名称为/Default的机架中。

起始IP地址为10.0.20.242。

终止IP地址为10.0.20.244。

每个节点的SSH密码是password。

所有节点的Unix帐户名为root。

和服务器端进行通信的信息被储存在名称为addnodes.json的文件中。

要在此场景中发送一个POST请求给资源,执行以下curl命令。

curl -k -u admin:admin --data @addnodes.json https://hadoop1:9443/restapi/intelcloud/api/v1/cluster/IDH-Cluster/nodes/batch/true

2.5.3消息请求示例{

"method": "useusernamepasswd",

"nodeinfo": {

"beginip":"10.0.20.242",

"endip":"10.0.20.244",

"password": "password",

"rackName": "/Default",

"username": "root"

}

}

Intel Hadoop 发行版REST API手册2.5.1,可部署于SkySAN存储设备

2.5.4消息响应示例

{

"items": [

{

"iporhostname":"10.0.20.242",

"info":"Connected"

},

{

"iporhostname":"10.0.20.244",

"info":"Connected"

},

{

"iporhostname":"10.0.20.243",

"info":"Connected"

}

]

}

在某些情况下,有些节点可被成功加入但有些却不能。要知道哪些节点已成功加入到集群,在Nodes资源上使用GET方法。

2.6使用公共秘钥验证方式批量添加节点的POST方法

发送POST方法到资源可将用户定义的IP地址范围内的所有节点添加到集群,其中管理节点使用私钥登录每个节点。要POST到本资源,HTTP消息请求必须包含一个JSON对象,其中定义了要搜索的IP地址范围和用于登录每个节点的登录认证信息。

JSON对象只能包含一组登录认证信息。因此,IP地址范围中的节点必须认可这些登录认证信息,以成功添加到集群中。如果集群为异构集群,多个节点有各自的SSH登录认证信息,则发送POST方法到Nodes资源,而不是本资源。关于使用Nodes资源的更多信息,参见章节20.6 使用公共秘钥验证方式添加节点的POST方法。

Intel Hadoop 发行版REST API手册2.5.1,可部署于SkySAN存储设备

2.6.1消息请求的结构

JSON对象中的结构描述如下:

{

"method": "${authentication method}",

"nodeinfo": {

"beginip": "{start of IP address range}",

"endip": "{end of IP address range}",

"username": "{username}",

"passphrase": "{keypassphrase}",

"authzkeyfile": "{path_to_key}",

"rackName": "{rack}"

}

}JSON对象中的Name-Value Pair(NVP)描述如下:名称描述

管理节点通过SSH登录到远程节点所使用

的SSH验证方法。

IP地址范围中开始搜索的起始IP地址。

IP地址搜索范围中的终止IP地址。

管理节点通过SSH登录到远程节点所使用

的Unix帐户名称。

如果Unix帐户名为非root用户,则远程

节点必须允许该帐户通过执行sudo bash

命令成为root用户。 值name-value pair的二个有效值: useusernamepasswd useauthzkeyfile一个有效的IPv4地址。一个有效的IPv4地址。methodbeginipendipusername任意有效的UTF-8编码字符串。

authzkeyfileSSH私钥的文件路径。当密钥上传到Intel® Manager网络服务器时,路径由Intel® Manager定义。SSH私钥可通过Upload资源上传到网络服上传到Intel® Manager网络服务器®务器。一旦密钥被上传,Intel Manager的SSH私钥的文件路径。 将返回JSON消息,它包含了上传的SSH私

钥的绝对文件路径。关于上传SSH私钥的

更多信息,参见章节32.5 SSH密钥的POST

方法。

用于解密SSH私钥的密码口令。

要添加节点的机架名称。机架必须已经存

在于集群中。

要获得集群中的机架名单,在Racks资源

上使用GET方法。要在集群中创建一个机

架,在Racks上使用POST方法。任意有效的UTF-8编码字符串。如果SSH私钥未被加密,则值为空白字符串。passhphraserackName任意有效的UTF-8编码字符串。 字符串中的第一个字符必须是/。

Intel Hadoop 发行版REST API手册2.5.1,可部署于SkySAN存储设备

2.6.2Curl命令

参考以下情形:

所有节点将被添加到名称为/Default的机架中。

起始IP地址为10.0.20.242。

终止IP地址为10.0.20.244。

已使用Upload资源为所有节点上传了一个SSH私钥。

上传的私钥位于/usr/lib/intelcloudui/webapps/webui/war/WEB-INF/data/connauthz/tmp1502605857121930868.pk。

SSH私钥已用口令加密。加密口令为123456。

所有节点的Unix帐户名为jdoe。

和服务器端进行通信的信息被储存在名称为addnodes.json的文件中。

要在此场景中发送一个POST请求给资源,执行以下curl命令。

curl -k -u admin:admin --data @addnodes.json https://hadoop1:9443/restapi/intelcloud/api/v1/cluster/IDH-Cluster/nodes/batch/true2.6.3消息请求示例{

"method": "useauthzkeyfile",

"nodeinfo":

{

"beginip":"10.0.20.242",

"endip":"10.0.20.244",

"username": "jdoe",

"passphrase":"123456",

"authzkeyfile": "/usr/lib/intelcloudui/webapps/webui/war/WEB-INF/data/connauthz/tmp1502605857121930868.pk",

"rackName": "/Default"

}

}

本文来源:https://www.bwwdw.com/article/6myh.html

Top