-
Notifications
You must be signed in to change notification settings - Fork 3
/
Copy pathREADME
96 lines (62 loc) · 2.43 KB
/
README
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
Hadoop Management System
HMS is open-sourced under the Apache Software Foundation License v2.0.
Quick Start
1. Setup Zookeeper
2. Compile HMS
mvn clean package
3. Setup HMS beacon on zookeeper nodes
$PREFIX/bin/hms beacon
4. Setup HMS controller
$PREFIX/bin/hms controller
5. Deploy HMS agent on all managed servers
cd hms/agent
mvn clean package -P rpm
sudo rpm -i hms-agent-[version].[arch].rpm
sudo hms-agent
6. Create a torrent file for the stack of software you want to install and seed the torrent.
7. Create a software manifest file to describe the software stack.
See: http://[hms-controller-host]:4080/v1/software/manifest/sample
8. Create a nodes manifest file to describe the list of servers.
See: http://[hms-controller-host]:4080/v1/nodes/manifest/sample
9. Create a config manifest file to describe how to configure the cluster.
See: http://[hms-controller-host]:4080/v1/config/manifest/create-hadoop-cluster
10. Launch browser and visit:
http://[hms-controller-host]:4080/
Start deploying clusters, and have fun.
Note HMS agent depends on the following software:
libevent-2.0.10-1geekery.i386.rpm
python-setuptools-0.6c5-2.el5.noarch.rpm
python-simplejson-2.0.9-8.el5.x86_64.rpm
transmission-2.22-1geekery.i386.rpm
transmission-cli-2.22-1geekery.i386.rpm
transmission-common-2.22-1geekery.i386.rpm
transmission-daemon-2.22-1geekery.i386.rpm
zkpython-3.4.0-1.x86_64.rpm
zookeeper-lib-3.4.0-1.x86_64.rpm
FAQ
1. How to use HMS Controller without Zeroconf?
Edit hms-controller-[version]/conf/hms.ini, and put:
[zookeeper]
quorum=host1:2181,host2:2181,host3:2181
Then start HMS controller.
2. How to use HMS Agent without Zeroconf?
Edit /etc/hms/hms.ini, and put:
[zookeeper]
quorum=host1:2181,host2:2181,host3:2181
Then start HMS agent.
3. How to install transmission on RHEL/CentOS 5?
Transmission Bit torrent client can be download and install from
Geekery yum repository, instructions:
cd /etc/yum/repos.d
wget http://geekery.altervista.org/geekery-el5.repo
yum install transmission-cli
4. How to install zkpython?
ZooKeeper python binding library can be built by downloading
ZooKeeper library from http://zookeeper.apache.org/
Download ZooKeeper 3.4.0 or latest release tarball.
You will need to have gcc, cppunit-devel, python-devel
installed on your building system.
The building procedure are:
ant rpm
zkpython rpm will be built and located in:
zookeeper-3.4.0/build/contrib/zkpython.