...
After you check all three boxes, it is time to setup the three 1TB drives we identified earlier for each node. Good sources of information on this process are here and here. The following is the play-by-play steps based on the first of the two provided links. Specifically, called out in the To make a volume available steps from the first link and then Step 7 from the second link. Add a Volume to Your Instance help page.
Code Block | ||||
---|---|---|---|---|
| ||||
[root@ip-172-31-7-169 ~]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/xvda1 7.9G 797M 6.7G 11% /
tmpfs 15G 0 15G 0% /dev/shm
[root@ip-172-31-7-169 ~]# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
xvda 202:0 0 8G 0 disk
└─xvda1 202:1 0 8G 0 part /
xvdd 202:48 0 1T 0 disk
xvdc 202:32 0 1T 0 disk
xvdb 202:16 0 1T 0 disk
[root@ip-172-31-7-169 ~]# mkfs -t ext4 /dev/xvdb
[root@ip-172-31-7-169 ~]# mkfs -t ext4 /dev/xvdc
[root@ip-172-31-7-169 ~]# mkfs -t ext4 /dev/xvdd
[root@ip-172-31-7-169 ~]# mkdir /grid
[root@ip-172-31-7-169 ~]# mkdir /grid/1
[root@ip-172-31-7-169 ~]# mkdir /grid/2
[root@ip-172-31-7-169 ~]# mkdir /grid/3
[root@ip-172-31-7-169 ~]# mount /dev/xvdb /grid/1
[root@ip-172-31-7-169 ~]# mount /dev/xvdc /grid/2
[root@ip-172-31-7-169 ~]# mount /dev/xvdd /grid/3
[root@ip-172-31-7-169 ~]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/xvda1 7.9G 797M 6.7G 11% /
tmpfs 15G 0 15G 0% /dev/shm
/dev/xvdb 1008G 200M 957G 1% /grid/1
/dev/xvdc 1008G 200M 957G 1% /grid/2
/dev/xvdd 1008G 200M 957G 1% /grid/3 |
Then Step 7 from the Making an Amazon EBS Volume Available for Use tells you how to correctly edit the /etc/fstab
file so these file systems will be mounted at boot time. The following shows the format of what the three additional rows added to the end of the file look like.
Code Block | ||||
---|---|---|---|---|
| ||||
ghghgg [root@ip-172-31-7-169 ~]# cat /etc/fstab | grep grid /dev/xvdb /grid/1 ext4 defaults,nofail 0 2 /dev/xvdc /grid/2 ext4 defaults,nofail 0 2 /dev/xvdd /grid/3 ext4 defaults,nofail 0 2 |
Do all of these file system activities to all three hosts. Once done, issue a shutdown -r now
on all nodes and then SSH to them when they have restarted and make sure the df -h
output shows all three of the /grid
file systems being mounted. If they are all there, now it is time to visit http://docs.hortonworks.com/HDPDocuments/Ambari-2.0.1.0/bk_Installing_HDP_AMB/content/index.html (or the latest version) Ambari install page and start following instructions. I'm not going to use the password-less SSH connectivity, and since I'll need to do something a bit different regarding hostnames, I'll go slightly out of order. The following are the steps I executed on the box I want to run Ambari on; ec2node1.hdp22
.
PICK UP ON DOING HTE AMBARI INSTALL!!!