搭建本地Yum软件源安装Cloudera Manager 5

简介:

 记录操作过程,不过多介绍相关知识以及原理,有问题自行百度或留言讨论。

一、搭建web服务服务器

    有两台虚拟机,elephant用于安装cdh-server相关作为管理者,monkey用于安装cdh-agent相关,作为被管理者。

    我选择的是nginx,网上安装教程较多,不在赘述,把用于放置Cloudera安装文件的conf配置贴上来。关闭防火墙之类的也不多讲,注意如果是centos7,防火墙服务不是iptables了,也许如下命令会用的着。

1
2
3
  firewall-cmd --state
  systemctl stop firewalld.service
  systemctl disable firewalld.service
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
[root@elephant cloudera-cdh5] # cat /etc/nginx/conf.d/elephant.conf
server {
     listen       80;
     server_name elephant www.elephant.com;
 
     location / {
         root    /data/webapps/elephant ;
         autoindex on;   #允许浏览文件
     }
 
     #error_page  404              /404.html;
 
     # redirect server error pages to the static page /50x.html
     #
     error_page   500 502 503 504   /50x .html;
     location =  /50x .html {
         root    /usr/share/nginx/html ;
     }
}

通过如上的操作,我在宿主机和monkey虚拟机添加host,就可以通过http协议来浏览文件了。

1
2
3
4
[root@elephant cloudera-cdh5] # cat /etc/hosts
192.168.1.109 elephant
192.168.1.110 monkey
[root@elephant cloudera-cdh5] # curl http://elephant
1
2
3
4
5
6
7
8
9
< html >
< head >< title >Index of /</ title ></ head >
< body  bgcolor = "white" >
< h1 >Index of /</ h1 >< hr >< pre >< a  href = "../" >../</ a >
< a  href = "cdh/" >cdh/</ a >                                               22-Mar-2017 15:12                   -
< a  href = "cm/" >cm/</ a >                                                24-Mar-2017 13:02                   -
< a  href = "index.html_txt" >index.html_txt</ a >                                     19-Mar-2017 07:15                  40
</ pre >< hr ></ body >
</ html >

二、下载CM资源包

在/data/webapps/elephant下新建目录,最终目录结构如下:

1
2
[root@elephant cm] # pwd
/data/webapps/elephant/cm

浏览网页 ,找到适合你自己环境的安装包,我选择的是 cm5.10.0-centos7.tar.gz

http://archive-primary.cloudera.com/cm5/repo-as-tarball/5.10.0/

注意版本要和你的cdh一致。800多M,虚拟机中直接wget很慢,于是宿主机中打开迅雷,添加下载地址 http://archive-primary.cloudera.com/cm5/repo-as-tarball/5.10.0/cm5.10.0-centos7.tar.gz ,然后去睡觉了。

第二天晚上下班回来继续操作。

把下载的软件包复制到虚拟机的 web目录,也就是上面的cm目录,解压

1
tar  -zxvf cm5.10.0-centos7. tar .gz

解压后的目录结构,进入到 5.10.0 目录可以看到下载的安装文件。

1
2
3
4
5
6
7
[root@elephant cm] # ll
total 8
lrwxrwxrwx 1 1106 592    6 Jan 21 03:38 5 -> 5.10.0
lrwxrwxrwx 1 1106 592    6 Jan 21 03:38 5.10 -> 5.10.0
drwxrwxr-x 4 1106 592   49 Mar 24 21:06 5.10.0
-rw-rw-r-- 1 1106 592 1690 Jan 21 03:35 RPM-GPG-KEY-cloudera
-rw-rw-r-- 1 1106 592  347 Jan 26 05:35 cloudera-cm.repo

三、重新生成repodata

进入到/data/webapps/elephant/cm/5.10 目录,执行如下命令,重新生成repodata。下一步配置yum源的baseurl,一定是有repodata的目录。

1
[root@elephant 5.10] # createrepo .

如果你的虚拟机没有repodata命令,请执行下面命令安装。

1
sudo  yum  install  yum-utils createrepo

四、配置 yum 源

把 上面cm目录中的 cloudera-cm.repo 复制到  /etc/yum.repos.d 目录,并进行编辑

1
2
3
4
5
6
7
8
9
10
[root@elephant yum.repos.d] # vim cloudera-cm.repo
[cloudera-cm]
# Packages for Cloudera's Distribution for cm, Version 5, on RedHat     or CentOS 7 x86_64
name=Cloudera's Distribution  for  cm, Version 5
#baseurl=http://repos.jenkins.cloudera.com/cm5.10.0-release/redhat/7/x86_64/cm/5/
#gpgkey = http://repos.jenkins.cloudera.com/cm5.10.0-release/redhat/7/x86_64/cm/RPM-GPG-KEY-cloudera
#gpgcheck = 1
baseurl=http: //elephant/cm/5 .10
#gpgkey = http://repos.jenkins.cloudera.com/cm5.10.0-release/redhat/7/x86_64/cm/RPM-GPG-KEY-cloudera
gpgcheck = 0

在管理机上运行 yum clean all 后,就可以如下命令安装cm了。

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
[root@elephant x86_64] # yum install -y cloudera-manager-server
Loaded plugins: fastestmirror
base                                                                                                                                                          | 3.6 kB  00:00:00
cloudera-cdh5                                                                                                                                                 | 2.9 kB  00:00:00
cloudera-cm                                                                                                                                                   | 2.9 kB  00:00:00
extras                                                                                                                                                        | 3.4 kB  00:00:00
nginx                                                                                                                                                         | 2.9 kB  00:00:00
updates                                                                                                                                                       | 3.4 kB  00:00:00
(1 /7 ): cloudera-cdh5 /primary_db                                                                                                                                |  77 kB  00:00:00
(2 /7 ): cloudera-cm /primary_db                                                                                                                                  |  11 kB  00:00:00
(3 /7 ): base /7/x86_64/group_gz                                                                                                                                  | 155 kB  00:00:00
(4 /7 ): extras /7/x86_64/primary_db                                                                                                                              | 139 kB  00:00:00
(5 /7 ): updates /7/x86_64/primary_db                                                                                                                             | 3.8 MB  00:00:03
(6 /7 ): nginx /x86_64/primary_db                                                                                                                                 |  21 kB  00:00:06
(7 /7 ): base /7/x86_64/primary_db                                                                                                                                | 5.6 MB  00:00:21
Determining fastest mirrors
  * base: mirrors.tuna.tsinghua.edu.cn
  * extras: mirrors.tuna.tsinghua.edu.cn
  * updates: mirrors.tuna.tsinghua.edu.cn
Resolving Dependencies
--> Running transaction check
---> Package cloudera-manager-server.x86_64 0:5.10.0-1.cm5100.p0.85.el7 will be installed
--> Processing Dependency: cloudera-manager-daemons = 5.10.0  for  package: cloudera-manager-server-5.10.0-1.cm5100.p0.85.el7.x86_64
--> Running transaction check
---> Package cloudera-manager-daemons.x86_64 0:5.10.0-1.cm5100.p0.85.el7 will be installed
--> Finished Dependency Resolution
……
……
Downloading packages:
(1 /2 ): cloudera-manager-server-5.10.0-1.cm5100.p0.85.el7.x86_64.rpm                                                                                           | 8.4 kB  00:00:00
(2 /2 ): cloudera-manager-daemons-5.10.0-1.cm5100.p0.85.el7.x86_64.rpm                                                                                          | 570 MB  00:00:09
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                                                                 60 MB /s  | 570 MB  00:00:09
Running transaction check
Running transaction  test
Transaction  test  succeeded
Running transaction
   Installing : cloudera-manager-daemons-5.10.0-1.cm5100.p0.85.el7.x86_64                                                                                                         1 /2
   Installing : cloudera-manager-server-5.10.0-1.cm5100.p0.85.el7.x86_64                                                                                                          2 /2
   Verifying  : cloudera-manager-server-5.10.0-1.cm5100.p0.85.el7.x86_64                                                                                                          1 /2
   Verifying  : cloudera-manager-daemons-5.10.0-1.cm5100.p0.85.el7.x86_64                                                                                                         2 /2
 
Installed:
   cloudera-manager-server.x86_64 0:5.10.0-1.cm5100.p0.85.el7
 
Dependency Installed:
   cloudera-manager-daemons.x86_64 0:5.10.0-1.cm5100.p0.85.el7
 
Complete!

为了验证是从本地源下载,特意查看了nginx访问日志

1
2
3
4
5
6
127.0.0.1 - - [24 /Mar/2017 :22:19:55 +0800]  "GET /cdh/cloudera-cdh5/repodata/repomd.xml HTTP/1.1"  200 2987  "-"  "urlgrabber/3.10 yum/3.4.3"  "-"
127.0.0.1 - - [24 /Mar/2017 :22:19:55 +0800]  "GET /cm/5.10/repodata/repomd.xml HTTP/1.1"  200 2980  "-"  "urlgrabber/3.10 yum/3.4.3"  "-"
127.0.0.1 - - [24 /Mar/2017 :22:20:05 +0800]  "GET /cdh/cloudera-cdh5/repodata/09b008ab02bc0b4f4b4279e2f0c0a5fb8ce53c5d0dcbd5258d32657a390f64fb-primary.sqlite.bz2 HTTP/1.1"  200 78773  "-"  "urlgrabber/3.10 yum/3.4.3"  "-"
127.0.0.1 - - [24 /Mar/2017 :22:20:05 +0800]  "GET /cm/5.10/repodata/600a57f21246adc3f5d159a4daa0ce8f74d860234b6943b7ce978682b2f6f0ad-primary.sqlite.bz2 HTTP/1.1"  200 11313  "-"  "urlgrabber/3.10 yum/3.4.3"  "-"
127.0.0.1 - - [24 /Mar/2017 :22:20:30 +0800]  "GET /cm/5.10/RPMS/x86_64/cloudera-manager-server-5.10.0-1.cm5100.p0.85.el7.x86_64.rpm HTTP/1.1"  200 8648  "-"  "urlgrabber/3.10 yum/3.4.3"  "-"
127.0.0.1 - - [24 /Mar/2017 :22:20:37 +0800]  "GET /cm/5.10/RPMS/x86_64/cloudera-manager-daemons-5.10.0-1.cm5100.p0.85.el7.x86_64.rpm HTTP/1.1"  200 597309256  "-"  "urlgrabber/3.10 yum/3.4.3"  "-"

wKioL1jVK-Ghpc0aAAMmuwPF4Gc294.png-wh_50


到此,yum本地源方式安装Cloudera Manager 5已经完成。


补充:

1
2
关于如何以类似的方式安装CDH,可以参考官网的博文,如果有问题可以留言。
https://www.cloudera.com/documentation/enterprise/5-9-x/topics/cdh_ig_yumrepo_local_create.html
1
2
这个命令会下载cdh的全部包,想到耗时间,做好心理准备
reposync -r cloudera-cdh5





本文转自 byteh 51CTO博客,原文链接:http://blog.51cto.com/byteh/1910197,如需转载请自行联系原作者

目录
相关文章
|
10天前
|
Linux C语言
linux yum安装ffmpeg 图文详解
linux yum安装ffmpeg 图文详解
28 0
|
10天前
|
Linux
linux yum 安装rar和unrar
linux yum 安装rar和unrar
35 0
|
1天前
|
应用服务中间件 nginx
yum 安装报错 No package nginx available Error:Nothing to do
yum 安装报错 No package nginx available Error:Nothing to do
6 1
|
10天前
|
关系型数据库 MySQL Linux
CentOS 7 下使用yum安装MySQL5.7.20 最简单 图文详解
CentOS 7 下使用yum安装MySQL5.7.20 最简单 图文详解
48 0
|
22天前
|
Linux
Linux: yum查看、安装、删除软件包
Linux: yum查看、安装、删除软件包
27 0
|
2月前
|
Linux Shell
Linux:centos yum安装指令指南
Linux:centos yum安装指令指南
171 0
Linux:centos yum安装指令指南
|
4月前
|
Java Linux Docker
Linux【上手 01】MobaXterm+系统版本查看+hostname修改+hosts修改+yum源配置+jdk安装+docker部署使用(不断完善)
Linux【上手 01】MobaXterm+系统版本查看+hostname修改+hosts修改+yum源配置+jdk安装+docker部署使用(不断完善)
52 0
|
4月前
|
Linux
linux添加硬盘,光驱及yum源安装
linux添加硬盘,光驱及yum源安装
53 0
|
4月前
|
关系型数据库 MySQL Linux
CentOS7 下使用yum安装MySQL
CentOS7 下使用yum安装MySQL
353 0
|
4月前
|
SQL 关系型数据库 MySQL
centos8使用yum源安装mysql8
剩下的数据库配置操作,请参考我之前的文章《Centos7.6配置lnmp》里边有详细的介绍。 有好的建议,请在下方输入你的评论。 欢迎访问个人博客 guanchao.site
412 0