ambari的安装步骤

这篇文章主要介绍"ambari的安装步骤"，在日常操作中，相信很多人在ambari的安装步骤问题上存在疑惑，小编查阅了各式资料，整理出简单好用的操作方法，希望对大家解答"ambari的安装步骤"的疑惑有所帮助！接下来，请跟着小编一起来学习吧！

系统要求：
CentOS 7
Python 2.7.x
JDK1.8+
安装环境准备
HDP版本兼容性

https://supportmatrix.hortonworks.com/

运维知识库 > ambari安装 > image2018-9-29_11-7-33.png

由于严格依赖版本，所以要先确定安装的版本。

系统初始化
修改主机名
sudo hostnamectl set-hostname test-bg-xx
sudo hostname test-bg-xx

修改时区和字符集
#修改时区：
cp /usr/share/zoneinfo/Asia/Shanghai /etc/localtime
同步集群时间
yum install -y ntp
ntpdate -u cn.pool.ntp.org
或：
ntpdate time1.aliyun.com
硬件时间和系统时间同步:
clock -w
配置自动同步:/etc/crontab写入
/1 * root ntpdate -u cn.pool.ntp.org >> /dev/null 2>&1

关闭防火墙和selinux
#关闭防火墙
systemctl stop firewalld
systemctl disable firewalld

#关闭selinux
修改配置
sed -i 's#SELINUX=enforcing#SELINUX=disabled#g' /etc/sysconfig/selinux
临时关闭
setenforce 0

配置免密钥登录
为了让Ambari服务器在所有集群主机上自动安装Ambari代理，您必须在Ambari服务器主机和集群中的所有其他主机之间设置无密码SSH连接。Ambari服务器主机使用SSH公钥认证来远程访问和安装Ambari代理
ssh-keygen -t rsa
ssh-copy-id -i ~/.ssh/id_rsa.pub root@node1
ssh-copy-id -i ~/.ssh/id_rsa.pub root@node2
ssh-copy-id -i ~/.ssh/id_rsa.pub root@node3
注意：您可以选择在每个集群主机上手动安装Ambari代理。在这种情况下，您不需要生成和分发SSH密钥
可以使用非root SSH帐户，如果该帐户可以执行sudo而不输入密码

#
#如果ssh端口不是默认，可以在.ssh下创建config文件如下
[jt_ops@test-bg-m01 .ssh]$ cat config
Host test-bg-m01
HostName test-bg-m01
User jt_ops
Port 1876

Host test-bg-w01
HostName test-bg-w01
User jt_ops
Port 1876

系统初始化参数
cat >> /etc/sysctl.conf << EOF
net.ipv4.tcp_syncookies = 1
net.ipv4.tcp_tw_reuse = 1
net.ipv4.tcp_tw_recycle = 1
net.ipv4.tcp_fin_timeout = 30
vm.max_map_count = 262144
net.ipv4.ip_forward = 0
net.ipv4.conf.default.rp_filter = 1
net.ipv4.conf.default.accept_source_route = 0
kernel.sysrq = 0
vm.swappiness = 0
kernel.core_uses_pid = 1
net.ipv4.tcp_syncookies = 1
kernel.msgmnb = 65536
kernel.msgmax = 65536
kernel.shmmax = 68719476736
kernel.shmall = 4294967296
net.core.somaxconn = 16384
EOF

文件描述符和用户最大进程数
#调整文件描述符
cat >> /etc/security/limits.conf <

• soft nproc 65535

• hard nproc 65535

• soft nofile 65535

• hard nofile 65535
  EOF
  ##用户进程限制
  cat >> /etc/security/limits.d/20-nproc.conf <

• soft nproc 8192
  root soft nproc unlimited
  EOF

安装
安装有两种方法：在线安装和搭建本地yum源仓库安装

在线安装
下载yum源配置文件repo

#如果做了免秘钥登陆，则只需要在主节点下载yum源sudo wget -nv http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.6.1.5/ambari.repo -O /etc/yum.repos.d/ambari.reposudo wget -nv http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.4.0/hdp.repo -O /etc/yum.repos.d/hdp.repsudo wget -nv http://public-repo-1.hortonworks.com/HDP-GPL/centos7/2.x/updates/2.6.4.0/hdp.gpl.repo -O /etc/yum.repos.d/hdp.gpl.repo离线安装 制作本地源制作本地镜像源安装HDP，可以在主节点或者单独的一台服务器（建议）选择一台可以访问internet的服务器配置本地源apache httpd提供离线仓库的下载服务#安装apacheyum install httpd -y#开启防火墙firewall-cmd --add-service=httpfirewall-cmd --permanent --add-service=http#添加系统服务systemctl start httpd.servicesystemctl enable httpd.service#安装本地源制作工具yum install yum-utils createrepo下载软件源在httpd网站根目录,默认是即/var/×××w/html/，创建目录ambari， 并且将下载的压缩包解压到/var/×××w/html/ambari目录cd /var/×××w/html/mkdir ambaricd /var/×××w/html/ambari/http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.6.1.5/ambari-2.6.1.5-centos7.tar.gzhttp://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.6.4.0/HDP-2.6.4.0-centos6-rpm.tar.gzhttp://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/centos6/HDP-UTILS-1.1.0.22-centos6.tar.gzhttp://public-repo-1.hortonworks.com/HDP-GPL/centos6/2.x/updates/2.6.4.0/HDP-GPL-2.6.4.0-centos6-rpm.tar.gz解压下载的tar包下载repo并修改下载yum源并修改源文件内容：[root@test-bg-w05 yum.repos.d]# cat ambari.repo #VERSION_NUMBER=2.6.1.5-3[ambari-2.6.1.5]name=ambari Version - ambari-2.6.1.5baseurl=http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.6.1.5gpgcheck=1gpgkey=http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.6.1.5/RPM-GPG-KEY/RPM-GPG-KEY-Jenkinsenabled=1priority=1修改为：[root@dev-bg-w01 yum.repos.d]# cat ambari.repo #VERSION_NUMBER=2.6.1.5-3[ambari-2.6.1.5]name=ambari Version - ambari-2.6.1.5baseurl=http://192.168.103.194:8080/ambari/centos7/2.6.1.5-3gpgcheck=1gpgkey=http://192.168.103.194:8080/ambari/centos7/2.6.1.5-3/RPM-GPG-KEY/RPM-GPG-KEY-Jenkinsenabled=1priority=1[root@dev-bg-w01 yum.repos.d]#源文件内容：[root@test-bg-w05 yum.repos.d]# cat ambari-hdp-1.repo [HDP-2.6-repo-1]name=HDP-2.6-repo-1baseurl=http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.4.0path=/enabled=1gpgcheck=0[HDP-UTILS-1.1.0.22-repo-1]name=HDP-UTILS-1.1.0.22-repo-1baseurl=http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/centos7path=/enabled=1gpgcheck=0[root@test-bg-w05 yum.repos.d]#修改为：[root@dev-bg-w01 yum.repos.d]# cat ambari-hdp-1.repo [HDP-2.6-repo-1]name=HDP-2.6-repo-1baseurl=http://192.168.103.194:8080/HDP/centos7/2.6.4.0-91path=/enabled=1gpgcheck=0[HDP-2.6-GPL-repo-1]name=HDP-2.6-GPL-repo-1baseurl=http://192.168.103.194:8080/HDP-GPL-2.6.4.0-centos7-rpm/HDP-GPL/centos7/2.6.4.0-91path=/enabled=1gpgcheck=0[HDP-UTILS-1.1.0.22-repo-1]name=HDP-UTILS-1.1.0.22-repo-1baseurl=http://192.168.103.194:8080/HDP-UTILS-1.1.0.22-centos7path=/enabled=1gpgcheck=0[root@dev-bg-w01 yum.repos.d]#更新yum 元数据yum clean allyum makecacheyum repolist安装Ambari-server在主节点安装ambari-serversudo yum install -y ambari-server配置Ambari-server配置mysql连接器由于ambari要访问数据库，所以要添加lib包，请自行去mysql官网下载sudo mkdir -p /usr/share/javasudo cp /opt/mysql-connector-java-5.1.47/mysql-connector-java-5.1.47-bin.jar /usr/share/java/在ambari-server配置文件中添加mysql lib包路径地址执行一下命令配置jdbc环境ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java-5.1.47-bin.jarvim /etc/ambari-server/conf/ambari.properties###在jdbc区下面找个位置添加如下如下语句server.jdbc.driver.path=/usr/share/java/mysql-connector-java-5.1.47-bin.jar检查环境并配置执行以下命令sudo ambari-server setup按提示操作会检查selinux，是否自定义用户，检查防火墙，设置JDK路径，数据库配置等，按提示操作即可具体操作如下：[root@dev-bg-m01 opt]# vim /etc/ambari-server/conf/ambari.properties [root@dev-bg-m01 opt]# ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java-5.1.47-bin.jarUsing python /usr/bin/pythonSetup ambari-serverCopying /usr/share/java/mysql-connector-java-5.1.47-bin.jar to /var/lib/ambari-server/resourcesIf you are updating existing jdbc driver jar for mysql with mysql-connector-java-5.1.47-bin.jar. Please remove the old driver jar, from all hosts. Restarting services that need the driver, will automatically copy the new jar to the hosts.JDBC driver was successfully initialized.Ambari Server 'setup' completed successfully.[root@dev-bg-m01 opt]# vim /etc/ambari-server/conf/ambari.properties [root@dev-bg-m01 opt]# ambari-server setupUsing python /usr/bin/pythonSetup ambari-serverChecking SELinux...SELinux status is 'disabled'Customize user account for ambari-server daemon [y/n] (n)? yEnter user account for ambari-server daemon (root):ambariAdjusting ambari-server permissions and ownership...Checking firewall status...Checking JDK...Do you want to change Oracle JDK [y/n] (n)? y [1] Oracle JDK 1.8 + Java Cryptography Extension (JCE) Policy Files 8[2] Oracle JDK 1.7 + Java Cryptography Extension (JCE) Policy Files 7[3] Custom JDK==============================================================================Enter choice (1): 3WARNING: JDK must be installed on all hosts and JAVA_HOME must be valid on all hosts.WARNING: JCE Policy files are required for configuring Kerberos security. If you plan to use Kerberos,please make sure JCE Unlimited Strength Jurisdiction Policy Files are valid on all hosts.Path to JAVA_HOME: /opt/jdk1.8.0_161Validating JDK on Ambari Server...done.Checking GPL software agreement...Completing setup...Configuring database...Enter advanced database configuration [y/n] (n)? yConfiguring database...==============================================================================Choose one of the following options:[1] - PostgreSQL (Embedded)[2] - Oracle[3] - MySQL / MariaDB[4] - PostgreSQL[5] - Microsoft SQL Server (Tech Preview)[6] - SQL Anywhere[7] - BDB==========================================Enter choice (1): 3Hostname (localhost): 192.168.103.3Port (3306): Database name (ambari): Username (ambari): Enter Database Password (bigdata): Re-enter password: Configuring ambari database...Configuring remote database connection properties...WARNING: Before starting Ambari Server, you must run the following DDL against the database to create the schema: /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sqlProceed with configuring remote database connection properties [y/n] (y)? nWARNING: Remote database setup aborted.Ambari Server 'setup' completed with warnings.[root@dev-bg-m01 opt]#将Ambari数据库脚本导入到数据库mysql -uambari -pxxxuse ambari;source /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql启动ambari serverambari-server start在浏览器中访问ip:8080，默认登录名：admin 密码:admin添加服务组件https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.5/bk_ambari-administration/content/ambari_admin_overview.htmlspark配置由于spark要访问数据库，所以要添加mysql lib包cp /opt/mysql-connector-java-5.1.47/mysql-connector-java-5.1.47-bin.jar /usr/hdp/2.6.4.0-91/spark/lib/ 安装数据库使用现有数据库或者自己安装创建ambari和hive库create database ambari character set utf8 ;添加权限GRANT ALL PRIVILEGES ON ambari.* TO 'ambari'@'%';FLUSH PRIVILEGES;删除权限：revoke all privileges on ambari.* from ambari@'%';# 程序安装目录程序默认安装目录[root@test-bg-m01 2.6.4.0-91]# pwd/usr/hdp/2.6.4.0-91[root@test-bg-m01 2.6.4.0-91]# lsatlas hadoop hadoop-mapreduce hbase hive2 kafka pig ranger-hdfs-plugin ranger-kafka-plugin ranger-yarn-plugin spark storm tez usretc hadoop-hdfs hadoop-yarn hive hive-hcatalog livy ranger-hbase-plugin ranger-hive-plugin ranger-storm-plugin slider spark2 storm-slider-client tez_hive2 zookeeper[root@test-bg-m01 2.6.4.0-91]#PID目录/var/run/日志目录/var/logs/一般修改log目录，在安装大数据组件的时候，修改配置文件即可。删除服务先停止服务Service Actions > Delete Serviceyum remove xxhttps://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.5/bk_ambari-administration/content/ambari_admin_overview.htmlambari监控 ambari安装默认用户和用户组https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.5/bk_ambari-administration/content/defining_service_users_and_groups_for_a_hdp_2x_stack.html常见问题问题1：Centos 7安装 ambari-agent报错NetUtil.py-[SSL: CERTIFICATE_VERIFY_FAILED]Centos 7安装 ambari通过Ambari部署系统时，ambari-agent注册失败，在/var/log/ambari-agent的log中可以看到日志显示：ERROR 2018-03-08 15:02:25,223 NetUtil.py:88 - [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:579) ERROR 2018-03-08 15:02:25,223 NetUtil.py:89 - SSLError: Failed to connect. Please check openssl library versions.解决方法：修改/etc/python/cert-verification.cfg配置文件： # vim /etc/python/cert-verification.cfg[https]verify=platform_default ###(这是默认配置)修改为verify=disable编辑 /etc/ambari-agent/conf/ambari-agent.ini 配置文件，在 [security] 节部分，确保设置如下两个值，其它值保持不变：[root@ambari ~]# vim /etc/ambari-agent/conf/ambari-agent.ini[security]ssl_verify_cert=0force_https_protocol=PROTOCOL_TLSv1_2以上配置修改完后，重试即可通过ambari-agent注册，执行即可下一步参考文档官方文档安装文档https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.5/bk_ambari-installation/content/determine_product_interop.html未完待续~

到此，关于"ambari的安装步骤"的学习就结束了，希望能够解决大家的疑惑。理论与实践的搭配能更好的帮助大家学习，快去试试吧！若想继续学习更多相关知识，请继续关注网站，小编会继续努力为大家带来更多实用的文章！