cdh6.3.x安裝詳細文檔

cdh6.3.x安裝文檔

1.安裝文檔鏈接

官方

/documentation/enterprise/6/6.0/topics/installation.html

網友貢獻1

/swordfall/p/10816797.html

網友貢獻2

/TXBSW/article/details/846482692.配置hosts

vim/etc/hosts

將集群的每臺機器的域名與ip的映射追加至/etc/hosts3.關閉防火墻

臨時關閉防火墻

#systemctlstopfirewalld

永久防火墻開機自啟動

#systemctldisablefirewalld

查看防火墻狀態(tài)

#systemctlstatusfirewalld4.selinux關閉

#vim/etc/sysconfig/selinux

SELINUX=disabled

重啟機器，命令：

#reboot

重啟后檢查：

#sestatus–v5.mysql

mysql版本建議

5.7.29MySQLCommunityServer(GPL)

CREATEDATABASEscmDEFAULTCHARACTERSETutf8DEFAULTCOLLATEutf8_general_ci;

CREATEDATABASEamonDEFAULTCHARACTERSETutf8DEFAULTCOLLATEutf8_general_ci;

CREATEDATABASEhueDEFAULTCHARACTERSETutf8DEFAULTCOLLATEutf8_general_ci;

CREATEDATABASEmetastoreDEFAULTCHARACTERSETutf8DEFAULTCOLLATEutf8_general_ci;

CREATEDATABASErmanDEFAULTCHARACTERSETutf8DEFAULTCOLLATEutf8_general_ci;

GRANTALLONscm.*TO'cdh6'@'%'IDENTIFIEDBY'12345678';

GRANTALLONamon.*TO'cdh6'@'%'IDENTIFIEDBY'12345678';

GRANTALLONhue.*TO'cdh6'@'%'IDENTIFIEDBY'12345678';

GRANTALLONmetastore.*TO'cdh6'@'%'IDENTIFIEDBY'12345678';

GRANTALLONrman.*TO'cdh6'@'%'IDENTIFIEDBY'12345678’;

GRANTALLONsentry.*TO'cdh6'@'%'IDENTIFIEDBY'aB!12345678';

FLUSHPRIVILEGES;

6.安裝jdk

安裝之前先卸載CentOS7自帶的JDK

選擇

jdk-8u181-linux-x64.tar.gz下載

/technetwork/java/javase/downloads/java-archive-javase8-2177648.html

查看系統(tǒng)已經裝的jdk：

#rpm-qa|grepjdk

卸載jdk：

#rpm-e--nodepsjava-1.6.0-openjdk-javadoc--3.0.el6.x86_64

1.下載“jdk-8u131-linux-x64.tar.gz”，放到/usr/java/目錄下

2.解壓

#tar-xzvfjdk-8u131-linux-x64.tar.gz

3.在任何目錄下均可編輯

#vim/etc/profile

exportJAVA_HOME=/usr/java/jdk1.8.0_131

exportJRE_HOME=$JAVA_HOME/jre

exportPATH=$PATH:$JAVA_HOME/bin

exportCLASSPATH=.:$JAVA_HOME/lib:$JRE_HOME/lib7.配置NTP服務（所有節(jié)點）

a.修改時區(qū)（改為中國標準時區(qū)）ln-sf/usr/share/zoneinfo/Asia/Shanghai/etc/localtime

b.安裝ntpyum-yinstallntp

c.ntp主機配置vim/etc/ntp.conf

sed's/tinker/#tinker/g'-i

/etc/ntp.conf

重新啟動ntp服務：systemctlrestartntpd.service

設置開機自啟：systemctlenablentpd.service

ntpdc-cloopinfo#查看與時間同步服務器的時間偏差

ntpq-p#查看當前同步的時間服務器

ntpstat#查看狀態(tài)

5分鐘后執(zhí)行ntptime查看是否存在error，沒有的話則代表啟動成功8.配置各節(jié)點之間ssh免密登錄

@運維9.優(yōu)化虛擬內存需求率

檢查虛擬內存需求率

#cat/proc/sys/vm/swappiness

顯示如下：

30

臨時降低虛擬內存需求率

#sysctlvm.swappiness=10

永久降低虛擬內存需求率

#echo'vm.swappiness=10'>/etc/sysctl.d/swappiness.conf

并運行如下命令使生效

#sysctl-p10.檢查透明大頁面問題

#cat/sys/kernel/mm/transparent_hugepage/defrag

如果顯示為：

[always]madvisenever

臨時關閉透明大頁面問題

#echonever>/sys/kernel/mm/transparent_hugepage/defrag

確認配置生效

#cat/sys/kernel/mm/transparent_hugepage/defrag

應該顯示為：

alwaysmadvise[never]

配置開機自動生效

#echonever>/sys/kernel/mm/transparent_hugepage/enabled

11.拷貝mysql-connector-java到各個節(jié)點指定目錄下

mkdir-p/usr/share/java

cpmysql-connector-java-5.1.44-bin.jar/usr/share/java/mysql-connector-java.jar12.配置ClouderaManager倉庫

a.wget'/cm6/6.3.1/redhat7/yum/cloudera-manager.repo'-P/etc/yum.repos.d/

b.rpm--import/cm6/6.3.1/redhat7/yum/RPM-GPG-KEY-cloudera

c.yuminstallcloudera-manager-daemonscloudera-manager-agentcloudera-manager-server(主節(jié)點，其余執(zhí)行yuminstallcloudera-manager-daemonscloudera-manager-agent)13.設置ClouderaManager數據庫

cd

/opt/cloudera/cm/schema/

shscm_prepare_database.shmysql-h

-uroot-p'Root!!2018'--scm-host7db_cdh6_scmroot'Root!!2018’

最后出現(xiàn)

Alldone,yourSCMdatabaseisconfiguredcorrectly!代表初始化數據庫成功14.修改scm-agent配置

sudovi

/etc/cloudera-scm-agent/config.ini

server_host=cdh1（這里我是以cdh1作為scm-server節(jié)點）15.啟動cloudera-scm-server

systemctlstartcloudera-scm-server16.錯誤匯總

a.kudu啟動失敗問題

Checkfailed:_s.ok()Badstatus:Service