北風(fēng)大數(shù)據(jù)o2o十三期課程02.隨堂課件1023hive初識(shí)入門

如：日志文件—>表數(shù)據(jù)

EDUCATIONTOCREATEABRIGHT

EDUCATIONTOCREATEABRIGHTMapReduceishardtoNoSchemalackofquerylanaguageseg.SQL

EDUCATIONTOCREATEABRIGHTApache

EDUCATIONTOCREATEABRIGHTWhatisHive

EDUCATIONTOCREATEABRIGHT

EDUCATIONTOCREATEABRIGHTHive

EDUCATIONTOCREATEABRIGHTuuuEDUCATIONTOCREATEABRIGHTEDUCATIONTOCREATEABRIGHTEDUCATIONTOCREATEABRIGHTEDUCATIONTOCREATEABRIGHTEDUCATIONTOCREATEABRIGHT#createtablecreatetableuser(idint,namestring)ROWFORMATDELIMITEDFIELDSTERMINATEDBY'\t'#loadloaddatalocalinpath'/opt/datas/user2.tsv'overwriteintotableuser;#querydataselect*fromuser##Hive

EDUCATIONTOCREATEABRIGHTHive

EDUCATIONTOCREATEABRIGHTCLI(hive ?元數(shù)據(jù): 默 ?驅(qū)動(dòng)器:

Hive

EDUCATIONTOCREATEABRIGHT select中被判定為聚合的字段在groupby中是否有出現(xiàn))；Hive

EDUCATIONTOCREATEABRIGHT

EDUCATIONTOCREATEABRIGHTDerbyApacheDerby是一個(gè)完全用java編寫的基于ApacheLicense2.0分發(fā)。 系統(tǒng)上。ApacheDerby非常小巧，部分derby.jar只有2M，所以既可

EDUCATIONTOCREATEABRIGHTSupportedBackendDatabasesfor

EDUCATIONTOCREATEABRIGHTMySQL

EDUCATIONTOCREATEABRIGHT MySQL

EDUCATIONTOCREATEABRIGHT

EDUCATIONTOCREATEABRIGHTmysql>selectUser,Host,Passwordfrom#設(shè) mysql>grantallprivilegeson*.*to'root'@'%'identifiedby'123456'withgrantmysql>deletefromuserwhereuser='root'andmysql>flush重啟servicemysqld

EDUCATIONTOCREATEABRIGHTHiveBasic

EDUCATIONTOCREATEABRIGHT

EDUCATIONTOCREATEABRIGHTHive

EDUCATIONTOCREATEABRIGHT SQLfromcommand SQLfrom?-v,--verboseVerbosemode(echoexecutedSQLtothe Silentmodein ctiveHiveHiveEDUCATIONTOCREATEABRIGHT ?set?set-v?queryu

EDUCATIONTOCREATEABRIGHT

EDUCATIONTOCREATEABRIGHTShow

EDUCATIONTOCREATEABRIGHTDescribe

EDUCATIONTOCREATEABRIGHT

EDUCATIONTOCREATEABRIGHT

EDUCATIONTOCREATEABRIGHT

EDUCATIONTOCREATEABRIGHTCreate

EDUCATIONTOCREATEABRIGHTu

ucreatetablecreatetableemp(empnoint,enamestring,jobmgrint,saldouble,commdouble,deptnoint)rowformatdelimitedfieldsterminatedbycreatetabledept(deptnoint,dnamestring,loc)rowformatdelimitedfieldsterminatedbyLoad

EDUCATIONTOCREATEABRIGHTLOADLOADDATA[LOCAL]INPATHloadloaddatalocalinpath'/home/hadoop/data/emp.txt'overwriteintotableloaddatalocalinpath'/home/hadoop/data/dept.txt'overwriteintotableCreateTableCreateTableAsSelect)EDUCATIONTOCREATEABRIGHT

EDUCATIONTOCREATEABRIGHT

EDUCATIONTOCREATEABRIGHT

EDUCATIONTOCREATEABRIGHTExternal

EDUCATIONTOCREATEABRIGHT External

EDUCATIONTOCREATEABRIGHT

EDUCATIONTOCREATEABRIGHTu分區(qū)表實(shí)際上就是對(duì)應(yīng)一個(gè)HDFS文件系統(tǒng)上的獨(dú)立的文件夾，該文件夾下是該分區(qū)所有 ，把一個(gè)大的數(shù)據(jù)集根據(jù)業(yè)務(wù)需要分割更小成的u在查詢時(shí)通過WHERE子句中的表達(dá)式來選擇查詢所需要的指定的分區(qū)，這樣的查詢效率createtabledept_partition(deptnocreatetabledept_partition(deptnoint,dnamestring,locstring)PARTITIONEDBY(event_monthROWFORMATDELIMITEDFIELDSTERMINATE