虛擬化與云計(jì)算課程試驗(yàn)報(bào)告——Hadoop平臺(tái)搭建

1、虛擬化與云計(jì)算實(shí)驗(yàn) 報(bào) 告目錄一、實(shí)驗(yàn)?zāi)繕?biāo) 1二、實(shí)驗(yàn)內(nèi)容1三、實(shí)驗(yàn)步驟1四、實(shí)驗(yàn)遇到的問(wèn)題及其解決方法 24五、實(shí)驗(yàn)結(jié)論25一、實(shí)驗(yàn)?zāi)康?. 實(shí)驗(yàn)題目：配置和使用 SAN存儲(chǔ)掌握在Linux上配置iSCSI target服務(wù)的方法。2. 實(shí)驗(yàn)題目:Hadoop&MapReduce安裝、部署、使用 Hadoop-HDFS配置運(yùn)行MapReduce程序，使用Map Reduce編程二、實(shí)驗(yàn)內(nèi)容1. 實(shí)驗(yàn)題目：配置和使用 SAN存儲(chǔ)配置在Linux上iSCSI實(shí)現(xiàn)兩臺(tái)機(jī)器間的共享存儲(chǔ)。2. 實(shí)驗(yàn)題目:Hadoop&MapReduce1. 掌握在集群上（使用虛擬機(jī)模擬）安裝部署Had

2、oop-HDFS的方法。2. 掌握在HDFS運(yùn)行MapReduce任務(wù)的方法。3. 理解Map Reduce編程模型的原理，初步使用 MapReduce模型編程。三、實(shí)驗(yàn)步驟及實(shí)驗(yàn)結(jié)果1.實(shí)驗(yàn)題目：配置和使用 SAN存儲(chǔ)在實(shí)驗(yàn)1中我作為主機(jī)提供共享存儲(chǔ)空間，實(shí)驗(yàn)地點(diǎn)是在機(jī)房，但是由于我 當(dāng)時(shí)沒(méi)有截圖所以回寢室在自己的電腦上重做，以下為主機(jī)步驟：1.1確定以root身份執(zhí)行以下步驟sudo su 一1.2 安裝 iSCSI Target軟件1I Q ra®_ Z.OGB'LibMfcu整障中心嚀 搟，匚.1ffiliVtHBIFA原史1IB主SPfS,圖片3DCE.247 0H

3、it機(jī)隋育乾樣推相陽(yáng)i#引周以址陋同皿曰做utility OptrrH£9-Uti5aa»_立忤i&回如d£EI Entarprlu Tirgit ufirUfKl tank 93<vpet土混徵&irtgh pcrPiinfUfKE, tr.n中urt KlEpcndrt rS£SI Inpkmcntatlara apefrfttni&CEl Enterprlu Target kcrrwl fnndilk- saurce dhmc 歡rslz i53Jt»pet-<Jfc5UfUM SCSI target

4、u&trpjct tookniDduUf, evEnt dnwn Inltrim InrrMtriKture - network support Jrsyil-netwvfcftribernet Sbor-tgc- Njmang SefYlct wsdbtcrnet St»r«ge Naming SeE 口t - dt-cllent rgnMhntClushef iLVM DMrnomfarLvm2£$C5I Entarprlu Tdrgt b«fMi fnodiHt but“ rraltvpct-HVX1.3 修改 /etc/default/i

5、scsitargetISCSITARGET_ENABLE = trueKeiKirgvE (/tKt/dtfMlE. -tdlc 立件1升殖裾斌國(guó)* TJI(f) ±»|Df胴助F FT開(kāi)JM俱停 3 L HM .匿| F $ *j. "|0 1464 1.械責(zé)口 3o ncsitaret tt I£SITARGET_EMABLE-true*K+ 奇 16腐：# * rri. M2* SA1.4創(chuàng)建共享存儲(chǔ)共享存儲(chǔ)可以是 logical volumes, image files, hard drives , hard drive partitions o

6、r RAID devices例如使用image file的方法，創(chuàng)建一個(gè)10G大小的LUN :dd if=/dev/zero of=/storage/lun1.img bs=1024k count=102401.5 修改/etc/iet/ietd.conf添加：Target iqn.2001-.example:storage.lun1IncomingUser username passwordOutgoingUserLun 0 Path=/storage/lun1.img,Type=fileioAlias LUN1w 胸叫山-4*dK玄的腫 S心雷閏 L1ICTI胴助呻0 E $外V。 14

7、CA1 ' ! » 0 1T 丹-W 叫 A +% * *4LJiKtd.conf NAMdxOuts tandtfigRZI*iflUdtaPIDUlnOrderVes呻即捉 KqwficMres*Er8-AHE-BderCrlgestKone .CRC3ZC氯）taDigestIfone, CRC3ZC階H對(duì)。瀏*都1跑匹53ftO'.ff V-orlcufs- LflrgeE. por-iwter s視墻“陌H*QueuedCaNiands;32* f V1? ¥f * 4 fIF «? #4 f Vc till ty >uppui l

8、 Max outstanding RZTs per cmd Dat-a in PDUb Is o«le-red He only Support n*dei* ed pflut In tequnc*ix-dsred如Euppe>rt twdfl-rndHe qmlLy support leve-l 0 PDU heavier checksw 4I90 list Mom or CHC3ZC if only one set then e nuf-t Jbgr<et ta it or the- ccnnec tin Mt it fAtl POU d-ata checksun ni

9、g口 list Shhe 45 flbove naxiFufi fluhfrtr WWthtt target - A s-Lend aIn ping each Afterthat narvy seconds If the conn <s otberwiiB Idile - 9 - off Hdtt Lh4匚 nafty ，更ftf -b r-eOftgf 頓 4 hCP-IH 同叫 If a ar NOPIntirvAliHWInttrvtl Is used!.Nurtbar 單r 10NuiMier &r queued remandsTarget iqn. 2001-04-hw

10、iQielMDl：stor-age-.lun3IikwitflguE.tr huh姑2如果需要弟盼皚ill.得用戶(hù)君Lun fi Pat hs75t<ir-ig#/lun 3. Ing ,Type-ft lie-tDAlias iLUNl|iHax iMinect Inns dSB加任此行正在保停 SS+Tg/FHdjCDff.境其尊.切景若宣腐：A *ffm.時(shí)#MaxConnections 61.6 修改 /etc/iet/initiators.allow如果只允許特定IP的initiator訪問(wèn)LUN ,則如下設(shè)置iqn.2001-.example:storage.lun1 192

11、.168.0.100如果任意initiator均可以訪問(wèn)，則:ALL ALL4iftlESE響f L<l0n- g«dlESfiHrl桃舊晝M 粘素閏 TJtCD女詢(xún)of filbH FT開(kāi)-19 砒凸 4 -V z* V e. K,irtflijtors.allow tt fl The sEHantics arej * HlEhmt any entries nit> tnltldt-ar c-an see 。connect to any target>.Fff * Sy “r胡it g all tntttiters te cenft?ct to Ml target

12、 t sthfi th# "ALL ALL* *ntrjr.a Clwrrld« Khich Initiators c-an -connect to which trats by putting efttry fbr d 1*41¥ T-terg«T fsllcwd &y -d iStnft* &ep4rd t-Ad list 0>F XfttttatorSj etthe-r lip wddgz w IQ* mmw (ImisU妙 網(wǎng)ttw站 rarf TQK nants sr* Acc*pt«d l*aw« a

13、ut * mM $ s.pKlAlt i-t thay art tKpllctt)W separate the two with Hhltespce.A B Eh'Ery pmceai-lng itoipa aE. tlie "ALL* target witry If prc3rnt>5one exaFifpleEVl-qn.20D3-04.c-cnexanple:starag*>dia-klsys.syz 192.14B 1.O/liB . :nscil- 1.-4.eM-B"pleV.con直WM.C4P1.earvle；stfrrae.lsA：.s

14、r&2,行£ 37*302;lKl;211;4)rr；fiil；軸Hd STFe: /4P 1!>2. lb。.22.e/2*i-qfi,aeeii-M,ca«-"豳仲“:玷胸角責(zé).JtsJki-syi3-ayi ahdlqn.24B3 M.con.e直日仲1普!sta-ragre-.dlskli-w/w4-Nyz 1J2.i4B.22.3：I lqn.vn<Are: .tspl電.cont ALL l<9ZlCB.a,a/DfiALL ALL歧支* 蚓艮得皂腐：事 fib ?J1 »A1.6啟動(dòng)/重啟動(dòng)iSCSI target

15、/etc/init.d/iscsitarget start/etc/init.d/iscsitarget restart4H亶e害打和1%處ihp立又忤(!)MHHM ISA!格式也lA£D M陽(yáng) 博的邸修 口 |工陞M 4 P吁箱ML吧 1， 時(shí)匚W 1 G| S 1114' | ttaMawawftaMft 丁 | 而| 日 B ASi 通I 區(qū)匡回叵 也,B £ B,直| ,Ikjl| DDD 33 獨(dú) 一«|im2.實(shí)驗(yàn)題目：Hadoop&MapReduce1. 安裝JDK在實(shí)驗(yàn)中安裝為 OpenJDK 6 Runtime2. 安裝 ope

16、nssh-server，命令為：sudo apt-get install openssh-server ,并檢查 ssh server 是否已經(jīng)啟動(dòng)： ps -e | grep ssh，如果只有 ssh-agent那ssh-server 還沒(méi)有啟動(dòng)，需要/etc/init.d/ssh start，如果看到 sshd那說(shuō)明ssh-server 已經(jīng)啟動(dòng)了。w|kunia< iua>|hia Im I IwmvHfi5；HZI3SIED«ft Lm3.免密碼ssh設(shè)置，確認(rèn)能否不輸入口令就用ssh登錄localhost:ssh localhost如果不輸入口令就無(wú)法用ssh登

17、陸localhost,執(zhí)行下面的命令：$ ssh-keygen -t rsa -f /.ssh/id_rsacat /.ssh/id_rsa.pub >> /.ssh/authorized_keys再次執(zhí)行ssh localhost完成后請(qǐng)登入確認(rèn)不用輸入密碼4.安裝 Hadoop解壓Hadoop安裝包到安裝目錄，在本實(shí)驗(yàn)中我新建了一個(gè)用戶(hù)hadoop并把hadoop解壓到home/hadoop文件夾下，在偽分布模式下使用的版本為 0.20.203,在分布模式下因?yàn)橐cEclipse兼容所以最終使用版本為0.20.2, 下面部分截圖為版本為0.20.203。并編輯conf/hado

18、op-env.sh將JAVA_HOME設(shè)置為Java安裝根路徑 運(yùn)行運(yùn)行bin目錄下的hadoop,如顯示hadoop腳本的使用文檔，說(shuō)明安裝 已經(jīng)完成。如下圖所示：kkdwiw.ih 5珈坤朋*心住心電占5 - ViiMS E * If. 23:22 L Q-aim日 ism 眉法舊# 妹滯114& anew) hhp kihiT三口t.小等 時(shí)口* 翌B iiadw-sclTlc mir&nBehT 標(biāo)ililsUs 沖融 The onl reqpLred ErrwirGnaent varidtoLe Ls JAVA HM. All etheri are 4#Tlonal.

19、 i*en runnifig & dlsTflkKrf confluuratiefl It Is tesi tof set JAVA HOHE in this- file, so that it is cnrrectlv defined on mate nodes.# The java mpleHntBlim to- use. Heqvired.eijMrt JAVA H0K-/usr/ll it：/jvb/j ava 1.6.fl apenjdk* Extra Jby-b CLASSPATH eleiieflts. CfptaHial.律 export iHMXKP CLA5EPA1

20、H=-, The Mximn awunl uf hea- to ux, in RD. Def-mil. t la 1BN.g exportHE APE IEE-2MA營(yíng) Ei'Etb Jbv-9 run LiM Dpt iora, Enply by dmnull ；Jf export WMKKP_DPT5=-&errt-r* Cowand IpeCJiflC UpliE* 占叩ended 2 NADQOP UFIT< irfierieilHirt HADOOF hAFEMDDE - Dcm. sw. Hnaqwnt. ju retate SHICOP 曲4ENOOE 0P

21、T5Bupdft 岫奸”轉(zhuǎn)W前岫他MEMDF DirrSr-i _Cqi : un .iwqirnr. > r«ti 拙四哭WIAAAfiMKN如F MTS3E時(shí)" 睥的L gFi-DCMaMiMnBOeMYL.jlHrMeU WtfmP MTlWCM_&PTSBeipqrt HADOOP BALANCER OFIS=" - Dcca. sw. unaqeHit. rEHte SHUMOP HAULNCEF. OPTS'»ip«rt HADW JGBTRACiC- Dcca.fun. .inngmer.t. j ixrwt

22、e 1MM&P XiEI1U£KER DPT4B* 虹iw&w?_Ti«i5KTMNtA_WT5-Jt The- fDll<MijHgiapplics tn iultiple comands 1fs-P dfs, fsckP distcp etc) »port HAD«P ELIEH1 Crf-TS Etra s»h options. Enpty by def-ault.# export nUDOCP 5£H OPTS*' a CannECtTamutfil，力 SfidEnv-HADOOP COHF D

23、IS'ff Where l即 files aE itonrt. SHIDOOF HQFE/logi ty default. export HADOOP LOG 0*就治DOOP HOHEJ/Lags# File nmng mate s-lL-Bve- hosts. SHJUXMP HDPIE/'csnf/slaves- fey de fault. export HADOOP 5UiVE$HAIH0P HfflEcanf/slats# hast:path uhe-rc hndocip code shnulld be rsync'd frm. UnMt by default

24、.10詢(xún)*女件(F)Mt闈略枷 WffililHlO* 母慰*4gp4胡BaiSnani«ZIWM.Ir(»tubfvntu: /lud&Dp/hAdMp- B. Ab chnod 777 btA/hadaafiriKtubuntu:/h-adwip/'hAdcop-B - Z&.203.4*0 btn/hadiiU玷聘；hjdoop -config conf dlr camAJMC 'tc cqiwm Ls <nw maftedf -f&riMi f我ga護(hù)gn的營(yíng) ndnenodc- da tarwde df s-adhin

25、 fifidnlrb r心iputT-. -jUhartaohart'arril55：wrtrngifiirlii攜HMM iqbdlarKe-r fE-tcMt jobcr-BCkerta-ktricktr httory&ervie-rMqueueversteft jar <)a.r»ditcp Ksrcurl*Tornat the dF$ TUesy&ttn FU任 run 血 rum run run* run. runtM“Bn心Ff nntnla-the DFS n-iM-nodeEFS dat-finMle-DFS -adnlin cl len

26、tMd-ftedXjce adnlft cltifttOFS ni*EyEtM i£h«MW uctlttyittkir Icuse-r cl tentcluster bdlanclngi utility a delcq-Btion token fron the Ha Recedei3fetchtl>e Hapeducc，ob f fatker nnde a Plpe-i Jet>p*uh>run* _rvn* a HjpR«duct M5>k TrcMr na<|t-run Jmb hlSitar werwra; a± &

27、#171; starMljlLDrH diaEg nanipulate MapRedu-cegntnFornHon regarding JoJbl>JEU«3 prtfic th# ersten郵 3 jar wHde-Eiturl* c:cpy file or directories r-ecurslve'Ly日chlLML f匚jdvcHarff NftftE -p *pji5tvdest* efretq 日 tiBdoap clhtAOWM占徑髯利adoa畦過(guò)程-haighaig&n口性撤于欄-腰宵腰.以七月呻敏FliSitiW袖虹耳用白.> K于1

28、2白期中#禮|,用開(kāi)M«Rtt« 禺戶(hù)-.W廈泳iSAt不. sudo paawtiE 夏國(guó)5蜜舛m.Wnqi pm*i FHitiVuahfrihimgivrVwliElil# 70H-3Q-I0 -ubunoj 1CUQ上聽(tīng)arioQ口的IE置弟屢成童百壯歪rfev畦ft布時(shí)站L ftAh. Qdi-&iSs34MH«&SJbti: AwftKJtfcHJITH / /mhn京H牌 i 注：, STRFIiTntfl示H戚孕kW阮ZrgM 咿戲肉 2511fcD-U - H.吐 N?。?.頓Vbash. Pmi,醐w dfeMXi森限不ty j

29、 m埋空間 版» 'nfWtMaJi>: PvnKMDfi «n«Mif-Kc4!T,V m:/tofvbuli: Pam酬勃 o«f|CIFV于) nfl命中OI11*1*5心能財(cái)崎炫I事際技115.安裝部署單機(jī)偽分布式模式Hadoop-HDFS Hadoop可以在單節(jié)點(diǎn)上以偽分布式模式運(yùn)行'編輯 /conf/core-site.xml<configuration><property><name></name><value>hdfs:/loc

30、alhost:9000</value></property><property><name>hadoop.tmp.dir</name><value>/tmp/hadoop/hadoop-$</value></property></configuration>呂 gQ3 f Ij. 25：20 L LM 0只件忻坷廈低I IBCn首舉同域落國(guó)幗BQCW3 Help司讖|出*T 已口C.M4E9 時(shí)口* 園<prnperty>*naK«tfii-dle

31、-fault. nw rnrcA功 Bl “印*rflT牝"lOCalLWt: 9熊站W(wǎng)L*>c/pirnirertip-rfproperry>。服 irF 而加fh Tp ,<Jlrv3,MR«VBlue>/tR»/hadDDp/>uftM)p - StuMir.riieJ/vHVue*</pfDpert)f>. nii-iTlijiir HFji. 編輯 /opt/hadoop/conf/hdfs-site.xml<configuration><property><name>dfs.

32、replication</name><value>1</value></property>l 1 II . iS J : 5 J -5 t ? ： I - id - Il - U - ia -14 it 1< -廿頊帕 M !tiVIm Ttivli: BdftMTXff(D卸MBS ItiAUl ffiStS)工鼻田 可口俚。用由回叩叩5#nil veIIDQQH r編輯 /opt/hadoop/conf/mapred-site.xml<configuration><property><name>map

33、red.job.tracker</name><value>localhost:9001</value></property></configuration>格式化HDFSbin/hadoop namenode format啟動(dòng)Hadoop,啟動(dòng)后可使用命令jps查看已啟動(dòng)進(jìn)程，觀察是否 namenodedatanode已啟動(dòng)，關(guān)閉所有服務(wù)，使用命令 stop-all.sh, bin/ start-all.sh匣3 H E 4 M .0 找膈1. L*奇'船主文件央圖片卜A ras二3DE蔑仟雄J247GB5I 件_什鼻機(jī)3E#

34、ng制即png王京麻法“一 1 MCSS3|9hpng3H3|.png*!5J.png蛔Egm Ji "S 底=st件聚維皓n rootfpubvntu: /hadQp/hadcap-G.ZD.ZOXQr瞄皂，J"白2睨)it “學(xué)-«pach«,hdfi.,jsm典lnse*!做，fsl*4ge-frwfsjf 權(quán)J孫由姓at org. *pache. Ivado-op. hdfs. server - n .an mi ode. FS Inage- tfornat (FSIugie-.3fl)at14p«chr i Kfldwp i hdfa

35、-. servern-mwoe. NdmNdv .Ferna. j«vd:it 心rg. Mdep. hff. ¥trvtr -W. jawa: 1145)at arg.iipjche.hadoup.hdfs.server-nwMiDde.NaneNade.HoinCNanesModa-.JiKva:! 1Fhll/ie/14 找宣 5打網(wǎng)mwgM .曲的h WUTWMhi_HrM.ESHIfTD£MN_Ji5(- Shutting down NdneNode at ubuntu/127.&_ 1.1*勺時(shí)RbumTS/h占勤*川白齡做0120iIflli

36、Mm M&i TaskTracker426£耳宰2SB1 mt 砒 ode*115*9 SccondBryH-aneNodeJ404 NanrH好322? Jbir*ckeri白女g 己 Jkia血呼'haidta嘩. 6. . N3 -白# 6.瀏覽NameNode和JobTracker的網(wǎng)絡(luò)接口，地址默認(rèn)為:NameNode - http:/localhost:50070/JobTracker - http:/localhost:50030/LJ Hiadoop NameNizde LHalh. XNameNode 'localhost:9000'

37、5urt«d； Mon Ort 網(wǎng) Z253X35 C3T 2911 Ve rsloni DJQJffllA rl M9-333Cmpikd： Mlay 4 07:S7:ED PDT 2011 by MinnUpfridvs； Th&re are w upMJe*5 In progress,grPE* tin mCluster Summary7 fines ddredoorle 1 格-8 tatdl. Heap Size Is 45.19 MB / BS&.94 MB 肉童JNamenode Ldgs頃恤rM Capaclly:22J&GBDF5 Ustd:

38、6.01 KBNan DF5 Uife d:332 GKPFSMma加嚇；博1事郁&FS Us«d%:。魅DF5 RtrrudHlmgliIS5.17WLM N皿£:1Pod N wd”i0flcommlsilninilrig 村的岫/:DNurntber Undeir-Replicated BlacksNimtNde Stara£«:SEi>ra<e DlrecRjaryq# 站 linkvloculi hid &I HAd>4AdmfahikfMldA-心 ML" FImF也I.E3 百度 Mdoop -i

39、jr-ieDde ffilBWBCTWRffUffinWnin +localhost Hadoop Map/Reduce Administration如曲 RUNNING$ta ntd; Mon Ort 24 談林;53 <$T 卸 a 1Version: D2DJM3.0, r1M5333Compllf-ft Wtd My407S7:5D PDT 3011 by camTdiinlllfltr：11iO24i22-flBCluster Sutnmary (Htap Size Is 4S.19 MB/S88.94 MB)Huiilrllfig Ma>pRiiilillfij R&#

40、171;4uc«i TasksTOEll SubmlHiQrwNodtvdMUpbtdOccijiplBdSlotsGrifrrV-fidlMap Skrts-D虹 rvad Rtdim 如tsMa p Talk CapacityRtdiitt Talk Capacity皿 TgWN 詢(xún) >«BlacfcHilUid NEmGhi/ll 地 d N做/Exdud>ed N做，D0D1000d214.CDQ00Scheduling InformationQueue NameStiteSclKdulIng lAfarmatlond磨陸岫runnirN腿Fitter

41、(Jobld. Prlarir WR Njmi)I idwnpi-iF. 'uvirhiiidi 3 IDO* aviil filar hy'faiiifh* duly n Wh ur&ai tad And '1200* in JI Ik IdaRunning Jobs| rwe |7.卜面嘗試在單機(jī)偽分布模式下運(yùn)行 wordcount樣例程序?qū)⑤斎胛募截惖椒植际轿募到y(tǒng)bin/hadoop fs -put home/lee原面 testfile input運(yùn)行 Hadoop自帶的 wordcount例子bin/hadoop jar hadoop-exampl

42、es-.jar wordcount input outputEI 1 云一 2 ；， L j 虬： ，力 仲 >L U ；4 W 噸 ITro 此 g b 哪 n t u:/h 占碗 ci 口川 M 口 。 Q.衛(wèi) CL ZO10小時(shí)wbufits/ba癡叫/際如opg,衛(wèi)6禎9 MnJhWgp fse tnpAitf aatgubufitu: /hadoop/hadtaop Sl 蹈.址3 “B*docstvybuil-d.jcnl h-aTinop -ant-C .20.1C3 口.扣ivysMnlg* +hadDQp -cpirfl -C. Ifl. Z

43、7;. f>. j-irlibNOTICE _tx.tREADME _tx.t crc tnt ii.- ：； |i-F- - =f：' r -i：,.-Si .7：»-i ：i. = .-"llhrkHdW岫r*e*nfh. a fl>. j«rLICEKE-tttrtbhadoop-tols-B-20-243.4. jarlosraotuibuntu:/tiadoDp/hadaap-9.20.2411-D# btn/ihjdoop jiar hadaop-e-xanples-fl.ZB-.2B3.Input outputT*Q THFO I

44、HFO INTO1H*<I 偵。THfd IHFd IHFQ INff!ljar iMrdc<7un>t ll/lfl/24 1UW14 91/IB/24 31/1B/Z4 I1/1D/Z4 1/1B/ZA11/W14 31/IB/24 31/1D/Z4 ai/in/zi tins XtH rH財(cái)vMq slts flS=6si：sa：ai jura 西中e.laxihrnx5J=3 sa 5S43 93 m 鮑 ei Gl 01 門(mén)Itrut. FlUIh*utF4rNi< t T«c«l Input詞: iRynrulns 村此時(shí)媲nap M r

45、educe- M nap 1MK reduce BX nap J.血需 redvce- IE#Job >eonpl«T«； j nezi zjub.owi SuniWm 25> lato Gq fLaun reduce- t-asks-lSLOTS_NI LLISJ<APS-12fifl*T序WL lbw 3pent 坷 all redkicvs 機(jī)孔神的，網(wǎng)XltmN rupred. InbClAmk: napred. JobCltenit: napred , obcllent; n占。red, JfibCllefttr 尚叩rfrd, ndpred.

46、iDbCllariK: napred.JobCltenti napred s obclient; napred.abclientrKW>： MHlH|MA |4M |I DEO 33：« |IW%將輸出文件從分布式文件系統(tǒng)拷貝到本地文件系統(tǒng)查看bin/hadoop fs -get output /home/lee皮檔 cat /home/lee 儀檔 /output/*輯， 女件呵單管f日也擅最國(guó)中斯D 腰圈ttD| 土 IP主女阡央圖.片卜 T Q HE疝B京忤疆 二衣了 G日尺怦一計(jì)算機(jī)aiming3|3F.png3<3|.png桃png故M.pngKSJ.png對(duì).

47、prq遷京,獎(jiǎng)U«fli?a» a th督吊對(duì) Lpmg州習(xí).png我 13Q.pngroot4pubvntu:/hackigp/hadcap-0-.2D.Z01弟11/W21 tl/W44 51/1H/24 31/1B)Z4 31/1D/Z4 ai/iu/zi ii/ie/H31/IB/24 31/1B/Z4 ai/in/z-1! ll/WH ii/je/i-i 11/14/24 31/1B/Z4 rootlubuntu <*6-t>fibu4h<u.r 吐 cati A/l«*/X13/tpiJt/_l*95 ? J8 中目真5«s

48、am 41 ai Gl Cl. m 1 ai ei ai 01 m ai si :!mm 偵。 IhF0 lira INFO IHVd IKO TMFO 2h: j INFO I MFC偵。 THFCI INTOnA|>red. JGbCl槌EU 孔叩X, 即心 nuprtd. JobCltanlt! napred.JobCltent: napred.JobClientr naprrd. obClleniC r fiepred. JbCHet! ndprtcl. MKlh”!; napred. JobC'Lkent napred.JobCltent: ndpred. JtibCl

49、 lent r fiipred. JefrCUtftttrtle I nt in Fernii Wua 好 m et«s n#a4=21M/.ftcduE Frjn-ffiworkReduce Input groupsSHap output noterialiEed bytes-57CDHbtne -Qutput recrwds-sSHep t<ipvc rec-ds=iRdUC* thuFflo ttytVSs$7Reduce output records-5Spilled Records-10Hap mtput bytes-41 lysE fiCSfd&=.5Hap

50、 output irfrcor(ts=$ lPLIT_PAli_BVTEiBie2 Reduce input records-SIs1just1tea it I1tilts158napred. DnbClt.ent! napred. JobCltenit:鈾5S/hadtiGip/hDdop D 20»Zfil- n* blnyhadoop fs -眼t output /hcjiw/lceJ KfSjh占勵(lì)op/h*如做學(xué)直6禎J.M WT /Nahe/X*t/5E8. 安裝部署多機(jī)Hadoop-HDFS這個(gè)部署多機(jī)的實(shí)驗(yàn)在實(shí)驗(yàn)室沒(méi)有做完，最后實(shí)在宿舍完成的，節(jié)點(diǎn)為 兩個(gè)，使用系統(tǒng)為

51、wubi安裝的Ubuntu,所以不需要橋接方式（因?yàn)橛泄潭?IP），以下步驟為我做為Master時(shí)的實(shí)驗(yàn)截圖：本機(jī)名為node1，另外一臺(tái)機(jī)器為 node2,兩臺(tái)機(jī)器均建立一個(gè)名為 hadoop的管理員用戶(hù)用丁統(tǒng)一部署安裝 had。編輯文件/etc/hostsii ubuntu 替換為 nodelR伴£Br«itubijntU = /t/«tc/lM3£txCredit :fl?S4): Gtk-HAHNIhKi *: ftttwiptinq to stare cJhanges into '/root/.lo

52、cal/sha rp/recently - usedbef .j. but f-ntled;宙立件IlMbl/h«e,/rcnitlv -udedu,如ww“失的；沒(méi)有那個(gè)女件戚目錄版或，農(nóng)tc) -edrtItaedlt: Gtk MAfiNING *: Atteflptlna ta set thu isr.、KHi.n .5J3rCirV M'. t»t f砒Rdis有那個(gè)R辛立可 mm a«(M 工T) st叫 (MDhOSIS khl7.e.a. 1 LattflllwstB27.e. 1.1 ruideir TM r&llOMtnfl l

53、liws ar« deitirable fer IPg edible IpAlxMhmt Ipg.lQcalnet tpfi-Kastpref lx ip4-Bllrwdes Lp4-dVlrouur 1 IpCfc-alltofitBfeBB:4 ffBS:e ffUZ:rl frni；;2 rres：:ijawaffis wd- aniptae： J.ianF 我加垃危隊(duì)丈耳Hrirl 田:InodLJpl ultHL HltfiA28IrwdgJ ini MxitZ|rMd#3Jp|IDEDU 臉一«觸 |g編輯 /etc/hostname刪除該文件的所有內(nèi)容，添加

54、node1芝-J；HARMING r: MKmpN* t*rt/f*cemtl-u-5ed-*t*l,. ftut r機(jī)我婚；創(chuàng)丑女 ii.csDxay-靛Mh蜜有失中女件Mt 泉-Lt:5a«2&: Gtk'IMnNING *£ Attenpttng m re/rKEntl.y"Used.Tbitl, B but failed:浪3fitt:5B2&): Gtk-WWNIIW *： ftttenpttrw to ecentlj-usfdKbel',. shut ffltlcd: filSi立件WQW“失RS；沒(méi)有雄個(gè)立件戚目呆h&

55、lt;H-LmniiE K(9edtt:5!>20); Gtk-HARNING *: ftttwipting t/3tiare/rfr£!&fttly-yitd.Kbe,l, B butr 汲： - - - '. : .9 帝 hfHtrfeMhE 妁鹿匚| . gdK5；件的 uiu>：Ej avivF nts) imn 衛(wèi)檔做 開(kāi)t ba庫(kù)尊a 用再，"運(yùn)行命令 hostname node1a)指定IP地址編輯文件 /etc/network/interfacesauto eth0iface eth0 inet staticaddress 11

56、96netmask it序£D 段邨 rpdQubuniuc/aiito atlhaIfacc etha Ln&t ±t«ttcadldrcss 90212 - 13netnask Z55kZlS.Z35-.c|Etdrl 虱|nod?Lji|明咐責(zé)IF互睞全揆L暗|im重啟 網(wǎng)絡(luò)服務(wù) sudo /etc/init.d/networking restart查看IP地址ifconfigb）修改/etc/hosts 文件node1中:96 node1115.24.250

57、.43 node2node2 中：96 node13 node2E3f H，: H 4 中 禎廿伯仆TMtubrijntU-/* /'ttc/fiftMirk/lnttrfKei auto rtfiB tfflce e-th® inet static ddkJresa- 115.Z4 .Z». 19« netMlk US.»S.2S3i.» r*qttutntus/*砒明隊(duì)呻”3口 Running /ctc/Lnit.d/nctwarlkiing restart is. deprecated beouse it my not endhL e -ag«tn sane interf-aces R«configuring network interfaces.u. R1HLTL1MK ifiSirtfl： flit tX.lltl Filled m 1x5 uprootubuntu.r-I no岫p| 3的lujiZInoibL jq| ndf IEilt IIB