Solaris10與EMCCX310c實現(xiàn)FCSAN實施手冊V2

1、Solaris 10與EMC CX3-10c實現(xiàn)FC-SAN實施手冊現(xiàn)場背景：服務器3臺，2臺Sun Fire V490，1臺Sun Fire V250。存儲為DELL|EMC CX3-10c，配備8TB硬盤，一臺Brocade SW200E光纖交換機。目的：實現(xiàn)FC-SAN構(gòu)架。拓撲圖：實施步驟：1、 先完成Dell|EMC CX3-10c初始化，配置兩個管理IP，分別為：XX.XX.XX.XX。2、 建立服務器、光纖交換機、存儲之間的鏈路。3、 初始化光纖交換機，配置管理地址：XX.XX.XX.XX4、 在Navisphere Manager管理界面發(fā)現(xiàn)鏈路。5、 在服務器端安裝Navis

2、phere agent注冊，安裝PowerPath多鏈路管理軟件。具體安裝操作如下：l Navisphere agent的安裝與配置先將光盤mount上后，再執(zhí)行下面的命令：pkgadd -d NAVIAGNT.pkg會出現(xiàn)下述提示信息，按照提示信息選擇安裝即可。Select the packages that you want to install by doing one of thefollowing:? Enter 1 (to install the host agent)or? Enter 2 (to install CLI) or Enter All (to install bot

3、h the host agentand CLI)Enter y and y to begin the installation.The installation program looks for any agent configuration filesyou may already have on your system. If the program doesnot find any agent configuration files, then you have finishedinstalling the agent; go to step 10q. If the program d

4、oes find anyexisting configuration files, it displays a message like the following:At Least 1 saved config file exists for NavisphereAgent.Please select 1 of the following:1Restore/etc/Navisphere/.Naviagent-config.000120:10592Restore/etc/Navisphere/.Naviagent-config.000121:14083 QuitSelect number 1

5、- 3.修改agent.config配置文件，主要方法如下：修改/etc/Navisphere/agent.configVi /etc/Navisphere/agent.config 修改內(nèi)容為：# Navisphere agent.config# -# This file is used by Navisphere Agent to configure# site specific values.# All entries in this file have this form:# object value-list# Where "object" tells what

6、sort of information is to# be configured, and "value-list" is a# whitespace-separated list of values to be configured.# Samples, which should be edited, appear below for all# permissible types of objects.# White space (tabs, space, line-feeds,# carriage-returns) and blank lines are ignored

7、;# To continue a line onto the next line, use "" as the# last character of that line. The "" is dropped when# the next line is concatenated to the continued line.# Description specification# -# The "clarDescr" object takes arbitrary text values# intended to describe the

8、 agent and its location.#clarDescr Navisphere Agent# The "clarContact" object takes arbitrary text values# intended to describe who is responsible for the# configured agent, and how to reach them.#clarContact John Smith, 800-555-1212# Device specification.# -# The format of "device&qu

9、ot; objects for CLARiiON devices# is:# devicedevice-specname "description"# where the device-specification is the device name to# open to access the CLARiiON device. It can be a# SCSI-2 file name. If this is "auto", all attached# arrays with bound LUNs will be automatically# conf

10、igured. (Currently, dummy arguments are required# for name and description, when using# auto-configuration.) This can NOT be defaulted.# The name is the per CLARiiON name that can be used to# identify each CLARiiON to the manager application.# The name is REQUIRED and cannot contain spaces (even# if

11、 surrounded by quotes). This can NOT be defaulted.# The description is a quoted string that contains a# brief description of the CLARiiON chassis being# managed. It defaults to "" if not specified, and to# the device name for auto-configuration.# SAMPLES:# device c0t0d0 NAVISPHERE-1 "

12、NAVISPHERE-1"# automatically detect manageable devicesdevice auto auto# User Specification.# -# The format of "user" objects is"# user localUserId# OR# user userIdhostname在此處添加存儲系統(tǒng)SPA和SPB管理地址即可user systemXX.XX.XX.XX user systemXX.XX.XX.XX# These build a list of users who are allo

13、wed to perform# WRITE operations to the CLARiiON devices managed by# this agent. By default, as specified below, only root# on this machine has WRITE access. Others can be# granted access by including their login name and host# which they can access from. A null list prevents# anyone, including admi

14、n, from having write access. In# order to get write access, this file would have to be# modified and the Agent stopped and restarted to# re-read the configuration file, or an appropriate# remote configuration file would have to be sent to the# agent from an already-priviledged user.user root # only

15、on this machine#user sbluepicasso # individual user "sblue" on# host "picasso"#user lgreenhannibal # individual user "lgreen" on# host "hannibal"# Poll specification# -# The "poll" object takes a numerical count of seconds.# This specifies how often

16、the agent solicits# information from the array, rather than using cached# information. The minimum is "10".#poll 60# Eventlog specification# -# The eventlog object takes a numerical count of log# entries.# This defines the maximum number of SP log events# received by the agent on startup,

17、and received by# clients per poll. A value of 0 causes the devices# entire log to be read at startup. A minimum of 100# events will be read on serial, and 2048 on fibre,# overriding any lower value configured below.#eventlog 100# Baud Rate specification# -# If the agent is using a serial port to man

18、age a# device, the next entry can specify either 9600 baud# or 19200 baud.#baud 9600# end of configuration file#保存配置文件，然后可以啟動/停止agent服務。命令如下：bash3.00#/etc/init.d/agent stopbash3.00#/etc/init.d/agent start如果安裝配置正常，啟動agent服務后在Navisphere Manager管理界面中的Connective中會看到鏈路狀態(tài)register為yes。如register顯示為no，可以考慮重啟

19、服務器或者重啟agent服務，或者在Navisphere Manager界面中進行手動注冊也可以。注冊完成后會在鏈路狀態(tài)中顯示主機名稱等信息。l PowerPath的安裝與注冊PowerPath的安裝1、Mount CDROM2、bash3.00# mkdir /unload3、bash3.00#cd /unload4、bash3.00#cp <source_location>/<package_name>. 從光盤將安裝文件拷貝到新建的目錄下面。5、bash3.00# gunzip <package_name> 解壓縮文件6、bash3.00# tar -

20、xvf <package_name> 解壓縮文件7、bash3.00#pkgadd d . 安裝PowerPath按照下述提示操作：SPARC host:The following packages are available:EMCpower EMC PowerPath(sparc) 5.2.x_bxxxSelect package(s) you wish to process (or 'all' toprocess all packages). (default: all) ?,?,q:x86 (i386) host:The following packages

21、 are available:EMCpower EMC PowerPath(i386) 5.2.x_bxxxSelect package(s) you wish to process (or 'all' toprocess all packages). (default: all) ?,?,q:Enter 1 and press ENTER. Enter package base directory (default: /opt):Press ENTER to accept the default base directory (/opt), or type thepath t

22、o an alternate base directory and press ENTER.This package contains scripts which will be executedwith super-user permission during the process ofinstalling this package.Do you want to continue with the installation of<EMCpower> y,n,?Enter y and press ENTER.Installation of <EMCpower> was

23、 successful.8、安裝完成后需要進行PowerPath的注冊注冊方法如下：bash3.00#/etc/emcpreg -installYou see the following output:= EMC PowerPath Registration =Do you have a new registration key or keys to enter? nType y and press ENTER.You see the following output:Enter the registration key(s) for your product(s),one per line,

24、 pressing Enter after each key.After typing all keys, press Enter again.Key (Enter if done):Enter the PowerPath registration key and press ENTER. You can alsoadd keys for other technologies, such as PowerPath MigrationEnabler or PowerPath Encryption with RSA.If you entered a valid key, you see the f

25、ollowing output:1 key(s) successfully added.Key successfully installed.Key (Enter if done):Press ENTER. You see the following output if you entered one key:1 key(s) successfully registered.在PowerPath軟件安裝注冊完成后重啟服務器，輸入下述命令可以看到服務器與存在之間的兩條鏈路：bash3.00#powermt display dev=all會顯示鏈路情況。還需要將Solaris主機的MPxIO功能關(guān)

26、閉。（主要是由于Solaris自帶的MPxIO功能與PowerPath的多路徑功能相沖突）具體修改文件如下：修改/kernel/drv/fp.conf，修改內(nèi)容如下：mpxio-disable="yes"修改/kernel/drv/scsi_vhci.conf，修改內(nèi)容如下：mpxio-disable="yes"修改完成后，運行如下命令：powermt display dev=all powermt check (Choose "A" for all. Clear the dead paths.) devfsadm C (Scan t

27、he SCSI bus.) powercf -q (Rebuild the logical link layer.) powermt config (Bring the device paths into PowerPath control.) powermt save (Save the current configuration.)完成配置保存等工作后PowerPath軟件即可正常使用。6、 存儲建立RAID Group，Storage Group，將服務器與LUN映射關(guān)系對應上。7、 服務器端識別存儲，格式化硬盤以及做文件系統(tǒng)。具體操作如下：sh-3.00# formatSea

28、rching for disks.doneAVAILABLE DISK SELECTIONS: 0. c0t0d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424> /pci1d,700000/scsi4/sd0,0 1. c0t8d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424> /pci1d,700000/scsi4/sd8,0 2. c3t0d0 <DGC RAID 5 0326 b761dc00> /pci1d,700000/QLGC,qlc2/sd0,0 3. c3t1d0 <DGC

29、 RAID 5 0326 b761dc00> /pci1d,700000/QLGC,qlc2/sd1,0 4. emcpower0a <DGC RAID 5 0326 b761dc00> /pseudo/emcp0Specify disk (enter its number): 4selecting emcpower0adisk formattedFORMAT MENU: disk - select a disk type - select (define) a disk type partition - select (define) a partition table c

30、urrent - describe the current disk format - format and analyze the disk repair - repair a defective sector label - write label to the disk analyze - surface analysis defect - defect list management backup - search for backup labels verify - read and display labels inquiry - show vendor, product and

31、revision volname - set 8-character volume name !<cmd> - execute <cmd>, then return quitformat> pPARTITION MENU: 0 - change 0' partition 1 - change 1' partition 2 - change 2' partition 3 - change 3' partition 4 - change 4' partition 5 - change 5' partition 6 - c

32、hange 6' partition select - select a predefined table modify - modify a predefined partition table name - name the current table print - display the current table label - write partition map and label to the disk !<cmd> - execute <cmd>, then return quitpartition> pCurrent partitio

33、n table (original):Total disk sectors available: 3076627422 + 16384 (reserved sectors)Part Tag Flag First Sector Size Last Sector0 root wm 34 128.00MB 262177 1 swap wu 262178 128.00MB 524321 2 unassigned wm 0 0 0 3 unassigned wm 0 0 0 4 unassigned wm 0 0 0 5 unassigned wm 0 0 0 6 usr wm 524322 1.43T

34、B 3076627421 8 reserved wm 3076627422 8.00MB 3076643805 partition> labelReady to label disk, continue? ypartition> qFORMAT MENU: disk - select a disk type - select (define) a disk type partition - select (define) a partition table current - describe the current disk format - format and analyze

35、 the disk repair - repair a defective sector label - write label to the disk analyze - surface analysis defect - defect list management backup - search for backup labels verify - read and display labels inquiry - show vendor, product and revision volname - set 8-character volume name !<cmd> -

36、execute <cmd>, then return quitformat> q創(chuàng)建文件系統(tǒng)，Solaris默認格式bash-3.00# newfs /dev/rdsk/emcpower0g newfs: 建構(gòu)新的文件系統(tǒng) /dev/rdsk/ emcpower0g: (y/n)？ y警告：最后一個未分配柱面中的 1104 扇區(qū)/dev/rdsk/ emcpower0g: 在 500668 磁道上，48 扇區(qū)的 128 柱面的 3076103088 扇區(qū)1502003.5MB 在 3502 柱面群組 (143 c/g, 429.00MB/g, 448 i/g)超塊 (fsck

37、 -F ufs -o b=#) 備份在：32, 878752, 1757472, 2636192, 3514912, 4393632, 5272352, 6151072, 7029792, 7908512,初始化柱面組：.最后 10 個柱面組的超級塊備份位置： 3068047904, 3068926624, 3069805344, 3070684064, 3071562784, 3072441504, 3073320224, 3074198944, 3075077664, 3075956384,文件系統(tǒng)做完。掛載硬盤bash-3.00# mkdir emcdiskbash-3.00# moun

38、t /dev/dsk/ emcpower0g /mnt/emcdisk/其它鏈路也如上述操作，完成后運行下面命令可以看到磁盤大小以及利用情況。bash-3.00# df -kh文件系統(tǒng) 大小 用了 可用 容量 掛接在/dev/dsk/c0t0d0s0 32G 1.1G 30G 4% /devices 0K 0K 0K 0% /devicesctfs 0K 0K 0K 0% /system/contractproc 0K 0K 0K 0% /procmnttab 0K 0K 0K 0% /etc/mnttabswap 2.1G 1.0M 2.1G 1% /etc/svc/volatileobjf

39、s 0K 0K 0K 0% /system/object/dev/dsk/c0t0d0s3 23G 4.3G 19G 19% /usrfd 0K 0K 0K 0% /dev/fd/dev/dsk/c0t8d0s7 67G 743M 66G 2% /varswap 2.1G 312K 2.1G 1% /tmpswap 2.1G 24K 2.1G 1% /var/run/dev/dsk/c0t0d0s6 1.2G 83M 1.1G 7% /temp/dev/dsk/c0t0d0s7 10G 1.9G 8.2G 19% /export/home/dev/dsk/emcpower0g 1.4T 64M

40、 1.4T 1% /mnt/emcdisk8、 硬盤自動掛載，修改配置文件，配置文件在/etc/vfstab具體修改參考下面文檔：bash-3.00# vi /etc/vfstab#device device mount FS fsck mount mount#to mount to fsck point type pass at boot options#fd - /dev/fd fd - no -/proc - /proc proc - no -/dev/dsk/c0t0d0s1 - - swap - no -/dev/dsk/c0t0d0s0 /dev/rdsk/c0t0d0s0 / u

41、fs 1 no -/dev/dsk/c0t0d0s3 /dev/rdsk/c0t0d0s3 /usr ufs 1 no -/dev/dsk/c0t8d0s7 /dev/rdsk/c0t8d0s7 /var ufs 1 no -/dev/dsk/c0t0d0s7 /dev/rdsk/c0t0d0s7 /export/home ufs 2 yes -/dev/dsk/c0t0d0s6 /dev/rdsk/c0t0d0s6 /temp ufs 2 yes -/devices - /devices devfs - no -ctfs - /system/contract ctfs - no -objfs

42、 - /system/object objfs - no -swap - /tmp tmpfs - yes -/dev/dsk/emcpower0g /dev/rdsk/emcpower0g /mnt/emcdisk ufs 1 yes -9、 光纖交換機配置zone光纖交換機主要配置管理ip地址，zone等，在初始化時已經(jīng)完成了ip地址的配置，配置zone的方法如下：SW200E:admin> switchshow 查看交換機信息switchName: SW200EswitchType: 34.0switchState: Online switchMode: NativeswitchR

43、ole: PrincipalswitchDomain: 1switchId: fffc01switchWwn: 10:00:00:05:1e:5b:f7:3ezoning: ON (XXXX)switchBeacon: OFFArea Port Media Speed State Proto= 0 0 id N4 Online F-Port 21:00:00:1b:32:08:2a:d4 1 1 id N4 Online F-Port 50:06:01:69:41:e0:b2:5f 2 2 id N4 Online F-Port 50:06:01:61:41:e0:b2:5f 3 3 id N

44、4 Online F-Port 21:00:00:e0:8b:8f:57:b3 4 4 id N4 Online F-Port 21:00:00:e0:8b:8f:a8:b3 5 5 id N4 No_Light 6 6 id N4 No_Light 7 7 id N4 No_Light 8 8 - N4 No_Module (No POD License) Disabled 9 9 - N4 No_Module (No POD License) Disabled 10 10 - N4 No_Module (No POD License) Disabled 11 11 - N4 No_Module (No POD License) Disabled 12 12 - N4 No_Module (No POD License) Disabled 13 13 - N4 No_Module (No POD License) Disabled 14 14 - N4 No_Module (No POD License) Disabled 15 15 - N4 No_Module (No POD License) DisabledSW200E:admin