Re: 6120 (T4) with Solaris 8 and VxVM 3.2: DMP not working
From: Paul Coray (paul.coray_at_spamblock.unibas.ch)
Date: 09/30/04
- Next message: Todd Sawyers: "Re: SVM - metattach question"
- Previous message: Scott Howard: "Re: Gigaswift card device name"
- In reply to: Paul Coray: "6120 (T4) with Solaris 8 and VxVM 3.2: DMP not working"
- Next in thread: Sami Ketola: "Re: 6120 (T4) with Solaris 8 and VxVM 3.2: DMP not working"
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
Date: Thu, 30 Sep 2004 14:28:18 +0200
Paul Coray schrieb:
> Sunmanagers,
>
> I have:
>
> V880, Solaris 8 2/02 u7, Kernelpatch 117350-06 (August 2004)
> Veritas VxVM 3.2 with latest patch (3.2t_p5.3:14-Jan-2004).
>
> I got a new Partnergroup of StorEdge 6120 (T4) and a 2 Gb FC PCI Dual
> Channel Network 2Gb Fibrechannel controller (SG-XPCI2FC-QF2 375-3108). I
> installed the controller, SUNWsan, SUNWcfpl and SUNWcfplx, plus all
> required patches stated in the FC Adapter Release Notes. So i have each
> tray of my storage attached to one controller on the host, as usual.
>
> I applied the latest firmware (3.1.2) to the 6120 RAID and cabled the
> loop properly to PG configuration, enabled mp_support=rw and created two
> volumes on each tray. These four volumes are visible through both FC
> controllers in the output of format on my host:
>
> 17. c7t2d0 <SUN-T4-0301 cyl 53246 alt 2 hd 40 sec 128>
> /pci@9,600000/SUNW,qlc@1/fp@0,0/ssd@w20030003ba4e7d80,0
> 18. c7t2d1 <SUN-T4-0301 cyl 43180 alt 2 hd 80 sec 128>
> /pci@9,600000/SUNW,qlc@1/fp@0,0/ssd@w20030003ba4e7d80,1
> 19. c7t2d2 <SUN-T4-0301 cyl 61438 alt 2 hd 40 sec 128>
> /pci@9,600000/SUNW,qlc@1/fp@0,0/ssd@w20030003ba4e7d80,2
> 20. c7t2d3 <SUN-T4-0301 cyl 39084 alt 2 hd 80 sec 128>
> /pci@9,600000/SUNW,qlc@1/fp@0,0/ssd@w20030003ba4e7d80,3
> 21. c8t1d0 <SUN-T4-0301 cyl 53246 alt 2 hd 40 sec 128>
> /pci@9,600000/SUNW,qlc@1,1/fp@0,0/ssd@w20030003ba4e8ac5,0
> 22. c8t1d1 <SUN-T4-0301 cyl 43180 alt 2 hd 80 sec 128>
> /pci@9,600000/SUNW,qlc@1,1/fp@0,0/ssd@w20030003ba4e8ac5,1
> 23. c8t1d2 <SUN-T4-0301 cyl 61438 alt 2 hd 40 sec 128>
> /pci@9,600000/SUNW,qlc@1,1/fp@0,0/ssd@w20030003ba4e8ac5,2
> 24. c8t1d3 <SUN-T4-0301 cyl 39084 alt 2 hd 80 sec 128>
> /pci@9,600000/SUNW,qlc@1,1/fp@0,0/ssd@w20030003ba4e8ac5,3
>
> So far, everything looks fine.
>
> Then I configured all devices/volumes on c7t2dX as VxVM disks (see
> below), in order to have DMP (dynamic multipathing) enabled (i.e
> configuring c8t1dX as the alternate path). But I never got VxVM to talk
> to these Volumes through both FC channels. vxdisk list on each of these
> volumes says 'numpaths: 1'
>
> On the same host I have an old T3A Partnergroup (Firmware 1.1803)
> attached, with two Volumes managed also by VxVM, and multipathing was
> enabled automatically, as soon as the param mp_support on the
> RAID-Controller was set to rw. Below is a comparison of the DMP
> pertinent information of VxVM, first for the correctly working T3A,
> then for the failing dmp on the 6120(T4).
>
> I have two observations:
>
> - vxdisk list doesn't show the working alternate controller c5tXdX for
> the T3A PG, but it does show the second path c8tXdX to the T4 volumes,
> which doesn't work as alternate path.
>
> - The enclosure type of T4 is only recognized as OTHER_DISKS in
> vxdmpadm, whereas all T3s are recognized correctly as enclosure type T3.
>
> Help is greatly appreciated, as I need to get this working ASAP!
>
> TIA
> Paul
>
>
> ==============================
> VxVM Disk info
> ==============================
>
> [root@aleph2 adm]# vxdisk list
> DEVICE TYPE DISK GROUP STATUS
> c1t0d0s2 sliced - - error
> c1t1d0s2 sliced - - error
> c1t2d0s2 sliced - - error
> c1t3d0s2 sliced - - error
> c1t4d0s2 sliced - - error
> c1t5d0s2 sliced - - error
> c1t8d0s2 sliced - - error
> c1t9d0s2 sliced - - error
> c1t10d0s2 sliced - - error
> c1t11d0s2 sliced - - error
> c1t12d0s2 sliced reserve1 rootdg online
> c1t13d0s2 sliced reserve2 rootdg online
> c2t1d0s2 sliced t3dg01 t3dg online
> c4t2d0s2 sliced t300-1 t3pgdg online
> c4t2d1s2 sliced t300-2 t3pgdg online
> c7t2d0s2 sliced t4dg01 t4dg online
> c7t2d1s2 sliced t4dg02 t4dg online
> c7t2d2s2 sliced t4dg03 t4dg online
> c7t2d3s2 sliced t4dg04 t4dg online
> c8t1d0s2 sliced - - online
> c8t1d1s2 sliced - - online
> c8t1d2s2 sliced - - online
> c8t1d3s2 sliced - - online
>
> [root@aleph2 /root]# vxprint -Aht
>
> [...]
>
> Disk group: t3pgdg
>
> DG NAME NCONFIG NLOG MINORS GROUP-ID
> DM NAME DEVICE TYPE PRIVLEN PUBLEN STATE
> RV NAME RLINK_CNT KSTATE STATE PRIMARY DATAVOLS SRL
> RL NAME RVG KSTATE STATE REM_HOST REM_DG REM_RLNK
> V NAME RVG KSTATE STATE LENGTH READPOL PREFPLEX
> UTYPE
> PL NAME VOLUME KSTATE STATE LENGTH LAYOUT NCOL/WID
> MODE
> SD NAME PLEX DISK DISKOFFS LENGTH [COL/]OFF DEVICE
> MODE
> SV NAME PLEX VOLNAME NVOLLAYR LENGTH [COL/]OFF AM/NM
> MODE
> DC NAME PARENTVOL LOGVOL
> SP NAME SNAPVOL DCO
>
> dg t3pgdg default default 0 992004501.1025.aleph2
>
> dm t300-1 c4t2d0s2 sliced 7167 244737024 -
> dm t300-2 c4t2d1s2 sliced 7167 244744192 -
>
> v aleph - ENABLED ACTIVE 186009600 SELECT -
> fsgen
> pl aleph-01 aleph ENABLED ACTIVE 186009600 CONCAT - RW
> sd t300-2-04 aleph-01 t300-2 58734592 186009600 0 c4t2d1
> ENA
>
> v aleph1 - ENABLED ACTIVE 209715200 SELECT -
> fsgen
> pl aleph1-01 aleph1 ENABLED ACTIVE 209721344 CONCAT - RW
> sd t300-1-02 aleph1-01 t300-1 8393728 209721344 0 c4t2d0
> ENA
>
> v archive - ENABLED ACTIVE 41943040 SELECT -
> fsgen
> pl archive-01 archive ENABLED ACTIVE 41947136 CONCAT - RW
> sd t300-2-02 archive-01 t300-2 8393728 41947136 0 c4t2d1
> ENA
>
> v redo3 - ENABLED ACTIVE 3072000 SELECT -
> fsgen
> pl redo3-01 redo3 ENABLED ACTIVE 3075072 CONCAT - RW
> sd t300-2-03 redo3-01 t300-2 50340864 3075072 0 c4t2d1
> ENA
>
> v swap - ENABLED ACTIVE 8388608 SELECT -
> fsgen
> pl swap-01 swap ENABLED ACTIVE 8393728 CONCAT - RW
> sd t300-1-01 swap-01 t300-1 0 8393728 0 c4t2d0
> ENA
>
> v swap1 - ENABLED ACTIVE 8388608 SELECT -
> fsgen
> pl swap1-01 swap1 ENABLED ACTIVE 8393728 CONCAT - RW
> sd t300-2-01 swap1-01 t300-2 0 8393728 0 c4t2d1
> ENA
>
> v usr_local - ENABLED ACTIVE 20971520 SELECT -
> fsgen
> pl usr_local-01 usr_local ENABLED ACTIVE 20973568 CONCAT - RW
> sd t300-1-03 usr_local-01 t300-1 218115072 20973568 0 c4t2d0
> ENA
>
> Disk group: t4dg
>
> DG NAME NCONFIG NLOG MINORS GROUP-ID
> DM NAME DEVICE TYPE PRIVLEN PUBLEN STATE
> RV NAME RLINK_CNT KSTATE STATE PRIMARY DATAVOLS SRL
> RL NAME RVG KSTATE STATE REM_HOST REM_DG REM_RLNK
> V NAME RVG KSTATE STATE LENGTH READPOL PREFPLEX
> UTYPE
> PL NAME VOLUME KSTATE STATE LENGTH LAYOUT NCOL/WID
> MODE
> SD NAME PLEX DISK DISKOFFS LENGTH [COL/]OFF DEVICE
> MODE
> SV NAME PLEX VOLNAME NVOLLAYR LENGTH [COL/]OFF AM/NM
> MODE
> DC NAME PARENTVOL LOGVOL
> SP NAME SNAPVOL DCO
>
> dg t4dg default default 124000 1096470388.1783.aleph3
>
> dm t4dg01 c7t2d0s2 sliced 5119 272609280 -
> dm t4dg02 c7t2d1s2 sliced 10239 442142720 -
> dm t4dg03 c7t2d2s2 sliced 5119 314552320 -
> dm t4dg04 c7t2d3s2 sliced 10239 400199680 -
>
> v aleph1 - ENABLED ACTIVE 272609280 SELECT -
> fsgen
> pl aleph1-01 aleph1 ENABLED ACTIVE 272609280 CONCAT - RW
> sd t4dg01-01 aleph1-01 t4dg01 0 272609280 0 c7t2d0
> ENA
>
> v exlibris - ENABLED ACTIVE 400199680 SELECT -
> fsgen
> pl exlibris-01 exlibris ENABLED ACTIVE 400199680 CONCAT - RW
> sd t4dg04-01 exlibris-01 t4dg04 0 400199680 0 c7t2d3
> ENA
>
> v exlibris1 - ENABLED ACTIVE 314552320 SELECT -
> fsgen
> pl exlibris1-01 exlibris1 ENABLED ACTIVE 314552320 CONCAT - RW
> sd t4dg03-01 exlibris1-01 t4dg03 0 314552320 0 c7t2d2
> ENA
>
> v reserve - ENABLED ACTIVE 442142720 SELECT -
> fsgen
> pl reserve-01 reserve ENABLED ACTIVE 442142720 CONCAT - RW
> sd t4dg02-01 reserve-01 t4dg02 0 442142720 0 c7t2d1
> ENA
>
>
> =====================
> DMP Info T3 PG (Good)
> =====================
>
> [root@aleph2 /]# vxdisk list t300-1
> Device: c4t2d0s2
> devicetag: c4t2d0
> type: sliced
> hostid: aleph3
> disk: name=t300-1 id=1095429937.1621.aleph3
> group: name=t3pgdg id=992004501.1025.aleph2
> flags: online ready private autoconfig autoimport imported
> pubpaths: block=/dev/vx/dmp/c4t2d0s4 char=/dev/vx/rdmp/c4t2d0s4
> privpaths: block=/dev/vx/dmp/c4t2d0s3 char=/dev/vx/rdmp/c4t2d0s3
> version: 2.2
> iosize: min=512 (bytes) max=2048 (blocks)
> public: slice=4 offset=0 len=244737024
> private: slice=3 offset=1 len=7167
> update: time=1096428634 seqno=0.13
> headers: 0 248
> configs: count=1 len=5268
> logs: count=1 len=798
> Defined regions:
> config priv 000017-000247[000231]: copy=01 offset=000000 enabled
> config priv 000249-005285[005037]: copy=01 offset=000231 enabled
> log priv 005286-006083[000798]: copy=01 offset=000000 enabled
> Multipathing information:
> numpaths: 2
> c4t2d0s2 state=enabled type=secondary
> c5t1d0s2 state=enabled type=primary
>
> [root@aleph2 /root]# vxdmpadm listctlr all
> CTLR-NAME ENCLR-TYPE STATE ENCLR-NAME
> =====================================================
> c1 Disk ENABLED Disk
> c2 T3 ENABLED T30
> c4 T3 ENABLED T31
> c5 T3 ENABLED T31
> c3 OTHER_DISKS ENABLED T41
> c6 OTHER_DISKS ENABLED T41
>
> [root@aleph2 /root]# vxdmpadm getdmpnode enclosure=T31
> NAME STATE ENCLR-TYPE PATHS ENBL DSBL ENCLR-NAME
> =========================================================================
> c4t2d1s2 ENABLED T3 2 2 0 T31
> c4t2d0s2 ENABLED T3 2 2 0 T31
>
> [root@aleph2 /root]# vxdmpadm getsubpaths ctlr=c4
> NAME STATE PATH-TYPE DMPNODENAME ENCLR-TYPE ENCLR-NAME
> ======================================================================
> c4t2d1s2 ENABLED PRIMARY c4t2d1s2 T3 T31
> c4t2d0s2 ENABLED SECONDARY c4t2d0s2 T3 T31
>
> [root@aleph2 /root]# vxdmpadm getsubpaths dmpnodename=c4t2d1s2
> NAME STATE PATH-TYPE CTLR-NAME ENCLR-TYPE ENCLR-NAME
> ====================================================================
> c4t2d1s2 ENABLED PRIMARY c4 T3 T31
> c5t1d1s2 ENABLED SECONDARY c5 T3 T31
>
> [root@aleph2 /root]# vxdmpadm getdmpnode nodename=c4t2d1s2
> NAME STATE ENCLR-TYPE PATHS ENBL DSBL ENCLR-NAME
> =========================================================================
> c4t2d1s2 ENABLED T3 2 2 0 T31
>
>
>
> =================
> DMP Info T4 (Bad)
> =================
>
> [root@aleph2 adm]# vxdisk list t4dg01
> Device: c7t2d0s2
> devicetag: c7t2d0
> type: sliced
> hostid: aleph3
> disk: name=t4dg01 id=1096470211.1774.aleph3
> group: name=t4dg id=1096470388.1783.aleph3
> info: privoffset=1
> flags: online ready private autoconfig autoimport imported
> pubpaths: block=/dev/vx/dmp/c7t2d0s4 char=/dev/vx/rdmp/c7t2d0s4
> privpaths: block=/dev/vx/dmp/c7t2d0s3 char=/dev/vx/rdmp/c7t2d0s3
> version: 2.2
> iosize: min=512 (bytes) max=2048 (blocks)
> public: slice=4 offset=0 len=272609280
> private: slice=3 offset=1 len=5119
> update: time=1096470388 seqno=0.5
> headers: 0 248
> configs: count=1 len=3750
> logs: count=1 len=568
> Defined regions:
> config priv 000017-000247[000231]: copy=01 offset=000000 enabled
> config priv 000249-003767[003519]: copy=01 offset=000231 enabled
> log priv 003768-004335[000568]: copy=01 offset=000000 enabled
> Multipathing information:
> numpaths: 1
> c7t2d0s2 state=enabled
>
> [root@aleph2 adm]# vxdmpadm getdmpnode enclosure=T41
> NAME STATE ENCLR-TYPE PATHS ENBL DSBL ENCLR-NAME
> =========================================================================
> c7t2d3s2 ENABLED OTHER_DISKS 1 1 0 T41
> c7t2d2s2 ENABLED OTHER_DISKS 1 1 0 T41
> c7t2d1s2 ENABLED OTHER_DISKS 1 1 0 T41
> c7t2d0s2 ENABLED OTHER_DISKS 1 1 0 T41
> c8t1d3s2 ENABLED OTHER_DISKS 1 1 0 T41
> c8t1d2s2 ENABLED OTHER_DISKS 1 1 0 T41
> c8t1d1s2 ENABLED OTHER_DISKS 1 1 0 T41
> c8t1d0s2 ENABLED OTHER_DISKS 1 1 0 T41
>
> [root@aleph2 adm]# vxdmpadm getsubpaths ctlr=c3
> NAME STATE PATH-TYPE DMPNODENAME ENCLR-TYPE ENCLR-NAME
> ======================================================================
> c7t2d3s2 ENABLED - c7t2d3s2 OTHER_DISKS T41
> c7t2d2s2 ENABLED - c7t2d2s2 OTHER_DISKS T41
> c7t2d1s2 ENABLED - c7t2d1s2 OTHER_DISKS T41
> c7t2d0s2 ENABLED - c7t2d0s2 OTHER_DISKS T41
>
> [root@aleph2 adm]# vxdmpadm getsubpaths ctlr=c6
> NAME STATE PATH-TYPE DMPNODENAME ENCLR-TYPE ENCLR-NAME
> ======================================================================
> c8t1d3s2 ENABLED - c8t1d3s2 OTHER_DISKS T41
> c8t1d2s2 ENABLED - c8t1d2s2 OTHER_DISKS T41
> c8t1d1s2 ENABLED - c8t1d1s2 OTHER_DISKS T41
> c8t1d0s2 ENABLED - c8t1d0s2 OTHER_DISKS T41
>
> [root@aleph2 adm]# vxdmpadm getsubpaths dmpnodename=c7t2d3s2
> NAME STATE PATH-TYPE CTLR-NAME ENCLR-TYPE ENCLR-NAME
> ====================================================================
> c7t2d3s2 ENABLED - c3 OTHER_DISKS T41
>
> [root@aleph2 adm]# vxdmpadm getsubpaths dmpnodename=c8t1d3s2
> NAME STATE PATH-TYPE CTLR-NAME ENCLR-TYPE ENCLR-NAME
> ====================================================================
> c8t1d3s2 ENABLED - c6 OTHER_DISKS T41
Me again...
Revising the docs, I just stumbled over the following software
requirement for the 6120 RAID in the installation guide:
Supported Software:
...
VERITAS Volume Manager 3.5 with Dynamic Multipathing (DMP) support
...
I still use version 3.2 :-(
My questions now are the following (unfortunately I have little
experience with VxVM): Does it _have_ to be 3.5, or can/should I
directly go for version 4.0? Who can share experiences with the upgrade
procedures, described in the Veritas docs? Do I have to umount all
Veritas Volumes before upgrading? Any more gotchas?
Thanks
Paul
- Next message: Todd Sawyers: "Re: SVM - metattach question"
- Previous message: Scott Howard: "Re: Gigaswift card device name"
- In reply to: Paul Coray: "6120 (T4) with Solaris 8 and VxVM 3.2: DMP not working"
- Next in thread: Sami Ketola: "Re: 6120 (T4) with Solaris 8 and VxVM 3.2: DMP not working"
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
Relevant Pages
|
