6120 (T4) with Solaris 8 and VxVM 3.2: DMP not working
From: Paul Coray (paul.coray_at_spamblock.unibas.ch)
Date: 09/30/04
- Next message: Tom: "Expired Accounts"
- Previous message: Christian Schmidt: "Re: Anyone else seeing this management trend favoring Linux?"
- Next in thread: Paul Coray: "Re: 6120 (T4) with Solaris 8 and VxVM 3.2: DMP not working"
- Reply: Paul Coray: "Re: 6120 (T4) with Solaris 8 and VxVM 3.2: DMP not working"
- Reply: Sami Ketola: "Re: 6120 (T4) with Solaris 8 and VxVM 3.2: DMP not working"
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
Date: Thu, 30 Sep 2004 12:00:58 +0200
Sunmanagers,
I have:
V880, Solaris 8 2/02 u7, Kernelpatch 117350-06 (August 2004)
Veritas VxVM 3.2 with latest patch (3.2t_p5.3:14-Jan-2004).
I got a new Partnergroup of StorEdge 6120 (T4) and a 2 Gb FC PCI Dual
Channel Network 2Gb Fibrechannel controller (SG-XPCI2FC-QF2 375-3108). I
installed the controller, SUNWsan, SUNWcfpl and SUNWcfplx, plus all
required patches stated in the FC Adapter Release Notes. So i have each
tray of my storage attached to one controller on the host, as usual.
I applied the latest firmware (3.1.2) to the 6120 RAID and cabled the
loop properly to PG configuration, enabled mp_support=rw and created two
volumes on each tray. These four volumes are visible through both FC
controllers in the output of format on my host:
17. c7t2d0 <SUN-T4-0301 cyl 53246 alt 2 hd 40 sec 128>
/pci@9,600000/SUNW,qlc@1/fp@0,0/ssd@w20030003ba4e7d80,0
18. c7t2d1 <SUN-T4-0301 cyl 43180 alt 2 hd 80 sec 128>
/pci@9,600000/SUNW,qlc@1/fp@0,0/ssd@w20030003ba4e7d80,1
19. c7t2d2 <SUN-T4-0301 cyl 61438 alt 2 hd 40 sec 128>
/pci@9,600000/SUNW,qlc@1/fp@0,0/ssd@w20030003ba4e7d80,2
20. c7t2d3 <SUN-T4-0301 cyl 39084 alt 2 hd 80 sec 128>
/pci@9,600000/SUNW,qlc@1/fp@0,0/ssd@w20030003ba4e7d80,3
21. c8t1d0 <SUN-T4-0301 cyl 53246 alt 2 hd 40 sec 128>
/pci@9,600000/SUNW,qlc@1,1/fp@0,0/ssd@w20030003ba4e8ac5,0
22. c8t1d1 <SUN-T4-0301 cyl 43180 alt 2 hd 80 sec 128>
/pci@9,600000/SUNW,qlc@1,1/fp@0,0/ssd@w20030003ba4e8ac5,1
23. c8t1d2 <SUN-T4-0301 cyl 61438 alt 2 hd 40 sec 128>
/pci@9,600000/SUNW,qlc@1,1/fp@0,0/ssd@w20030003ba4e8ac5,2
24. c8t1d3 <SUN-T4-0301 cyl 39084 alt 2 hd 80 sec 128>
/pci@9,600000/SUNW,qlc@1,1/fp@0,0/ssd@w20030003ba4e8ac5,3
So far, everything looks fine.
Then I configured all devices/volumes on c7t2dX as VxVM disks (see
below), in order to have DMP (dynamic multipathing) enabled (i.e
configuring c8t1dX as the alternate path). But I never got VxVM to talk
to these Volumes through both FC channels. vxdisk list on each of these
volumes says 'numpaths: 1'
On the same host I have an old T3A Partnergroup (Firmware 1.1803)
attached, with two Volumes managed also by VxVM, and multipathing was
enabled automatically, as soon as the param mp_support on the
RAID-Controller was set to rw. Below is a comparison of the DMP
pertinent information of VxVM, first for the correctly working T3A,
then for the failing dmp on the 6120(T4).
I have two observations:
- vxdisk list doesn't show the working alternate controller c5tXdX for
the T3A PG, but it does show the second path c8tXdX to the T4 volumes,
which doesn't work as alternate path.
- The enclosure type of T4 is only recognized as OTHER_DISKS in
vxdmpadm, whereas all T3s are recognized correctly as enclosure type T3.
Help is greatly appreciated, as I need to get this working ASAP!
TIA
Paul
==============================
VxVM Disk info
==============================
[root@aleph2 adm]# vxdisk list
DEVICE TYPE DISK GROUP STATUS
c1t0d0s2 sliced - - error
c1t1d0s2 sliced - - error
c1t2d0s2 sliced - - error
c1t3d0s2 sliced - - error
c1t4d0s2 sliced - - error
c1t5d0s2 sliced - - error
c1t8d0s2 sliced - - error
c1t9d0s2 sliced - - error
c1t10d0s2 sliced - - error
c1t11d0s2 sliced - - error
c1t12d0s2 sliced reserve1 rootdg online
c1t13d0s2 sliced reserve2 rootdg online
c2t1d0s2 sliced t3dg01 t3dg online
c4t2d0s2 sliced t300-1 t3pgdg online
c4t2d1s2 sliced t300-2 t3pgdg online
c7t2d0s2 sliced t4dg01 t4dg online
c7t2d1s2 sliced t4dg02 t4dg online
c7t2d2s2 sliced t4dg03 t4dg online
c7t2d3s2 sliced t4dg04 t4dg online
c8t1d0s2 sliced - - online
c8t1d1s2 sliced - - online
c8t1d2s2 sliced - - online
c8t1d3s2 sliced - - online
[root@aleph2 /root]# vxprint -Aht
[...]
Disk group: t3pgdg
DG NAME NCONFIG NLOG MINORS GROUP-ID
DM NAME DEVICE TYPE PRIVLEN PUBLEN STATE
RV NAME RLINK_CNT KSTATE STATE PRIMARY DATAVOLS SRL
RL NAME RVG KSTATE STATE REM_HOST REM_DG REM_RLNK
V NAME RVG KSTATE STATE LENGTH READPOL
PREFPLEX UTYPE
PL NAME VOLUME KSTATE STATE LENGTH LAYOUT
NCOL/WID MODE
SD NAME PLEX DISK DISKOFFS LENGTH [COL/]OFF DEVICE
MODE
SV NAME PLEX VOLNAME NVOLLAYR LENGTH [COL/]OFF AM/NM
MODE
DC NAME PARENTVOL LOGVOL
SP NAME SNAPVOL DCO
dg t3pgdg default default 0 992004501.1025.aleph2
dm t300-1 c4t2d0s2 sliced 7167 244737024 -
dm t300-2 c4t2d1s2 sliced 7167 244744192 -
v aleph - ENABLED ACTIVE 186009600 SELECT -
fsgen
pl aleph-01 aleph ENABLED ACTIVE 186009600 CONCAT -
RW
sd t300-2-04 aleph-01 t300-2 58734592 186009600 0 c4t2d1
ENA
v aleph1 - ENABLED ACTIVE 209715200 SELECT -
fsgen
pl aleph1-01 aleph1 ENABLED ACTIVE 209721344 CONCAT -
RW
sd t300-1-02 aleph1-01 t300-1 8393728 209721344 0 c4t2d0
ENA
v archive - ENABLED ACTIVE 41943040 SELECT -
fsgen
pl archive-01 archive ENABLED ACTIVE 41947136 CONCAT -
RW
sd t300-2-02 archive-01 t300-2 8393728 41947136 0 c4t2d1
ENA
v redo3 - ENABLED ACTIVE 3072000 SELECT -
fsgen
pl redo3-01 redo3 ENABLED ACTIVE 3075072 CONCAT -
RW
sd t300-2-03 redo3-01 t300-2 50340864 3075072 0 c4t2d1
ENA
v swap - ENABLED ACTIVE 8388608 SELECT -
fsgen
pl swap-01 swap ENABLED ACTIVE 8393728 CONCAT -
RW
sd t300-1-01 swap-01 t300-1 0 8393728 0 c4t2d0
ENA
v swap1 - ENABLED ACTIVE 8388608 SELECT -
fsgen
pl swap1-01 swap1 ENABLED ACTIVE 8393728 CONCAT -
RW
sd t300-2-01 swap1-01 t300-2 0 8393728 0 c4t2d1
ENA
v usr_local - ENABLED ACTIVE 20971520 SELECT -
fsgen
pl usr_local-01 usr_local ENABLED ACTIVE 20973568 CONCAT -
RW
sd t300-1-03 usr_local-01 t300-1 218115072 20973568 0 c4t2d0
ENA
Disk group: t4dg
DG NAME NCONFIG NLOG MINORS GROUP-ID
DM NAME DEVICE TYPE PRIVLEN PUBLEN STATE
RV NAME RLINK_CNT KSTATE STATE PRIMARY DATAVOLS SRL
RL NAME RVG KSTATE STATE REM_HOST REM_DG REM_RLNK
V NAME RVG KSTATE STATE LENGTH READPOL
PREFPLEX UTYPE
PL NAME VOLUME KSTATE STATE LENGTH LAYOUT
NCOL/WID MODE
SD NAME PLEX DISK DISKOFFS LENGTH [COL/]OFF DEVICE
MODE
SV NAME PLEX VOLNAME NVOLLAYR LENGTH [COL/]OFF AM/NM
MODE
DC NAME PARENTVOL LOGVOL
SP NAME SNAPVOL DCO
dg t4dg default default 124000 1096470388.1783.aleph3
dm t4dg01 c7t2d0s2 sliced 5119 272609280 -
dm t4dg02 c7t2d1s2 sliced 10239 442142720 -
dm t4dg03 c7t2d2s2 sliced 5119 314552320 -
dm t4dg04 c7t2d3s2 sliced 10239 400199680 -
v aleph1 - ENABLED ACTIVE 272609280 SELECT -
fsgen
pl aleph1-01 aleph1 ENABLED ACTIVE 272609280 CONCAT -
RW
sd t4dg01-01 aleph1-01 t4dg01 0 272609280 0 c7t2d0
ENA
v exlibris - ENABLED ACTIVE 400199680 SELECT -
fsgen
pl exlibris-01 exlibris ENABLED ACTIVE 400199680 CONCAT -
RW
sd t4dg04-01 exlibris-01 t4dg04 0 400199680 0 c7t2d3
ENA
v exlibris1 - ENABLED ACTIVE 314552320 SELECT -
fsgen
pl exlibris1-01 exlibris1 ENABLED ACTIVE 314552320 CONCAT -
RW
sd t4dg03-01 exlibris1-01 t4dg03 0 314552320 0 c7t2d2
ENA
v reserve - ENABLED ACTIVE 442142720 SELECT -
fsgen
pl reserve-01 reserve ENABLED ACTIVE 442142720 CONCAT -
RW
sd t4dg02-01 reserve-01 t4dg02 0 442142720 0 c7t2d1
ENA
=====================
DMP Info T3 PG (Good)
=====================
[root@aleph2 /]# vxdisk list t300-1
Device: c4t2d0s2
devicetag: c4t2d0
type: sliced
hostid: aleph3
disk: name=t300-1 id=1095429937.1621.aleph3
group: name=t3pgdg id=992004501.1025.aleph2
flags: online ready private autoconfig autoimport imported
pubpaths: block=/dev/vx/dmp/c4t2d0s4 char=/dev/vx/rdmp/c4t2d0s4
privpaths: block=/dev/vx/dmp/c4t2d0s3 char=/dev/vx/rdmp/c4t2d0s3
version: 2.2
iosize: min=512 (bytes) max=2048 (blocks)
public: slice=4 offset=0 len=244737024
private: slice=3 offset=1 len=7167
update: time=1096428634 seqno=0.13
headers: 0 248
configs: count=1 len=5268
logs: count=1 len=798
Defined regions:
config priv 000017-000247[000231]: copy=01 offset=000000 enabled
config priv 000249-005285[005037]: copy=01 offset=000231 enabled
log priv 005286-006083[000798]: copy=01 offset=000000 enabled
Multipathing information:
numpaths: 2
c4t2d0s2 state=enabled type=secondary
c5t1d0s2 state=enabled type=primary
[root@aleph2 /root]# vxdmpadm listctlr all
CTLR-NAME ENCLR-TYPE STATE ENCLR-NAME
=====================================================
c1 Disk ENABLED Disk
c2 T3 ENABLED T30
c4 T3 ENABLED T31
c5 T3 ENABLED T31
c3 OTHER_DISKS ENABLED T41
c6 OTHER_DISKS ENABLED T41
[root@aleph2 /root]# vxdmpadm getdmpnode enclosure=T31
NAME STATE ENCLR-TYPE PATHS ENBL DSBL ENCLR-NAME
=========================================================================
c4t2d1s2 ENABLED T3 2 2 0 T31
c4t2d0s2 ENABLED T3 2 2 0 T31
[root@aleph2 /root]# vxdmpadm getsubpaths ctlr=c4
NAME STATE PATH-TYPE DMPNODENAME ENCLR-TYPE ENCLR-NAME
======================================================================
c4t2d1s2 ENABLED PRIMARY c4t2d1s2 T3 T31
c4t2d0s2 ENABLED SECONDARY c4t2d0s2 T3 T31
[root@aleph2 /root]# vxdmpadm getsubpaths dmpnodename=c4t2d1s2
NAME STATE PATH-TYPE CTLR-NAME ENCLR-TYPE ENCLR-NAME
====================================================================
c4t2d1s2 ENABLED PRIMARY c4 T3 T31
c5t1d1s2 ENABLED SECONDARY c5 T3 T31
[root@aleph2 /root]# vxdmpadm getdmpnode nodename=c4t2d1s2
NAME STATE ENCLR-TYPE PATHS ENBL DSBL ENCLR-NAME
=========================================================================
c4t2d1s2 ENABLED T3 2 2 0 T31
=================
DMP Info T4 (Bad)
=================
[root@aleph2 adm]# vxdisk list t4dg01
Device: c7t2d0s2
devicetag: c7t2d0
type: sliced
hostid: aleph3
disk: name=t4dg01 id=1096470211.1774.aleph3
group: name=t4dg id=1096470388.1783.aleph3
info: privoffset=1
flags: online ready private autoconfig autoimport imported
pubpaths: block=/dev/vx/dmp/c7t2d0s4 char=/dev/vx/rdmp/c7t2d0s4
privpaths: block=/dev/vx/dmp/c7t2d0s3 char=/dev/vx/rdmp/c7t2d0s3
version: 2.2
iosize: min=512 (bytes) max=2048 (blocks)
public: slice=4 offset=0 len=272609280
private: slice=3 offset=1 len=5119
update: time=1096470388 seqno=0.5
headers: 0 248
configs: count=1 len=3750
logs: count=1 len=568
Defined regions:
config priv 000017-000247[000231]: copy=01 offset=000000 enabled
config priv 000249-003767[003519]: copy=01 offset=000231 enabled
log priv 003768-004335[000568]: copy=01 offset=000000 enabled
Multipathing information:
numpaths: 1
c7t2d0s2 state=enabled
[root@aleph2 adm]# vxdmpadm getdmpnode enclosure=T41
NAME STATE ENCLR-TYPE PATHS ENBL DSBL ENCLR-NAME
=========================================================================
c7t2d3s2 ENABLED OTHER_DISKS 1 1 0 T41
c7t2d2s2 ENABLED OTHER_DISKS 1 1 0 T41
c7t2d1s2 ENABLED OTHER_DISKS 1 1 0 T41
c7t2d0s2 ENABLED OTHER_DISKS 1 1 0 T41
c8t1d3s2 ENABLED OTHER_DISKS 1 1 0 T41
c8t1d2s2 ENABLED OTHER_DISKS 1 1 0 T41
c8t1d1s2 ENABLED OTHER_DISKS 1 1 0 T41
c8t1d0s2 ENABLED OTHER_DISKS 1 1 0 T41
[root@aleph2 adm]# vxdmpadm getsubpaths ctlr=c3
NAME STATE PATH-TYPE DMPNODENAME ENCLR-TYPE ENCLR-NAME
======================================================================
c7t2d3s2 ENABLED - c7t2d3s2 OTHER_DISKS T41
c7t2d2s2 ENABLED - c7t2d2s2 OTHER_DISKS T41
c7t2d1s2 ENABLED - c7t2d1s2 OTHER_DISKS T41
c7t2d0s2 ENABLED - c7t2d0s2 OTHER_DISKS T41
[root@aleph2 adm]# vxdmpadm getsubpaths ctlr=c6
NAME STATE PATH-TYPE DMPNODENAME ENCLR-TYPE ENCLR-NAME
======================================================================
c8t1d3s2 ENABLED - c8t1d3s2 OTHER_DISKS T41
c8t1d2s2 ENABLED - c8t1d2s2 OTHER_DISKS T41
c8t1d1s2 ENABLED - c8t1d1s2 OTHER_DISKS T41
c8t1d0s2 ENABLED - c8t1d0s2 OTHER_DISKS T41
[root@aleph2 adm]# vxdmpadm getsubpaths dmpnodename=c7t2d3s2
NAME STATE PATH-TYPE CTLR-NAME ENCLR-TYPE ENCLR-NAME
====================================================================
c7t2d3s2 ENABLED - c3 OTHER_DISKS T41
[root@aleph2 adm]# vxdmpadm getsubpaths dmpnodename=c8t1d3s2
NAME STATE PATH-TYPE CTLR-NAME ENCLR-TYPE ENCLR-NAME
====================================================================
c8t1d3s2 ENABLED - c6 OTHER_DISKS T41
- Next message: Tom: "Expired Accounts"
- Previous message: Christian Schmidt: "Re: Anyone else seeing this management trend favoring Linux?"
- Next in thread: Paul Coray: "Re: 6120 (T4) with Solaris 8 and VxVM 3.2: DMP not working"
- Reply: Paul Coray: "Re: 6120 (T4) with Solaris 8 and VxVM 3.2: DMP not working"
- Reply: Sami Ketola: "Re: 6120 (T4) with Solaris 8 and VxVM 3.2: DMP not working"
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
Relevant Pages
|
