SUMMARY: Solaris as FC SAN client and multipathing

• Previous message: Ben De Mora: "Solaris 10 x86 problem"
• In reply to: Tony Howat: "Solaris as FC SAN client"
• Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

Date: Thu, 29 Jul 2004 10:48:44 +0100
To: sunmanagers@sunmanagers.org, a.mcclements@arts.ac.uk

Tony Howat wrote:

> Q: How I get going with mounting a SAN partition using Sun Fiber card on
> Solaris 8 running on a 280R?
>
> I need to be able to create and mount a newly created SAN partition on
> an existing IBM FAST600 FC SAN system.
>
> We have an SG-XPCI2FC-QF2 2Gb PCI Dual FC Network Adapter, as
> recommended by our suppliers for the purpose. My brain keeps telling me
> we need the HBA version, but both Sun and our suppliers say this is
> correct.
>
> Now, documentation is minimal to non existent. The manual for the card
> covers installation and playing around with boot net. I started to think
> I needed a HBA as I'd suspected in the first place, but looking at that
> manual it's equally useless. Sun confirm the part should connect to the
> SAN and allow me to mount partitions.
>
> Could someone point me at documentation which covers actually
> configuring the card, any software installation, and using a SAN
> partition under Solaris?
>
> So far I have got this far, working from the Sun StorEdge 2G FC PCI
> Double Channel Network Adapter Network Installation Guide (816-5001-10):
>
> show-devs
> /pci@8,600000/SUNW,qlc@4
> /pci@8,600000/SUNW,qlc@4/fp@0,0
> /pci@8,600000/SUNW,qlc@4/fp@0,0/disk
> /pci@8,700000/SUNW,qlc@2,1
> /pci@8,700000/SUNW,qlc@2
>
> To me that looks like two cards - one being the on board controller on
> the 280R and one being the add in card I'm trying to configure.
>
> I've tried Qlogic's drivers but they don't detect the card:
> http://www.sun.com/products-n-solutions/hardware/docs/pdf/816-5002-14.pdf
>
> Anyone got notes on this sort of thing?
>
> Any pointers welcome, I'm working utterly blind on this.
>

Thanks to Mark Wiederspahn, Mike Ekholm and Kevin Smith for their help.

The procedure is this (MW):

To start with, from this page is (http://www.sun.com/storage/san/)
is a link to the sun drivers:
http://javashoplm.sun.com/ECom/docs/Welcome.jsp?StoreId=8&PartDetailId=StoreEdgeSw-4.0-G-F&TransactionId=Try

Download the "Install_it Script SAN 4.4.1, English" under optional
products, and install that software.

The sun drivers kind of suck because they require 10 packages
and 15 patches to be applied in a specific order. The install_it script
will install those packages/patches in that order.

Once the products are installed, reboot and run cfgadm -al and see if
you see your disk.

#cfgadm -al
Ap_Id Type Receptacle Occupant
Condition
c0 scsi-bus connected configured
unknown
c0::dsk/c0t6d0 CD-ROM connected configured
unknown
c1 fc-private connected configured
unknown
c1::21000004cf6efe8d disk connected configured
unknown
c1::21000004cf6f1b1f disk connected configured
unknown
c2 scsi-bus connected configured
unknown
c2::rmt/0 tape connected configured
unknown
c3 fc-fabric connected configured
unknown
c3::200800a0b813180d disk connected configured
unknown
c3::210000e08b1014ba unknown connected unconfigured
unknown
c3::210000e08b102c41 unknown connected unconfigured
unknown
c3::210000e08b1071ba unknown connected unconfigured
unknown
c3::210000e08b10a241 unknown connected unconfigured
unknown
c3::210000e08b10e33c unknown connected unconfigured
unknown
c3::500308c13e646003 tape connected unconfigured
unknown
c4 fc connected unconfigured
unknown
usb0/1 unknown empty unconfigured ok
usb0/2 unknown empty unconfigured ok
usb0/3 unknown empty unconfigured ok
usb0/4 unknown empty unconfigured ok

(apologies for wrapping. the FC SAN stuff is on c3)

If cfgadm sees your adapter/disk, run cfgadm -c (fiber_ctrl) to pickup
the disk.

(TH) Also add to /kernel/drv/sd.conf

#
# added for SAN
#
name="sd" class="scsi"
   target=0 lun=1;
name="sd" class="scsi"
   target=0 lun=2;
name="sd" class="scsi"
   target=0 lun=3;
name="sd" class="scsi"
   target=0 lun=4;
name="sd" class="scsi"
   target=0 lun=5;
name="sd" class="scsi"
   target=0 lun=7;
name="sd" class="scsi"
   target=0 lun=8;
name="sd" class="scsi"
   target=0 lun=9;

to scan the LUNs designated to SAN space.

boot -r

format will show :

AVAILABLE DISK SELECTIONS:
        0. c1t0d0 <SUN36G cyl 24620 alt 2 hd 27 sec 107>
           /pci@8,600000/SUNW,qlc@4/fp@0,0/ssd@w21000004cf6f1b1f,0
        1. c1t1d0 <SUN36G cyl 24620 alt 2 hd 27 sec 107>
           /pci@8,600000/SUNW,qlc@4/fp@0,0/ssd@w21000004cf6efe8d,0
        2. c3t200800A0B813180Dd3
           <IBM-1722-600-0520 cyl 51198 alt 2 hd 64 sec 64>
           /pci@8,700000/SUNW,qlc@2/fp@0,0/ssd@w200800a0b813180d,3

So, we're off.

Now, in terms of sorting out multipathing I asked a second question to
the list, about how to get multipathing working. The software I needed
(Sun Traffic Manager) is already within the SAN package I installed
earlier, so it is a matter of configuration.

Thanks to Jochen who replied :

1. check with array vendor (IBM) if configuration is ok for STMS (or
MPxIO, other name)
2. you need to edit /kernel/drv/scsi_vhci.conf, mpxio
is disabled by default. also you need to edit vendor/product there. look
at the comments and watch the spaces, they need to be exactly as shown
there.
Use format and inq-command to find out vendor/product.
3. you will also want to add to /etc/system:

set fp:fp_offline_ticker=15
set fp:fp_retry_count=2

with the default setting of these variables path failover takes 2
minutes, now its 45 seconds.
4. boot -r
Your devices should show in format on new controller
number with path
/scsi_vhci/ssd@g012301230123...

Richard Voss also suggested setting auto-failback="enable" in
/kernel/drv/scsi_vhci.conf

After following these steps the SAN device now appears in format as :

AVAILABLE DISK SELECTIONS:
        0. c1t0d0 <SUN36G cyl 24620 alt 2 hd 27 sec 107>
           /pci@8,600000/SUNW,qlc@4/fp@0,0/ssd@w21000004cf6f1b1f,0
        1. c1t1d0 <SUN36G cyl 24620 alt 2 hd 27 sec 107>
           /pci@8,600000/SUNW,qlc@4/fp@0,0/ssd@w21000004cf6efe8d,0
        2. c5t600A0B80001323B80000000040F2051Dd0
           <IBM-1722-600-0520 cyl 51198 alt 2 hd 64 sec 64>
           /scsi_vhci/ssd@g600a0b80001323b80000000040f2051d

...and should multipath.

-- 
Tony Howat
UNIX Network Administrator
University Of The Arts London
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers

• Previous message: Ben De Mora: "Solaris 10 x86 problem"
• In reply to: Tony Howat: "Solaris as FC SAN client"
• Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]