GPF - how do you map two different devices names to the same nsd device name from two different nodes



Write now I am trying to setup GPFS w/o any underlying clustering s/w
that is just a GPFS, 2 node cluster

In which both the nodes are directly attached to a FC disk on the SAN.



I was able to create the filesystem and mount it on one of the nodes
but when I try to mount

It on the other node it fails with the foll error



[root@gem/]mmmount /dev/two_node_gpfs

Thu Apr 26 06:01:31 PAKDT 2007: 6027-1623 mmmount: Mounting file
systems ...

GPFS: 6027-549 Failed to open two_node_gpfs.

The media is not formatted or the format is not correct.

GPFS: 6027-510 Cannot mount /dev/two_node_gpfs on /gpfs_two_node: The
media is n

ot formatted or the format is not correct.





I suspect the problem is with the NSD descriptor file that I am using.



The 2 nodes are gem(172.16.27.25, root, cv_gem) and
bull(172.16.27.174, root, cv_bulll)



[root@gem/]lsdev -C -c disk

hdisk0 Available 1S-08-00-8,0 16 Bit LVD SCSI Disk Drive

hdisk2 Available 1S-08-00-5,0 Other SCSI Disk Drive

hdisk3 Available 1H-08-02 Other FC SCSI Disk Drive





[root@bull/dev]lsdev -C -c disk

hdisk0 Available 04-08-00-5,0 16 Bit LVD SCSI Disk Drive

hdisk1 Available 04-08-00-8,0 16 Bit LVD SCSI Disk Drive

hdisk2 Available 00-08-02 Other FC SCSI Disk Drive



the shared disk is seen as /dev/hdisk3 on gem and /dev/hdisk2 on bull



here is what I did



1. [root@bull/dev]cat /home/sudha/nsd_desc_gpfs_two_node_cluster

hdisk2:::dataAndMetadata:::



2. [root@bull/dev]mmcrnsd -F /home/sudha/
nsd_desc_gpfs_two_node_cluster -v no

mmcrnsd: Processing disk hdisk2

mmcrnsd: 6027-1371 Propagating the cluster configuration data to all

affected nodes. This is an asynchronous process.







3. [root@bull/dev]cat /home/sudha/nsd_desc_gpfs_two_node_cluster

# hdisk2:::dataAndMetadata:::

gpfs7nsd:::dataAndMetadata:-1::





4. [root@bull/dev]mmlsnsd -m



Disk name NSD volume ID Device Node
name Remarks



--------------------------------------------------------------------------------

-------

gpfs7nsd AC101BAE462FE827 /dev/hdisk2
bull.gp.cv.commvault.com directl

y attached









5. [root@gem/]mmlsnsd -m



Disk name NSD volume ID Device Node
name Remarks



--------------------------------------------------------------------------------

-------

gpfs7nsd AC101BAE462FE827 -
gem.gp.cv.commvault.com (not fo

und) directly attached







6. [root@bull/dev]mmcrfs /gpfs_two_node /dev/two_node_gpfs -F /home/
sudha/nsd_desc

_gpfs_two_node_cluster



GPFS: 6027-531 The following disks of two_node_gpfs will be formatted
on node bull:

gpfs7nsd: size 52428800 KB

GPFS: 6027-540 Formatting file system ...

GPFS: 6027-535 Disks up to size 111 GB can be added to storage pool
system.

Creating Inode File

Creating Allocation Maps

Clearing Inode Allocation Map

Clearing Block Allocation Map

GPFS: 6027-572 Completed creation of file system /dev/two_node_gpfs.

mmcrfs: 6027-1371 Propagating the cluster configuration data to all

affected nodes. This is an asynchronous process.





7. [root@bull/dev]mmmount /dev/two_node_gpfs -a

Wed Apr 25 20:20:06 CDT 2007: 6027-1623 mmmount: Mounting file
systems ...

gem.gp.cv.commvault.com: GPFS: 6027-549 Failed to open two_node_gpfs.

gem.gp.cv.commvault.com: The media is not formatted or the format is
not correc

t.

gem.gp.cv.commvault.com: GPFS: 6027-510 Cannot mount /dev/
two_node_gpfs on /gpf

s_two_node: The media is not formatted or the format is not correct.

[root@bull/dev]mount

node mounted mounted over vfs date
options

-------- --------------- --------------- ------ ------------
---------------

/dev/hd4 / jfs2 Apr 23 10:18 rw,log=/
dev/hd8

/dev/hd2 /usr jfs2 Apr 23 10:18 rw,log=/
dev/hd8

/dev/hd9var /var jfs2 Apr 23 10:18 rw,log=/
dev/hd8

/dev/hd3 /tmp jfs2 Apr 23 10:18 rw,log=/
dev/hd8

/dev/fwdump /var/adm/ras/platform jfs2 Apr 23 10:19
rw,log=/dev/

hd8

/dev/hd1 /home jfs2 Apr 23 10:19 rw,log=/
dev/hd8

/proc /proc procfs Apr 23 10:19 rw

/dev/hd10opt /opt jfs2 Apr 23 10:19 rw,log=/
dev/hd8

/dev/lv00 /var/adm/csd jfs Apr 23 10:19 rw,log=/
dev/loglv

00

/dev/two_node_gpfs /gpfs_two_node mmfs Apr 25 20:20
rw,mtime,atime,

dev=two_node_gpfs











8.

[root@gem/]mmmount /dev/two_node_gpfs

Thu Apr 26 07:53:27 PAKDT 2007: 6027-1623 mmmount: Mounting file
systems ...

GPFS: 6027-549 Failed to open two_node_gpfs.

The media is not formatted or the format is not correct.

GPFS: 6027-510 Cannot mount /dev/two_node_gpfs on /gpfs_two_node: The
media is n

ot formatted or the format is not correct.

[root@gem/]





I suspect that this is only because the nsd status is not found.



So my question is how do you map two different devices names to the
same nsd device name from two different nodes



Thanks

Sudha

.



Relevant Pages

  • Re: GPF - how do you map two different devices names to the same nsd device name from two differ
    ... The media is not formatted or the format is not correct. ... bull.gp.cv.commvault.com directl ... GPFS: ...
    (comp.unix.aix)
  • Windows was unable to complete the format
    ... Originally I had a cluster with 2 poweredge dell servers running server ... The cluster is connnected to storage array EMC AEX-4 box. ... something went wrong in the process and now I can't format the volumes on ...
    (microsoft.public.dotnet.general)
  • Re: 2 large hard drive questions
    ... However, on the cluster issue, I was wondering what effect cluster size would have on these big ... I did install my OS on its own partition, about 40GB and then formated the rest of the ... smaller drives but I was thinking that in the same way the manufacturers use of 1000 instead of ... It will format it automatically. ...
    (microsoft.public.windowsxp.hardware)
  • Re: RAC Cluster Waits
    ... We are seeing what may be "excessive" cluster waits. ... Our ASH reports look fine. ... col "AVG RECVD TIME " format 9999999.9 ... WHERE b1.name = 'global cache current block receive time' ...
    (comp.databases.oracle.server)
  • Re: Problem Copying Files to a ZIP Drive
    ... The "size on disk" may be much more than that, depending on how the Zip ... ("cluster"), and the size of a cluster depends on the format. ...
    (microsoft.public.windowsxp.basics)