Re: iSCSI disconnects dilema

Wilko Bulte wrote:
On Fri, Jan 12, 2007 at 09:31:04PM +0200, Danny Braniss wrote..
--s/l3CgOIzMHHjg/5
Content-Type: text/plain; charset=iso-8859-2
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

On Tue, Jan 09, 2007 at 09:06:46AM +0200, Danny Braniss wrote:
Hi,
While I think I have almost solved the problem of network disconnects,
It downed on me a major problem:
When a 'local' disk crashes, the kernel will probably hang/panic/crash.
if i don't try to recover, then there is no change in the above scenario.
if i try to recover, then the client does not know that it should
umount/fsck/mount.
While all this seems familiar, removing a floppy/disk-on-key while it's
mounted, we could always say "you shouldn't have done that!", with
a network connection, it can happen very often - rebooting the target, a
network hickup, etc.
=20
So, any ideas?
In my opinion it should be done this way:

You have a queue of I/O requests. You send the to the other end and wait
for confirmation. Until confirmation is received, you keep the requests
queued. If the other end dies, you try to reconnect (until some timeout
expires, the processes which send those requests will just wait), if you
reconnect successfully, you resend not-confirmed requests, if you won't
be able to reconnect, you just pass the errors up.

This is what I did in ggate and it seems to work.
That is basically what i'm doing - unacked request get requed.
the problem I fear (and maybe I'm paranoid :-):

Paranoia is a Good Thing(TM) in data storage land :-)

assume the following scenario, the client(initiator) sends a write command,
the target acks it, then it crashes, if the write was never completed,
the initiator goes on as nothing ever happened.

Yes, but what can the initiator do about that? I mean, it does not have any
visibility of what the target has (or has not) done with the data. '

This is roughly the same as a RAID box accepting a write into a writeback cache
and ACK-ing to the host. You can only assume that the RAID box' cache
will get flushed to the spindles properly. All the usual horror scenarios
with a broken battery backup of the cache and a powerfailure etc apply here.

Wilko


I forget, does iSCSI have a concept of a flush_cache command, or the
equivalent of what parallel SCSI does with ordered tags? If so, then
that's how your app or OS knows that the transaction got committed to
stable storage. It's been long assumed in the external storage world
that you are at the mercy of the external storage cache, so the problem
that Danny is referring to is nothing new. The real question is how
to implement the equivalent mechanism that iSCSI provides in a way that
the OS/app can make use of it. For example, CAM issues an ordered tag
periodically to flush the disk cache to stable storage. Most storage
drivers, including CAM, will issue some sort of a flush_cache command to
the controller and media during system shutdown.

Scott

_______________________________________________
freebsd-hackers@xxxxxxxxxxx mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@xxxxxxxxxxx"

Relevant Pages

  • Re: iSCSI disconnects dilema
    ... While I think I have almost solved the problem of network disconnects, ... Paranoia is a Good Thingin data storage land :-) ... the target acks it, then it crashes, if the write was never completed, ... This is roughly the same as a RAID box accepting a write into a writeback cache ...
    (freebsd-hackers)
  • Re: iSCSI disconnects dilema
    ... While I think I have almost solved the problem of network disconnects, ... When a 'local' disk crashes, ... You have a queue of I/O requests. ... This is roughly the same as a RAID box accepting a write into a writeback cache ...
    (freebsd-hackers)
  • Re: VMS SAN Primer
    ... (SAN - as in the interconnecting infrastructure). ... Area Network), corrolary to a VLAN. ... have different seperate nodes accesing drives in a SAN, ... CI-based storage array. ...
    (comp.os.vms)
  • Re: How Netlogon Service creates the WinlogonDomain Cache
    ... The GINA gets invoked long before the network is available. ... why msgina creates a cache in the registry of the available domains. ... 3.If i can delete this key from registry and then press Alt+Clt+Del ...
    (microsoft.public.platformsdk.security)
  • Re: Information store on WSS 2003
    ... communication with the storage, not with the network. ... Check for firmware and driver updates for storage solution. ... Check with your storage manufacturer to see if one or more settings ... Please do not send email directly to this alias. ...
    (microsoft.public.exchange.admin)