Member crash after increasing max_aliasid (num

From: Andrew Martin (andrew.martin_at_cameo-consultants.com)
Date: 08/11/03

  • Next message: Renato Fabene: "How can I user the comand HISTORY"
    Date: Mon, 11 Aug 2003 18:06:52 +0000
    To: tru64-unix-managers@ornl.gov
    
    

    Hello Folks,

    We have a two node TruCluster V5.1A configuration. the max_aliasid setting is 8
    on both members. We have 8 cluster aliases defined, and try and add one more, and get
    the message "no more aliases available".

    We then decide to increase the number of cluster aliases to 32. We do this as
    follows on both cluster members (its a dynamic kernel param that can be changed
    in the running kernel):

    # sysconfig -r clua max_aliasid=32

    Both systems accept it without any complaints.

    We then try and add the alias:

    # cluamgr -a ........

    Then the other cluster member crashes (not the one we issued the cluamgr -a cmd
    on).

    Looking at the crash-data file, I see that it was running clua code
    (update_member_info in clua_kch.c).

    Any idea why this happened (systems have patch kit 3 installed).

    Crash data file:

    #
    # Crash Data Collection (Version 1.4)
    #
    _crash_data_collection_time: Mon Aug 11 13:26:32 BST 2003
    _current_directory: /
    _crash_kernel: /var/adm/crash/vmunix.5
    _crash_core: /var/adm/crash/vmzcore.5
    _crash_arch: alpha
    _crash_os: Compaq Tru64 UNIX
    _host_version: TruCluster Server V5.1A (Rev. 1312); 08/24/02 10:08
    V5.1A (Rev. 1885)
    Compaq Tru64 UNIX V5.1A (Rev. 1885); Sun May 4 21:14:12 BST 2003
    _crash_version: TruCluster Server V5.1A (Rev. 1312); 08/24/02 10:08
    V5.1A (Rev. 1885)
    Compaq Tru64 UNIX V5.1A (Rev. 1885); Sun May 4 21:14:12 BST 2003

    thread 0xfffffc03ffebce00 stopped at [stop_secondary_cpu:1339 ,0xfffffc0000c83730] Source not available

    warning: Files compiled -g3: parameter values probably wrong
    _crashtime: struct {
        tv_sec = 1060604505
        tv_usec = 610728
    }
    _boottime: struct {
        tv_sec = 1058911284
        tv_usec = 871493
    }
    _config: struct {
        sysname = "OSF1"
        nodename = "unat.cpp.co.uk"
        release = "V5.1"
        version = "1885"
        machine = "alpha"
    }
    _cpu: 60
    _system_string: 0xffffffffffdc7030 = "Compaq AlphaServer ES45 Model 2"
    _ncpus: 3
    _avail_cpus: 3
    _partial_dump: 1
    _physmem(MBytes): 16383
    _panic_string: 0xfffffc000109dbd0 = "clua"
    _paniccpu: 2
    _panic_thread: 0xfffffc03ffebce00
    _preserved_message_buffer_begin:
    struct {
        hdr = struct {
            msg_magic = 0x880524
            msg_bufx = 0x24f8
            msg_bufr = 0x249e
            msg_size = 0x3fe0
        }
        msg_bufc = "Alpha boot: available memory from 0x13d00000 to 0x3fffee000
    Compaq Tru64 UNIX V5.1A (Rev. 1885); Sun May 4 21:14:12 BST 2003
    physical memory = 16384.00 megabytes.
    available memory = 16066.92 megabytes.
    using 62819 buffers containing 490.77 megabytes of memory
    Master cpu at slot 0
    Starting secondary cpu 1
    Starting secondary cpu 2
    Firmware revision: 6.1-3
    PALcode: UNIX version 1.88-28
    Compaq AlphaServer ES45 Model 2
    pci0 (primary bus:0) at nexus
    isa0 at pci0
    gpc0 at isa0
    gpc1 not probed
    ace0 at isa0
    ace1 at isa0
    lp0 at isa0
    fdi0 at isa0
    fd0 at fdi0 unit 0
    mchan0: Module revision = 36
    mchan0: jumpered as HUB configuration
    mchan0 at pci0 slot 8
    mchan1: Module revision = 35
    mchan1: jumpered as HUB configuration
    mchan1 at pci0 slot 9
    isp0 at pci0 slot 10
    isp0: QLOGIC ISP1040B/V2 - Differential Mode
    isp0: Firmware revision 5.57 (loaded by console)
    isp0: Fast RAM timing enabled.
    scsi0 at isp0 slot 0 rad 0
    isp1 at pci0 slot 11
    isp1: QLOGIC ISP1040B/V2 - Differential Mode
    isp1: Firmware revision 5.57 (loaded by console)
    isp1: Fast RAM timing enabled.
    scsi1 at isp1 slot 0 rad 0
    ata0 at pci0 slot 16
    ata0: ACER M1543C
    scsi2 at ata0 slot 0 rad 0
    scsi3 at ata0 slot 1 rad 0
    pci1 (primary bus:1) at nexus
    emx0 at pci1 slot 1
    FCA-2354 : Driver Rev 2.05 : F/W Rev 3.81A4(1.01A0) : wwn 1000-0000-c931-8267
    emx0: emx_linkup_timedout: link up timeout has expired
    scsi4 at emx0 slot 0 rad 0
    emx2 at pci1 slot 2
    FCA-2354 : Driver Rev 2.05 : F/W Rev 3.81A4(1.01A0) : wwn 1000-0000-c931-843f
    emx2: emx_linkup_timedout: link up timeout has expired
    scsi5 at emx2 slot 0 rad 0
    pci2 (primary bus:2) at nexus
    itpsa0 at pci2 slot 1
    IntraServer ROM Version V2.0 (c)1998
    scsi6 at itpsa0 slot 0 rad 0
    itpsa1 at pci2 slot 2
    IntraServer ROM Version V2.0 (c)1998
    scsi7 at itpsa1 slot 0 rad 0
    pci3 (primary bus:3) at nexus
    pci4 (primary bus:3 subordinate bus:2) at pci3 slot 1
    ee0 at pci4 slot 4
    ee0: COMPAQ Intel 82559 (10/100 Mbps) Ethernet Interface
    ee0: Driver Rev = V1.0.18, Chip Rev = 8, hardware address: 00-02-A5-AD-FC-B8
    ee1 at pci4 slot 5
    ee1: COMPAQ Intel 82559 (10/100 Mbps) Ethernet Interface
    ee1: Driver Rev = V1.0.18, Chip Rev = 8, hardware address: 00-02-A5-AD-FC-B9
    pci5 (primary bus:3 subordinate bus:3) at pci3 slot 2
    ee2 at pci5 slot 4
    ee2: COMPAQ Intel 82559 (10/100 Mbps) Ethernet Interface
    ee2: Driver Rev = V1.0.18, Chip Rev = 8, hardware address: 00-02-A5-AD-F1-94
    ee3 at pci5 slot 5
    ee3: COMPAQ Intel 82559 (10/100 Mbps) Ethernet Interface
    ee3: Driver Rev = V1.0.18, Chip Rev = 8, hardware address: 00-02-A5-AD-F1-95
    Created FRU table binary error log packet
    kernel console: ace0
    dli: configured
    NetRAIN configured.
    ATM Subsystem configured with 3 restart threads
    ATMUNI: configured
    ATMSIG: 3.x (module=uni3x) configured
    ILMI: 3.x (module=ilmi) configured
    ATM IP: configured
    ATM LANE: configured.
    ATM IFMP: configured
    TruCluster Server V5.1A (Rev. 1312); 08/24/02 10:08
    TNC kproc_creator_daemon: Initialized and Ready
    clubase: configured
    Configuring RDG to use Memory Channel
    ics_hl: Configuring memory channel as transport.
    icsnet: configured
    drd configured 0
    kch: configured
    dlm: configured
    Starting CFS daemons
    Registering CFS Services
    Initializing CFSREC ICS Service
    Registering CFSMSFS remote syscall interface
    Registering CMS Services
    ee1: Autonegotiated, 100 Mbps full duplex
    ee3: Autonegotiated, 100 Mbps full duplex
    rm primary: mchan0, hubslot = 4, phys_rail 0 (size 128 MB)
    rm primary: log_rail 0 (size 128 MB), phys_rail 0 (mchan0)
    rm primary: mchan1, hubslot = 4, phys_rail 1 (size 128 MB)
    ics_mct: icsinfo set for node 2
    ics_mct: Declaring this node up 2
    CNX MGR: insufficient votes to form cluster: have 1 need 2
    CNX QDISK: Adding 1 quorum disk vote toward formation.
    CNX MGR: Cluster delphi incarnation 0xb9595 has been formed
    CNX MGR: Founding node id is 2 csid is 0x10001
    CNX MGR: membership configuration index: 1 (1 additions, 0 removals)
    CNX MGR: Node unat 2 incarn 0xb9595 csid 0x10001 has been added to the cluster
    dlm: resuming lock activity
    kch: resuming activity
    CNX QDISK: Successfully claimed quorum disk, adding 1 vote.
    CNX MGR: quorum (re)gained, (re)starting cluster operations.
    Joining versw kch set.
    clsm: checking for peer configurations
    clsm: initialized
    Waiting for cluster mount to complete
    scsi7: SCSI Bus was reset
    cam_logger: SCSI event packet
    cam_logger: bus 7 target 255 lun 255
    itpsa SCSI HBA
    SCSI Bus was reset

    scsi7: SCSI Bus was reset
    cam_logger: SCSI event packet
    cam_logger: bus 7 target 255 lun 255
    itpsa SCSI HBA
    SCSI Bus was reset

    vm_swap_init: swap is set to lazy (over commitment) mode
    CMS: Joining deferred filesystem sets
    <3>drd_evm_hw_connections_increased: device 574 not found
    <3>drd_evm_hw_connections_increased: device 574 not found
    <3>drd_evm_hw_connections_increased: device 575 not found
    <3>drd_evm_hw_connections_increased: device 575 not found
    cluster alias subsystem enabled
    Environmental Monitoring Subsystem Configured.
    Recovering filesystem mounted at / to this node (member id 2)
    Recovery to this node (member id 2) complete for filesystem mounted at /
    Recovering filesystem mounted at /var to this node (member id 2)
    Recovery to this node (member id 2) complete for filesystem mounted at /var
    Recovering filesystem mounted at /backup to this node (member id 2)
    Recovery to this node (member id 2) complete for filesystem mounted at /backup
    Recovering filesystem mounted at /u01 to this node (member id 2)
    Recovery to this node (member id 2) complete for filesystem mounted at /u01
    Recovering filesystem mounted at /home to this node (member id 2)
    Recovery to this node (member id 2) complete for filesystem mounted at /home
    Recovering filesystem mounted at /backup to this node (member id 2)
    Recovery to this node (member id 2) complete for filesystem mounted at /backup
    Recovering filesystem mounted at /u01 to this node (member id 2)
    Recovery to this node (member id 2) complete for filesystem mounted at /u01
    Recovering filesystem mounted at /home to this node (member id 2)
    Recovery to this node (member id 2) complete for filesystem mounted at /home
    Recovering filesystem mounted at /oraexp to this node (member id 2)
    Recovery to this node (member id 2) complete for filesystem mounted at /oraexp
    Recovering filesystem mounted at /oraarc to this node (member id 2)
    Recovery to this node (member id 2) complete for filesystem mounted at /oraarc
    Recovering filesystem mounted at /backup to this node (member id 2)
    Recovery to this node (member id 2) complete for filesystem mounted at /backup
    Recovering filesystem mounted at /u01 to this node (member id 2)
    Recovery to this node (member id 2) complete for filesystem mounted at /u01
    Recovering filesystem mounted at /home to this node (member id 2)
    Recovery to this node (member id 2) complete for filesystem mounted at /home
    Recovering filesystem mounted at /ukmi to this node (member id 2)
    Recovery to this node (member id 2) complete for filesystem mounted at /ukmi
    MEMORY CHANNEL API - initializing
    MEMORY CHANNEL API - node 6 has joined the cluster
    ics_mct: icsinfo set for node 1
    CNX MGR: Join operation complete
    CNX MGR: membership configuration index: 2 (2 additions, 0 removals)
    ics_mct: Declaring this node up 1
    CNX MGR: Node unas 1 incarn 0x195eb csid 0x10002 has been added to the cluster
    dlm: suspending lock activity
    kch: suspending activity
    dlm: resuming lock activity
    kch: resuming activity
    clsm: sent CNX partition data
    <3>arp: local IP address 172.20.49.7 in use by hardware address 02-08-02-B0-10-DF
    <3>arp: local IP address 172.20.49.11 in use by hardware address 02-08-02-B0-10-DF
    <3>arp: local IP address 172.20.49.63 in use by hardware address 02-08-02-B0-10-DF
    <3>arp: local IP address 172.20.49.64 in use by hardware address 02-08-02-B0-10-DF
    <3>arp: local IP address 172.20.49.6 in use by hardware address 02-08-02-B0-10-DF
    <3>arp: local IP address 172.20.49.23 in use by hardware address 02-08-02-B0-10-DF
    <3>arp: local IP address 172.20.49.7 in use by hardware address 02-08-02-B0-10-DF
    <3>arp: local IP address 172.20.49.11 in use by hardware address 02-08-02-B0-10-DF
    <3>arp: local IP address 172.20.49.63 in use by hardware address 02-08-02-B0-10-DF
    <3>arp: local IP address 1"
    }
    _preserved_message_buffer_end:
    _kernel_process_status_begin:
      PID COMM
    1048576 kernel idle
    1048577 init
    1048578 kproc_creator_da
    1048579 icssvr_nomem_dae
    1048580 icssvr_throttle_
    1048581 icssvr_daemon_fr
    1048582 icssvr_daemon_fr
    1048583 icssvr_nanny
    1048584 icscli_throttle_
    1048590 CFS daemon
    1048591 icssvr_daemon_pe
    1048592 icssvr_daemon_pe
    1048593 icssvr_daemon_pe
    1048595 kloadsrv
    1048597 hotswapd
    1048663 update
    1048779 evmd
    1048824 evmlogger
    1048825 evmchmgr
    1114396 oracle
    1114403 oracle
    1114410 oracle
    1114421 oracle
    1114425 oracle
    1114428 oracle
    1114433 oracle
    1114437 oracle
    1114438 oracle
    1048988 niffd
    1049026 syslogd
    1049030 binlogd
    1049142 aliasd
    1049144 aliasd_niff
    1049152 portmap
    1049154 icssvr_daemon_pe
    1049157 caad
    1049183 gated
    1049185 mountd
    1049187 nfsd
    1049198 rpc.statd
    1049200 rpc.lockd
    1049204 nfsiod
    1049207 rpc.statd
    1049209 rpc.lockd
    1049219 auditd
    1049281 sendmail
    1049283 xntpd
    1049318 snmpd
    1049331 svrMgt_mib
    1049332 svrSystem_mib
    1049333 clu_mibs
    1049338 os_mibs
    1049339 pmgrd
    1049348 cpq_mibs
    1049374 cpqthresh_mib
    1049386 insightd
    1049407 java
    1049446 envmond
    1049452 config_hmmod
    1049453 rcmgr
    1049474 sysman_hmmod
    1049484 inetd
    1049485 inetd
    1049496 cron
    1049505 httpd
    1049511 httpd
    1049512 httpd
    1049521 httpd
    1049529 httpd
    1049531 httpd
    1049532 httpd
    1049533 httpd
    1049534 httpd
    1049546 lpd
    1049575 dtlogin
    1049643 java
    1050305 clu_wall
    1050308 rdginit
    1050492 smsd
    1050497 getty
    1054716 rlogind
    1054721 bash
    1054842 httpd
    1054983 imc_mapper
    1055634 icssvr_daemon_pe
    1055635 icssvr_daemon_pe
    1055644 icssvr_daemon_pe
    1055645 icssvr_daemon_pe
    1055651 icssvr_daemon_fr
    1055698 icssvr_daemon_pe
    1055707 icssvr_daemon_pe
    1056336 httpd
    1195169 icssvr_daemon_fr
    1195192 icssvr_daemon_fr
    1195201 icssvr_daemon_fr
    1195639 icssvr_daemon_fr
    1199065 oracle
    1201339 icssvr_daemon_fr
    1201392 icssvr_daemon_fr
    1201481 oracle
    1201497 ksh
    1201517 rlogind
    1201645 oracle
    1202682 rlogind
    1202790 bash
    1203157 telnetd
    1203923 ksh
    1204522 bash
    1205057 oracle
    1205069 oracle
    1205140 oracle
    1205152 oracle
    1205157 oracle
    1205161 oracle
    1205163 oracle
    1205165 oracle
    1205168 oracle
    1205179 oracle
    1205187 oracle
    1074333 bash
    1206170 ksh
    1206264 oracle
    1207179 oracle
    1207193 imp
    1208632 icssvr_daemon_fr
    1208678 icssvr_daemon_fr
    1208682 icssvr_daemon_fr
    1208705 icssvr_daemon_fr
    1211934 icssvr_daemon_fr
    1084743 oracle
    1084745 oracle
    1084747 oracle
    1084749 oracle
    1084751 oracle
    1084753 oracle
    1084755 oracle
    1084757 oracle
    1084759 oracle
    1084780 oracle
    1084782 oracle
    1084784 oracle
    1084786 oracle
    1084797 oracle
    1084799 oracle
    1084801 oracle
    1084803 oracle
    1084805 oracle
    1084826 oracle
    1084828 oracle
    1084830 oracle
    1084832 oracle
    1084842 oracle
    1084844 oracle
    1084846 oracle
    1084848 oracle
    1084850 oracle
    1084875 oracle
    1084877 oracle
    1084879 oracle
    1084881 oracle
    1084883 oracle
    1084885 oracle
    1084887 oracle
    1084889 oracle
    1084891 oracle
    1084921 oracle
    1084923 oracle
    1084925 oracle
    1084927 oracle
    1084929 oracle
    1084931 oracle
    1084933 oracle
    1084935 oracle
    1084937 oracle
    1084976 oracle
    1084978 oracle
    1084980 oracle
    1084982 oracle
    1084984 oracle
    1084986 oracle
    1084988 oracle
    1084990 oracle
    1084992 oracle
    1084994 oracle
    1084996 oracle
    1085101 tnslsnr
    1085113 tnslsnr
    1350515 oracle
    1484108 oracle
    1484297 oracle
    1484367 oracle
    1484498 oracle
    1484509 oracle
    1484515 oracle
    1484517 oracle
    1484522 oracle
    1484525 oracle
    1484528 oracle
    1484530 oracle
    1485603 advfsd
    1098690 icssvr_daemon_fr
    1167375 icssvr_daemon_fr
    1167390 icssvr_daemon_fr
    1177286 collect
    1113131 icssvr_daemon_fr
    _kernel_process_status_end:
    _current_pid: 1048576
    _current_tid: 0xfffffc03ffebce00
    _proc_thread_list_begin:
    thread 0xfffffc03ffebce00 stopped at [stop_secondary_cpu:1339 ,0xfffffc0000c83730] Source not available
    thread 0xfffffc03ffebdc00 stopped at [boot:2672 ,0xfffffc0000c89ab4] Source not available
    thread 0xfffffc03ffebd880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db06e000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db06ea80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db06e700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db06e380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db06f500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db06f180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db06ee00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db06fc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db06f880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a0000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a0a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a0700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a0380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a1500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a1180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a0e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a1c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a1880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a4000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a4a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a4700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a4380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a5500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a5180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a4e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a5c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a5880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a8000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a8a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a8700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a8380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a9500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a9180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a8e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a9c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a9880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0aa000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0ab500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0ab180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0aae00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0abc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0ab880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dae1a000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dae1aa80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dae1a700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dae1a380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dae1b180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb02000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb02700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb03500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffebca80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dae1b500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd420000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dac36000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0aaa80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dae1bc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dae1b880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dac36a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dac36700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dac36380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dab8f180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dab8fc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dac36e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03daba5180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dac37880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03daba8a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dabab500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dabaa700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dabab180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dabac000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dabab880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dabaca80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03da420380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03da421180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03da420e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03da421c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03daba8700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc0259dd6380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc0358f20700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc009ac2ee00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03daba4e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dabac700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dabaa000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dabad500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03daba5880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f81ce000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f81ce700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f81ce380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f81cfc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f81cf880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f7d9a000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f7d9aa80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f7d9a700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f7d9a380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f7d9b500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f7d9b180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f7d9ae00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f7d9bc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f7d9b880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f9b04000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f9b04a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f81cf180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f9b05c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dab8e700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc02cd559500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc0259dd7880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc0259dd6700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f8d48380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc0164bc5180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc014450a380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01bbd25c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc02224afc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc02224af180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc00ebe26a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01bbd24e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01bbd24380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc00e6548700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc00e6548380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc0287bc8700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe10a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe10700 stopped at [boot:2919 ,0xfffffc0000c8a0a0] Source not available
    thread 0xfffffc03ffe10380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe11500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe11180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe10e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe11c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe11880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe40000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe40a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe40700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe40380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe41500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe41180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe40e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe41c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe41880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda0a000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda0aa80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda0a700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda0a380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda0b500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda0b180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda0ae00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda0bc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda0b880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd420a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd420700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd420380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd421500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd420e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd421c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd3c6000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd3c6a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd3c6700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd3c6380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd3c7500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd3c6e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd3c7c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd3c7880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda32000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda32a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda32700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda32380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda33500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda33180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda32e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda33c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda33880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dc428000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dc428a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dc428700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dc428380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dc429500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dc429180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dc428e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dc429c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dc429880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe5c000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe5ca80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe5c700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe5c380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe5d500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe5d180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe5ce00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe5dc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe5d880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbaf4000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbaf4a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb2a700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb2a380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb2b500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb2b180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb2ae00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb2bc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb2b880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb40000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb40a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb40700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb40380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb41500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb41180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb40e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb41c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb4c000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb4ca80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb4c700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb4c380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb4d500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb4d180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb4ce00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb4dc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb4d880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe76a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe76700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe76380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe8b500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe8b180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe8ae00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe99c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe99880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffea1500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffea1180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffea0e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffeab500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffeab180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffeaae00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffebc000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffebd500 stopped at [stop_secondary_cpu:1339 ,0xfffffc0000c83730] Source not available
    thread 0xfffffc03ffebd180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    _proc_thread_list_end:
    _dump_begin:
    > 0 stop_secondary_cpu(do_lwc = (unallocated - symbol optimized away)) ["../../../../src/kernel/arch/alpha/cpu.c":1339, 0xfffffc0000c83730]
    rpb_ptr = 0xfffffc000128ab20
    rpb_cpu = 0x2

       1 panic(s = (unallocated - symbol optimized away)) ["../../../../src/kernel/bsd/subr_prf.c":1296, 0xfffffc00008a1ee4]
    i = 300
    mycpu = 2
    saved_spl = 7
    pcpu = 0xfffffc0013d08200
    sync_mode = 0

       2 event_timeout(func = (unallocated - symbol optimized away), arg = (unallocated - symbol optimized away), timeout = (unallocated - symbol optimized away)) ["../../../../src/kernel/arch/alpha/cpu.c":2227, 0xfffffc0000c84d4c]
    prevcc = 12265159068166659042
    nextcc = 1
    timer = 0
    limit = 5000000
    usec = 0
    cycles = 0
    delta = 12265159068166659042
    ev6trouble = 300
    mhz = (unallocated - symbol optimized away)
    cpu_clock_rate_mhz = 1000
    processor = 0x4c4b40

       3 printf(fmt = (unallocated - symbol optimized away)) ["../../../../src/kernel/bsd/subr_prf.c":981, 0xfffffc00008a11e8]
    valist = struct {
        _a0 = 0x1
        _offset = 8
    }
    n = (unallocated - symbol optimized away)
    s = 7
    ps = 14
    cpu = 2
    buf = {
        [0] 'p'
        [1] 'a'
        [2] 'n'
        [3] 'i'
        [4] 'c'
        [5] ' '
        [6] '('
        [7] 'c'
        [8] 'p'
        [9] 'u'
        [10] ' '
        [11] '2'
        [12] ')'
        [13] ':'
        [14] ' '
        [15] 'c'
        [16] 'l'
        [17] 'u'
        [18] 'a'
        [19] '\n'
        [20] '^@'
        [21] '^@'
        [22] '^@'
        [23] '^@'
        [24] '^F'
        [25] '^@'
        [26] '^@'
        [27] '^@'
        [28] '^@'
        [29] '^@'
        [30] '^@'
        [31] '^@'
        [32] '^B'
        [33] '^@'
        [34] '^@'
        [35] '^@'
        [36] '^@'
        [37] '^@'
        [38] '^@'
        [39] '^@'
        [40] '^A'
        [41] '^@'
        [42] '^@'
        [43] '^@'
        [44] '^@'
        [45] '^@'
        [46] '^@'
        [47] '^@'
        [48] '^@'
        [49] '^:'
        [50] 'Z'
        [51] 'J'
        [52] '^@'
        [53] '\374'
        [54] '\377'
        [55] '\377'
        [56] '8'
        [57] '^Ô'
        [58] '^6'
        [59] '^@'
        [60] '^@'
        [61] '\374'
        [62] '\377'
        [63] '\377'
        [64] '\t'
        [65] '^@'
        [66] '^@'
        [67] '^@'
        [68] '^A'
        [69] '^@'
        [70] '^@'
        [71] '^@'
        [72] '^@'
        [73] '^@'
        [74] '^@'
        [75] '^@'
        [76] '^@'
        [77] '^@'
        [78] '^@'
        [79] '^@'
        [80] ' '
        [81] '^@'
        [82] '^@'
        [83] '^@'
        [84] '^@'
        [85] '^@'
        [86] '^@'
        [87] '^@'
        [88] '^@'
        [89] '^@'
        [90] '^@'
        [91] '^@'
        [92] '^@'
        [93] '\300'
        [94] 's'
        [95] '^@'
        [96] '^@'
        [97] '^@'
        [98] '^@'
        [99] '^@'
        [100] ' '
        [101] '^@'
        [102] '^@'
        [103] '^@'
        [104] '^A'
        [105] '^@'
        [106] '^@'
        [107] '^@'
        [108] '^@'
        [109] '^@'
        [110] '^@'
        [111] '^@'
        [112] '^@'
        [113] '^@'
        [114] '^@'
        [115] '^@'
        [116] '^@'
        [117] '^@'
        [118] '^@'
        [119] '^@'
        [120] '^@'
        [121] '^@'
        [122] '^@'
        [123] '^@'
        [124] '^@'
        [125] '^@'
        [126] '^@'
        [127] '^@'
    }

       4 panic(s = (unallocated - symbol optimized away)) ["../../../../src/kernel/bsd/subr_prf.c":1353, 0xfffffc00008a2054]
    i = 1
    mycpu = 2
    saved_spl = 0
    pcpu = 0x1
    sync_mode = 0

       5 update_member_info(sethandle = (unallocated - symbol optimized away), proposal = (unallocated - symbol optimized away)) ["../../../../src/kernel/clua/clua_kch.c":1372, 0xfffffc0000f69440]
    cadef = (nil)
    memid = 908767176
    mem = 0xfffffe0a0fb7f6e8
    memset = 0x1
    msg = 0xfffffc0298e36ca0
    st = (unallocated - symbol optimized away)

       6 clua_kch_callback(sethandle = (unallocated - symbol optimized away), proposal = (unallocated - symbol optimized away), status = (unallocated - symbol optimized away), set_state = (unallocated - symbol optimized away), nrejections = (unallocated - symbol optimized away), rejections = (unallocated - symbol optimized away)) ["../../../../src/kernel/clua/clua_kch.c":1199, 0xfffffc0000f691d0]
    msg = 0x2000000000
    vote = (unallocated - symbol optimized away)
    st = (unallocated - symbol optimized away)
    i = 908767176
    failed_node_count = (unallocated - symbol optimized away)
    failed_node_id = {
        [0] 1
        [1] 0
        [2] 0
        [3] 0
        [4] 0
        [5] 0
        [6] 1
        [7] 0
        [8] -1854682624
        [9] -1022
        [10] 15824340
        [11] -1024
        [12] -751390112
        [13] -1024
        [14] 0
        [15] 0
        [16] 1
        [17] 155
        [18] -751390112
        [19] -1024
        [20] -751390072
        [21] -1024
        [22] 908767080
        [23] -1022
        [24] 18942328
        [25] -1024
        [26] 9252308
        [27] -1024
        [28] 22832368
        [29] -1024
        [30] 15780896
        [31] -1024
        [32] 0
        [33] 0
        [34] 22832600
        [35] -1024
        [36] 19482464
        [37] -1024
        [38] 908766976
        [39] -1022
        [40] 65538
        [41] 0
        [42] 263715024
        [43] -502
        [44] 263715024
        [45] -502
        [46] 22832368
        [47] -1024
        [48] 0
        [49] 0
        [50] 22832376
        [51] -1024
        [52] 19456448
        [53] -1024
        [54] 15780900
        [55] -1024
        [56] 908766976
        [57] -1022
        [58] 908767080
        [59] -1022
        [60] 18928832
        [61] -1024
        [62] 15763448
        [63] -1024
    }
    actual_node_count = 23279352

       7 kch_local_callbacks(set = (unallocated - symbol optimized away)) ["../../../../src/kernel/kch/kch_workq.c":1538, 0xfffffc0000f088e4]
    p_msg = 0x2

       8 do_phase2_work(set = (unallocated - symbol optimized away)) ["../../../../src/kernel/kch/kch_workq.c":1665, 0xfffffc0000f08470]
    func = (unallocated - symbol optimized away)

       9 do_non_initiator_work(set = (unallocated - symbol optimized away)) ["../../../../src/kernel/kch/kch_workq.c":978, 0xfffffc0000f07898]
    func = (unallocated - symbol optimized away)
    rmt_initiators_node = 0xfffffc00799defc0
    initiators_csid = 9

      10 do_kch_work() ["../../../../src/kernel/kch/kch_workq.c":538, 0xfffffc0000f06e84]
    func = (unallocated - symbol optimized away)
    p = (unallocated - symbol optimized away)
    set = 0xfffffc02362aaf00

    _dump_end:
    _kernel_thread_list_begin:
    thread 0xfffffc03ffebce00 stopped at [stop_secondary_cpu:1339 ,0xfffffc0000c83730] Source not available
    thread 0xfffffc03ffebdc00 stopped at [boot:2672 ,0xfffffc0000c89ab4] Source not available
    thread 0xfffffc03ffebd880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db06e000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db06ea80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db06e700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db06e380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db06f500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db06f180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db06ee00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db06fc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db06f880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a0000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a0a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a0700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a0380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a1500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a1180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a0e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a1c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a1880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a4000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a4a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a4700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a4380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a5500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a5180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a4e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a5c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a5880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a8000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a8a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a8700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a8380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a9500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a9180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a8e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a9c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0a9880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0aa000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0ab500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0ab180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0aae00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0abc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0ab880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dae1a000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dae1aa80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dae1a700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dae1a380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dae1b180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb02000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb02700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb03500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffebca80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dae1b500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd420000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dac36000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03db0aaa80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dae1bc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dae1b880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dac36a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dac36700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dac36380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dab8f180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dab8fc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dac36e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03daba5180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dac37880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03daba8a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dabab500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dabaa700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dabab180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dabac000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dabab880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dabaca80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03da420380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03da421180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03da420e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03da421c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03daba8700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc0259dd6380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc0358f20700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc009ac2ee00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03daba4e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dabac700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dabaa000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dabad500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03daba5880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f81ce000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f81ce700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f81ce380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f81cfc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f81cf880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f7d9a000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f7d9aa80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f7d9a700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f7d9a380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f7d9b500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f7d9b180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f7d9ae00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f7d9bc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f7d9b880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f9b04000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f9b04a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f81cf180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f9b05c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dab8e700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc02cd559500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc0259dd7880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc0259dd6700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01f8d48380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc0164bc5180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc014450a380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01bbd25c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc02224afc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc02224af180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc00ebe26a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01bbd24e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc01bbd24380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc00e6548700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc00e6548380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc0287bc8700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe10a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe10700 stopped at [boot:2919 ,0xfffffc0000c8a0a0] Source not available
    thread 0xfffffc03ffe10380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe11500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe11180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe10e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe11c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe11880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe40000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe40a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe40700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe40380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe41500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe41180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe40e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe41c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe41880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda0a000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda0aa80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda0a700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda0a380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda0b500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda0b180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda0ae00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda0bc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda0b880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd420a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd420700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd420380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd421500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd420e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd421c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd3c6000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd3c6a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd3c6700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd3c6380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd3c7500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd3c6e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd3c7c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dd3c7880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda32000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda32a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda32700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda32380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda33500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda33180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda32e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda33c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dda33880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dc428000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dc428a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dc428700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dc428380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dc429500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dc429180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dc428e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dc429c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dc429880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe5c000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe5ca80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe5c700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe5c380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe5d500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe5d180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe5ce00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe5dc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe5d880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbaf4000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbaf4a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb2a700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb2a380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb2b500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb2b180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb2ae00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb2bc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb2b880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb40000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb40a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb40700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb40380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb41500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb41180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb40e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb41c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb4c000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb4ca80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb4c700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb4c380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb4d500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb4d180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb4ce00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb4dc00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03dbb4d880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe76a80 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe76700 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe76380 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe8b500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe8b180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe8ae00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe99c00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffe99880 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffea1500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffea1180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffea0e00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffeab500 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffeab180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffeaae00 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffebc000 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    thread 0xfffffc03ffebd500 stopped at [stop_secondary_cpu:1339 ,0xfffffc0000c83730] Source not available
    thread 0xfffffc03ffebd180 stopped at [thread_block:3223 ,0xfffffc00008ea4cc] Source not available
    _kernel_thread_list_end:
    _savedefp: (nil)
    _kernel_memory_fault_data_begin:
    struct {
        fault_va = 0x0
        fault_pc = 0x0
        fault_ra = 0x0
        fault_sp = 0x0
        access = 0x0
        status = 0x0
        cpunum = 0x0
        count = 0x0
        pcb = (nil)
        thread = (nil)
        task = (nil)
        proc = (nil)
    }
    _kernel_memory_fault_data_end:
    _uptime: 470.33 hours

    thread 0xfffffc03ffebce00 stopped at [stop_secondary_cpu:1339 ,0xfffffc0000c83730] Source not available

    warning: Files compiled -g3: parameter values probably wrong
    paniccpu: 0x2
    machine_slot[paniccpu]: struct {
        is_cpu = 0x1
        cpu_type = 0xf
        cpu_subtype = 0x26
        running = 0x1
        cpu_ticks = {
            [0] 0x0
            [1] 0x0
            [2] 0x0
            [3] 0x0
            [4] 0x0
        }
        clock_freq = 0x400
        error_restart = 0x0
        cpu_panicstr = 0xfffffc000109dbd0 = "clua"
        cpu_panic_thread = 0xfffffc03ffebce00
    }
    tset machine_slot[paniccpu].cpu_panic_thread:
    Begin Trace for machine_slot[paniccpu].cpu_panic_thread:
    thread 0xfffffc03ffebce00 stopped at [stop_secondary_cpu:1339 ,0xfffffc0000c83730] Source not available
    > 0 stop_secondary_cpu(do_lwc = (unallocated - symbol optimized away)) ["../../../../src/kernel/arch/alpha/cpu.c":1339, 0xfffffc0000c83730]
       1 panic(s = (unallocated - symbol optimized away)) ["../../../../src/kernel/bsd/subr_prf.c":1296, 0xfffffc00008a1ee4]
       2 event_timeout(func = (unallocated - symbol optimized away), arg = (unallocated - symbol optimized away), timeout = (unallocated - symbol optimized away)) ["../../../../src/kernel/arch/alpha/cpu.c":2227, 0xfffffc0000c84d4c]
       3 printf(fmt = (unallocated - symbol optimized away)) ["../../../../src/kernel/bsd/subr_prf.c":981, 0xfffffc00008a11e8]
       4 panic(s = (unallocated - symbol optimized away)) ["../../../../src/kernel/bsd/subr_prf.c":1353, 0xfffffc00008a2054]
       5 update_member_info(sethandle = (unallocated - symbol optimized away), proposal = (unallocated - symbol optimized away)) ["../../../../src/kernel/clua/clua_kch.c":1372, 0xfffffc0000f69440]
       6 clua_kch_callback(sethandle = (unallocated - symbol optimized away), proposal = (unallocated - symbol optimized away), status = (unallocated - symbol optimized away), set_state = (unallocated - symbol optimized away), nrejections = (unallocated - symbol optimized away), rejections = (unallocated - symbol optimized away)) ["../../../../src/kernel/clua/clua_kch.c":1199, 0xfffffc0000f691d0]
       7 kch_local_callbacks(set = (unallocated - symbol optimized away)) ["../../../../src/kernel/kch/kch_workq.c":1538, 0xfffffc0000f088e4]
       8 do_phase2_work(set = (unallocated - symbol optimized away)) ["../../../../src/kernel/kch/kch_workq.c":1665, 0xfffffc0000f08470]
       9 do_non_initiator_work(set = (unallocated - symbol optimized away)) ["../../../../src/kernel/kch/kch_workq.c":978, 0xfffffc0000f07898]
      10 do_kch_work() ["../../../../src/kernel/kch/kch_workq.c":538, 0xfffffc0000f06e84]
    End Trace for machine_slot[paniccpu].cpu_panic_thread:

    thread 0xfffffc03ffebce00 stopped at [stop_secondary_cpu:1339 ,0xfffffc0000c83730] Source not available

    warning: Files compiled -g3: parameter values probably wrong
    thread 0xfffffc03ffebdc00 stopped at [boot:2672 ,0xfffffc0000c89ab4] Source not available
    _stack_trace[0]_begin:
    > 0 boot(reason = (unallocated - symbol optimized away), howto = (unallocated - symbol optimized away)) ["../../../../src/kernel/arch/alpha/machdep.c":2672, 0xfffffc0000c89ab4]
       1 panic(s = (unallocated - symbol optimized away)) ["../../../../src/kernel/bsd/subr_prf.c":1401, 0xfffffc00008a2110]
       2 xcpu_panic_ipir() ["../../../../src/kernel/bsd/subr_prf.c":1596, 0xfffffc00008a266c]
       3 cpu_ip_intr() ["../../../../src/kernel/arch/alpha/cpu.c":1570, 0xfffffc0000c83c70]
       4 _XentInt(0x4, 0xfffffc0000c72650, 0xfffffc00010cab20, 0x0, 0x8ebf1a) ["../../../../src/kernel/arch/alpha/locore.s":1611, 0xfffffc0000c70ebc]
       5 lsb(0x4, 0xfffffc0000c72650, 0xfffffc00010cab20, 0x0, 0x8ebf1a) ["../../../../src/kernel/arch/alpha/locore.s":3585, 0xfffffc0000c72650]
       6 get_thread_high(myprocessor = (unallocated - symbol optimized away), pri = (unallocated - symbol optimized away)) ["../../../../src/kernel/kern/sched_prim.c":2921, 0xfffffc00008e9d88]
       7 thread_block() ["../../../../src/kernel/kern/sched_prim.c":3029, 0xfffffc00008ea05c]
       8 sleep_prim(chan = 0x3e, pri = (unallocated - symbol optimized away), wmesg = (unallocated - symbol optimized away), timo = (unallocated - symbol optimized away), lockp = (unallocated - symbol optimized away), flags = (unallocated - symbol optimized away)) ["../../../../src/kernel/kern/sched_prim.c":5475, 0xfffffc00008edc90]
       9 mpsleep(chan = (unallocated - symbol optimized away), pri = 9355034, wmesg = (unallocated - symbol optimized away), timo = 0, lockp = (unallocated - symbol optimized away), flags = 1537) ["../../../../src/kernel/kern/sched_prim.c":5381, 0xfffffc00008ed9e8]
      10 do_kch_work() ["../../../../src/kernel/kch/kch_workq.c":434, 0xfffffc0000f06b90]
    _stack_trace[0]_end:

    thread 0xfffffc03ffebce00 stopped at [stop_secondary_cpu:1339 ,0xfffffc0000c83730] Source not available

    warning: Files compiled -g3: parameter values probably wrong
    thread 0xfffffc03ffebd500 stopped at [stop_secondary_cpu:1339 ,0xfffffc0000c83730] Source not available
    _stack_trace[1]_begin:
    > 0 stop_secondary_cpu(do_lwc = (unallocated - symbol optimized away)) ["../../../../src/kernel/arch/alpha/cpu.c":1339, 0xfffffc0000c83730]
       1 panic(s = (unallocated - symbol optimized away)) ["../../../../src/kernel/bsd/subr_prf.c":1367, 0xfffffc00008a2094]
       2 xcpu_panic_ipir() ["../../../../src/kernel/bsd/subr_prf.c":1596, 0xfffffc00008a266c]
       3 cpu_ip_intr() ["../../../../src/kernel/arch/alpha/cpu.c":1570, 0xfffffc0000c83c70]
       4 _XentInt(0x4, 0xfffffc00008e8ed4, 0xfffffc00010cab20, 0xfffffe0402118be0, 0x8e8ea6) ["../../../../src/kernel/arch/alpha/locore.s":1611, 0xfffffc0000c70ebc]
       5 assert_wait_mesg(event = (unallocated - symbol optimized away), interruptible = (unallocated - symbol optimized away), mesg = (unallocated - symbol optimized away)) ["../../../../src/kernel/kern/sched_prim.c":2250, 0xfffffc00008e8ed4]
       6 sleep_prim(chan = 0xfffffc03ffebdd00, pri = (unallocated - symbol optimized away), wmesg = (unallocated - symbol optimized away), timo = (unallocated - symbol optimized away), lockp = (unallocated - symbol optimized away), flags = (unallocated - symbol optimized away)) ["../../../../src/kernel/kern/sched_prim.c":5411, 0xfffffc00008edac4]
       7 mpsleep(chan = (unallocated - symbol optimized away), pri = 9342630, wmesg = (unallocated - symbol optimized away), timo = 0, lockp = (unallocated - symbol optimized away), flags = 1537) ["../../../../src/kernel/kern/sched_prim.c":5381, 0xfffffc00008ed9e8]
       8 do_kch_work() ["../../../../src/kernel/kch/kch_workq.c":434, 0xfffffc0000f06b90]
    _stack_trace[1]_end:

    thread 0xfffffc03ffebce00 stopped at [stop_secondary_cpu:1339 ,0xfffffc0000c83730] Source not available

    warning: Files compiled -g3: parameter values probably wrong
    thread 0xfffffc03ffebce00 stopped at [stop_secondary_cpu:1339 ,0xfffffc0000c83730] Source not available
    _stack_trace[2]_begin:
    > 0 stop_secondary_cpu(do_lwc = (unallocated - symbol optimized away)) ["../../../../src/kernel/arch/alpha/cpu.c":1339, 0xfffffc0000c83730]
       1 panic(s = (unallocated - symbol optimized away)) ["../../../../src/kernel/bsd/subr_prf.c":1296, 0xfffffc00008a1ee4]
       2 event_timeout(func = (unallocated - symbol optimized away), arg = (unallocated - symbol optimized away), timeout = (unallocated - symbol optimized away)) ["../../../../src/kernel/arch/alpha/cpu.c":2227, 0xfffffc0000c84d4c]
       3 printf(fmt = (unallocated - symbol optimized away)) ["../../../../src/kernel/bsd/subr_prf.c":981, 0xfffffc00008a11e8]
       4 panic(s = (unallocated - symbol optimized away)) ["../../../../src/kernel/bsd/subr_prf.c":1353, 0xfffffc00008a2054]
       5 update_member_info(sethandle = (unallocated - symbol optimized away), proposal = (unallocated - symbol optimized away)) ["../../../../src/kernel/clua/clua_kch.c":1372, 0xfffffc0000f69440]
       6 clua_kch_callback(sethandle = (unallocated - symbol optimized away), proposal = (unallocated - symbol optimized away), status = (unallocated - symbol optimized away), set_state = (unallocated - symbol optimized away), nrejections = (unallocated - symbol optimized away), rejections = (unallocated - symbol optimized away)) ["../../../../src/kernel/clua/clua_kch.c":1199, 0xfffffc0000f691d0]
       7 kch_local_callbacks(set = (unallocated - symbol optimized away)) ["../../../../src/kernel/kch/kch_workq.c":1538, 0xfffffc0000f088e4]
       8 do_phase2_work(set = (unallocated - symbol optimized away)) ["../../../../src/kernel/kch/kch_workq.c":1665, 0xfffffc0000f08470]
       9 do_non_initiator_work(set = (unallocated - symbol optimized away)) ["../../../../src/kernel/kch/kch_workq.c":978, 0xfffffc0000f07898]
      10 do_kch_work() ["../../../../src/kernel/kch/kch_workq.c":538, 0xfffffc0000f06e84]
    _stack_trace[2]_end:

    thread 0xfffffc03ffebce00 stopped at [stop_secondary_cpu:1339 ,0xfffffc0000c83730] Source not available
    warning: Files compiled -g3: parameter values probably wrong
    _kdbx_sum_start:
    Hostname : unat.cpp.co.uk
    cpu: Compaq AlphaServer ES45 Model 2 avail: 3
    Boot-time: Tue Jul 22 23:01:24 2003
    Time: Mon Aug 11 13:21:45 2003
    Kernel : OSF1 release V5.1 version 1885 (alpha)
    _kdbx_sum_end:
    _kdbx_swap_start:

           Swap device name Size In Use Free
    -------------------------------- ---------- ---------- ----------
    /dev/disk/dsk2b 8388608k 8k 8388600k
                                        1048576p 1p 1048575p
    -------------------------------- ---------- ---------- ----------
    Total swap partitions: 1 8388608k 8k 8388600k
                                        1048576p 1p 1048575p
    _kdbx_swap_end:
    _kdbx_proc_start:
    Addr PID PPID PGRP UID NICE SIGCATCH P_SIG Event Flags
    =========== ===== ===== ===== ===== ==== ======== ======== =========== ============
    k0xffe00cc0 1048576 0 0 0 0 00000000 00000000 NULL in sys
    k0xdac30240 1048577 1048576 1048577 0 0 307a62ff 00000000 NULL in contign pagv
    k0xdd443740 1048578 1048576 0 0 0 00000000 00000000 NULL in nochildwait
    k0xffe64240 1048579 1048578 0 0 0 00000000 00000000 NULL in
    k0xffe65740 1048580 1048578 0 0 0 00000000 00000000 NULL in
    k0xffe64cc0 1048581 1048578 0 0 0 00000000 00000000 NULL in sys
    k0xffe7a240 1048582 1048578 0 0 0 00000000 00000000 NULL in sys
    k0xffe7b740 1048583 1048578 0 0 0 00000000 00000000 NULL in
    k0xffe7acc0 1048584 1048578 0 0 0 00000000 00000000 NULL in
    k0xdb072240 1048590 1048578 0 0 0 00000000 00000000 NULL in
    k0xdb073740 1048591 1048578 0 0 0 00000000 00000000 NULL in sys
    k0xdb072cc0 1048592 1048578 0 0 0 00000000 00000000 NULL in sys
    k0xdae78240 1048593 1048578 0 0 0 00000000 00000000 NULL in sys
    k0xdd442cc0 1048595 1048577 1048595 0 0 00000001 00000000 NULL in pagv
    k0xdb04acc0 1048597 1048577 1048597 0 0 00001ef8 00000000 NULL in pagv
    k0xd6aad740 1048663 1048577 1048663 0 0 00002000 00000000 NULL in pagv
    k0x5bc41740 1048779 1048577 1048779 0 0 fffffffffffaf047 00000000 NULL in pagv
    k0x5bc40cc0 1048824 1048779 1048779 0 0 00083001 00000000 NULL in pagv
    k0xd6aaccc0 1048825 1048779 1048779 0 0 00003001 00000000 NULL in pagv
    k0xdb112cc0 1114396 1048577 1114396 1007 0 41802ebc 00000000 NULL in pagv
    k0xd6aac240 1114403 1048577 1114403 1007 0 41802ebc 00000000 NULL in pagv
    k0xcde68cc0 1114410 1048577 1114410 1007 0 41802ebc 00000000 NULL in pagv
    k0xd38ce240 1114421 1048577 1114421 1007 0 41802ebc 00000000 NULL in pagv
    k0x2c058240 1114425 1048577 1114425 1007 0 41802ebc 00000000 NULL in pagv
    k0x9d884240 1114428 1048577 1114428 1007 0 41802ebc 00000000 NULL in pagv
    k0x6e12d740 1114433 1048577 1114433 1007 0 41802ebc 00000000 NULL in pagv
    k0x9bce2240 1114437 1048577 1114437 1007 0 41802ebc 00000000 NULL in pagv
    k0x82901740 1114438 1048577 1114438 1007 0 41802ebc 00000000 NULL in pagv
    k0x5bc40240 1048988 1048577 1048988 0 0 00003000 00000000 NULL in pagv
    k0xd6d89740 1049026 1048577 1049026 0 0 70087001 00000000 NULL in pagv
    k0x593e3740 1049030 1048577 1049030 0 0 20007001 00000000 NULL in pagv
    k0x64600240 1049142 1048577 1049142 0 0 00405406 00000000 NULL in pagv
    k0xd6d88240 1049144 1049142 1049142 0 0 00001000 00000000 NULL in pagv
    k0xdb112240 1049152 1048577 1049152 0 0 00480628 00000000 NULL in pagv
    k0x64601740 1049154 1048578 0 0 0 00000000 00000000 NULL in sys
    k0x64600cc0 1049157 1048577 0 0 0 00000000 00000000 NULL in contign pagv
    k0x9b1becc0 1049183 1048577 1049183 0 0 60084003 00000000 NULL in pagv
    k0xa82ed740 1049185 1048577 1049185 0 0 66006001 00000000 NULL in pagv
    k0xf844d740 1049187 1048577 1049187 0 0 00000000 00000000 NULL in pagv
    k0xf844ccc0 1049198 1048577 1049198 0 0 66082000 00000000 NULL in pagv
    k0xf87d9740 1049200 1048577 1049200 0 0 66002000 00000000 NULL in pagv
    k0xa82ec240 1049204 1048577 1049204 0 0 00000000 00000000 NULL in pagv
    k0x593e2240 1049207 1048577 1049207 0 0 66082000 00000000 NULL in pagv
    k0x5997a240 1049209 1048577 1049209 0 0 66002000 00000000 NULL in pagv
    k0x5997b740 1049219 1048577 0 0 -5 00004001 00000000 NULL in contign pagv
    k0x2bd85740 1049281 1048577 1049281 0 0 20086ef9 00000000 NULL in pagv
    k0x2bd84240 1049283 1048577 1049283 0 -88 60086207 00000000 NULL in pagv
    k0xf844c240 1049318 1048577 1049318 0 0 20004003 00000000 NULL in pagv
    k0xce79b740 1049331 1048577 1049331 0 0 00004002 00000000 NULL in pagv
    k0x2bd84cc0 1049332 1048577 1049332 0 0 00004002 00000000 NULL in pagv
    k0xce79a240 1049333 1048577 1049333 0 0 00005002 00000000 NULL in pagv
    k0xdb110240 1049338 1048577 1049338 0 0 00004002 00000000 NULL in pagv
    k0x5997acc0 1049339 1048577 1049339 0 -1 00004002 00000000 NULL in pagv
    k0xf87d8cc0 1049348 1048577 1049348 0 0 00002002 00000000 NULL in pagv
    k0xdac30cc0 1049374 1048577 1049374 0 0 00004002 00000000 NULL in pagv
    k0x2d118240 1049386 1048577 1049385 0 0 03806efa 00000000 NULL in pagv ctty
    k0x5c419740 1049407 1048577 1049393 100 0 20001ef8 00000000 NULL in pagv
    k0x9b1bf740 1049446 1048577 1049446 0 0 00004003 00000000 NULL in pagv
    k0xce79acc0 1049452 1048577 1049452 0 0 00000ef8 00000000 NULL in pagv
    k0xdac31740 1049453 1049446 1049446 0 0 00000000 00000000 NULL in exit pagv
    k0xd7dd1740 1049474 1048577 1049474 0 0 00000ef8 00000000 NULL in pagv
    k0x5905ecc0 1049484 1048577 1049484 0 0 40084005 00000000 NULL in pagv
    k0xf87d8240 1049485 1049484 1049484 0 0 60083001 00000000 NULL in pagv
    k0xd7dd0cc0 1049496 1048577 1049496 0 0 00006000 00000000 NULL in pagv
    k0x5e31f740 1049505 1048577 1049505 0 0 2000462b 00000000 NULL in pagv
    k0x5e31e240 1049511 1049505 1049505 0 0 2000e62b 00000000 NULL in pagv
    k0xe31bc240 1049512 1049505 1049505 0 0 2000e62b 00000000 NULL in pagv
    k0x6545c240 1049521 1048577 1049521 0 0 2000462b 00000000 NULL in pagv
    k0x5b639740 1049529 1049521 1049521 100 0 2000e62b 00000000 NULL in pagv
    k0x5905e240 1049531 1049521 1049521 100 0 2000e62b 00000000 NULL in pagv
    k0xe31bccc0 1049532 1049521 1049521 100 0 2000e62b 00000000 NULL in pagv
    k0x600ec240 1049533 1049521 1049521 100 0 2000e62b 00000000 NULL in pagv
    k0x600ed740 1049534 1049521 1049521 100 0 2000e62b 00000000 NULL in pagv
    k0x85816cc0 1049546 1048577 1049546 0 0 00085007 00000000 NULL in pagv
    k0x5e31ecc0 1049575 1048577 1049575 0 0 00084003 00000000 NULL in pagv
    k0xb785acc0 1049643 1048577 1048917 0 0 21800ef8 00000000 NULL in pagv ctty
    k0xb785a240 1050305 1048577 1050305 0 0 00001000 00000000 NULL in pagv
    k0x398fa240 1050308 1048577 1050308 0 0 00001ef8 00000000 NULL in pagv
    k0xd852ecc0 1050492 1048577 1050492 0 0 00000ef8 00000000 NULL in pagv
    k0xda422240 1050497 1048577 1050497 0 0 00000000 00000000 NULL in pagv ctty
    k0x2c059740 1054716 1049485 1054716 0 0 00084027 00000000 NULL in pagv
    k0xda422cc0 1054721 1054716 1054721 1006 0 6f883efb 00000000 NULL in pagv ctty
    k0x82900240 1054842 1049521 1049521 100 0 2000e62b 00000000 NULL in pagv
    k0x6545ccc0 1054983 1048577 1054983 0 0 00000000 00000000 NULL in pagv
    k0x2c058cc0 1055634 1048578 0 0 0 00000000 00000000 NULL in sys
    k0xd38cf740 1055635 1048578 0 0 0 00000000 00000000 NULL in sys
    k0x10636cc0 1055644 1048578 0 0 0 00000000 00000000 NULL in sys
    k0x39af4cc0 1055645 1048578 0 0 0 00000000 00000000 NULL in sys
    k0xd7dd0240 1055651 1048578 0 0 0 00000000 00000000 NULL in sys
    k0x85816240 1055698 1048578 0 0 0 00000000 00000000 NULL in sys
    k0x6212a240 1055707 1048578 0 0 0 00000000 00000000 NULL in sys
    k0xc27b1740 1056336 1049521 1049521 100 0 2000e62b 00000000 NULL in pagv
    k0x5fef5740 1195169 1048578 0 0 0 00000000 00000000 NULL in sys
    k0x337b5740 1195192 1048578 0 0 0 00000000 00000000 NULL in sys
    k0x3d8aa240 1195201 1048578 0 0 0 00000000 00000000 NULL in sys
    k0xa5dad740 1195639 1048578 0 0 0 00000000 00000000 NULL in sys
    k0x35b05740 1199065 1048577 1199065 1007 0 41802ebc 00000000 NULL in pagv
    k0x12233740 1201339 1048578 0 0 0 00000000 00000000 NULL in sys
    k0x44e5ecc0 1201392 1048578 0 0 0 00000000 00000000 NULL in sys
    k0xc27b0240 1201481 1048577 1201481 1007 0 41802ebc 00000000 NULL in pagv
    k0x7c280cc0 1201497 1201517 1201497 1007 0 60083aff 00000000 NULL in pagv ctty
    k0x28af6240 1201517 1049485 1201517 0 0 00084027 00000000 NULL in pagv
    k0xc78c6cc0 1201645 1048577 1201645 1007 0 41802ebc 00000000 NULL in pagv
    k0xa530ecc0 1202682 1049485 1202682 0 0 00084027 00000000 NULL in pagv
    k0x10637740 1202790 1202682 1202790 1005 0 6f883efb 00000000 NULL in pagv ctty
    k0xffebecc0 1203157 1049485 1203157 0 0 00084025 00000000 NULL in pagv
    k0x39af5740 1203923 1203157 1203923 1007 0 60003aff 00000000 NULL in pagv ctty
    k0xc3f87740 1204522 1202790 1204522 0 0 6f883efb 00000000 NULL in pagv ctty
    k0xfdf54cc0 1205057 1048577 1205057 1007 0 41802ebc 00000000 NULL in pagv
    k0xc78c6240 1205069 1048577 1205069 1007 0 41802ebc 00000000 NULL in pagv
    k0x49590cc0 1205140 1048577 1205140 1007 0 41802ebc 00000000 NULL in pagv
    k0xcaff2cc0 1205152 1048577 1205152 1007 0 41802ebc 00000000 NULL in pagv
    k0xa530f740 1205157 1048577 1205157 1007 0 41802ebc 00000000 NULL in pagv
    k0xec3accc0 1205161 1048577 1205161 1007 0 41802ebc 00000000 NULL in pagv
    k0x337b4240 1205163 1048577 1205163 1007 0 41802ebc 00000000 NULL in pagv
    k0xaf9dccc0 1205165 1048577 1205165 1007 0 41802ebc 00000000 NULL in pagv
    k0x593e2cc0 1205168 1048577 1205168 1007 0 41802ebc 00000000 NULL in pagv
    k0xfdf55740 1205179 1048577 1205179 1007 0 41802ebc 00000000 NULL in pagv
    k0x60e8acc0 1205187 1048577 1205187 1007 0 41802ebc 00000000 NULL in pagv
    k0x4a321740 1074333 1054721 1074333 0 0 6f883efb 00000000 NULL in pagv ctty
    k0x398fb740 1206170 1203923 1206170 1007 0 61007aff 00000000 NULL in pagv ctty
    k0x10636240 1206264 1048577 1206264 1007 0 41802ebc 00000000 NULL in pagv
    k0x098e1740 1207179 1207193 1207179 1007 0 4180aebc 00000000 NULL in pagv
    k0x60e8b740 1207193 1206170 1206170 1007 0 00081002 00000000 NULL in pagv ctty
    k0xffeb6240 1208632 1048578 0 0 0 00000000 00000000 NULL in sys
    k0x4fc6c240 1208678 1048578 0 0 0 00000000 00000000 NULL in sys
    k0x0d59b740 1208682 1048578 0 0 0 00000000 00000000 NULL in sys
    k0x0d59acc0 1208705 1048578 0 0 0 00000000 00000000 NULL in sys
    k0x69557740 1211934 1048578 0 0 0 00000000 00000000 NULL in sys
    k0xdae79740 1084743 1048577 1084743 1007 0 41802ebc 00000000 NULL in pagv
    k0x5fef4cc0 1084745 1048577 1084745 1007 0 41802ebc 00000000 NULL in pagv
    k0x600eccc0 1084747 1048577 1084747 1007 0 41802ebc 00000000 NULL in pagv
    k0x157f4cc0 1084749 1048577 1084749 1007 0 41802ebc 00000000 NULL in pagv
    k0x6e12ccc0 1084751 1048577 1084751 1007 0 41802ebc 00000000 NULL in pagv
    k0x49590240 1084753 1048577 1084753 1007 0 41802ebc 00000000 NULL in pagv
    k0x35b04240 1084755 1048577 1084755 1007 0 41802ebc 00000000 NULL in pagv
    k0x9b1be240 1084757 1048577 1084757 1007 0 41802ebc 00000000 NULL in pagv
    k0xc3f86240 1084759 1048577 1084759 1007 0 41802ebc 00000000 NULL in pagv
    k0x6e12c240 1084780 1048577 1084780 1007 0 41802ebc 00000000 NULL in pagv
    k0x157f4240 1084782 1048577 1084782 1007 0 41802ebc 00000000 NULL in pagv
    k0xfd38e240 1084784 1048577 1084784 1007 0 41802ebc 00000000 NULL in pagv
    k0x81241740 1084786 1048577 1084786 1007 0 41802ebc 00000000 NULL in pagv
    k0x6aa13740 1084797 1048577 1084797 1007 0 41802ebc 00000000 NULL in pagv
    k0x6aa12cc0 1084799 1048577 1084799 1007 0 41802ebc 00000000 NULL in pagv
    k0xd38cecc0 1084801 1048577 1084801 1007 0 41802ebc 00000000 NULL in pagv
    k0x49591740 1084803 1048577 1084803 1007 0 41802ebc 00000000 NULL in pagv
    k0x81240240 1084805 1048577 1084805 1007 0 41802ebc 00000000 NULL in pagv
    k0xcaff3740 1084826 1048577 1084826 1007 0 41802ebc 00000000 NULL in pagv
    k0x6aa12240 1084828 1048577 1084828 1007 0 41802ebc 00000000 NULL in pagv
    k0xfd38f740 1084830 1048577 1084830 1007 0 41802ebc 00000000 NULL in pagv
    k0xb785b740 1084832 1048577 1084832 1007 0 41802ebc 00000000 NULL in pagv
    k0xe90ff740 1084842 1048577 1084842 1007 0 41802ebc 00000000 NULL in pagv
    k0xc81b1740 1084844 1048577 1084844 1007 0 41802ebc 00000000 NULL in pagv
    k0xe90fe240 1084846 1048577 1084846 1007 0 41802ebc 00000000 NULL in pagv
    k0xa0f58cc0 1084848 1048577 1084848 1007 0 41802ebc 00000000 NULL in pagv
    k0xa0f58240 1084850 1048577 1084850 1007 0 41802ebc 00000000 NULL in pagv
    k0xfc993740 1084875 1048577 1084875 1007 0 41802ebc 00000000 NULL in pagv
    k0xc84cc240 1084877 1048577 1084877 1007 0 41802ebc 00000000 NULL in pagv
    k0xfc992cc0 1084879 1048577 1084879 1007 0 41802ebc 00000000 NULL in pagv
    k0xfc992240 1084881 1048577 1084881 1007 0 41802ebc 00000000 NULL in pagv
    k0x5c418cc0 1084883 1048577 1084883 1007 0 41802ebc 00000000 NULL in pagv
    k0x81240cc0 1084885 1048577 1084885 1007 0 41802ebc 00000000 NULL in pagv
    k0x6491e240 1084887 1048577 1084887 1007 0 41802ebc 00000000 NULL in pagv
    k0xc84cccc0 1084889 1048577 1084889 1007 0 41802ebc 00000000 NULL in pagv
    k0xffeb7740 1084891 1048577 1084891 1007 0 41802ebc 00000000 NULL in pagv
    k0x9bce2cc0 1084921 1048577 1084921 1007 0 41802ebc 00000000 NULL in pagv
    k0xcde69740 1084923 1048577 1084923 1007 0 41802ebc 00000000 NULL in pagv
    k0xd852f740 1084925 1048577 1084925 1007 0 41802ebc 00000000 NULL in pagv
    k0xfd38ecc0 1084927 1048577 1084927 1007 0 41802ebc 00000000 NULL in pagv
    k0xc81b0240 1084929 1048577 1084929 1007 0 41802ebc 00000000 NULL in pagv
    k0x6545d740 1084931 1048577 1084931 1007 0 41802ebc 00000000 NULL in pagv
    k0xc81b0cc0 1084933 1048577 1084933 1007 0 41802ebc 00000000 NULL in pagv
    k0xc84cd740 1084935 1048577 1084935 1007 0 41802ebc 00000000 NULL in pagv
    k0x8985ecc0 1084937 1048577 1084937 1007 0 41802ebc 00000000 NULL in pagv
    k0xd852e240 1084976 1048577 1084976 1007 0 41802ebc 00000000 NULL in pagv
    k0xb43c9740 1084978 1048577 1084978 1007 0 41802ebc 00000000 NULL in pagv
    k0xd4150cc0 1084980 1048577 1084980 1007 0 41802ebc 00000000 NULL in pagv
    k0xb43c8240 1084982 1048577 1084982 1007 0 41802ebc 00000000 NULL in pagv
    k0x46c5acc0 1084984 1048577 1084984 1007 0 41802ebc 00000000 NULL in pagv
    k0xb43c8cc0 1084986 1048577 1084986 1007 0 41802ebc 00000000 NULL in pagv
    k0x46c5b740 1084988 1048577 1084988 1007 0 41802ebc 00000000 NULL in pagv
    k0x7c281740 1084990 1048577 1084990 1007 0 41802ebc 00000000 NULL in pagv
    k0x46c5a240 1084992 1048577 1084992 1007 0 41802ebc 00000000 NULL in pagv
    k0x7c280240 1084994 1048577 1084994 1007 0 41802ebc 00000000 NULL in pagv
    k0xa5daccc0 1084996 1048577 1084996 1007 0 41802ebc 00000000 NULL in pagv
    k0xbf7a3740 1085101 1048577 1085101 1007 0 00000000 00000000 NULL in pagv ctty
    k0xcde68240 1085113 1048577 1085113 1007 0 00000000 00000000 NULL in pagv ctty
    k0x4a320240 1350515 1048577 1350515 1007 0 41802ebc 00000000 NULL in pagv
    k0x44e5f740 1484108 1048577 1484108 1007 0 41802ebc 00000000 NULL in pagv
    k0x4a320cc0 1484297 1048577 1484297 1007 0 41802ebc 00000000 NULL in pagv
    k0x5fef4240 1484367 1048577 1484367 1007 0 41802ebc 00000000 NULL in pagv
    k0x12232240 1484498 1048577 1484498 1007 0 41802ebc 00000000 NULL in pagv
    k0xe90fecc0 1484509 1048577 1484509 1007 0 41802ebc 00000000 NULL in pagv
    k0xd6d88cc0 1484515 1048577 1484515 1007 0 41802ebc 00000000 NULL in pagv
    k0x44e5e240 1484517 1048577 1484517 1007 0 41802ebc 00000000 NULL in pagv
    k0x6212b740 1484522 1048577 1484522 1007 0 41802ebc 00000000 NULL in pagv
    k0xffebf740 1484525 1048577 1484525 1007 0 41802ebc 00000000 NULL in pagv
    k0xc78c7740 1484528 1048577 1484528 1007 0 41802ebc 00000000 NULL in pagv
    k0x9bce3740 1484530 1048577 1484530 1007 0 41802ebc 00000000 NULL in pagv
    k0x4fc6ccc0 1485603 1048577 1485568 0 -1 60027eff 00000000 NULL in pagv ctty
    k0x398facc0 1098690 1048578 0 0 0 00000000 00000000 NULL in sys
    k0x69556cc0 1167375 1048578 0 0 0 00000000 00000000 NULL in sys
    k0x5b638cc0 1167390 1048578 0 0 0 00000000 00000000 NULL in sys
    k0x2d119740 1177286 1048577 1048917 0 -20 20007efb 00000000 NULL in pagv ctty
    k0xc7e27740 1113131 1048578 0 0 0 00000000 00000000 NULL in sys
    _kdbx_proc_end:

    thread 0xfffffc03ffebce00 stopped at [stop_secondary_cpu:1339 ,0xfffffc0000c83730] Source not available
    warning: Files compiled -g3: parameter values probably wrong
    Audit subsystem enabled

    36111 bytes audit data saved to /var/adm/crash/audit-data.5
    #
    _crash_data_collection_finished:

      

    -- 
    Best regards,
     Andrew
    mailto:andrew.martin@cameo-consultants.com
    

  • Next message: Renato Fabene: "How can I user the comand HISTORY"

    Relevant Pages

    • [RFC] nodemanager, ocfs2, dlm
      ... interested in seeing some similarity in dlm/ocfs configuration. ... +struct clusters; ... +static struct node_attribute node_attr_nodeid = { ... +/* Hierarchy of four kinds of objects: clusters, cluster, nodes, node. ...
      (Linux-Kernel)
    • Oracle RAC 10g_r2: Oracle Notification Server Configuration Assistant - FAILED
      ... I am stuck on the configuration of the Oracle Clusterware ... Checking Cluster manager integrity... ... Daemon status check failed for "CSS daemon". ...
      (comp.databases.oracle.server)
    • Re: RAC unexpected reboot of nodes
      ... A few weeks ago we succeeded to configure an Oracle 10.2.0.1 cluster. ... The configuration was comprised of 2 nodes and the underlying OS was ... In order to prove this we decided to configure a RAC on a single node ... for what really causes the reboot. ...
      (comp.databases.oracle.server)
    • Re: Oracle SQL Developer && LDAP Connection
      ... Generated by Oracle configuration tools. ... The problem lies in that I can't create LDAP connection in Oracle SQL ... The version of Oracle SQL developer is 1.5.1.54.40. ...
      (comp.databases.oracle.tools)
    • Re: Oracle 9iR2 32bit on windows 2003 server 64bit
      ... Oracle won't use the extra memory in the machine. ... If Oracle does not support the configuration what is the ... Please install into a supported configuration and then we ... The reason for the requirement is that oracle will run in a cluster. ...
      (comp.databases.oracle.server)