Sun Fire E2900 crashed. Help analyze explorer

Dear Friends,

Sun Fire E2900 crashed. I collected explorer output. core dump files been generated.

There some interesting output files related to crash dumps, that I need some help from you guys to understand.

The file in the explorer output is under /sysconfig/crash it's called: msgbuf.0.out: this is the content of the file:

MESSAGE                                                               
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: High TCP connect timeout rate! System (port 49932) may be under a SYN f
lood attack!
WARNING: High TCP connect timeout rate! System (port 49260) may be under a SYN f
lood attack!
NOTICE: fp(0): PLOGI to a7 failed state=Packet Transport error, reason=No Connec
tion
WARNING: fp(0)::PLOGI to a7 failed. state=e reason=5.

WARNING: /ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0 (fcp0):
        PLOGI to D_ID=0xa7 failed: State:Packet Transport error, Reason:No Conne
ction. Giving up
        Device is gone
/ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0 (fcp0):
        offlining lun=0 (trace=0), target=a7 (trace=2800101)
NOTICE: Qlogic qlc(0): Loop OFFLINE
NOTICE: Qlogic qlc(0): Loop ONLINE
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: ScApp does not support the application watchdog feature.
NOTICE: VxVM vxdmp V-5-0-258 removed disk array 082619

NOTICE: VxVM vxdmp V-5-0-112 disabled path 118/0x18 belonging to the dmpnode 326
/0x8

NOTICE: VxVM vxdmp V-5-0-111 disabled dmpnode 326/0x8

NOTICE: fp(0): PLOGI to a7 failed state=Packet Transport error, reason=No Connec
tion
WARNING: fp(0)::PLOGI to a7 failed. state=e reason=5.

WARNING: /ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0 (fcp0):
        PLOGI to D_ID=0xa7 failed: State:Packet Transport error, Reason:No Conne
ction. Giving up
/ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0 (fcp0):
        offlining lun=0 (trace=0), target=a7 (trace=2800101)
NOTICE: Qlogic qlc(0): Loop OFFLINE
NOTICE: Qlogic qlc(0): Loop ONLINE
NOTICE: VxVM vxdmp V-5-0-34 added disk array 082619, datype = SUN3510

NOTICE: VxVM vxdmp V-5-0-148 enabled path 118/0x18 belonging to the dmpnode 326/
0x8

NOTICE: VxVM vxdmp V-5-0-147 enabled dmpnode 326/0x8

NOTICE: Qlogic qlc(0): Loop OFFLINE
NOTICE: Qlogic qlc(0): Loop ONLINE
/ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0 (fcp0):
        ndi_devi_online: failed for scsiclass,0d: target=a7 lun=0 ffffffff
NOTICE: fp(0): PLOGI to a7 failed state=Packet Transport error, reason=No Connec
tion
WARNING: fp(0)::PLOGI to a7 failed. state=e reason=5.

WARNING: /ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0 (fcp0):
        PLOGI to D_ID=0xa7 failed: State:Packet Transport error, Reason:No Conne
ction. Giving up
        Device is gone
/ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0 (fcp0):
        offlining lun=0 (trace=0), target=a7 (trace=2800101)
/ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0/ses@w216000c0ff882619,0 (ses96) offline
NOTICE: Qlogic qlc(0): Loop OFFLINE
NOTICE: Qlogic qlc(0): Loop ONLINE
/ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0 (fcp0):
        ndi_devi_online: failed for scsiclass,0d: target=a7 lun=0 ffffffff
NOTICE: fp(0): PLOGI to a7 failed state=Packet Transport error, reason=No Connec
tion
WARNING: fp(0)::PLOGI to a7 failed. state=e reason=5.

WARNING: /ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0 (fcp0):
        PLOGI to D_ID=0xa7 failed: State:Packet Transport error, Reason:No Conne
ction. Giving up
        Device is gone
/ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0 (fcp0):
        offlining lun=0 (trace=0), target=a7 (trace=2800101)
/ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0/ses@w216000c0ff882619,0 (ses96) offline
NOTICE: Qlogic qlc(0): Loop OFFLINE
NOTICE: Qlogic qlc(0): Loop ONLINE
/ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0 (fcp0):
        ndi_devi_online: failed for scsiclass,0d: target=a7 lun=0 ffffffff
/ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0 (fcp0):
        ndi_devi_online: failed for scsa,00.bfcp: target=a7 lun=0 ffffffff
/ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0/ses@w216000c0ff882619,0 (ses96) offline
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
NOTICE: fp(0): PLOGI to a7 failed state=Packet Transport error, reason=No Connec
tion
WARNING: fp(0)::PLOGI to a7 failed. state=e reason=5.

WARNING: /ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0 (fcp0):
        PLOGI to D_ID=0xa7 failed: State:Packet Transport error, Reason:No Conne
ction. Giving up
        Device is gone
/ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0 (fcp0):
        offlining lun=0 (trace=0), target=a7 (trace=2800101)
NOTICE: Qlogic qlc(0): Loop OFFLINE
NOTICE: Qlogic qlc(0): Loop ONLINE
        Device is gone
ssd6 at fp0: name w216000c0ff882619,1, bus address a7
ssd6 is /ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0/ssd@w216000c0ff882619,1
WARNING: /ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0/ssd@w216000c0ff882619,1 (ssd6)
:
        Corrupt label; wrong magic number

/ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0/ssd@w216000c0ff882619,1 (ssd6) online
/ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0 (fcp0):
        ndi_devi_online: failed for scsa,00.bfcp: target=a7 lun=0 ffffffff
WARNING: /ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0/ssd@w216000c0ff882619,1 (ssd6)
:
        Corrupt label; wrong magic number

WARNING: /ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0/ssd@w216000c0ff882619,1 (ssd6)
:
        Corrupt label; wrong magic number

NOTICE: VxVM vxdmp V-5-0-112 disabled path 118/0x30 belonging to the dmpnode 326
/0x28

NOTICE: VxVM vxdmp V-5-0-111 disabled dmpnode 326/0x28

NOTICE: VxVM vxdmp V-5-0-148 enabled path 118/0x30 belonging to the dmpnode 326/
0x28

NOTICE: VxVM vxdmp V-5-0-147 enabled dmpnode 326/0x28

WARNING: /ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0/ssd@w216000c0ff882619,1 (ssd6)
:
        Corrupt label; wrong magic number

WARNING: /ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0/ssd@w216000c0ff882619,1 (ssd6)
:
        Corrupt label; wrong magic number

WARNING: /ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0/ssd@w216000c0ff882619,1 (ssd6)
:
        Corrupt label; wrong magic number

WARNING: /ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0/ssd@w216000c0ff882619,1 (ssd6)
:
        Corrupt label; wrong magic number

WARNING: /ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0/ssd@w216000c0ff882619,1 (ssd6)
:
        Corrupt label; wrong magic number

WARNING: /ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0/ssd@w216000c0ff882619,1 (ssd6)
:
        Corrupt label; wrong magic number

NOTICE: Qlogic qlc(0): Loop OFFLINE
NOTICE: Qlogic qlc(0): Loop ONLINE
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
WARNING: couldn't allocate FBT table for module vxio
NOTICE: msgcnt 1 mesg 001: V-2-1: vx_nospace - /dev/vx/dsk/ossdg/home file syste
m full (32 block extent)
WARNING: High TCP connect timeout rate! System (port 49260) may be under a SYN f
lood attack!
WARNING: ScApp does not support the application watchdog feature.


panic[cpu1]/thread=2a1017c3ca0: 
BAD TRAP: type=31 rp=2a1017c31a0 addr=0 mmu_fsr=0 occurred in module "unix" due 
to a NULL pointer dereference


sched: 
trap type = 0x31
pid=0, pc=0x1048d64, sp=0x2a1017c2a41, tstate=0x4480001604, context=0x0
g1-g7: 1c0, 5316, 60062ac4d54, 60062ac4cf0, 60062ac4cf0, 46, 2a1017c3ca0

000002a1017c2ec0 unix:die+78 (31, 2a1017c31a0, 0, 0, 2a1017c2f80, 1084800)
  %l0-3: 00000000c0800000 0000000000000031 0000000001000000 0000000000002000
  %l4-7: 000000000183c188 000000000183c000 0000000000000000 0000000000000002
000002a1017c2fa0 unix:trap+9e0 (2a1017c31a0, 0, 1fff, 5, 0, 1)
  %l0-3: 0000000000000000 0000000001885dd0 0000000000000031 0000000000001c00
  %l4-7: 0000000000000000 0000000000000001 ffffffffffffe000 0000000000000005
000002a1017c30f0 unix:ktl0+48 (0, 2a1017c3ca0, 1, 5316, 0, 64)
  %l0-3: 0000000000000005 0000000000001400 0000004480001604 000000000101b974
  %l4-7: 0000000000200000 0000060055005e48 0000000000000000 000002a1017c31a0
000002a1017c3240 ip:ip_wput_ioctl+c4 (600e03d53c8, 600e6dbf4c0, 600709a3640, 0, 
60055005e48, 0)
  %l0-3: 00000300859b6a70 000000007b27842c 000000007084ec00 0000000000005000
  %l4-7: 0000000000000006 000000007b27819c 000000007084eca8 0000060062ac4cf0
000002a1017c32f0 ip:tcp_xmit_early_reset+6b8 (7b2251f4, 0, 60062ac4cf0, 10, 0, 0
)
  %l0-3: 000006005529c000 000003002a45ba80 0000000000000000 000003007ad65e10
  %l4-7: 0000000000000004 0000000003444e1b 000002a1017c33dc 0000000000000000
000002a1017c3400 ip:tcp_xmit_listeners_reset+1f4 (3004a809380, 14, 0, 6005529c00
0, 3002a45b880, 3d4fd5c2)
  %l0-3: 000000000000003d 000003004a809380 0000000000000000 000000007d9bc99f
  %l4-7: 000003007ad65e24 00000000000000c9 000000007d000000 0000000000000011
000002a1017c34d0 ip:ip_tcp_input+af8 (11, 3007ad65e10, 30000554c68, 3002a45b880,
 0, 30000554c68)
  %l0-3: 0000060055284000 0000060055292000 0000000000000000 0000000000000014
  %l4-7: 0000000000000000 0000060061cc3a40 000003007ad65e24 0000000021df3a55
000002a1017c35b0 ip:ip_input+a68 (3007ad65e10, 0, 0, 30000554c68, 0, 0)
  %l0-3: 0000000000000000 0000000000000000 0000060061a6f598 0000060055284000
  %l4-7: 00000000e0000000 0000000000000001 0000000000000000 0000000000000006
000002a1017c3720 unix:putnext+218 (60061b09168, 60061b08f78, 3004a809380, 100, 6
0061b09208, 0)
  %l0-3: 0000000000000000 0000000000000000 0000000000000000 00000000000057d0
  %l4-7: 000000000000010d 000000007084e7b8 000000007b21ba9c fffffd5efe842000
000002a1017c37d0 ce:ce_drain_fifo+57e4 (1, 3004a809380, 60055190040, 7b7b77b4, 7
b7b7bb8, 3007ad65e02)
  %l0-3: 0000060061b09208 0000000000000009 0000000000000000 0000000090000000
  %l4-7: 0000000001069cbc 0000000000000001 0000060061a6bbb0 00000000010c9e48

syncing file systems...
 67
 64
 63
 63
 63
 63
 63
 63
 63
 63
 63
 63
 63
 63
 63
 63
 63
 63
 63
 63
 63
 63
 63
 done (not all i/o completed)
dumping to /dev/md/dsk/d30, offset 65536, content: kernel

Does this file give you any hint ?

Any explanation from your side is highly appreciated :b:

---------- Post updated at 06:39 AM ---------- Previous update was at 06:36 AM ----------

output of "uname -a":

SunOS *** 5.10 Generic_127127-11 sun4u sparc SUNW,Netra-T12

output of "format":

AVAILABLE DISK SELECTIONS:
       0. c1t0d0 <SEAGATE-ST373307LSUN72G-0507 cyl 14087 alt 2 hd 24 sec 424>
          /ssm@0,0/pci@18,600000/scsi@2/sd@0,0
       1. c1t1d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
          /ssm@0,0/pci@18,600000/scsi@2/sd@1,0
       2. c2t40d0 <SUN-StorEdge3510-421F cyl 35010 alt 2 hd 64 sec 255>
          /ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0/ssd@w2***882619,0
       3. c2t40d1 <SUN-StorEdge3510-421F cyl 35010 alt 2 hd 64 sec 255>
          /ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0/ssd@w216000c***19,1
       4. c3t40d0 <SUN-StorEdge3510-421F cyl 35010 alt 2 hd 64 sec 255>
          /ssm@0,0/pci@19,700000/SUNW,qlc@2/fp@0,0/ssd@w2160****018,0
       5. c3t40d1 <SUN-StorEdge3510-421F cyl 35010 alt 2 hd 64 sec 255>
          /ssm@0,0/pci@19,700000/SUNW,qlc@2/fp@0,0/ssd@w216****0018,1

---------- Post updated at 06:39 AM ---------- Previous update was at 06:39 AM ----------

output of "uname -a":

SunOS *** 5.10 Generic_127127-11 sun4u sparc SUNW,Netra-T12

output of "format":

AVAILABLE DISK SELECTIONS:
       0. c1t0d0 <SEAGATE-ST373307LSUN72G-0507 cyl 14087 alt 2 hd 24 sec 424>
          /ssm@0,0/pci@18,600000/scsi@2/sd@0,0
       1. c1t1d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
          /ssm@0,0/pci@18,600000/scsi@2/sd@1,0
       2. c2t40d0 <SUN-StorEdge3510-421F cyl 35010 alt 2 hd 64 sec 255>
          /ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0/ssd@w2***882619,0
       3. c2t40d1 <SUN-StorEdge3510-421F cyl 35010 alt 2 hd 64 sec 255>
          /ssm@0,0/pci@19,700000/QLGC,qla@1/fp@0,0/ssd@w216000c***19,1
       4. c3t40d0 <SUN-StorEdge3510-421F cyl 35010 alt 2 hd 64 sec 255>
          /ssm@0,0/pci@19,700000/SUNW,qlc@2/fp@0,0/ssd@w2160****018,0
       5. c3t40d1 <SUN-StorEdge3510-421F cyl 35010 alt 2 hd 64 sec 255>
          /ssm@0,0/pci@19,700000/SUNW,qlc@2/fp@0,0/ssd@w216****0018,1

---------- Post updated at 06:40 AM ---------- Previous update was at 06:39 AM ----------

output of "prtdiag -v"

System Configuration: Sun Microsystems  sun4u Sun Fire E2900
System clock frequency: 150 MHZ
Memory size: 64GB       

======================================= CPUs =======================================
               E$          CPU                  CPU
CPU      Freq      Size        Implementation       Mask    Status      Location
-------  --------  ----------  -------------------  -----   ------      --------
  0,512  1050 MHz  16MB        SUNW,UltraSPARC-IV    2.3    on-line     SB0/P0
  1,513  1050 MHz  16MB        SUNW,UltraSPARC-IV    2.3    on-line     SB0/P1
  2,514  1050 MHz  16MB        SUNW,UltraSPARC-IV    2.3    on-line     SB0/P2
  3,515  1050 MHz  16MB        SUNW,UltraSPARC-IV    2.3    on-line     SB0/P3
  8,520  1050 MHz  16MB        SUNW,UltraSPARC-IV    2.3    on-line     SB2/P0
  9,521  1050 MHz  16MB        SUNW,UltraSPARC-IV    2.3    on-line     SB2/P1
 10,522  1050 MHz  16MB        SUNW,UltraSPARC-IV    2.3    on-line     SB2/P2
 11,523  1050 MHz  16MB        SUNW,UltraSPARC-IV    2.3    on-line     SB2/P3
 16,528  1350 MHz  16MB        SUNW,UltraSPARC-IV    3.1    on-line     SB4/P0
 17,529  1350 MHz  16MB        SUNW,UltraSPARC-IV    3.1    on-line     SB4/P1
 18,530  1350 MHz  16MB        SUNW,UltraSPARC-IV    3.1    on-line     SB4/P2
 19,531  1350 MHz  16MB        SUNW,UltraSPARC-IV    3.1    on-line     SB4/P3

==================================== IO Devices ====================================
Bus   Freq      Slot +  Name +
Type  MHz       Status  Path                          Model
----  ----  ----------  ----------------------------  --------------------
pci    33         PCI0  pci100b,35 (network)          SUNW,pci-ce        
                  okay  /ssm@0,0/pci@18,700000/pci@1/network@0

pci    33         PCI0  pci100b,35 (network)          SUNW,pci-ce        
                  okay  /ssm@0,0/pci@18,700000/pci@1/network@1

pci    33         PCI0  scsi-pci1000,b (scsi-2)                          
                  okay  /ssm@0,0/pci@18,700000/pci@1/scsi@2

pci    33         PCI0  scsi-pci1000,b (scsi-2)                          
                  okay  /ssm@0,0/pci@18,700000/pci@1/scsi@2,1

pci    33         PCI1  pci100b,35 (network)          SUNW,pci-ce        
                  okay  /ssm@0,0/pci@18,700000/pci@2/network@0

pci    33         PCI1  pci100b,35 (network)          SUNW,pci-ce        
                  okay  /ssm@0,0/pci@18,700000/pci@2/network@1

pci    33         PCI1  scsi-pci1000,b (scsi-2)                          
                  okay  /ssm@0,0/pci@18,700000/pci@2/scsi@2

pci    33         PCI1  scsi-pci1000,b (scsi-2)                          
                  okay  /ssm@0,0/pci@18,700000/pci@2/scsi@2,1

pci    33         PCI2  QLGC,qla-pci1077,2300 (scsi)                     
                  okay  /ssm@0,0/pci@19,700000/QLGC,qla@1

pci    33         PCI3  SUNW,qlc-pci1077,2300 (scsi-+                    
                  okay  /ssm@0,0/pci@19,700000/SUNW,qlc@2

pci    66            1  pci108e,abba (network)        SUNW,pci-ce        
                  okay  /ssm@0,0/pci@19,600000/network@1

pci    66            2  scsi-pci1000,21 (scsi-2)                         
                  okay  /ssm@0,0/pci@18,600000/scsi@2

pci    66            2  scsi-pci1000,21 (scsi-2)                         
                  okay  /ssm@0,0/pci@18,600000/scsi@2,1

pci    66            2  pci108e,abba (network)        SUNW,pci-ce        
                  okay  /ssm@0,0/pci@19,600000/network@2

pci    33            3  pci1095,646 (ide)                                
                  okay  /ssm@0,0/pci@18,700000/ide@3

pci    33            4  bootbus-controller-sgsbbc     SUNW,sgsbbc        
                  okay  /ssm@0,0/pci@18,700000/bootbus-controller@4


=============================== Memory Configuration ===============================
Segment Table:
-----------------------------------------------------------------------
Base Address       Size       Interleave Factor  Contains
-----------------------------------------------------------------------
0x0                16GB              16          BankIDs 0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15
0x2000000000       16GB              16          BankIDs 32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47
0x4000000000       32GB              16          BankIDs 64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79

Bank Table:
-----------------------------------------------------------
           Physical Location
ID       ControllerID  GroupID   Size       Interleave Way
-----------------------------------------------------------
0        0             0         1GB             0
1        0             1         1GB             4
2        0             0         1GB             8
3        0             1         1GB             12
4        1             0         1GB             1
5        1             1         1GB             5
6        1             0         1GB             9
7        1             1         1GB             13
8        2             0         1GB             2
9        2             1         1GB             6
10       2             0         1GB             10
11       2             1         1GB             14
12       3             0         1GB             3
13       3             1         1GB             7
14       3             0         1GB             11
15       3             1         1GB             15
32       8             0         1GB             0
33       8             1         1GB             4
34       8             0         1GB             8
35       8             1         1GB             12
36       9             0         1GB             1
37       9             1         1GB             5
38       9             0         1GB             9
39       9             1         1GB             13
40       10            0         1GB             2
41       10            1         1GB             6
42       10            0         1GB             10
43       10            1         1GB             14
44       11            0         1GB             3
45       11            1         1GB             7
46       11            0         1GB             11
47       11            1         1GB             15
64       16            0         2GB             0
65       16            1         2GB             4
66       16            0         2GB             8
67       16            1         2GB             12
68       17            0         2GB             1
69       17            1         2GB             5
70       17            0         2GB             9
71       17            1         2GB             13
72       18            0         2GB             2
73       18            1         2GB             6
74       18            0         2GB             10
75       18            1         2GB             14
76       19            0         2GB             3
77       19            1         2GB             7
78       19            0         2GB             11
79       19            1         2GB             15

Memory Module Groups:
--------------------------------------------------
ControllerID   GroupID  Labels         Status
--------------------------------------------------
0              0        SB0/P0/B0/D0   okay
0              0        SB0/P0/B0/D1   okay
0              0        SB0/P0/B0/D2   okay
0              0        SB0/P0/B0/D3   okay
0              1        SB0/P0/B1/D0   okay
0              1        SB0/P0/B1/D1   okay
0              1        SB0/P0/B1/D2   okay
0              1        SB0/P0/B1/D3   okay
1              0        SB0/P1/B0/D0   okay
1              0        SB0/P1/B0/D1   okay
1              0        SB0/P1/B0/D2   okay
1              0        SB0/P1/B0/D3   okay
1              1        SB0/P1/B1/D0   okay
1              1        SB0/P1/B1/D1   okay
1              1        SB0/P1/B1/D2   okay
1              1        SB0/P1/B1/D3   okay
2              0        SB0/P2/B0/D0   okay
2              0        SB0/P2/B0/D1   okay
2              0        SB0/P2/B0/D2   okay
2              0        SB0/P2/B0/D3   okay
2              1        SB0/P2/B1/D0   okay
2              1        SB0/P2/B1/D1   okay
2              1        SB0/P2/B1/D2   okay
2              1        SB0/P2/B1/D3   okay
3              0        SB0/P3/B0/D0   okay
3              0        SB0/P3/B0/D1   okay
3              0        SB0/P3/B0/D2   okay
3              0        SB0/P3/B0/D3   okay
3              1        SB0/P3/B1/D0   okay
3              1        SB0/P3/B1/D1   okay
3              1        SB0/P3/B1/D2   okay
3              1        SB0/P3/B1/D3   okay
8              0        SB2/P0/B0/D0   okay
8              0        SB2/P0/B0/D1   okay
8              0        SB2/P0/B0/D2   okay
8              0        SB2/P0/B0/D3   okay
8              1        SB2/P0/B1/D0   okay
8              1        SB2/P0/B1/D1   okay
8              1        SB2/P0/B1/D2   okay
8              1        SB2/P0/B1/D3   okay
9              0        SB2/P1/B0/D0   okay
9              0        SB2/P1/B0/D1   okay
9              0        SB2/P1/B0/D2   okay
9              0        SB2/P1/B0/D3   okay
9              1        SB2/P1/B1/D0   okay
9              1        SB2/P1/B1/D1   okay
9              1        SB2/P1/B1/D2   okay
9              1        SB2/P1/B1/D3   okay
10             0        SB2/P2/B0/D0   okay
10             0        SB2/P2/B0/D1   okay
10             0        SB2/P2/B0/D2   okay
10             0        SB2/P2/B0/D3   okay
10             1        SB2/P2/B1/D0   okay
10             1        SB2/P2/B1/D1   okay
10             1        SB2/P2/B1/D2   okay
10             1        SB2/P2/B1/D3   okay
11             0        SB2/P3/B0/D0   okay
11             0        SB2/P3/B0/D1   okay
11             0        SB2/P3/B0/D2   okay
11             0        SB2/P3/B0/D3   okay
11             1        SB2/P3/B1/D0   okay
11             1        SB2/P3/B1/D1   okay
11             1        SB2/P3/B1/D2   okay
11             1        SB2/P3/B1/D3   okay
16             0        SB4/P0/B0/D0   okay
16             0        SB4/P0/B0/D1   okay
16             0        SB4/P0/B0/D2   okay
16             0        SB4/P0/B0/D3   okay
16             1        SB4/P0/B1/D0   okay
16             1        SB4/P0/B1/D1   okay
16             1        SB4/P0/B1/D2   okay
16             1        SB4/P0/B1/D3   okay
17             0        SB4/P1/B0/D0   okay
17             0        SB4/P1/B0/D1   okay
17             0        SB4/P1/B0/D2   okay
17             0        SB4/P1/B0/D3   okay
17             1        SB4/P1/B1/D0   okay
17             1        SB4/P1/B1/D1   okay
17             1        SB4/P1/B1/D2   okay
17             1        SB4/P1/B1/D3   okay
18             0        SB4/P2/B0/D0   okay
18             0        SB4/P2/B0/D1   okay
18             0        SB4/P2/B0/D2   okay
18             0        SB4/P2/B0/D3   okay
18             1        SB4/P2/B1/D0   okay
18             1        SB4/P2/B1/D1   okay
18             1        SB4/P2/B1/D2   okay
18             1        SB4/P2/B1/D3   okay
19             0        SB4/P3/B0/D0   okay
19             0        SB4/P3/B0/D1   okay
19             0        SB4/P3/B0/D2   okay
19             0        SB4/P3/B0/D3   okay
19             1        SB4/P3/B1/D0   okay
19             1        SB4/P3/B1/D1   okay
19             1        SB4/P3/B1/D2   okay
19             1        SB4/P3/B1/D3   okay

=============================== Environmental Status ===============================
Fan Status:
---------------------------------------
Location       Sensor          Status          
---------------------------------------
FT0/FAN0       ft_fan0         self-regulating 
FT0/FAN1       ft_fan1         self-regulating 
FT0/FAN2       ft_fan2         self-regulating 
FT0/FAN3       ft_fan3         self-regulating 
FT0/FAN4       ft_fan4         self-regulating 
FT0/FAN5       ft_fan5         self-regulating 
FT0/FAN6       ft_fan6         self-regulating 
FT0/FAN7       ft_fan7         self-regulating 
IB6/FAN0       ft_fan0         okay
IB6/FAN1       ft_fan1         okay

---------------------------------------
Temperature sensors:
------------------------------------
Location       Sensor         Status
------------------------------------
SSC1           t_sbbc0        okay 
SSC1           t_cbh0         okay 
SSC1           t_ambient0     okay 
SSC1           t_ambient1     okay 
SSC1           t_ambient2     okay 
RP0            t_ambient0     okay 
RP0            t_ambient1     okay 
RP0            t_sdc0         okay 
RP0            t_ar0          okay 
RP0            t_dx0          okay 
RP0            t_dx1          okay 
RP2            t_ambient0     okay 
RP2            t_ambient1     okay 
RP2            t_sdc0         okay 
RP2            t_ar0          okay 
RP2            t_dx0          okay 
RP2            t_dx1          okay 
SB0            t_sdc0         okay 
SB0            t_ar0          okay 
SB0            t_dx0          okay 
SB0            t_dx1          okay 
SB0            t_dx2          okay 
SB0            t_dx3          okay 
SB0            t_sbbc0        okay 
SB0/P0         Ambient        okay 
SB0/P1         Ambient        okay 
SB0/P0         Die            okay 
SB0/P1         Die            okay 
SB0            t_sbbc1        okay 
SB0/P2         Ambient        okay 
SB0/P3         Ambient        okay 
SB0/P2         Die            okay 
SB0/P3         Die            okay 
SB2            t_sdc0         okay 
SB2            t_ar0          okay 
SB2            t_dx0          okay 
SB2            t_dx1          okay 
SB2            t_dx2          okay 
SB2            t_dx3          okay 
SB2            t_sbbc0        okay 
SB2/P0         Ambient        okay 
SB2/P1         Ambient        okay 
SB2/P0         Die            okay 
SB2/P1         Die            okay 
SB2            t_sbbc1        okay 
SB2/P2         Ambient        okay 
SB2/P3         Ambient        okay 
SB2/P2         Die            okay 
SB2/P3         Die            okay 
SB4            t_sdc0         okay 
SB4            t_ar0          okay 
SB4            t_dx0          okay 
SB4            t_dx1          okay 
SB4            t_dx2          okay 
SB4            t_dx3          okay 
SB4            t_sbbc0        okay 
SB4/P0         Ambient        okay 
SB4/P1         Ambient        okay 
SB4/P0         Die            okay 
SB4/P1         Die            okay 
SB4            t_sbbc1        okay 
SB4/P2         Ambient        okay 
SB4/P3         Ambient        okay 
SB4/P2         Die            okay 
SB4/P3         Die            okay 
IB6            t_ambient0     okay 
IB6            t_ambient1     okay 
IB6            t_sdc0         okay 
IB6            t_ar0          okay 
IB6            t_dx0          okay 
IB6            t_dx1          okay 
IB6            t_sbbc0        okay 
IB6            t_schizo0      okay 
IB6            t_schizo1      okay 
--------------------------------
Voltage sensors:
-------------------------------
Location   Sensor        Status
-------------------------------
SSC1       v_1.5vdc0     okay 
SSC1       v_3.3vdc0     okay 
SSC1       v_5vdc0       okay 
RP0        v_1.5vdc0     okay 
RP0        v_3.3vdc0     okay 
RP2        v_1.5vdc0     okay 
RP2        v_3.3vdc0     okay 
SB0        v_1.5vdc0     okay 
SB0        v_3.3vdc0     okay 
SB0/P0     v_cheetah0    okay 
SB0/P1     v_cheetah1    okay 
SB0/P2     v_cheetah2    okay 
SB0/P3     v_cheetah3    okay 
SB2        v_1.5vdc0     okay 
SB2        v_3.3vdc0     okay 
SB2/P0     v_cheetah0    okay 
SB2/P1     v_cheetah1    okay 
SB2/P2     v_cheetah2    okay 
SB2/P3     v_cheetah3    okay 
SB4        v_1.5vdc0     okay 
SB4        v_3.3vdc0     okay 
SB4/P0     v_cheetah0    okay 
SB4/P1     v_cheetah1    okay 
SB4/P2     v_cheetah2    okay 
SB4/P3     v_cheetah3    okay 
IB6        v_1.5vdc0     okay 
IB6        v_3.3vdc0     okay 
IB6        v_5vdc0       okay 
IB6        v_12vdc0      okay 
IB6        v_3.3vdc1     okay 
IB6        v_3.3vdc2     okay 
IB6        v_1.8vdc0     okay 
IB6        v_2.4vdc0     okay 
PS0        v_input0      okay
PS0        v_output0     okay
PS1        v_input0      okay
PS1        v_output0     okay
PS2        v_input0      okay
PS2        v_output0     okay
PS3        v_input0      okay
PS3        v_output0     okay
--------------------------------------------------
Led State:
--------------------------------------------------
Location   Led                   State       Color
--------------------------------------------------
      -    fault                 OFF         amber           
      -    power                 ON          green           
      -    locator               OFF         white           
      -    top_access            OFF         amber           
      -    alarm1                OFF         amber           
      -    alarm2                OFF         amber           
      -    system                ON          green           
      -    supplyA               ON          green           
      -    supplyB               ON          green           
DISK0      fault                 OFF         amber           
DISK0      power                 ON          green           
DISK0      ok_to_remove          OFF         blue            
DISK1      fault                 OFF         amber           
DISK1      power                 ON          green           
DISK1      ok_to_remove          OFF         blue            
PS0        fault                 OFF         amber           
PS0        power                 ON          green           
PS0        predicted_fault       OFF         amber           
PS1        fault                 OFF         amber           
PS1        power                 ON          green           
PS1        predicted_fault       OFF         amber           
PS2        fault                 OFF         amber           
PS2        power                 ON          green           
PS2        predicted_fault       OFF         amber           
PS3        fault                 OFF         amber           
PS3        power                 ON          green           
PS3        predicted_fault       OFF         amber           
FT0/FAN0   fault                 OFF         amber           
FT0/FAN1   fault                 OFF         amber           
FT0/FAN2   fault                 OFF         amber           
FT0/FAN3   fault                 OFF         amber           
FT0/FAN4   fault                 OFF         amber           
FT0/FAN5   fault                 OFF         amber           
FT0/FAN6   fault                 OFF         amber           
FT0/FAN7   fault                 OFF         amber           
FT0        fault                 OFF         amber           
FT0        power                 ON          green           
FT0        ok_to_remove          OFF         amber           
RP0        fault                 OFF         amber           
RP0        power                 ON          green           
RP0        ok_to_remove          OFF         amber           
RP2        fault                 OFF         amber           
RP2        power                 ON          green           
RP2        ok_to_remove          OFF         amber           
SB0        fault                 OFF         amber           
SB0        power                 ON          green           
SB0        ok_to_remove          OFF         amber           
SB2        fault                 OFF         amber           
SB2        power                 ON          green           
SB2        ok_to_remove          OFF         amber           
SB4        fault                 OFF         amber           
SB4        power                 ON          green           
SB4        ok_to_remove          OFF         amber           
IB6/FAN0   fault                 OFF         amber           
IB6/FAN1   fault                 OFF         amber           
IB6        fault                 OFF         amber           
IB6        power                 ON          green           
IB6        ok_to_remove          OFF         amber           

============================== FRU Operational Status ==============================
-------------------------
Fru Operational Status:
-------------------------
Location        Status   
-------------------------
PS0             okay
PS1             okay
PS2             okay
PS3             okay
FT0             okay
FT0/FAN0        okay
FT0/FAN1        okay
FT0/FAN2        okay
FT0/FAN3        okay
FT0/FAN4        okay
FT0/FAN5        okay
FT0/FAN6        okay
FT0/FAN7        okay
RP0             okay
RP2             okay
SB0             okay
SB0/P0          okay
SB0/P0/B0/D0    okay
SB0/P0/B0/D1    okay
SB0/P0/B0/D2    okay
SB0/P0/B0/D3    okay
SB0/P0/B1/D0    okay
SB0/P0/B1/D1    okay
SB0/P0/B1/D2    okay
SB0/P0/B1/D3    okay
SB0/P1          okay
SB0/P1/B0/D0    okay
SB0/P1/B0/D1    okay
SB0/P1/B0/D2    okay
SB0/P1/B0/D3    okay
SB0/P1/B1/D0    okay
SB0/P1/B1/D1    okay
SB0/P1/B1/D2    okay
SB0/P1/B1/D3    okay
SB0/P2          okay
SB0/P2/B0/D0    okay
SB0/P2/B0/D1    okay
SB0/P2/B0/D2    okay
SB0/P2/B0/D3    okay
SB0/P2/B1/D0    okay
SB0/P2/B1/D1    okay
SB0/P2/B1/D2    okay
SB0/P2/B1/D3    okay
SB0/P3          okay
SB0/P3/B0/D0    okay
SB0/P3/B0/D1    okay
SB0/P3/B0/D2    okay
SB0/P3/B0/D3    okay
SB0/P3/B1/D0    okay
SB0/P3/B1/D1    okay
SB0/P3/B1/D2    okay
SB0/P3/B1/D3    okay
SB2             okay
SB2/P0          okay
SB2/P0/B0/D0    okay
SB2/P0/B0/D1    okay
SB2/P0/B0/D2    okay
SB2/P0/B0/D3    okay
SB2/P0/B1/D0    okay
SB2/P0/B1/D1    okay
SB2/P0/B1/D2    okay
SB2/P0/B1/D3    okay
SB2/P1          okay
SB2/P1/B0/D0    okay
SB2/P1/B0/D1    okay
SB2/P1/B0/D2    okay
SB2/P1/B0/D3    okay
SB2/P1/B1/D0    okay
SB2/P1/B1/D1    okay
SB2/P1/B1/D2    okay
SB2/P1/B1/D3    okay
SB2/P2          okay
SB2/P2/B0/D0    okay
SB2/P2/B0/D1    okay
SB2/P2/B0/D2    okay
SB2/P2/B0/D3    okay
SB2/P2/B1/D0    okay
SB2/P2/B1/D1    okay
SB2/P2/B1/D2    okay
SB2/P2/B1/D3    okay
SB2/P3          okay
SB2/P3/B0/D0    okay
SB2/P3/B0/D1    okay
SB2/P3/B0/D2    okay
SB2/P3/B0/D3    okay
SB2/P3/B1/D0    okay
SB2/P3/B1/D1    okay
SB2/P3/B1/D2    okay
SB2/P3/B1/D3    okay
SB4             okay
SB4/P0          okay
SB4/P0/B0/D0    okay
SB4/P0/B0/D1    okay
SB4/P0/B0/D2    okay
SB4/P0/B0/D3    okay
SB4/P0/B1/D0    okay
SB4/P0/B1/D1    okay
SB4/P0/B1/D2    okay
SB4/P0/B1/D3    okay
SB4/P1          okay
SB4/P1/B0/D0    okay
SB4/P1/B0/D1    okay
SB4/P1/B0/D2    okay
SB4/P1/B0/D3    okay
SB4/P1/B1/D0    okay
SB4/P1/B1/D1    okay
SB4/P1/B1/D2    okay
SB4/P1/B1/D3    okay
SB4/P2          okay
SB4/P2/B0/D0    okay
SB4/P2/B0/D1    okay
SB4/P2/B0/D2    okay
SB4/P2/B0/D3    okay
SB4/P2/B1/D0    okay
SB4/P2/B1/D1    okay
SB4/P2/B1/D2    okay
SB4/P2/B1/D3    okay
SB4/P3          okay
SB4/P3/B0/D0    okay
SB4/P3/B0/D1    okay
SB4/P3/B0/D2    okay
SB4/P3/B0/D3    okay
SB4/P3/B1/D0    okay
SB4/P3/B1/D1    okay
SB4/P3/B1/D2    okay
SB4/P3/B1/D3    okay
IB6             okay
IB6/FAN0        okay
IB6/FAN1        okay

=================================== HW Revisions ===================================
ASIC Revisions:
-------------------------------------------------------------------
Path                   Device           Status             Revision
-------------------------------------------------------------------
/ssm@0,0/pci@18,700000 pci108e,8001     okay               4   
/ssm@0,0/pci@18,600000 pci108e,8001     okay               4   
/ssm@0,0/pci@19,700000 pci108e,8001     okay               4   
/ssm@0,0/pci@19,600000 pci108e,8001     okay               4   




---------- Post updated at 06:40 AM ---------- Previous update was at 06:40 AM ----------

output of "prtdiag -v"


System Configuration: Sun Microsystems  sun4u Sun Fire E2900
System clock frequency: 150 MHZ
Memory size: 64GB       

======================================= CPUs =======================================
               E$          CPU                  CPU
CPU      Freq      Size        Implementation       Mask    Status      Location
-------  --------  ----------  -------------------  -----   ------      --------
  0,512  1050 MHz  16MB        SUNW,UltraSPARC-IV    2.3    on-line     SB0/P0
  1,513  1050 MHz  16MB        SUNW,UltraSPARC-IV    2.3    on-line     SB0/P1
  2,514  1050 MHz  16MB        SUNW,UltraSPARC-IV    2.3    on-line     SB0/P2
  3,515  1050 MHz  16MB        SUNW,UltraSPARC-IV    2.3    on-line     SB0/P3
  8,520  1050 MHz  16MB        SUNW,UltraSPARC-IV    2.3    on-line     SB2/P0
  9,521  1050 MHz  16MB        SUNW,UltraSPARC-IV    2.3    on-line     SB2/P1
 10,522  1050 MHz  16MB        SUNW,UltraSPARC-IV    2.3    on-line     SB2/P2
 11,523  1050 MHz  16MB        SUNW,UltraSPARC-IV    2.3    on-line     SB2/P3
 16,528  1350 MHz  16MB        SUNW,UltraSPARC-IV    3.1    on-line     SB4/P0
 17,529  1350 MHz  16MB        SUNW,UltraSPARC-IV    3.1    on-line     SB4/P1
 18,530  1350 MHz  16MB        SUNW,UltraSPARC-IV    3.1    on-line     SB4/P2
 19,531  1350 MHz  16MB        SUNW,UltraSPARC-IV    3.1    on-line     SB4/P3

==================================== IO Devices ====================================
Bus   Freq      Slot +  Name +
Type  MHz       Status  Path                          Model
----  ----  ----------  ----------------------------  --------------------
pci    33         PCI0  pci100b,35 (network)          SUNW,pci-ce        
                  okay  /ssm@0,0/pci@18,700000/pci@1/network@0

pci    33         PCI0  pci100b,35 (network)          SUNW,pci-ce        
                  okay  /ssm@0,0/pci@18,700000/pci@1/network@1

pci    33         PCI0  scsi-pci1000,b (scsi-2)                          
                  okay  /ssm@0,0/pci@18,700000/pci@1/scsi@2

pci    33         PCI0  scsi-pci1000,b (scsi-2)                          
                  okay  /ssm@0,0/pci@18,700000/pci@1/scsi@2,1

pci    33         PCI1  pci100b,35 (network)          SUNW,pci-ce        
                  okay  /ssm@0,0/pci@18,700000/pci@2/network@0

pci    33         PCI1  pci100b,35 (network)          SUNW,pci-ce        
                  okay  /ssm@0,0/pci@18,700000/pci@2/network@1

pci    33         PCI1  scsi-pci1000,b (scsi-2)                          
                  okay  /ssm@0,0/pci@18,700000/pci@2/scsi@2

pci    33         PCI1  scsi-pci1000,b (scsi-2)                          
                  okay  /ssm@0,0/pci@18,700000/pci@2/scsi@2,1

pci    33         PCI2  QLGC,qla-pci1077,2300 (scsi)                     
                  okay  /ssm@0,0/pci@19,700000/QLGC,qla@1

pci    33         PCI3  SUNW,qlc-pci1077,2300 (scsi-+                    
                  okay  /ssm@0,0/pci@19,700000/SUNW,qlc@2

pci    66            1  pci108e,abba (network)        SUNW,pci-ce        
                  okay  /ssm@0,0/pci@19,600000/network@1

pci    66            2  scsi-pci1000,21 (scsi-2)                         
                  okay  /ssm@0,0/pci@18,600000/scsi@2

pci    66            2  scsi-pci1000,21 (scsi-2)                         
                  okay  /ssm@0,0/pci@18,600000/scsi@2,1

pci    66            2  pci108e,abba (network)        SUNW,pci-ce        
                  okay  /ssm@0,0/pci@19,600000/network@2

pci    33            3  pci1095,646 (ide)                                
                  okay  /ssm@0,0/pci@18,700000/ide@3

pci    33            4  bootbus-controller-sgsbbc     SUNW,sgsbbc        
                  okay  /ssm@0,0/pci@18,700000/bootbus-controller@4


=============================== Memory Configuration ===============================
Segment Table:
-----------------------------------------------------------------------
Base Address       Size       Interleave Factor  Contains
-----------------------------------------------------------------------
0x0                16GB              16          BankIDs 0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15
0x2000000000       16GB              16          BankIDs 32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47
0x4000000000       32GB              16          BankIDs 64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79

Bank Table:
-----------------------------------------------------------
           Physical Location
ID       ControllerID  GroupID   Size       Interleave Way
-----------------------------------------------------------
0        0             0         1GB             0
1        0             1         1GB             4
2        0             0         1GB             8
3        0             1         1GB             12
4        1             0         1GB             1
5        1             1         1GB             5
6        1             0         1GB             9
7        1             1         1GB             13
8        2             0         1GB             2
9        2             1         1GB             6
10       2             0         1GB             10
11       2             1         1GB             14
12       3             0         1GB             3
13       3             1         1GB             7
14       3             0         1GB             11
15       3             1         1GB             15
32       8             0         1GB             0
33       8             1         1GB             4
34       8             0         1GB             8
35       8             1         1GB             12
36       9             0         1GB             1
37       9             1         1GB             5
38       9             0         1GB             9
39       9             1         1GB             13
40       10            0         1GB             2
41       10            1         1GB             6
42       10            0         1GB             10
43       10            1         1GB             14
44       11            0         1GB             3
45       11            1         1GB             7
46       11            0         1GB             11
47       11            1         1GB             15
64       16            0         2GB             0
65       16            1         2GB             4
66       16            0         2GB             8
67       16            1         2GB             12
68       17            0         2GB             1
69       17            1         2GB             5
70       17            0         2GB             9
71       17            1         2GB             13
72       18            0         2GB             2
73       18            1         2GB             6
74       18            0         2GB             10
75       18            1         2GB             14
76       19            0         2GB             3
77       19            1         2GB             7
78       19            0         2GB             11
79       19            1         2GB             15

Memory Module Groups:
--------------------------------------------------
ControllerID   GroupID  Labels         Status
--------------------------------------------------
0              0        SB0/P0/B0/D0   okay
0              0        SB0/P0/B0/D1   okay
0              0        SB0/P0/B0/D2   okay
0              0        SB0/P0/B0/D3   okay
0              1        SB0/P0/B1/D0   okay
0              1        SB0/P0/B1/D1   okay
0              1        SB0/P0/B1/D2   okay
0              1        SB0/P0/B1/D3   okay
1              0        SB0/P1/B0/D0   okay
1              0        SB0/P1/B0/D1   okay
1              0        SB0/P1/B0/D2   okay
1              0        SB0/P1/B0/D3   okay
1              1        SB0/P1/B1/D0   okay
1              1        SB0/P1/B1/D1   okay
1              1        SB0/P1/B1/D2   okay
1              1        SB0/P1/B1/D3   okay
2              0        SB0/P2/B0/D0   okay
2              0        SB0/P2/B0/D1   okay
2              0        SB0/P2/B0/D2   okay
2              0        SB0/P2/B0/D3   okay
2              1        SB0/P2/B1/D0   okay
2              1        SB0/P2/B1/D1   okay
2              1        SB0/P2/B1/D2   okay
2              1        SB0/P2/B1/D3   okay
3              0        SB0/P3/B0/D0   okay
3              0        SB0/P3/B0/D1   okay
3              0        SB0/P3/B0/D2   okay
3              0        SB0/P3/B0/D3   okay
3              1        SB0/P3/B1/D0   okay
3              1        SB0/P3/B1/D1   okay
3              1        SB0/P3/B1/D2   okay
3              1        SB0/P3/B1/D3   okay
8              0        SB2/P0/B0/D0   okay
8              0        SB2/P0/B0/D1   okay
8              0        SB2/P0/B0/D2   okay
8              0        SB2/P0/B0/D3   okay
8              1        SB2/P0/B1/D0   okay
8              1        SB2/P0/B1/D1   okay
8              1        SB2/P0/B1/D2   okay
8              1        SB2/P0/B1/D3   okay
9              0        SB2/P1/B0/D0   okay
9              0        SB2/P1/B0/D1   okay
9              0        SB2/P1/B0/D2   okay
9              0        SB2/P1/B0/D3   okay
9              1        SB2/P1/B1/D0   okay
9              1        SB2/P1/B1/D1   okay
9              1        SB2/P1/B1/D2   okay
9              1        SB2/P1/B1/D3   okay
10             0        SB2/P2/B0/D0   okay
10             0        SB2/P2/B0/D1   okay
10             0        SB2/P2/B0/D2   okay
10             0        SB2/P2/B0/D3   okay
10             1        SB2/P2/B1/D0   okay
10             1        SB2/P2/B1/D1   okay
10             1        SB2/P2/B1/D2   okay
10             1        SB2/P2/B1/D3   okay
11             0        SB2/P3/B0/D0   okay
11             0        SB2/P3/B0/D1   okay
11             0        SB2/P3/B0/D2   okay
11             0        SB2/P3/B0/D3   okay
11             1        SB2/P3/B1/D0   okay
11             1        SB2/P3/B1/D1   okay
11             1        SB2/P3/B1/D2   okay
11             1        SB2/P3/B1/D3   okay
16             0        SB4/P0/B0/D0   okay
16             0        SB4/P0/B0/D1   okay
16             0        SB4/P0/B0/D2   okay
16             0        SB4/P0/B0/D3   okay
16             1        SB4/P0/B1/D0   okay
16             1        SB4/P0/B1/D1   okay
16             1        SB4/P0/B1/D2   okay
16             1        SB4/P0/B1/D3   okay
17             0        SB4/P1/B0/D0   okay
17             0        SB4/P1/B0/D1   okay
17             0        SB4/P1/B0/D2   okay
17             0        SB4/P1/B0/D3   okay
17             1        SB4/P1/B1/D0   okay
17             1        SB4/P1/B1/D1   okay
17             1        SB4/P1/B1/D2   okay
17             1        SB4/P1/B1/D3   okay
18             0        SB4/P2/B0/D0   okay
18             0        SB4/P2/B0/D1   okay
18             0        SB4/P2/B0/D2   okay
18             0        SB4/P2/B0/D3   okay
18             1        SB4/P2/B1/D0   okay
18             1        SB4/P2/B1/D1   okay
18             1        SB4/P2/B1/D2   okay
18             1        SB4/P2/B1/D3   okay
19             0        SB4/P3/B0/D0   okay
19             0        SB4/P3/B0/D1   okay
19             0        SB4/P3/B0/D2   okay
19             0        SB4/P3/B0/D3   okay
19             1        SB4/P3/B1/D0   okay
19             1        SB4/P3/B1/D1   okay
19             1        SB4/P3/B1/D2   okay
19             1        SB4/P3/B1/D3   okay

=============================== Environmental Status ===============================
Fan Status:
---------------------------------------
Location       Sensor          Status          
---------------------------------------
FT0/FAN0       ft_fan0         self-regulating 
FT0/FAN1       ft_fan1         self-regulating 
FT0/FAN2       ft_fan2         self-regulating 
FT0/FAN3       ft_fan3         self-regulating 
FT0/FAN4       ft_fan4         self-regulating 
FT0/FAN5       ft_fan5         self-regulating 
FT0/FAN6       ft_fan6         self-regulating 
FT0/FAN7       ft_fan7         self-regulating 
IB6/FAN0       ft_fan0         okay
IB6/FAN1       ft_fan1         okay

---------------------------------------
Temperature sensors:
------------------------------------
Location       Sensor         Status
------------------------------------
SSC1           t_sbbc0        okay 
SSC1           t_cbh0         okay 
SSC1           t_ambient0     okay 
SSC1           t_ambient1     okay 
SSC1           t_ambient2     okay 
RP0            t_ambient0     okay 
RP0            t_ambient1     okay 
RP0            t_sdc0         okay 
RP0            t_ar0          okay 
RP0            t_dx0          okay 
RP0            t_dx1          okay 
RP2            t_ambient0     okay 
RP2            t_ambient1     okay 
RP2            t_sdc0         okay 
RP2            t_ar0          okay 
RP2            t_dx0          okay 
RP2            t_dx1          okay 
SB0            t_sdc0         okay 
SB0            t_ar0          okay 
SB0            t_dx0          okay 
SB0            t_dx1          okay 
SB0            t_dx2          okay 
SB0            t_dx3          okay 
SB0            t_sbbc0        okay 
SB0/P0         Ambient        okay 
SB0/P1         Ambient        okay 
SB0/P0         Die            okay 
SB0/P1         Die            okay 
SB0            t_sbbc1        okay 
SB0/P2         Ambient        okay 
SB0/P3         Ambient        okay 
SB0/P2         Die            okay 
SB0/P3         Die            okay 
SB2            t_sdc0         okay 
SB2            t_ar0          okay 
SB2            t_dx0          okay 
SB2            t_dx1          okay 
SB2            t_dx2          okay 
SB2            t_dx3          okay 
SB2            t_sbbc0        okay 
SB2/P0         Ambient        okay 
SB2/P1         Ambient        okay 
SB2/P0         Die            okay 
SB2/P1         Die            okay 
SB2            t_sbbc1        okay 
SB2/P2         Ambient        okay 
SB2/P3         Ambient        okay 
SB2/P2         Die            okay 
SB2/P3         Die            okay 
SB4            t_sdc0         okay 
SB4            t_ar0          okay 
SB4            t_dx0          okay 
SB4            t_dx1          okay 
SB4            t_dx2          okay 
SB4            t_dx3          okay 
SB4            t_sbbc0        okay 
SB4/P0         Ambient        okay 
SB4/P1         Ambient        okay 
SB4/P0         Die            okay 
SB4/P1         Die            okay 
SB4            t_sbbc1        okay 
SB4/P2         Ambient        okay 
SB4/P3         Ambient        okay 
SB4/P2         Die            okay 
SB4/P3         Die            okay 
IB6            t_ambient0     okay 
IB6            t_ambient1     okay 
IB6            t_sdc0         okay 
IB6            t_ar0          okay 
IB6            t_dx0          okay 
IB6            t_dx1          okay 
IB6            t_sbbc0        okay 
IB6            t_schizo0      okay 
IB6            t_schizo1      okay 
--------------------------------
Voltage sensors:
-------------------------------
Location   Sensor        Status
-------------------------------
SSC1       v_1.5vdc0     okay 
SSC1       v_3.3vdc0     okay 
SSC1       v_5vdc0       okay 
RP0        v_1.5vdc0     okay 
RP0        v_3.3vdc0     okay 
RP2        v_1.5vdc0     okay 
RP2        v_3.3vdc0     okay 
SB0        v_1.5vdc0     okay 
SB0        v_3.3vdc0     okay 
SB0/P0     v_cheetah0    okay 
SB0/P1     v_cheetah1    okay 
SB0/P2     v_cheetah2    okay 
SB0/P3     v_cheetah3    okay 
SB2        v_1.5vdc0     okay 
SB2        v_3.3vdc0     okay 
SB2/P0     v_cheetah0    okay 
SB2/P1     v_cheetah1    okay 
SB2/P2     v_cheetah2    okay 
SB2/P3     v_cheetah3    okay 
SB4        v_1.5vdc0     okay 
SB4        v_3.3vdc0     okay 
SB4/P0     v_cheetah0    okay 
SB4/P1     v_cheetah1    okay 
SB4/P2     v_cheetah2    okay 
SB4/P3     v_cheetah3    okay 
IB6        v_1.5vdc0     okay 
IB6        v_3.3vdc0     okay 
IB6        v_5vdc0       okay 
IB6        v_12vdc0      okay 
IB6        v_3.3vdc1     okay 
IB6        v_3.3vdc2     okay 
IB6        v_1.8vdc0     okay 
IB6        v_2.4vdc0     okay 
PS0        v_input0      okay
PS0        v_output0     okay
PS1        v_input0      okay
PS1        v_output0     okay
PS2        v_input0      okay
PS2        v_output0     okay
PS3        v_input0      okay
PS3        v_output0     okay
--------------------------------------------------
Led State:
--------------------------------------------------
Location   Led                   State       Color
--------------------------------------------------
      -    fault                 OFF         amber           
      -    power                 ON          green           
      -    locator               OFF         white           
      -    top_access            OFF         amber           
      -    alarm1                OFF         amber           
      -    alarm2                OFF         amber           
      -    system                ON          green           
      -    supplyA               ON          green           
      -    supplyB               ON          green           
DISK0      fault                 OFF         amber           
DISK0      power                 ON          green           
DISK0      ok_to_remove          OFF         blue            
DISK1      fault                 OFF         amber           
DISK1      power                 ON          green           
DISK1      ok_to_remove          OFF         blue            
PS0        fault                 OFF         amber           
PS0        power                 ON          green           
PS0        predicted_fault       OFF         amber           
PS1        fault                 OFF         amber           
PS1        power                 ON          green           
PS1        predicted_fault       OFF         amber           
PS2        fault                 OFF         amber           
PS2        power                 ON          green           
PS2        predicted_fault       OFF         amber           
PS3        fault                 OFF         amber           
PS3        power                 ON          green           
PS3        predicted_fault       OFF         amber           
FT0/FAN0   fault                 OFF         amber           
FT0/FAN1   fault                 OFF         amber           
FT0/FAN2   fault                 OFF         amber           
FT0/FAN3   fault                 OFF         amber           
FT0/FAN4   fault                 OFF         amber           
FT0/FAN5   fault                 OFF         amber           
FT0/FAN6   fault                 OFF         amber           
FT0/FAN7   fault                 OFF         amber           
FT0        fault                 OFF         amber           
FT0        power                 ON          green           
FT0        ok_to_remove          OFF         amber           
RP0        fault                 OFF         amber           
RP0        power                 ON          green           
RP0        ok_to_remove          OFF         amber           
RP2        fault                 OFF         amber           
RP2        power                 ON          green           
RP2        ok_to_remove          OFF         amber           
SB0        fault                 OFF         amber           
SB0        power                 ON          green           
SB0        ok_to_remove          OFF         amber           
SB2        fault                 OFF         amber           
SB2        power                 ON          green           
SB2        ok_to_remove          OFF         amber           
SB4        fault                 OFF         amber           
SB4        power                 ON          green           
SB4        ok_to_remove          OFF         amber           
IB6/FAN0   fault                 OFF         amber           
IB6/FAN1   fault                 OFF         amber           
IB6        fault                 OFF         amber           
IB6        power                 ON          green           
IB6        ok_to_remove          OFF         amber           

============================== FRU Operational Status ==============================
-------------------------
Fru Operational Status:
-------------------------
Location        Status   
-------------------------
PS0             okay
PS1             okay
PS2             okay
PS3             okay
FT0             okay
FT0/FAN0        okay
FT0/FAN1        okay
FT0/FAN2        okay
FT0/FAN3        okay
FT0/FAN4        okay
FT0/FAN5        okay
FT0/FAN6        okay
FT0/FAN7        okay
RP0             okay
RP2             okay
SB0             okay
SB0/P0          okay
SB0/P0/B0/D0    okay
SB0/P0/B0/D1    okay
SB0/P0/B0/D2    okay
SB0/P0/B0/D3    okay
SB0/P0/B1/D0    okay
SB0/P0/B1/D1    okay
SB0/P0/B1/D2    okay
SB0/P0/B1/D3    okay
SB0/P1          okay
SB0/P1/B0/D0    okay
SB0/P1/B0/D1    okay
SB0/P1/B0/D2    okay
SB0/P1/B0/D3    okay
SB0/P1/B1/D0    okay
SB0/P1/B1/D1    okay
SB0/P1/B1/D2    okay
SB0/P1/B1/D3    okay
SB0/P2          okay
SB0/P2/B0/D0    okay
SB0/P2/B0/D1    okay
SB0/P2/B0/D2    okay
SB0/P2/B0/D3    okay
SB0/P2/B1/D0    okay
SB0/P2/B1/D1    okay
SB0/P2/B1/D2    okay
SB0/P2/B1/D3    okay
SB0/P3          okay
SB0/P3/B0/D0    okay
SB0/P3/B0/D1    okay
SB0/P3/B0/D2    okay
SB0/P3/B0/D3    okay
SB0/P3/B1/D0    okay
SB0/P3/B1/D1    okay
SB0/P3/B1/D2    okay
SB0/P3/B1/D3    okay
SB2             okay
SB2/P0          okay
SB2/P0/B0/D0    okay
SB2/P0/B0/D1    okay
SB2/P0/B0/D2    okay
SB2/P0/B0/D3    okay
SB2/P0/B1/D0    okay
SB2/P0/B1/D1    okay
SB2/P0/B1/D2    okay
SB2/P0/B1/D3    okay
SB2/P1          okay
SB2/P1/B0/D0    okay
SB2/P1/B0/D1    okay
SB2/P1/B0/D2    okay
SB2/P1/B0/D3    okay
SB2/P1/B1/D0    okay
SB2/P1/B1/D1    okay
SB2/P1/B1/D2    okay
SB2/P1/B1/D3    okay
SB2/P2          okay
SB2/P2/B0/D0    okay
SB2/P2/B0/D1    okay
SB2/P2/B0/D2    okay
SB2/P2/B0/D3    okay
SB2/P2/B1/D0    okay
SB2/P2/B1/D1    okay
SB2/P2/B1/D2    okay
SB2/P2/B1/D3    okay
SB2/P3          okay
SB2/P3/B0/D0    okay
SB2/P3/B0/D1    okay
SB2/P3/B0/D2    okay
SB2/P3/B0/D3    okay
SB2/P3/B1/D0    okay
SB2/P3/B1/D1    okay
SB2/P3/B1/D2    okay
SB2/P3/B1/D3    okay
SB4             okay
SB4/P0          okay
SB4/P0/B0/D0    okay
SB4/P0/B0/D1    okay
SB4/P0/B0/D2    okay
SB4/P0/B0/D3    okay
SB4/P0/B1/D0    okay
SB4/P0/B1/D1    okay
SB4/P0/B1/D2    okay
SB4/P0/B1/D3    okay
SB4/P1          okay
SB4/P1/B0/D0    okay
SB4/P1/B0/D1    okay
SB4/P1/B0/D2    okay
SB4/P1/B0/D3    okay
SB4/P1/B1/D0    okay
SB4/P1/B1/D1    okay
SB4/P1/B1/D2    okay
SB4/P1/B1/D3    okay
SB4/P2          okay
SB4/P2/B0/D0    okay
SB4/P2/B0/D1    okay
SB4/P2/B0/D2    okay
SB4/P2/B0/D3    okay
SB4/P2/B1/D0    okay
SB4/P2/B1/D1    okay
SB4/P2/B1/D2    okay
SB4/P2/B1/D3    okay
SB4/P3          okay
SB4/P3/B0/D0    okay
SB4/P3/B0/D1    okay
SB4/P3/B0/D2    okay
SB4/P3/B0/D3    okay
SB4/P3/B1/D0    okay
SB4/P3/B1/D1    okay
SB4/P3/B1/D2    okay
SB4/P3/B1/D3    okay
IB6             okay
IB6/FAN0        okay
IB6/FAN1        okay

=================================== HW Revisions ===================================
ASIC Revisions:
-------------------------------------------------------------------
Path                   Device           Status             Revision
-------------------------------------------------------------------
/ssm@0,0/pci@18,700000 pci108e,8001     okay               4   
/ssm@0,0/pci@18,600000 pci108e,8001     okay               4   
/ssm@0,0/pci@19,700000 pci108e,8001     okay               4   
/ssm@0,0/pci@19,600000 pci108e,8001     okay               4   


In this kind of panic and to find the root cause, it is not so straight forward. Need to analyse the crashdump.

Document Audience: PUBLIC
Document ID: 200864
Title: Security Vulnerability in the TCP Implementation of Solaris Systems May Allow a Denial of Service When Accepting New Connections While Undergoing a TCP "SYN Flood" Attack
Copyright Notice: Copyright ? 2008 Sun Microsystems, Inc. All Rights Reserved
Update Date: Wed Jul 30 00:00:00 MDT 2008

Solution Type Sun Alert

Solution 200864 : Security Vulnerability in the TCP Implementation of Solaris Systems May Allow a Denial of Service When Accepting New Connections While Undergoing a TCP "SYN Flood" Attack
Related Categories
Home>Content>Sun Alert Criteria Categories>Security

Home>Content>Sun Alert Release Phase>Resolved

Bug ID
6402737

Product
Solaris 8 Operating System, Solaris 9 Operating System, Solaris 10 Operating System

Date of Resolved Release
06-May-2008

SA Document Body
Security Vulnerability in the TCP Implementation of Solaris Systems May Allow a Denial of Service When Accepting New Connections While Undergoing a TCP "SYN Flood" Attack

  1. Impact

A security vulnerability in the TCP implementation of Solaris 8, 9 and 10 may allow a remote unprivileged user to cause a Solaris system which is undergoing a "TCP SYN" flood condition to be slow to accept new network connections. Such network connections may time out without establishing a connection. This would lead to a Denial of Service (DoS) to the network services provided by that system. In addition, a uniprocessor system may also experience overall slowdown due to high CPU usage, resulting in a Denial of Service to the system as a whole.

  1. Contributing Factors

This issue can occur in the following releases:

SPARC Platform
Solaris 8 without patch 116965-33
Solaris 9 without patch 114344-35
Solaris 10 without patch 119998-01

x86 Platform
Solaris 8 without patch 116966-32
Solaris 9 without patch 119435-23
Solaris 10 without patch 119999-01

Note: This issue affects hosts which have a value for the ndd(1M) tunable 'tcp_conn_req_max_q0' which is considerably higher than the default value of 1024. The higher the value, the greater the impact of this issue if it is exploited on a host. While a value close to or less than 1024 does not make the system immune to a Denial of Service, it decreases the impact of a DoS on the system.

To determine the value of the 'tcp_conn_req_max_q0' tunable, the following command can be used:
$ ndd -get /dev/tcp tcp_conn_req_max_q0
1024

  1. Symptoms

If this issue is exploited, the following message may be seen on the console:
WARNING: High TCP connect timeout rate!
System (port <port number>) may be under a SYN flood attack

  1. Workaround

To work around the described issue, make sure the value of the ndd(1M) tunable 'tcp_conn_req_max_q0' for TCP is not much higher than the default of 1024, using commands such as the following:
$ ndd -get /dev/tcp tcp_conn_req_max_q0
4000
$ ndd -set /dev/tcp tcp_conn_req_max_q0 1024
$ ndd -get /dev/tcp tcp_conn_req_max_q0
1024

  1. Resolution

This issue is addressed in the following releases:

SPARC Platform
Solaris 8 with patch116965-33 or later
Solaris 9 with patch 114344-35 or later
Solaris 10 with patch 119998-01 or later

x86 Platform
Solaris 8 with patch 116966-32 or later
Solaris 9 with patch 119435-23 or later
Solaris 10 with patch 119999-01 or later
Note: There are additional Solaris 8 and 9 patches which list 6402737 in their README, however these patches are not required to address the issue described in this Sun Alert. These additional patches deliver an updated kernel debugger (kadb(1M)). The patch-IDs are:

SPARC Platform
Solaris 8 patch 117350-54 or later
Solaris 9 patch 122300-25 or later
x86 Platform
Solaris 8 patch 117351-54 or later
Solaris 9 patch 122301-25 or later

Thanks man.

I'm not knowledgeable when it comes to Crash dump analysis.

The document you provided is very helpful, and I don't have that patch installed on the system in question, so it's very possible.

I'll try to patch and the system.

Did the server actually panic I cant see any panic string.

The problems I see could have made the server sluggish or hang it.
The first messages has to do with veritas volumemanager/filesystem
and you are having problems with the fibre connection to the SUN3510 raid.

I would update HBA card driver (sun would probably tell you to ugrade tha SAN "package" its varios patches) ,firmware in the 3510 array and check
fibre cables and "GBICS"

The volume manager error can be ignored.
Dtrace probes cause error message "fbt: WARNING: couldn't allocate FBT table for module vxio" to appear in system logs

Actually yes, the server crash, and under /var/crash I have unix.0, vmcore.0 , and bounds files.

3510 FC firmware is latest.

I agree regarding the driver, I found the server patch level is kind of old, so my colleague installed the latest patches and upgraded drivers. He kept it under observation.