Cannot configure RAID on T5240

delavega · April 26, 2013, 8:38am

Hi !

I've been given a T5240 with 4 disks and 2 HBA cards (but no array connected). I did a factory reset on SP and NVRAM clean on OBP because the server had been used before.

I boot cdrom in single mode and try to create a hw mirror with disks from c1... but only c2 is seen by raidctl.

# raidctl
Controller: 2
#
#
# format
Searching for disks...done

AVAILABLE DISK SELECTIONS:
       0. c1t0d0 <Sun-STK RAID INT-V1.0-68.25GB>
          /pci@400/pci@0/pci@c/scsi@0/disk@0,0
       1. c1t1d0 <Sun-STK RAID INT-V1.0-68.25GB>
          /pci@400/pci@0/pci@c/scsi@0/disk@1,0
       2. c1t2d0 <Sun-STK RAID INT-V1.0-68.25GB>
          /pci@400/pci@0/pci@c/scsi@0/disk@2,0
       3. c1t3d0 <Sun-STK RAID INT-V1.0-68.25GB>
          /pci@400/pci@0/pci@c/scsi@0/disk@3,0
Specify disk (enter its number): ^C

# cfgadm -avl
Ap_Id                          Receptacle   Occupant     Condition  Information
When         Type         Busy     Phys_Id
c1                             connected    configured   unknown
unavailable  scsi-bus     n        /devices/pci@400/pci@0/pci@c/scsi@0:scsi
c1::dsk/c1t0d0                 connected    configured   unknown    Sun STK RAID INT
unavailable  disk         n        /devices/pci@400/pci@0/pci@c/scsi@0:scsi::dsk/c1t0d0
c1::dsk/c1t1d0                 connected    configured   unknown    Sun STK RAID INT
unavailable  disk         n        /devices/pci@400/pci@0/pci@c/scsi@0:scsi::dsk/c1t1d0
c1::dsk/c1t2d0                 connected    configured   unknown    Sun STK RAID INT
unavailable  disk         n        /devices/pci@400/pci@0/pci@c/scsi@0:scsi::dsk/c1t2d0
c1::dsk/c1t3d0                 connected    configured   unknown    Sun STK RAID INT
unavailable  disk         n        /devices/pci@400/pci@0/pci@c/scsi@0:scsi::dsk/c1t3d0
c2                             connected    unconfigured unknown
unavailable  scsi-sata    n        /devices/pci@400/pci@0/pci@8/scsi@0:scsi
c3                             connected    unconfigured unknown
unavailable  fc           n        /devices/pci@400/pci@0/pci@9/SUNW,qlc@0/fp@0,0:fc
c4                             connected    unconfigured unknown
unavailable  fc           n        /devices/pci@400/pci@0/pci@9/SUNW,qlc@0,1/fp@0,0:fc
c5                             connected    unconfigured unknown
unavailable  fc           n        /devices/pci@400/pci@0/pci@d/SUNW,qlc@0/fp@0,0:fc
c6                             connected    unconfigured unknown
unavailable  fc           n        /devices/pci@400/pci@0/pci@d/SUNW,qlc@0,1/fp@0,0:fc
usb0/1                         empty        unconfigured ok
unavailable  unknown      n        /devices/pci@400/pci@0/pci@1/pci@0/usb@0:1
usb0/2                         empty        unconfigured ok
unavailable  unknown      n        /devices/pci@400/pci@0/pci@1/pci@0/usb@0:2
usb0/3                         empty        unconfigured ok
unavailable  unknown      n        /devices/pci@400/pci@0/pci@1/pci@0/usb@0:3
usb1/1                         empty        unconfigured ok
unavailable  unknown      n        /devices/pci@400/pci@0/pci@1/pci@0/usb@0,1:1
usb1/2                         empty        unconfigured ok
unavailable  unknown      n        /devices/pci@400/pci@0/pci@1/pci@0/usb@0,1:2
usb2/1                         empty        unconfigured ok
unavailable  unknown      n        /devices/pci@400/pci@0/pci@1/pci@0/usb@0,2:1
usb2/2                         connected    configured   ok         Mfg: Texas Instruments Incorporated  Product: 6250 FW: 03.05.02.22.562AD423  NConfigs: 1  Config: 0  <no cfg str descr>
unavailable  usb-storage  n        /devices/pci@400/pci@0/pci@1/pci@0/usb@0,2:2
usb2/3                         empty        unconfigured ok
unavailable  unknown      n        /devices/pci@400/pci@0/pci@1/pci@0/usb@0,2:3
usb2/4                         connected    configured   ok         Mfg: <undef>  Product: <undef>  NConfigs: 1  Config: 0  <no cfg str descr>
unavailable  usb-hub      n        /devices/pci@400/pci@0/pci@1/pci@0/usb@0,2:4
usb2/4.1                       empty        unconfigured ok
unavailable  unknown      n        /devices/pci@400/pci@0/pci@1/pci@0/usb@0,2/hub@4:4.1
usb2/4.2                       empty        unconfigured ok
unavailable  unknown      n        /devices/pci@400/pci@0/pci@1/pci@0/usb@0,2/hub@4:4.2
usb2/4.3                       empty        unconfigured ok
unavailable  unknown      n        /devices/pci@400/pci@0/pci@1/pci@0/usb@0,2/hub@4:4.3
usb2/4.4                       empty        unconfigured ok
unavailable  unknown      n        /devices/pci@400/pci@0/pci@1/pci@0/usb@0,2/hub@4:4.4
usb2/5                         empty        unconfigured ok
unavailable  unknown      n        /devices/pci@400/pci@0/pci@1/pci@0/usb@0,2:5
#

On the OBP :

{0} ok probe-scsi-all
/pci@400/pci@0/pci@d/SUNW,qlc@0,1
QLogic QLE2462 Host Adapter Driver(SPARC): 1.24  11/15/06
Firmware version 4.00.26
Fibre Channel Link down
Possible causes: No cable, incorrect connection mode or data rate

/pci@400/pci@0/pci@d/SUNW,qlc@0
QLogic QLE2462 Host Adapter Driver(SPARC): 1.24  11/15/06
Firmware version 4.00.26
Fibre Channel Link down
Possible causes: No cable, incorrect connection mode or data rate

/pci@400/pci@0/pci@c/scsi@0
Waiting for AAC Controller to start: . . Started

AAC Kernel Version: 15825

Target 0 Volume 0
  Unit 0   Disk     Adaptec RAID ASR5805    V1.0    143134721 Blocks, 73 GB
Target 1 Volume 1
  Unit 0   Disk     Adaptec RAID ASR5805    V1.0    143132673 Blocks, 73 GB
Target 2 Volume 2
  Unit 0   Disk     Adaptec RAID ASR5805    V1.0    143134721 Blocks, 73 GB
Target 3 Volume 3
  Unit 0   Disk     Adaptec RAID ASR5805    V1.0    143134721 Blocks, 73 GB

/pci@400/pci@0/pci@9/SUNW,qlc@0,1
QLogic QLE2462 Host Adapter Driver(SPARC): 1.24  11/15/06
Firmware version 4.00.26
Fibre Channel Link down
Possible causes: No cable, incorrect connection mode or data rate

/pci@400/pci@0/pci@9/SUNW,qlc@0
QLogic QLE2462 Host Adapter Driver(SPARC): 1.24  11/15/06
Firmware version 4.00.26
Fibre Channel Link down
Possible causes: No cable, incorrect connection mode or data rate

/pci@400/pci@0/pci@8/scsi@0

MPT Version 1.05, Firmware Version 1.27.00.00

ERROR: /pci@400: Last Trap: Fast Data Access MMU Miss

{0} ok

Got an idea ?

hicksd8 · April 26, 2013, 10:45am

I've looked through your post and wow(!) you seem to have a real box of tricks there obviously used with a lot of storage in the past.

I've tried to digest the information you have given but it is incomplete so I'm going to just write a few things that might help and then ask you to post back further questions. You need to do some Google research yourself on the products in there.

Firstly, you've got two QLogic QLE2462 (Google that) fibre channel controllers in there (either both on one card) or more likely two separate cards with no disk drives attached. To simplify things I would take the lid of the box and pull them out.

There also seems to be an Adaptec RAID ASR5805 (Google that) card in there that has four disks attached.

The Sun T5240 has an on-board RAID (1 and 0) controller which is a LSI brand. The command for managing that one is raidctl; a command you have tried. Try using the -S switch with raidctl which will tell you the existing status/configuration. It looks like there are no disks attached to that one either but see what

raidctl -S

tells you.

Research the Adaptec (Google) for documentation and command set to control that one.

By defaulting the OBP and NVRAM you will have reset the Sun hardware but NOT any RAID configuration on any of these cards. Therefore, if there is still a RAID array configured, it may be masking the existence of one or more disks and presenting them to the system as one LUN.

As I said, research all this stuff and post back your progress and any questions.

Really hope that helps.

After thought......you might be able to disconnect the disks from the add-on Adaptec controller (and remove it) and reconnect them to the on-board LSI if they are compatible drives (SATA vs SCSI vs SAS or whatever).

Sun (StorageTek) OEM's the Adaptec ASR 5805..........

delavega · April 29, 2013, 8:57am

Hi ! I finally managed to configure a RAID 1 with arcconf command (found on Intel RAID card LiveCD). I may come back on this thread soon, as I have some problem with additional disks : hot insertion detected by SP but not in OBP..