Hi,
I got a (used) server to install Solaris 11 and wipe out every information on existing disks. There are 6 disks of 300GB and two disks of 146GB. I am not able to figure out, how to find out RAID (if there is any) and break it. Can anybody help me with that ? Below is configuration. I have installed OS on c2t0d0.
root@predb-dev2:~# echo|format
Searching for disks...done
AVAILABLE DISK SELECTIONS:
0. c2t0d0 <Sun-STKRAIDINT-V1.0 cyl 17831 alt 2 hd 255 sec 63>
/pci@0/pci@0/pci@9/scsi@0/disk@0,0
1. c2t1d0 <Sun-STKRAIDINT-V1.0 cyl 36417 alt 2 hd 255 sec 63>
/pci@0/pci@0/pci@9/scsi@0/disk@1,0
Specify disk (enter its number): Specify disk (enter its number):
root@predb-dev2:~#
root@predb-dev2:~# iostat -En
c2t1d0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: Sun Product: STK RAID INT Revision: V1.0 Serial No: E0A48F26
Size: 299.56GB <299562434560 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 3 Predictive Failure Analysis: 0 Non-Aligned Writes: 0
c2t0d0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: Sun Product: STK RAID INT Revision: V1.0 Serial No: 13187F26
Size: 146.68GB <146684248064 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 3 Predictive Failure Analysis: 0 Non-Aligned Writes: 0
c1t0d0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: TSSTcorp Product: CD/DVDW TS-T632A Revision: SR03 Serial No:
Size: 0.00GB <0 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 6 Predictive Failure Analysis: 0 Non-Aligned Writes: 0
root@predb-dev2:~#
root@predb-dev2:~# raidctl
Controller: 3
root@predb-dev2:~#
root@predb-dev2:~# raidctl -l 3
Controller Type Version
----------------------------------------------------------------
c3 LSI_1068E 1.22.00.00
root@predb-dev2:~#
root@predb-dev2:~# cfgadm -al
Ap_Id Type Receptacle Occupant Condition
c2 scsi-bus connected configured unknown
c2::dsk/c2t0d0 disk connected configured unknown
c2::dsk/c2t1d0 disk connected configured unknown
c3 scsi-sas connected unconfigured unknown
usb0/1 unknown empty unconfigured ok
usb0/2 unknown empty unconfigured ok
usb0/3 unknown empty unconfigured ok
usb1/1 unknown empty unconfigured ok
usb1/2 unknown empty unconfigured ok
usb2/1 unknown empty unconfigured ok
usb2/2 usb-storage connected configured ok
usb2/3 unknown empty unconfigured ok
usb2/4 usb-hub connected configured ok
usb2/4.1 unknown empty unconfigured ok
usb2/4.2 unknown empty unconfigured ok
usb2/4.3 unknown empty unconfigured ok
usb2/4.4 unknown empty unconfigured ok
usb2/5 unknown empty unconfigured ok
root@predb-dev2:~#
Thanks much. It was very helpful.
I booted from RAID Management DVD and ran "arcconf DELETE 1 LOGICALDRIVE ALL"
That wiped out installed OS also, which is OK for me. I am booting from Solaris 11 OS DVD now, but it says "OS can not be installed on any of the disks". I checked in "shell" and it doesn't see any disk now
To select the language you wish to use, enter a number [default is 3]:
User selected: English
Configuring devices.
Hostname: solaris
Welcome to the Oracle Solaris installation menu
1 Install Oracle Solaris
2 Install Additional Drivers
3 Shell
4 Terminal type (currently xterm)
5 Reboot
Please enter a number [1]: 3
To return to the main menu, exit the shell
root@solaris:/root# echo|format
Searching for disks...done
No disks found!
root@solaris:/root#
---------- Post updated at 09:27 PM ---------- Previous update was at 09:19 PM ----------
However, on OBP level, I can see below output
{0} ok show-disks
a) /pci@0/pci@0/pci@9/scsi@0/disk
b) /pci@0/pci@0/pci@2/scsi@0/disk
c) /pci@0/pci@0/pci@1/pci@0/pci@1/pci@0/usb@0,2/storage@2/disk
q) NO SELECTION
Enter Selection, q to quit:
You have used the STK RAID Live CD which DukeNuke2 told you to download to wipe existing RAID arrays from the STK controller. You can now see no disks from Solaris. That is correct behaviour.
Solaris will only see RAID arrays configured via the STK management suite (which on initialisation, will be automatically mapped to the host - Solaris).
It is likely that the previous sysadmin had a RAID1 (mirror) array configured for the root disk of 2 x 146GB giving a usable capacity of 146GB, plus a RAID5 array of 6 x 300GB for data giving a usable capacity of 1.5TB. That's why you could see only 2 disks originally.
Solaris will NOT see all 8 disks together only the result of each RAID array you create with the STK Manager as a single disk.
So you need to boot into the STK Manager again and create the arrays you want, then each of them will appear as a disk to Solaris.
Got some idea with your explanation and documentation.
I wanted to use "no RIAD" at all and just want standard zfs mirror with two disks of 146GB. For other 300 GB disks, I will figure later, what needs to be done.
Here, don't I have option to, not use STK RAID at all and just see all disks in format output as standard ?
I am still learning this suite and going through documentations, but any quick help would be appreciated.
Okay, some of what I'm about to say I'm guessing....please note that....
Is the Storagetek controller an add-in card? Or is it built into the motherboard?
If it's add-in you might be able to pull out the card and connect the ribbon cables from the disks to the motherboard. I'm really not sure. Anybody know amongst all the Sun experts on here?
Otherwise, there may be a "pass-through" option on the STK Manager to simply map raw disks (without RAID) to Solaris. That needs investigation unless another member with better knowledge of STK than me chips in.
---------- Post updated at 06:25 PM ---------- Previous update was at 06:08 PM ----------
It looks like if you don't want RAID (other than RAID0 or RAID1 which the motherboard provides according to this pdf), just pull the card out. (Don't throw it away because it's worth money!!!)
---------- Post updated at 06:31 PM ---------- Previous update was at 06:25 PM ----------
It would still be better to do a pass-through of drives from the STK if that's possible.
Let me go to DC and open server, will try to figure it
-------------------------------------------------------------------
Removing card and messing with connections and MB was not agreed with management and they said to go with RAID 1 for rpool and RAID 5 for application/db filesystems.
Do we have any tools/utility, which can be managed from OS level and we can check status/configuration from there ?
All I can see is below, but it is not giving much details :-
root@predb-dev2:~# raidctl
Controller: 3
root@predb-dev2:~# raidctl -l 3
Controller Type Version
----------------------------------------------------------------
c3 LSI_1068E 1.22.00.00
root@predb-dev2:~#
Search for "sun storagetek common array manager" (for Solaris).
sent from my HTC smartphone
---------- Post updated at 10:36 AM ---------- Previous update was at 09:08 AM ----------
Okay, I'm now on my workstation so here's the detail..........
The raidctl command shows that you have an integrated LSI 1068E raid controller on your motherboard. That is what you would connect to if you pull out the Storagetek. The LSI supports RAID0, RAID1, and RAID1E. So it can't do RAID5.
Sun (Oracle) OEM'd the LSI 1068E chipset and the Storagetek RAID add-in card and you have BOTH of them.
The LSI is configured and controlled with the 'raidctl' command from Solaris but, again, you would need to configure any raid array to be used for the root filesystem by booting from DVD into single user. Then, the 'disk' is visible from the OS install routine.
For the Storagetek you need the package I told you to search for above which doesn't use raidctl (that's for the LSI) so don't get confused.
The Storagetek package you need to manage from Solaris may well also be on the CD that DN2 told you to download and burn. I'm not sure.
Very helpful information for me. I was able to download and install "Sun Storage Common Array Manager". But still I am little far from final results.
root@predb-dev2:/# /opt/SUNWstkcam/bin/sscs
An Internal Error occurred. The Fault Management Service may not be responding.
root@predb-dev2:/# svcs -a | grep -i fmservice
maintenance 12:18:48 svc:/system/fmservice:default
root@predb-dev2:/# svcadm clear svc:/system/fmservice:default
root@predb-dev2:/# svcs -a | grep -i fmservice
maintenance 12:24:45 svc:/system/fmservice:default
root@predb-dev2:/#
root@predb-dev2:/# cat /opt/SUNWsefms/var/log/server.log
osgi> Starting bundles.
/var/tmp/.whitneyinstall not found. Informational.
/opt/SUNWsefms/../pkg-out/bundles/target-cli does not exists! No target-cli bundles to load. Bundles may have already been loaded.
root@predb-dev2:/#
root@predb-dev2:/# tail -5 /var/svc/log/system-fmservice:default.log
[ Dec 19 12:24:12 Enabled. ]
[ Dec 19 12:24:13 Executing start method ("/opt/SUNWsefms/sbin/fms start"). ]
Starting Sun Storage Common Array Manager Fault Management Service
Could not determine if Sun Storage Common Array Manager Fault Management Service started.
[ Dec 19 12:24:45 Method "start" exited with status 2. ]
root@predb-dev2:/#
YES to all questions.
Sun Storagetek Common Array Manager is downloaded (from Installing the Typical Full Management Software ) and installed, which was installed successfully. But when I am issuing /opt/SUNWstkcam/bin/sscs, I am seeing these errors.
The first thing that hits me is that the package you've installed is "Sun storage common array manager" which doesn't mention "Storagetek" which is the RAID controller manufacturer.
I was expecting "Sun Storagetek Common Array Manager" and I wonder whether they are the same thing.
I need to go and check that out.
---------- Post updated at 09:28 PM ---------- Previous update was at 09:20 PM ----------
I also note that you are installing Solaris 11. We need to confirm that the Storagetek monitoring suite is supported under Solaris 11.
---------- Post updated at 09:48 PM ---------- Previous update was at 09:28 PM ----------
Looks like "Sun storage common array manager" is indeed the Storagetek product.
I can't find anywhere that says it doesn't work on Solaris 11.
Seems like Solaris-11 is not compatible/supported for this software. I have installed as per your downloadable link, but it is generating dump. If this is so, I need not go back and remove both SAS cables and plug them on MB "somewhere" and that will bypass RAID controller.
root@predb-dev2:/# /opt/StorMan/arcconf
| UCLI | Sun uniform command line interface
| UCLI | Version 6.40 (B17557)
| UCLI | (C) Adaptec 2003-2009
| UCLI | All Rights Reserved
COPYBACK | toggles controller copy back mode
CREATE | creates a logical device
DATASCRUB | toggles the controller background consistency check mode
DELETE | deletes one or more logical devices
FAILOVER | toggles the controller autotomatic failover mode
GETCONFIG | prints controller information
GETLOGS | gets controller log information
GETSTATUS | displays the status of running tasks
GETVERSION | prints version information for all controllers
IDENTIFY | blinks LEDS on device(s) connected to a controller
KEY | installs a Feature Key onto a controller
MODIFY | performs RAID Level Migration or Online Capacity Expansion
RESCAN | checks for new or removed drives
ROMUPDATE | updates controller firmware
SETALARM | controls the controller alarm, if present
SETCONFIG | restores the default configuration
SETCACHE | adjusts physical or logical device cache mode
SETNAME | renames a logical device given its logical device number
SETPRIORITY | changes specific or global task priority
SETSTATE | manually sets the state of a physical or logical device
TASK | performs a task such as build/verify on a physical or logical device
root@predb-dev2:/#
root@predb-dev2:/# /opt/StorMan/arcconf getconfig 1 PD
Bus Error (core dumped)
root@predb-dev2:/#
No luck. I tried refreshing and restarting that. Still it is generating core dump.
Let me go inside DC and try to find those two slots, where I can plug in both cables.
-------------------------------------------------------------------------------------------------------
I am able to plug both cables to correct controller and install OS. So, I am back to, whatever I planned to do initially. But I had lot of learning on the way. Thanks a lot guys.
