Hello to all,
Actually, currently on my Solaris box, I've a LUN (5TB space) from a EMC storage which is working fine, and a partition with ZFS filesystem is created for that LUN. as further you'll see in the logs, the "c4t6006016053802E00E6A9196B6506E211d0s2" is the current configured LUN in the system.
So, from Storage administration guys I've informed that I need to config our Solaris server to search for a new LUN (8TB space) and create another ZFS partition for the new LUN too.
Actually, I don't have much information from EMC storage side, but supposedly multi-pathing feature is activated (for both old and new LUNs).
Well from my box I've got these information:
I've only one HBA connected to a Fabric switch,
both old and new LUN should be reached from this HBA:
Please note that I've already used "cfgadm" and "devfsadm" for looking up any changes in LUNs.
root@host1 # fcinfo hba-port -l
HBA Port WWN: 2100001b3282c706
OS Device Name: /dev/cfg/c3
Manufacturer: QLogic Corp.
Model: 375-3355-02
Firmware Version: 05.03.02
FCode/BIOS Version: BIOS: 2.02; fcode: 2.01; EFI: 2.00;
Serial Number: 0402H00-0912711667
Driver Name: qlc
Driver Version: 20100301-3.00
Type: N-port
State: online
Supported Speeds: 1Gb 2Gb 4Gb
Current Speed: 4Gb
Node WWN: 2000001b3282c706
Link Error Statistics:
Link Failure Count: 0
Loss of Sync Count: 0
Loss of Signal Count: 0
Primitive Seq Protocol Error Count: 0
Invalid Tx Word Count: 0
Invalid CRC Count: 0
root@host1 # fcinfo remote-port -ls -p 2100001b3282c706
Remote Port WWN: 5006016247200898
Active FC4 Types: SCSI
SCSI Target: yes
Node WWN: 50060160c7200898
Link Error Statistics:
Link Failure Count: 0
Loss of Sync Count: 0
Loss of Signal Count: 0
Primitive Seq Protocol Error Count: 0
Invalid Tx Word Count: 0
Invalid CRC Count: 0
LUN: 0
Vendor: DGC
Product: LUNZ
OS Device Name: /dev/rdsk/c3t5006016247200898d0s2
LUN: 31
Vendor: DGC
Product: VRAID
OS Device Name: /dev/rdsk/c4t6006016053802E00E6A9196B6506E211d0s2
Remote Port WWN: 5006016347200898
Active FC4 Types: SCSI
SCSI Target: yes
Node WWN: 50060160c7200898
Link Error Statistics:
Link Failure Count: 0
Loss of Sync Count: 0
Loss of Signal Count: 0
Primitive Seq Protocol Error Count: 0
Invalid Tx Word Count: 0
Invalid CRC Count: 0
LUN: 0
Vendor: DGC
Product: LUNZ
OS Device Name: /dev/rdsk/c3t5006016347200898d0s2
LUN: 31
Vendor: DGC
Product: VRAID
OS Device Name: /dev/rdsk/c4t6006016053802E00E6A9196B6506E211d0s2
Remote Port WWN: 5006016847204656
Active FC4 Types: SCSI
SCSI Target: yes
Node WWN: 50060160c7204656
Link Error Statistics:
Link Failure Count: 0
Loss of Sync Count: 0
Loss of Signal Count: 0
Primitive Seq Protocol Error Count: 0
Invalid Tx Word Count: 0
Invalid CRC Count: 0
LUN: 0
Vendor: DGC
Product: RAID 5
OS Device Name: /dev/rdsk/c3t5006016847204656d0s2
Remote Port WWN: 5006016a47204656
Active FC4 Types: SCSI
SCSI Target: yes
Node WWN: 50060160c7204656
Link Error Statistics:
Link Failure Count: 0
Loss of Sync Count: 0
Loss of Signal Count: 0
Primitive Seq Protocol Error Count: 0
Invalid Tx Word Count: 0
Invalid CRC Count: 0
LUN: 0
Vendor: DGC
Product: RAID 5
OS Device Name: /dev/rdsk/c3t5006016A47204656d0s2
Remote Port WWN: 5006016847200898
Active FC4 Types: SCSI
SCSI Target: yes
Node WWN: 50060160c7200898
Link Error Statistics:
Link Failure Count: 0
Loss of Sync Count: 0
Loss of Signal Count: 0
Primitive Seq Protocol Error Count: 0
Invalid Tx Word Count: 0
Invalid CRC Count: 0
LUN: 0
Vendor: DGC
Product: LUNZ
OS Device Name: /dev/rdsk/c3t5006016847200898d0s2
LUN: 31
Vendor: DGC
Product: VRAID
OS Device Name: /dev/rdsk/c4t6006016053802E00E6A9196B6506E211d0s2
Remote Port WWN: 5006016d47204656
Active FC4 Types: SCSI
SCSI Target: yes
Node WWN: 50060160c7204656
Link Error Statistics:
Link Failure Count: 0
Loss of Sync Count: 0
Loss of Signal Count: 0
Primitive Seq Protocol Error Count: 0
Invalid Tx Word Count: 0
Invalid CRC Count: 0
LUN: 0
Vendor: DGC
Product: RAID 5
OS Device Name: /dev/rdsk/c3t5006016D47204656d0s2
Remote Port WWN: 5006016947200898
Active FC4 Types: SCSI
SCSI Target: yes
Node WWN: 50060160c7200898
Link Error Statistics:
Link Failure Count: 0
Loss of Sync Count: 0
Loss of Signal Count: 0
Primitive Seq Protocol Error Count: 0
Invalid Tx Word Count: 0
Invalid CRC Count: 0
LUN: 0
Vendor: DGC
Product: LUNZ
OS Device Name: /dev/rdsk/c3t5006016947200898d0s2
LUN: 31
Vendor: DGC
Product: VRAID
OS Device Name: /dev/rdsk/c4t6006016053802E00E6A9196B6506E211d0s2
Remote Port WWN: 5006016047204656
Active FC4 Types: SCSI
SCSI Target: yes
Node WWN: 50060160c7204656
Link Error Statistics:
Link Failure Count: 0
Loss of Sync Count: 0
Loss of Signal Count: 0
Primitive Seq Protocol Error Count: 0
Invalid Tx Word Count: 0
Invalid CRC Count: 0
LUN: 0
Vendor: DGC
Product: RAID 5
OS Device Name: /dev/rdsk/c3t5006016047204656d0s2
Remote Port WWN: 5006016247204656
Active FC4 Types: SCSI
SCSI Target: yes
Node WWN: 50060160c7204656
Link Error Statistics:
Link Failure Count: 0
Loss of Sync Count: 0
Loss of Signal Count: 0
Primitive Seq Protocol Error Count: 0
Invalid Tx Word Count: 0
Invalid CRC Count: 0
LUN: 0
Vendor: DGC
Product: RAID 5
OS Device Name: /dev/rdsk/c3t5006016247204656d0s2
Remote Port WWN: 5006016547204656
Active FC4 Types: SCSI
SCSI Target: yes
Node WWN: 50060160c7204656
Link Error Statistics:
Link Failure Count: 0
Loss of Sync Count: 0
Loss of Signal Count: 0
Primitive Seq Protocol Error Count: 0
Invalid Tx Word Count: 0
Invalid CRC Count: 0
LUN: 0
Vendor: DGC
Product: RAID 5
OS Device Name: /dev/rdsk/c3t5006016547204656d0s2
From above log, the new LUNs are:
/dev/rdsk/c3t5006016847204656d0s2
/dev/rdsk/c3t5006016A47204656d0s2
/dev/rdsk/c3t5006016D47204656d0s2
/dev/rdsk/c3t5006016047204656d0s2
/dev/rdsk/c3t5006016247204656d0s2
/dev/rdsk/c3t5006016547204656d0s2
root@host1 # cfgadm -al -o show_SCSI_LUN
Ap_Id Type Receptacle Occupant Condition
c3 fc-fabric connected configured unknown
c3::5006016047204656,0 disk connected configured unknown
c3::5006016247200898,0 disk connected configured unknown
c3::5006016247200898,31 disk connected configured unknown
c3::5006016247204656,0 disk connected configured unknown
c3::5006016347200898,0 disk connected configured unknown
c3::5006016347200898,31 disk connected configured unknown
c3::5006016547204656,0 disk connected configured unknown
c3::5006016847200898,0 disk connected configured unknown
c3::5006016847200898,31 disk connected configured unknown
c3::5006016847204656,0 disk connected configured unknown
c3::5006016947200898,0 disk connected configured unknown
c3::5006016947200898,31 disk connected configured unknown
c3::5006016a47204656,0 disk connected configured unknown
c3::5006016d47204656,0 disk connected configured unknown
root@host1 # format
Searching for disks...done
c3t5006016A47204656d0: configured with capacity of 8248.22GB
c3t5006016D47204656d0: configured with capacity of 8248.22GB
c3t5006016547204656d0: configured with capacity of 8248.22GB
c3t5006016247204656d0: configured with capacity of 8248.22GB
c3t5006016047204656d0: configured with capacity of 8248.22GB
c3t5006016847204656d0: configured with capacity of 8248.22GB
AVAILABLE DISK SELECTIONS:
0. c1t0d0 <LSILOGIC-LogicalVolume-3000 cyl 65533 alt 2 hd 16 sec 273>
/pci@0/pci@0/pci@2/scsi@0/sd@0,0
1. c3t5006016A47204656d0 <DGC-RAID 5-0531-8.05TB>
/pci@0/pci@0/pci@9/SUNW,qlc@0/fp@0,0/ssd@w5006016a47204656,0
2. c3t5006016D47204656d0 <DGC-RAID 5-0531-8.05TB>
/pci@0/pci@0/pci@9/SUNW,qlc@0/fp@0,0/ssd@w5006016d47204656,0
3. c3t5006016547204656d0 <DGC-RAID 5-0531-8.05TB>
/pci@0/pci@0/pci@9/SUNW,qlc@0/fp@0,0/ssd@w5006016547204656,0
4. c3t5006016247204656d0 <DGC-RAID 5-0531-8.05TB>
/pci@0/pci@0/pci@9/SUNW,qlc@0/fp@0,0/ssd@w5006016247204656,0
5. c3t5006016247200898d0 <drive type unknown>
/pci@0/pci@0/pci@9/SUNW,qlc@0/fp@0,0/ssd@w5006016247200898,0
6. c3t5006016047204656d0 <DGC-RAID 5-0531-8.05TB>
/pci@0/pci@0/pci@9/SUNW,qlc@0/fp@0,0/ssd@w5006016047204656,0
7. c3t5006016847204656d0 <DGC-RAID 5-0531-8.05TB>
/pci@0/pci@0/pci@9/SUNW,qlc@0/fp@0,0/ssd@w5006016847204656,0
8. c3t5006016347200898d0 <drive type unknown>
/pci@0/pci@0/pci@9/SUNW,qlc@0/fp@0,0/ssd@w5006016347200898,0
9. c3t5006016847200898d0 <drive type unknown>
/pci@0/pci@0/pci@9/SUNW,qlc@0/fp@0,0/ssd@w5006016847200898,0
10. c3t5006016947200898d0 <drive type unknown>
/pci@0/pci@0/pci@9/SUNW,qlc@0/fp@0,0/ssd@w5006016947200898,0
11. c4t6006016053802E00E6A9196B6506E211d0 <DGC-VRAID-0531-5.08TB>
/scsi_vhci/ssd@g6006016053802e00e6a9196b6506e211
So, by this logs i assume the new LUNs are already detected by Solaris.
Again "DGC-VRAID-0531-5.08TB" is the current configured LUN in the system, and new LUNs (DGC-RAID 5-0531-8.05TB) are the devices which I've mentioned before.
First, before i get into detail, the first difference here is that current configured LUN is defined as "c4" controller and also defined in "/scsi_vhci/ssd@", but for new LUNs it is "c3" and they're all defined in "/pci@0/pci@". also the new LUN device files are differ in naming scheme.
other thing which I found strange is that, the "mpathadm" does not list the new LUNs (but only the old LUN):
root@host1 # mpathadm list LU
/dev/rdsk/c4t6006016053802E00E6A9196B6506E211d0s2
Total Path Count: 4
Operational Path Count: 4
root@host1 # mpathadm show lu /dev/rdsk/c4t6006016053802E00E6A9196B6506E211d0s2
Logical Unit: /dev/rdsk/c4t6006016053802E00E6A9196B6506E211d0s2
mpath-support: libmpscsi_vhci.so
Vendor: DGC
Product: VRAID
Revision: 0531
Name Type: unknown type
Name: 6006016053802e00e6a9196b6506e211
Asymmetric: yes
Current Load Balance: round-robin
Logical Unit Group ID: NA
Auto Failback: on
Auto Probing: NA
Paths:
Initiator Port Name: 2100001b3282c706
Target Port Name: 5006016847200898
Override Path: NA
Path State: OK
Disabled: no
Initiator Port Name: 2100001b3282c706
Target Port Name: 5006016247200898
Override Path: NA
Path State: OK
Disabled: no
Initiator Port Name: 2100001b3282c706
Target Port Name: 5006016347200898
Override Path: NA
Path State: OK
Disabled: no
Initiator Port Name: 2100001b3282c706
Target Port Name: 5006016947200898
Override Path: NA
Path State: OK
Disabled: no
Target Port Groups:
ID: 2
Explicit Failover: yes
Access State: active optimized
Target Ports:
Name: 5006016847200898
Relative ID: 9
Name: 5006016947200898
Relative ID: 10
ID: 1
Explicit Failover: yes
Access State: active not optimized
Target Ports:
Name: 5006016247200898
Relative ID: 3
Name: 5006016347200898
Relative ID: 4
and also I'm sure all new LUNs are actually refer to same storage, but why there are several device filenames (unlike the old LUN)
root@host1 # luxadm probe
No Network Array enclosures found in /dev/es
Found Fibre Channel device(s):
Node WWN:50060160c7204656 Device Type:Disk device
Logical Path:/dev/rdsk/c3t5006016A47204656d0s2
Logical Path:/dev/rdsk/c3t5006016D47204656d0s2
Logical Path:/dev/rdsk/c3t5006016847204656d0s2
Logical Path:/dev/rdsk/c3t5006016047204656d0s2
Logical Path:/dev/rdsk/c3t5006016247204656d0s2
Logical Path:/dev/rdsk/c3t5006016547204656d0s2
Node WWN:50060160c7200898 Device Type:Disk device
Logical Path:/dev/rdsk/c3t5006016247200898d0s2
Logical Path:/dev/rdsk/c3t5006016847200898d0s2
Logical Path:/dev/rdsk/c3t5006016347200898d0s2
Logical Path:/dev/rdsk/c3t5006016947200898d0s2
Node WWN:50060160c7200898 Device Type:Disk device
Logical Path:/dev/rdsk/c4t6006016053802E00E6A9196B6506E211d0s2
root@host1 # luxadm display /dev/rdsk/c4t6006016053802E00E6A9196B6506E211d0s2
DEVICE PROPERTIES for disk: /dev/rdsk/c4t6006016053802E00E6A9196B6506E211d0s2
Vendor: DGC
Product ID: VRAID
Revision: 0531
Serial Num: CKM00114600743
Unformatted capacity: 5324800.000 MBytes
Write Cache: Enabled
Read Cache: Enabled
Minimum prefetch: 0x0
Maximum prefetch: 0x0
Device Type: Disk device
Path(s):
/dev/rdsk/c4t6006016053802E00E6A9196B6506E211d0s2
/devices/scsi_vhci/ssd@g6006016053802e00e6a9196b6506e211:c,raw
Controller /devices/pci@0/pci@0/pci@9/SUNW,qlc@0/fp@0,0
Device Address 5006016847200898,1f
Host controller port WWN 2100001b3282c706
Class primary
State ONLINE
Controller /devices/pci@0/pci@0/pci@9/SUNW,qlc@0/fp@0,0
Device Address 5006016247200898,1f
Host controller port WWN 2100001b3282c706
Class secondary
State ONLINE
Controller /devices/pci@0/pci@0/pci@9/SUNW,qlc@0/fp@0,0
Device Address 5006016347200898,1f
Host controller port WWN 2100001b3282c706
Class secondary
State ONLINE
Controller /devices/pci@0/pci@0/pci@9/SUNW,qlc@0/fp@0,0
Device Address 5006016947200898,1f
Host controller port WWN 2100001b3282c706
Class primary
State ONLINE
root@host1 # luxadm display /dev/rdsk/c3t5006016847204656d0s2 # one of new LUNs (random!)
DEVICE PROPERTIES for disk: /dev/rdsk/c3t5006016847204656d0s2
Vendor: DGC
Product ID: RAID 5
Revision: 0531
Serial Num: CKM00123701178
Unformatted capacity: 8446179.000 MBytes
Read Cache: Enabled
Minimum prefetch: 0x0
Maximum prefetch: 0x0
Device Type: Disk device
Path(s):
/dev/rdsk/c3t5006016847204656d0s2
/devices/pci@0/pci@0/pci@9/SUNW,qlc@0/fp@0,0/ssd@w5006016847204656,0:c,raw
LUN path port WWN: 5006016847204656
Host controller port WWN: 2100001b3282c706
Path status: O.K.
/dev/rdsk/c3t5006016A47204656d0s2
/devices/pci@0/pci@0/pci@9/SUNW,qlc@0/fp@0,0/ssd@w5006016a47204656,0:c,raw
LUN path port WWN: 5006016a47204656
Host controller port WWN: 2100001b3282c706
Path status: O.K.
/dev/rdsk/c3t5006016D47204656d0s2
/devices/pci@0/pci@0/pci@9/SUNW,qlc@0/fp@0,0/ssd@w5006016d47204656,0:c,raw
LUN path port WWN: 5006016d47204656
Host controller port WWN: 2100001b3282c706
Path status: O.K.
/dev/rdsk/c3t5006016047204656d0s2
/devices/pci@0/pci@0/pci@9/SUNW,qlc@0/fp@0,0/ssd@w5006016047204656,0:c,raw
LUN path port WWN: 5006016047204656
Host controller port WWN: 2100001b3282c706
Path status: O.K.
/dev/rdsk/c3t5006016247204656d0s2
/devices/pci@0/pci@0/pci@9/SUNW,qlc@0/fp@0,0/ssd@w5006016247204656,0:c,raw
LUN path port WWN: 5006016247204656
Host controller port WWN: 2100001b3282c706
Path status: O.K.
/dev/rdsk/c3t5006016547204656d0s2
/devices/pci@0/pci@0/pci@9/SUNW,qlc@0/fp@0,0/ssd@w5006016547204656,0:c,raw
LUN path port WWN: 5006016547204656
Host controller port WWN: 2100001b3282c706
Path status: O.K.
So, can anybody please tell me what I'm missing here ? is there anything else i need to do ?
Regards,