Please help if you have any insight.
I could use some advice as I have never run into this before.
Oracle T4-4 server Solaris 10 SPARC
8 HDD, first 2 for OS (rpool), next 6 for LDOMs (ldompool)
10 LDOMs running Solaris 11.3 & Solaris 10
There were fatal errors in the messages log about a specific drive in the system so we decided to replace it. I shutdown all the ldoms on ldompool & found a "repurposed" HDD of the same type to replace the one mentioned in the logs. I zpool detached the drive from ldompool. Replaced the drive…
I was pulled away by other issues so that topic got closed.
Environment:
Oracle T4-4 running Solaris 10 1/13 s10s_u11wos_24a SPARC
256 GB RAM, (2) 300GB HDD, (6) 600GB HDD
The (2) 300s are hardware mirrored to appear as 1 LSI volume for /root (rpool)
The (6) 600GB HDD in a zpool RAID making /ldompool (ldompool)
The 2 affected LDOMs are also Solaris 10
Originally I had (6) 300GB HDD for ldompool, but 1 drive went FUBAR & another had some errors but still working. I couldn't seem to get anywhere with the original drives so I put (6) 600GB drives in and restored that ZPOOL from snapshot.
Now when I boot either of the 2 LDOMs I get to the "ok" prompt, but any attempt to boot gets the following error:
WARNING: /virtual-devices@100/channel-devices@200/disk@0: Timeout receiving packet from LDC ... retrying
WARNING: /virtual-devices@100/channel-devices@200/disk@0: Communication error with Virtual Disk Server using Port 0. Retrying.
I found the MOS article (1507770.1) with the same error, but it didn't seem to point to any solution for my system.
Peasant Moderator
Nov '23
How about output
zpool status -v ldompool
pool: ldompool
state: ONLINE
scan: none requested
config:
=================================================
NAME STATE READ WRITE CKSUM
ldompool ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
c11t5000CCA02593AB28d0 ONLINE 0 0 0
c11t5000CCA02594C4C0d0 ONLINE 0 0 0
c11t5000CCA02598B7B8d0 ONLINE 0 0 0
c11t5000CCA025895C64d0 ONLINE 0 0 0
c11t5000CCA02597902Cd0 ONLINE 0 0 0
c11t5000CCA025976200d0 ONLINE 0 0 0
errors: No known data errors
=================================================
# ldm list -l hostdb1
NAME STATE FLAGS CONS VCPU MEMORY UTIL NORM UPTIME
hostdb1 active -t---- 5007 24 24G 4.2% 4.2% 22h 20m
SOFTSTATE
OpenBoot Running
UUID
fbc84b64-c8ad-e71c-8de6-a9c3a4449f7c
MAC
00:14:4f:f9:50:a0
HOSTID
0x84f950a0
CONTROL
failure-policy=ignore
extended-mapin-space=on
cpu-arch=native
rc-add-policy=
shutdown-group=15
perf-counters=
DEPENDENCY
master=
CORE
CID CPUSET
16 (128, 129, 130, 131, 132, 133, 134, 135)
17 (136, 137, 138, 139, 140, 141, 142, 143)
18 (144, 145, 146, 147, 148, 149, 150, 151)
VCPU
VID PID CID UTIL NORM STRAND
0 128 16 100% 100% 100%
1 129 16 0.0% 0.0% 100%
2 130 16 0.0% 0.0% 100%
3 131 16 0.0% 0.0% 100%
4 132 16 0.0% 0.0% 100%
5 133 16 0.0% 0.0% 100%
6 134 16 0.0% 0.0% 100%
7 135 16 0.0% 0.0% 100%
8 136 17 0.0% 0.0% 100%
9 137 17 0.0% 0.0% 100%
10 138 17 0.0% 0.0% 100%
11 139 17 0.0% 0.0% 100%
12 140 17 0.0% 0.0% 100%
13 141 17 0.0% 0.0% 100%
14 142 17 0.0% 0.0% 100%
15 143 17 0.0% 0.0% 100%
16 144 18 0.0% 0.0% 100%
17 145 18 0.0% 0.0% 100%
18 146 18 0.0% 0.0% 100%
19 147 18 0.0% 0.0% 100%
20 148 18 0.0% 0.0% 100%
21 149 18 0.0% 0.0% 100%
22 150 18 0.0% 0.0% 100%
23 151 18 0.0% 0.0% 100%
MEMORY
RA PA SIZE
0x80000000 0x2000000000 24G
CONSTRAINT
cpu=whole-core
max-cores=unlimited
threading=max-throughput
physical-bindings=core,memory
VARIABLES
auto-boot?=false
boot-device=disk:a disk net
keyboard-layout=US-English
oem-banner=Authorized users only. All activity may be monitored and reported.
oem-banner?=true
pm_boot_policy=disabled=0;ttfc=2000;ttmr=0;
NETWORK
NAME SERVICE ID DEVICE MAC MODE PVID VID MTU MAXBW LINKPROP
vnet0 host-cde_host-vsw0@primary 0 network@0 00:14:4f:f9:3f:3b 1 101 9000
vnet1 host-cde_host-vsw0@primary 1 network@1 00:14:4f:fb:be:03 1 102 9000
DISK
NAME VOLUME TOUT ID DEVICE SERVER MPGROUP
vdisk1 db1_vol0@host-os-vds0 0 disk@0 primary
vdisk2 cddb1_data1@host-mds-vds0 1 disk@1 primary
vdisk3 cddb1_data2@host-mds-vds0 2 disk@2 primary
vdisk4 cddb1_reco1@host-bds-vds0 3 disk@3 primary
vdisk5 cddb1_reco2@host-bds-vds0 4 disk@4 primary
vdisk6 cddb1_reco3@host-bds-vds0 5 disk@5 primary
vdisk7 cddb1_data3@host-mds-vds0 6 disk@6 primary
vdisk8 cddb1_data4@host-mds-vds0 7 disk@7 primary
temp temp@host-os-vds0 8 disk@8 primary
VCONS
NAME SERVICE PORT LOGGING
hostdb1 primary-vcc0@primary 5007 on
=====================================================
***** NOTE: I replaced the actual hostname with "host" & I removed any of the settings for LDOMs running on other pools with no problems.
# ldm list-services
VCC
NAME LDOM PORT-RANGE
primary-vcc0 primary 5000-5100
VSW
NAME LDOM MAC NET-DEV ID DEVICE LINKPROP DEFAULT-VLAN-ID PVID VID MTU MODE INTER-VNET-LINK
host-cde_host-vsw0 primary 00:14:4f:f9:56:74 0 switch@0 1 1 101,102,103,104 9000 on
host-app3_xnet-vsw1 primary 00:14:4f:f9:21:f6 1 switch@1 1 1 110 9000 on
host-app5_xnet-vsw2 primary 00:14:4f:fb:62:4d 2 switch@2 1 1 120 9000 on
host-app1_xnet-vsw3 primary 00:14:4f:f9:27:ac 3 switch@3 1 1 130 9000 on
host-app2_xnet-vsw4 primary 00:14:4f:fb:bb:b2 4 switch@4 1 1 140 9000 on
host-app4_host-vsw5 primary 00:14:4f:f8:7c:cc aggr1 5 switch@5 1 1 1500 on
host1_host primary 00:14:4f:f9:e2:5e e1000g4 6 switch@6 1 1 1500 on
VDS
NAME LDOM VOLUME OPTIONS MPGROUP DEVICE
host-os-vds0 primary db1_vol0 /dev/zvol/dsk/ldompol/host/db/db1
temp /dev/zvol/dsk/rpool/temp
db2_vol0 /dev/zvol/dsk/ldompool/host/db/db2
host-mds-vds0 primary cddb1_data1 /dev/zvol/dsk/ldompool/host/db/cddb/disk0
cddb1_data2 /dev/zvol/dsk/ldompool/host/db/cddb/disk1
cddb1_data3 /dev/zvol/dsk/ldompool/host/db/cddb/disk5
cddb1_data4 /dev/zvol/dsk/ldompool/host/db/cddb/disk6
cddb2_data1 /dev/zvol/dsk/ldompool/host/db/cddb/disk0
cddb2_data2 /dev/zvol/dsk/ldompool/host/db/cddb/disk1
cddb2_data3 /dev/zvol/dsk/ldompool/host/db/cddb/disk5
cddb2_data4 /dev/zvol/dsk/ldompool/host/db/cddb/disk6
host-bds-vds0 primary cddb1_reco1 /dev/zvol/dsk/ldompool/host/db/cddb/disk2
cddb1_reco2 /dev/zvol/dsk/ldompool/host/db/cddb/disk3
cddb1_reco3 /dev/zvol/dsk/ldompool/host/db/cddb/disk4
cddb2_reco1 /dev/zvol/dsk/ldompool/host/db/cddb/disk2
cddb2_reco2 /dev/zvol/dsk/ldompool/host/db/cddb/disk3
cddb2_reco3 /dev/zvol/dsk/ldompool/host/db/cddb/disk4
@Wraith_G2IC ,markdown code tags whenever posting data/code samples.
Sorry, I didn't know what those are.
system
February 21, 2024, 7:35pm
5
This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.