M5000 splitting existing domain

UNIX Solaris
1

Hi

We have an M5000 with one domain running Sun Cluster on it. We would like to split the domain into two domains. One with the existing Sun Cluster and one with a fresh install. We have 2 CPU Boards (8 CPU) / 4 Mem Boards (64 gb memory) and 2 IOU as well as 4 disks

Is it possible to have such a configuration?

Domain 0
5 CPU
40 GB Memory
1 IO Board
2 Disks

Domain 1
3 CPU
24 GB Memory
1 IO Board
2 Disks

What are the limitations in configuring domains? What is the relationship between memory and cpu?

Is there anything I need to be aware of if I want to split the existing domain?
How would I split the domain without risking to lose the Sun Cluster OS.

Here the showhardconf

XSCF> showhardconf
SPARC Enterprise M5000;
+ Serial:BCF092004F; Operator_Panel_Switch:Locked;
+ Power_Supply_System:Single; SCF-ID:XSCF#0;
+ System_Power:On; System_Phase:Cabinet Power On;
Domain#0 Domain_Status:Running;

MBU_B Status:Normal; Ver:0201h; Serial:BC0920031A ;
+ FRU-Part-Number:CF00541-0478 07 /541-0478-07 ;
+ Memory_Size:64 GB;
+ Type:1;
CPUM#0-CHIP#0 Status:Normal; Ver:0401h; Serial:PP0910014R ;
+ FRU-Part-Number:CA06761-D202 E0 /375-3568-05 ;
+ Freq:2.400 GHz; Type:32;
+ Core:4; Strand:2;
CPUM#0-CHIP#1 Status:Normal; Ver:0401h; Serial:PP0910014R ;
+ FRU-Part-Number:CA06761-D202 E0 /375-3568-05 ;
+ Freq:2.400 GHz; Type:32;
+ Core:4; Strand:2;
CPUM#1-CHIP#0 Status:Normal; Ver:0401h; Serial:PP090903WE ;
+ FRU-Part-Number:CA06761-D202 E0 /375-3568-05 ;
+ Freq:2.400 GHz; Type:32;
+ Core:4; Strand:2;
CPUM#1-CHIP#1 Status:Normal; Ver:0401h; Serial:PP090903WE ;
+ FRU-Part-Number:CA06761-D202 E0 /375-3568-05 ;
+ Freq:2.400 GHz; Type:32;
+ Core:4; Strand:2;
CPUM#2-CHIP#0 Status:Normal; Ver:0401h; Serial:PP091702L0 ;
+ FRU-Part-Number:CA06761-D202 E0 /375-3568-05 ;
+ Freq:2.400 GHz; Type:32;
+ Core:4; Strand:2;
CPUM#2-CHIP#1 Status:Normal; Ver:0401h; Serial:PP091702L0 ;
+ FRU-Part-Number:CA06761-D202 E0 /375-3568-05 ;
+ Freq:2.400 GHz; Type:32;
+ Core:4; Strand:2;
CPUM#3-CHIP#0 Status:Normal; Ver:0401h; Serial:PP091604HZ ;
+ FRU-Part-Number:CA06761-D202 E0 /375-3568-05 ;
+ Freq:2.400 GHz; Type:32;
+ Core:4; Strand:2;
CPUM#3-CHIP#1 Status:Normal; Ver:0401h; Serial:PP091604HZ ;
+ FRU-Part-Number:CA06761-D202 E0 /375-3568-05 ;
+ Freq:2.400 GHz; Type:32;
+ Core:4; Strand:2;
MEMB#0 Status:Normal; Ver:0101h; Serial:BF09175UHL ;
+ FRU-Part-Number:CF00541-0545 06 /541-0545-06 ;
MEM#0A Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-48256a66;
+ Type:2A; Size:2 GB;
MEM#0B Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-48256a7c;
+ Type:2A; Size:2 GB;
MEM#1A Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-48256a51;
+ Type:2A; Size:2 GB;
MEM#1B Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-48256a4d;
+ Type:2A; Size:2 GB;
MEM#2A Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-48256a7d;
+ Type:2A; Size:2 GB;
MEM#2B Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-48256a52;
+ Type:2A; Size:2 GB;
MEM#3A Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-48256a4c;
+ Type:2A; Size:2 GB;
MEM#3B Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-48256a75;
+ Type:2A; Size:2 GB;
MEMB#1 Status:Normal; Ver:0101h; Serial:BF091863HN ;
+ FRU-Part-Number:CF00541-0545 06 /541-0545-06 ;
MEM#0A Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-482569c2;
+ Type:2A; Size:2 GB;
MEM#0B Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-48256a73;
+ Type:2A; Size:2 GB;
MEM#1A Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-48256a79;
+ Type:2A; Size:2 GB;
MEM#1B Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-48256a83;
+ Type:2A; Size:2 GB;
MEM#2A Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-48256ac8;
+ Type:2A; Size:2 GB;
MEM#2B Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-48256ac9;
+ Type:2A; Size:2 GB;
MEM#3A Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-48256ac0;
+ Type:2A; Size:2 GB;
MEM#3B Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-48256aab;
+ Type:2A; Size:2 GB;
MEMB#4 Status:Normal; Ver:0101h; Serial:BF091863L9 ;
+ FRU-Part-Number:CF00541-0545 06 /541-0545-06 ;
MEM#0A Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-482569cd;
+ Type:2A; Size:2 GB;
MEM#0B Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-482569dd;
+ Type:2A; Size:2 GB;
MEM#1A Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-48256989;
+ Type:2A; Size:2 GB;
MEM#1B Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-4825698d;
+ Type:2A; Size:2 GB;
MEM#2A Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-477f7355;
+ Type:2A; Size:2 GB;
MEM#2B Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-48256980;
+ Type:2A; Size:2 GB;
MEM#3A Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-4825698b;
+ Type:2A; Size:2 GB;
MEM#3B Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-48256981;
+ Type:2A; Size:2 GB;
MEMB#5 Status:Normal; Ver:0101h; Serial:BF09175U6N ;
+ FRU-Part-Number:CF00541-0545 06 /541-0545-06 ;
MEM#0A Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-477f74e5;
+ Type:2A; Size:2 GB;
MEM#0B Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-477f7398;
+ Type:2A; Size:2 GB;
MEM#1A Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-477f7392;
+ Type:2A; Size:2 GB;
MEM#1B Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-477f73e0;
+ Type:2A; Size:2 GB;
MEM#2A Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-477f734c;
+ Type:2A; Size:2 GB;
MEM#2B Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-477f7397;
+ Type:2A; Size:2 GB;
MEM#3A Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-477f7395;
+ Type:2A; Size:2 GB;
MEM#3B Status:Normal;
+ Code:ce0000000000000001M3 93T5660QZA-CE6 4151-477f74e2;
+ Type:2A; Size:2 GB;
DDC_A#0 Status:Normal;
DDC_A#1 Status:Normal;
DDC_A#2 Status:Normal;
DDC_A#3 Status:Normal;
DDC_B#0 Status:Normal;
DDC_B#1 Status:Normal;
IOU#0 Status:Normal; Ver:0101h; Serial:BF0905133A ;
+ FRU-Part-Number:CF00541-2240 03 /541-2240-03 ;
+ Type:1;
DDC_A#0 Status:Normal;
DDCR Status:Normal;
DDC_B#0 Status:Normal;
PCI#1 Name_Property:network; Card_Type:Other;
PCI#3 Name_Property:SUNW,qlc; Card_Type:Other;
IOU#1 Status:Normal; Ver:0101h; Serial:BF091760TC ;
+ FRU-Part-Number:CF00541-2240 04 /541-2240-04 ;
+ Type:1;
DDC_A#0 Status:Normal;
DDCR Status:Normal;
DDC_B#0 Status:Normal;
PCI#1 Name_Property:network; Card_Type:Other;
PCI#3 Name_Property:SUNW,qlc; Card_Type:Other;
XSCFU Status:Normal,Active; Ver:0101h; Serial:BF09030HTG ;
+ FRU-Part-Number:CF00541-0481 04 /541-0481-04 ;
OPNL Status:Normal; Ver:0101h; Serial:BF09030CDF ;
+ FRU-Part-Number:CF00541-0850 06 /541-0850-06 ;
PSU#0 Status:Normal; Serial:1357FYG-0848AD00FR;
+ FRU-Part-Number:CF00300-2011 0202 /300-2011-02-02;
+ Power_Status:On; AC:200 V;
PSU#1 Status:Normal; Serial:1357FYG-0848AD00FU;
+ FRU-Part-Number:CF00300-2011 0202 /300-2011-02-02;
+ Power_Status:On; AC:200 V;
PSU#2 Status:Normal; Serial:1357FYG-0848AD00H3;
+ FRU-Part-Number:CF00300-2011 0202 /300-2011-02-02;
+ Power_Status:On; AC:200 V;
PSU#3 Status:Normal; Serial:1357FYG-0848AD00H5;
+ FRU-Part-Number:CF00300-2011 0202 /300-2011-02-02;
+ Power_Status:On; AC:200 V;
FANBP_C Status:Normal; Ver:0301h; Serial:BF0849PR0H ;
+ FRU-Part-Number:CF00541-0848 05 /541-0848-05 ;
FAN_A#0 Status:Normal;
FAN_A#1 Status:Normal;
FAN_A#2 Status:Normal;
FAN_A#3 Status:Normal;
XSCF>

XSCF> showboards -a
XSB DID(LSB) Assignment Pwr Conn Conf Test Fault
----

----------- ---- ---- ----
--------
00-0 00(00) Assigned y y y Passed Normal
01-0 00(01) Assigned y y y Passed Normal
XSCF>

XSCF> showdomainstatus -a
DID Domain Status
00 Running
01 -
02 -
03 -
XSCF>

Thanks a lot for your help.

2

you'll need to read here:
Domain Configuration
the magic word you are looking for is "quad-xsb".

3

Hi

Thanks for the link. Looking at TABLE 4-3 I am a little bit confused. Maybe you can explain me this:

In our M5000 we have the following:

XSB00
   00-0 CPU0-0 Memb 0
   00-1 CPU0-1 Memb 1
   00-2 CPU1-0
   00-3 CPU1-1

XSB01
   01-0 CPU0-0 Memb 4
   01-1 CPU0-1 Memb 5
   01-2 CPU1-0
   01-3 CPU1-1

Could I leave XSB00 in Uni-Mode and put XSB01 in Quad-Mode.

Then Assign XSB00 completely to Domain0 plus the CPU of XSB01-3?

Which would mean Domain 0 would have 5 CPU + 2 Memb? What about Memb 4 or 5?

4

can't say... i've never tried that. only quad on all xsb and then you can do what you are trying...

5

Hi

Is this config posisble as well by just swapping one memoryboard to slot 2?

Domain 0

XSB00
00-0 CPU0-0 Memb 0
00-1 CPU0-1 Memb 1
00-2 CPU1-0 Memb 2
00-3 CPU1-1
01-3 CPU1-1

Domain 1

XSB01
01-0 CPU0-0 Memb 4
01-1 CPU0-1
01-2 CPU1-0
6

i had to do it with a full assembled M5000 and i did quad XSB on all boards back then to have a larger and a smaller domain. so i think you have to try your configuration on your own :wink:

7

Ok I'll give it a try. Thanks anyway.

One more question. We have 4 HDDs. Will HD 3+4 automatically be assigned to Domain 1 ?

8

yes they will. and there will be NO dvd or tape (if there is a tape in your machine) in domain 1. only domain 0 will have the dvd and the tape!

9

Ok. So I guess the second domain has to be installed via network then.
Could this procedure be right then?

# Detach XSB01 from Domain 0
deleteboard -c unassign 01-0

# Check status
showdcl -va

# Put XSB01 in Quadmode
setupfru -x 4 sb 1

# Set XSB01-3 to domain 0 and assign
setdcl -d 0 -a 1=01-3
addboard -c assign -d 1 01-3

# Set XSB01 rest to domain 1
setdcl -d 1 -a 0=01-0
setdcl -d 1 -a 1=01-1
setdcl -d 1 -a 2=01-2
addboard -c assign -d 1 01-0 01-1 01-2
10

looks ok... good luck!