Legacy boot problem with two softraid volumes

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Legacy boot problem with two softraid volumes

Atanas Vladimirov
Hello,

I'm not sure if I will explain the problem right, so, please do not
hesitate to ask for additional info.

I did a new OpenBSD install (latest snapshot) on a test machine with
four 1TB HDDs. My plan was to split each hdd
into two slices - one for RAID1 and one for RAID5:

hodor# disklabel sd0
# /dev/rsd0c:
type: SCSI
disk: SCSI disk
label: WDC WD1003FBYZ-0
duid: 291c3978d096d35e
flags:
bytes/sector: 512
sectors/track: 63
tracks/cylinder: 255
sectors/cylinder: 16065
cylinders: 121601
total sectors: 1953525168
boundstart: 64
boundend: 1953520065
drivedata: 0

16 partitions:
#                size           offset  fstype [fsize bsize   cpg]
   a:       1048578551               64    RAID
   c:       1953525168                0  unused
   d:        904941450       1048578615    RAID


So, during the install I created the RAID volumes successfully.

Volume      Status               Size Device
softraid0 0 Online       536871947776 sd6     RAID1
           0 Online       536871947776 0:0.0   noencl <sd0a>
           1 Online       536871947776 0:1.0   noencl <sd1a>
           2 Online       536871947776 0:2.0   noencl <sd2a>
           3 Online       536871947776 0:3.0   noencl <sd3a>

Volume      Status               Size Device
softraid0 1 Online      1389989068800 sd7     RAID5
           0 Online       463329752064 1:0.0   noencl <sd0d>
           1 Online       463329752064 1:1.0   noencl <sd1d>
           2 Online       463329752064 1:2.0   noencl <sd2d>
           3 Online       463329752064 1:3.0   noencl <sd3d>

Then finished the installation the regular way, installing on the RAID1
volume.
The problem is that after reboot the process stopped at bootloader
"disks:" line - I've recorded a short video [0]
Then I tried to UEFI boot from "miniroot65.fs" (another short video [1])
and this time the server booted.

After that I made a few re-installations to be sure that the problem
reoccurs. If I do the installation without creating the RAID5
volume during the installation the server boots okay from RAID1.
Then, creating the RAID5 volume and another reboot breaks the next boot
the same way.

An UEFI installation works as expected.

[0] https://hodor.bsdbg.net/legacy_boot.avi
[1] https://hodor.bsdbg.net/uefi_boot.avi

# dmesg

OpenBSD 6.5-current (GENERIC.MP) #0: Sat Jun  1 13:24:14 MDT 2019
     [hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 17132285952 (16338MB)
avail mem = 16602955776 (15833MB)
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.7 @ 0xeb5a0 (56 entries)
bios0: vendor American Megatrends Inc. version "2.3" date 06/12/2018
bios0: Supermicro X9SCL/X9SCM
acpi0 at bios0: rev 2
acpi0: sleep states S0 S1 S4 S5
acpi0: tables DSDT FACP APIC FPDT MCFG HPET SSDT SPMI SSDT SSDT BGRT
EINJ ERST HEST BERT
acpi0: wakeup devices UAR1(S4) UAR2(S4) P0P1(S4) USB1(S4) USB2(S4)
USB3(S4) USB4(S4) USB5(S4) USB6(S4) USB7(S4) PXSX(S4) RP01(S4) PXSX(S4)
RP02(S4) PXSX(S4) RP03(S4) [...]
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) CPU E31270 @ 3.40GHz, 3400.57 MHz, 06-2a-07
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,XSAVE,AVX,NXE,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu0: 256KB 64b/line 8-way L2 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
cpu0: apic clock running at 100MHz
cpu0: mwait min=64, max=64, C-substates=0.2.1.1, IBE
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Xeon(R) CPU E31270 @ 3.40GHz, 3400.03 MHz, 06-2a-07
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,XSAVE,AVX,NXE,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu1: 256KB 64b/line 8-way L2 cache
cpu1: smt 0, core 1, package 0
cpu2 at mainbus0: apid 4 (application processor)
cpu2: Intel(R) Xeon(R) CPU E31270 @ 3.40GHz, 3400.03 MHz, 06-2a-07
cpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,XSAVE,AVX,NXE,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu2: 256KB 64b/line 8-way L2 cache
cpu2: smt 0, core 2, package 0
cpu3 at mainbus0: apid 6 (application processor)
cpu3: Intel(R) Xeon(R) CPU E31270 @ 3.40GHz, 3400.03 MHz, 06-2a-07
cpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,XSAVE,AVX,NXE,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu3: 256KB 64b/line 8-way L2 cache
cpu3: smt 0, core 3, package 0
cpu4 at mainbus0: apid 1 (application processor)
cpu4: Intel(R) Xeon(R) CPU E31270 @ 3.40GHz, 3400.03 MHz, 06-2a-07
cpu4:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,XSAVE,AVX,NXE,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu4: 256KB 64b/line 8-way L2 cache
cpu4: smt 1, core 0, package 0
cpu5 at mainbus0: apid 3 (application processor)
cpu5: Intel(R) Xeon(R) CPU E31270 @ 3.40GHz, 3400.03 MHz, 06-2a-07
cpu5:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,XSAVE,AVX,NXE,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu5: 256KB 64b/line 8-way L2 cache
cpu5: smt 1, core 1, package 0
cpu6 at mainbus0: apid 5 (application processor)
cpu6: Intel(R) Xeon(R) CPU E31270 @ 3.40GHz, 3400.03 MHz, 06-2a-07
cpu6:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,XSAVE,AVX,NXE,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu6: 256KB 64b/line 8-way L2 cache
cpu6: smt 1, core 2, package 0
cpu7 at mainbus0: apid 7 (application processor)
cpu7: Intel(R) Xeon(R) CPU E31270 @ 3.40GHz, 3400.03 MHz, 06-2a-07
cpu7:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,DEADLINE,XSAVE,AVX,NXE,RDTSCP,LONG,LAHF,PERF,ITSC,MD_CLEAR,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,MELTDOWN
cpu7: 256KB 64b/line 8-way L2 cache
cpu7: smt 1, core 3, package 0
ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 24 pins
acpimcfg0 at acpi0
acpimcfg0: addr 0xe0000000, bus 0-255
acpihpet0 at acpi0: 14318179 Hz
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 3 (P0P1)
acpiprt2 at acpi0: bus 1 (RP01)
acpiprt3 at acpi0: bus -1 (RP02)
acpiprt4 at acpi0: bus -1 (RP03)
acpiprt5 at acpi0: bus -1 (RP04)
acpiprt6 at acpi0: bus 2 (RP05)
acpiprt7 at acpi0: bus -1 (RP06)
acpiprt8 at acpi0: bus -1 (RP07)
acpiprt9 at acpi0: bus -1 (RP08)
acpiprt10 at acpi0: bus -1 (PEG0)
acpiprt11 at acpi0: bus -1 (PEG1)
acpiprt12 at acpi0: bus -1 (PEG2)
acpiprt13 at acpi0: bus -1 (PEG3)
acpiec0 at acpi0: not present
acpicpu0 at acpi0: C3(350@104 mwait.1@0x20), C1(1000@1 mwait.1), PSS
acpicpu1 at acpi0: C3(350@104 mwait.1@0x20), C1(1000@1 mwait.1), PSS
acpicpu2 at acpi0: C3(350@104 mwait.1@0x20), C1(1000@1 mwait.1), PSS
acpicpu3 at acpi0: C3(350@104 mwait.1@0x20), C1(1000@1 mwait.1), PSS
acpicpu4 at acpi0: C3(350@104 mwait.1@0x20), C1(1000@1 mwait.1), PSS
acpicpu5 at acpi0: C3(350@104 mwait.1@0x20), C1(1000@1 mwait.1), PSS
acpicpu6 at acpi0: C3(350@104 mwait.1@0x20), C1(1000@1 mwait.1), PSS
acpicpu7 at acpi0: C3(350@104 mwait.1@0x20), C1(1000@1 mwait.1), PSS
acpipwrres0 at acpi0: FN00, resource for FAN0
acpipwrres1 at acpi0: FN01, resource for FAN1
acpipwrres2 at acpi0: FN02, resource for FAN2
acpipwrres3 at acpi0: FN03, resource for FAN3
acpipwrres4 at acpi0: FN04, resource for FAN4
acpitz0 at acpi0: critical temperature is 95 degC
acpitz1 at acpi0: critical temperature is 95 degC
acpipci0 at acpi0 PCI0: 0x00000010 0x00000011 0x00000000
acpicmos0 at acpi0
"IPI0001" at acpi0 not configured
acpibtn0 at acpi0: PWRB
"PNP0C0B" at acpi0 not configured
"PNP0C0B" at acpi0 not configured
"PNP0C0B" at acpi0 not configured
"PNP0C0B" at acpi0 not configured
"PNP0C0B" at acpi0 not configured
acpivideo0 at acpi0: GFX0
acpivout0 at acpivideo0: DD01
acpivout at acpivideo0 not configured
acpivout at acpivideo0 not configured
acpivout at acpivideo0 not configured
acpivout at acpivideo0 not configured
acpivout at acpivideo0 not configured
acpivout at acpivideo0 not configured
acpivout at acpivideo0 not configured
ipmi at mainbus0 not configured
cpu0: using VERW MDS workaround (except on vmm entry)
cpu0: Enhanced SpeedStep 3400 MHz: speeds: 3401, 3400, 3300, 3100, 3000,
2900, 2800, 2600, 2500, 2400, 2200, 2100, 2000, 1900, 1700, 1600 MHz
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel Xeon E3-1200 Host" rev 0x09
em0 at pci0 dev 25 function 0 "Intel 82579LM" rev 0x05: msi, address
00:25:90:73:88:61
ehci0 at pci0 dev 26 function 0 "Intel 6 Series USB" rev 0x05: apic 2
int 16
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 configuration 1 interface 0 "Intel EHCI root hub" rev
2.00/1.00 addr 1
ppb0 at pci0 dev 28 function 0 "Intel 6 Series PCIE" rev 0xb5: msi
pci1 at ppb0 bus 1
ppb1 at pci0 dev 28 function 4 "Intel 6 Series PCIE" rev 0xb5: msi
pci2 at ppb1 bus 2
em1 at pci2 dev 0 function 0 "Intel 82574L" rev 0x00: msi, address
00:25:90:73:88:60
ehci1 at pci0 dev 29 function 0 "Intel 6 Series USB" rev 0x05: apic 2
int 23
usb1 at ehci1: USB revision 2.0
uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev
2.00/1.00 addr 1
ppb2 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0xa5
pci3 at ppb2 bus 3
"Matrox MGA G200eW" rev 0x0a at pci3 dev 3 function 0 not configured
pcib0 at pci0 dev 31 function 0 "Intel C204 LPC" rev 0x05
ahci0 at pci0 dev 31 function 2 "Intel 6 Series AHCI" rev 0x05: msi,
AHCI 1.3
ahci0: port 0: 6.0Gb/s
ahci0: port 1: 3.0Gb/s
ahci0: port 2: 3.0Gb/s
ahci0: port 3: 3.0Gb/s
scsibus1 at ahci0: 32 targets
sd0 at scsibus1 targ 0 lun 0: <ATA, WDC WD1003FBYZ-0, 01.0> SCSI3
0/direct fixed naa.50014ee2b48c46be
sd0: 953869MB, 512 bytes/sector, 1953525168 sectors
sd1 at scsibus1 targ 1 lun 0: <ATA, WDC WD1003FBYX-0, 01.0> SCSI3
0/direct fixed naa.50014ee206cc8405
sd1: 953869MB, 512 bytes/sector, 1953525168 sectors
sd2 at scsibus1 targ 2 lun 0: <ATA, WDC WD1003FBYX-0, 01.0> SCSI3
0/direct fixed naa.50014ee206cc9050
sd2: 953869MB, 512 bytes/sector, 1953525168 sectors
sd3 at scsibus1 targ 3 lun 0: <ATA, WDC WD1003FBYX-0, 01.0> SCSI3
0/direct fixed naa.50014ee206cd502a
sd3: 953869MB, 512 bytes/sector, 1953525168 sectors
ichiic0 at pci0 dev 31 function 3 "Intel 6 Series SMBus" rev 0x05: apic
2 int 18
iic0 at ichiic0
sdtemp0 at iic0 addr 0x18: stts2002
sdtemp1 at iic0 addr 0x19: stts2002
sdtemp2 at iic0 addr 0x1a: stts2002
sdtemp3 at iic0 addr 0x1b: stts2002
spdmem0 at iic0 addr 0x50: 4GB DDR3 SDRAM ECC PC3-10600 with thermal
sensor
spdmem1 at iic0 addr 0x51: 4GB DDR3 SDRAM ECC PC3-10600 with thermal
sensor
spdmem2 at iic0 addr 0x52: 4GB DDR3 SDRAM ECC PC3-10600 with thermal
sensor
spdmem3 at iic0 addr 0x53: 4GB DDR3 SDRAM ECC PC3-10600 with thermal
sensor
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
com2 at isa0 port 0x3e8/8 irq 5: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5 irq 1 irq 12
pckbd0 at pckbc0 (kbd slot)
wskbd0 at pckbd0: console keyboard
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
wbsio0 at isa0 port 0x2e/2: NCT6776F rev 0x33
lm1 at wbsio0 port 0xa30/8: NCT6776F
vmm0 at mainbus0: VMX/EPT
efifb0 at mainbus0: 1280x1024, 32bpp
wsdisplay0 at efifb0 mux 1: console (std, vt100 emulation), using wskbd0
wsdisplay0: screen 1-5 added (std, vt100 emulation)
uhub2 at uhub0 port 1 configuration 1 interface 0 "Intel Rate Matching
Hub" rev 2.00/0.00 addr 2
umass0 at uhub2 port 1 configuration 1 interface 0 "Ours Technology
product 0x2222" rev 2.00/2.00 addr 3
umass0: using SCSI over Bulk-Only
scsibus2 at umass0: 2 targets, initiator 0
sd4 at scsibus2 targ 1 lun 0: <IPMI, Virtual Disk, 3000> SCSI0 0/direct
removable
sd4: 3856MB, 512 bytes/sector, 7897088 sectors
umass1 at uhub2 port 1 configuration 1 interface 1 "Ours Technology
product 0x2222" rev 2.00/2.00 addr 3
umass1: using ATAPI over Bulk-Only
scsibus3 at umass1: 2 targets, initiator 0
cd0 at scsibus3 targ 1 lun 0: <IPMI, Virtual CDROM, YS0J> ATAPI 5/cdrom
removable
uhidev0 at uhub2 port 2 configuration 1 interface 0 "Winbond Electronics
Corp Hermon USB hidmouse Device" rev 1.10/0.01 addr 4
uhidev0: iclass 3/1
ums0 at uhidev0: 3 buttons, Z dir
wsmouse0 at ums0 mux 0
uhidev1 at uhub2 port 2 configuration 1 interface 1 "Winbond Electronics
Corp Hermon USB hidmouse Device" rev 1.10/0.01 addr 4
uhidev1: iclass 3/1
ukbd0 at uhidev1: 8 variable keys, 6 key codes
wskbd1 at ukbd0 mux 1
wskbd1: connecting to wsdisplay0
uhub3 at uhub1 port 1 configuration 1 interface 0 "Intel Rate Matching
Hub" rev 2.00/0.00 addr 2
umass2 at uhub3 port 1 configuration 1 interface 0 "bsdbg.net 16GB" rev
2.00/1.00 addr 3
umass2: using SCSI over Bulk-Only
scsibus4 at umass2: 2 targets, initiator 0
sd5 at scsibus4 targ 1 lun 0: <bsdbg.ne, 16GB, 1.00> SCSI0 0/direct
fixed serial.1005b1132900000010A4
sd5: 15528MB, 512 bytes/sector, 31802088 sectors
vscsi0 at root
scsibus5 at vscsi0: 256 targets
softraid0 at root
scsibus6 at softraid0: 256 targets
sd6 at scsibus6 targ 1 lun 0: <OPENBSD, SR RAID 1, 006> SCSI2 0/direct
fixed
sd6: 512000MB, 512 bytes/sector, 1048578023 sectors
sd7 at scsibus6 targ 2 lun 0: <OPENBSD, SR RAID 5, 006> SCSI2 0/direct
fixed
sd7: 1325596MB, 512 bytes/sector, 2714822400 sectors
root on sd6a (192b3694126eba3b.a) swap on sd6b dump on sd6b

Reply | Threaded
Open this post in threaded view
|

Re: Legacy boot problem with two softraid volumes

Atanas Vladimirov
On 2019-06-02 22:54, Atanas Vladimirov wrote:

> Hello,
>
> I'm not sure if I will explain the problem right, so, please do not
> hesitate to ask for additional info.
>
> I did a new OpenBSD install (latest snapshot) on a test machine with
> four 1TB HDDs. My plan was to split each hdd
> into two slices - one for RAID1 and one for RAID5:
>
> hodor# disklabel sd0
> # /dev/rsd0c:
> type: SCSI
> disk: SCSI disk
> label: WDC WD1003FBYZ-0
> duid: 291c3978d096d35e
> flags:
> bytes/sector: 512
> sectors/track: 63
> tracks/cylinder: 255
> sectors/cylinder: 16065
> cylinders: 121601
> total sectors: 1953525168
> boundstart: 64
> boundend: 1953520065
> drivedata: 0
>
> 16 partitions:
> #                size           offset  fstype [fsize bsize   cpg]
>   a:       1048578551               64    RAID
>   c:       1953525168                0  unused
>   d:        904941450       1048578615    RAID
>
>
> So, during the install I created the RAID volumes successfully.
>
> Volume      Status               Size Device
> softraid0 0 Online       536871947776 sd6     RAID1
>           0 Online       536871947776 0:0.0   noencl <sd0a>
>           1 Online       536871947776 0:1.0   noencl <sd1a>
>           2 Online       536871947776 0:2.0   noencl <sd2a>
>           3 Online       536871947776 0:3.0   noencl <sd3a>
>
> Volume      Status               Size Device
> softraid0 1 Online      1389989068800 sd7     RAID5
>           0 Online       463329752064 1:0.0   noencl <sd0d>
>           1 Online       463329752064 1:1.0   noencl <sd1d>
>           2 Online       463329752064 1:2.0   noencl <sd2d>
>           3 Online       463329752064 1:3.0   noencl <sd3d>
>
> Then finished the installation the regular way, installing on the RAID1
> volume.
> The problem is that after reboot the process stopped at bootloader
> "disks:" line - I've recorded a short video [0]
> Then I tried to UEFI boot from "miniroot65.fs" (another short video
> [1]) and this time the server booted.
>
> After that I made a few re-installations to be sure that the problem
> reoccurs. If I do the installation without creating the RAID5
> volume during the installation the server boots okay from RAID1.
> Then, creating the RAID5 volume and another reboot breaks the next
> boot the same way.
>
> An UEFI installation works as expected.
>
> [0] https://hodor.bsdbg.net/legacy_boot.avi
> [1] https://hodor.bsdbg.net/uefi_boot.avi
>

Hello again,

I'm writing because no one answer me and I'm starting to think if this
is not related only to my hardware.
I will appreciate any input, really! Thanks in advance and sorry to
bother you,

Atanas