[RAID] OpenBSD arm64 and RAID adapters

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

[RAID] OpenBSD arm64 and RAID adapters

Olivier BURELLI
Hello,

For previous versions i checked on https://www.openbsd.org/amd64.html or
https://www.openbsd.org/arm64.html to find supported hardware.

For example for amd64, i could use a megaraid 9240 RAID adapter.

Now i can not find supported RAID Adapters.

_ If for amd64, i can use a LSI MEGARAID 9240, may i plug it on arm64
architecture ?

_ Does the base kernel is including the drivers or i have to build the
kernel to include it ?

_ Where, currently, can i find all RAID adapters supported by OpenBSD ?

Thanks in advance.

Olivier.

Reply | Threaded
Open this post in threaded view
|

Re: [RAID] OpenBSD arm64 and RAID adapters

Stuart Henderson
On 2019/11/19 14:27, Olivier Burelli wrote:

> Hello,
>
> For previous versions i checked on https://www.openbsd.org/amd64.html or
> https://www.openbsd.org/arm64.html to find supported hardware.
>
> For example for amd64, i could use a megaraid 9240 RAID adapter.
>
> Now i can not find supported RAID Adapters.
>
> _ If for amd64, i can use a LSI MEGARAID 9240, may i plug it on arm64
> architecture ?

This sounds like something that somebody who has suitable hardware
(controller and preconfigured drives) would need to test.

Presumably you won't be able to boot directly from it if it even works
at all...

> _ Does the base kernel is including the drivers or i have to build the
> kernel to include it ?

None are compiled in the GENERIC / GENERIC.MP kernel on arm64. You
can check this by looking in /sys/arch/arm64/conf/GENERIC.

> _ Where, currently, can i find all RAID adapters supported by OpenBSD ?

I think it's the union of "man -s 4 -k RAID" and "man -s 4 -k fusion".
Some of them are old and crappy and are unlikely to work on much other than
(32-bit) i386.

On any arch, I would restrict myself to the common ones:
mpi/mpii/mfi/mfii/softraid. (For mpi, some changes that went into
-current recently make it suck much less).

Reply | Threaded
Open this post in threaded view
|

Re: [RAID] OpenBSD arm64 and RAID adapters

Olivier BURELLI
Hi stuart, thank for your help.

My goal :

_ Pine64  ROCKPro64 4Gb with boot on eMMC (just ordered)
_ LSI Megaraid 9260 + 5 SATA disks ; raid is only for a data home NAS
(not ordered yet)

Yes, if someone has already tested... it should be appreciated :)

Effectively no drivers are present in /sys/arch/arm64/conf/GENERIC but
present in i386 arch.

I hope that the pcie port will work fine :

_ rkpcie0 at fdt ?
_ pci at rkpcie ?
_ mfi*    at pci?            # LSI MegaRAID SAS controllers
_ mfii*    at pci?           # LSI MegaRAID SAS Fusion controllers
_ mpi*    at pci?           # LSI Logic Message Passing Interface
_ mpii*    at pci?          # LSI Message Passing Interface II

--> Maybe I should add them in the GENERIC file. Play, in second, with
the kernel compilation.

Question : for someone does pcie port running well on ROCKPro64 ?

Thank you,

Olivier.

On 11/19/2019 7:12 PM, Stuart Henderson wrote:

> On 2019/11/19 14:27, Olivier Burelli wrote:
>> Hello,
>>
>> For previous versions i checked on https://www.openbsd.org/amd64.html or
>> https://www.openbsd.org/arm64.html to find supported hardware.
>>
>> For example for amd64, i could use a megaraid 9240 RAID adapter.
>>
>> Now i can not find supported RAID Adapters.
>>
>> _ If for amd64, i can use a LSI MEGARAID 9240, may i plug it on arm64
>> architecture ?
> This sounds like something that somebody who has suitable hardware
> (controller and preconfigured drives) would need to test.
>
> Presumably you won't be able to boot directly from it if it even works
> at all...
>
>> _ Does the base kernel is including the drivers or i have to build the
>> kernel to include it ?
> None are compiled in the GENERIC / GENERIC.MP kernel on arm64. You
> can check this by looking in /sys/arch/arm64/conf/GENERIC.
>
>> _ Where, currently, can i find all RAID adapters supported by OpenBSD ?
> I think it's the union of "man -s 4 -k RAID" and "man -s 4 -k fusion".
> Some of them are old and crappy and are unlikely to work on much other than
> (32-bit) i386.
>
> On any arch, I would restrict myself to the common ones:
> mpi/mpii/mfi/mfii/softraid. (For mpi, some changes that went into
> -current recently make it suck much less).

Reply | Threaded
Open this post in threaded view
|

Re: [RAID] OpenBSD arm64 and RAID adapters

Todd Mortimer


> On Nov 19, 2019, at 16:22, Olivier Burelli <[hidden email]> wrote:
>
> Hi stuart, thank for your help.
>
> My goal :
>
> _ Pine64  ROCKPro64 4Gb with boot on eMMC (just ordered)
> _ LSI Megaraid 9260 + 5 SATA disks ; raid is only for a data home NAS (not ordered yet)
>
> Yes, if someone has already tested... it should be appreciated :)
>
> Effectively no drivers are present in /sys/arch/arm64/conf/GENERIC but present in i386 arch.
>
> I hope that the pcie port will work fine :
>
> _ rkpcie0 at fdt ?
> _ pci at rkpcie ?
> _ mfi*    at pci?            # LSI MegaRAID SAS controllers
> _ mfii*    at pci?           # LSI MegaRAID SAS Fusion controllers
> _ mpi*    at pci?           # LSI Logic Message Passing Interface
> _ mpii*    at pci?          # LSI Message Passing Interface II
>
> --> Maybe I should add them in the GENERIC file. Play, in second, with the kernel compilation.
>
> Question : for someone does pcie port running well on ROCKPro64 ?

I have a rockpro64 with the pcie sata card in it, and a ssd disk attached to that and it seems to work fine. i have done multiple snapshot builds using the attached disk without issue.

>
> Thank you,
>
> Olivier.
>
>> On 11/19/2019 7:12 PM, Stuart Henderson wrote:
>>> On 2019/11/19 14:27, Olivier Burelli wrote:
>>> Hello,
>>>
>>> For previous versions i checked on https://www.openbsd.org/amd64.html or
>>> https://www.openbsd.org/arm64.html to find supported hardware.
>>>
>>> For example for amd64, i could use a megaraid 9240 RAID adapter.
>>>
>>> Now i can not find supported RAID Adapters.
>>>
>>> _ If for amd64, i can use a LSI MEGARAID 9240, may i plug it on arm64
>>> architecture ?
>> This sounds like something that somebody who has suitable hardware
>> (controller and preconfigured drives) would need to test.
>>
>> Presumably you won't be able to boot directly from it if it even works
>> at all...
>>
>>> _ Does the base kernel is including the drivers or i have to build the
>>> kernel to include it ?
>> None are compiled in the GENERIC / GENERIC.MP kernel on arm64. You
>> can check this by looking in /sys/arch/arm64/conf/GENERIC.
>>
>>> _ Where, currently, can i find all RAID adapters supported by OpenBSD ?
>> I think it's the union of "man -s 4 -k RAID" and "man -s 4 -k fusion".
>> Some of them are old and crappy and are unlikely to work on much other than
>> (32-bit) i386.
>>
>> On any arch, I would restrict myself to the common ones:
>> mpi/mpii/mfi/mfii/softraid. (For mpi, some changes that went into
>> -current recently make it suck much less).
>

Reply | Threaded
Open this post in threaded view
|

Re: [RAID] OpenBSD arm64 and RAID adapters

Kurt Miller-3
In reply to this post by Olivier BURELLI
On Tue, 2019-11-19 at 22:22 +0100, Olivier Burelli wrote:

> Hi stuart, thank for your help.
>
> My goal :
>
> _ Pine64  ROCKPro64 4Gb with boot on eMMC (just ordered)
> _ LSI Megaraid 9260 + 5 SATA disks ; raid is only for a data home NAS 
> (not ordered yet)
>
> Yes, if someone has already tested... it should be appreciated :)
>
> Effectively no drivers are present in /sys/arch/arm64/conf/GENERIC but 
> present in i386 arch.
>
> I hope that the pcie port will work fine :
>
> _ rkpcie0 at fdt ?
> _ pci at rkpcie ?
> _ mfi*    at pci?            # LSI MegaRAID SAS controllers
> _ mfii*    at pci?           # LSI MegaRAID SAS Fusion controllers
> _ mpi*    at pci?           # LSI Logic Message Passing Interface
> _ mpii*    at pci?          # LSI Message Passing Interface II
>
> --> Maybe I should add them in the GENERIC file. Play, in second, with 
> the kernel compilation.
>
> Question : for someone does pcie port running well on ROCKPro64 ?

I have tested a few cards on the rockpro64 and found the following.

No issues found with these cards/chipsets:

StarTech.com PEXSAT32 2 Port SATA Controller
ahci0 at pci1 dev 0 function 0 "Marvell 88SE9128 AHCI" rev 0x20: msi, AHCI 1.2

QNINE NVME PCIe Adapter M.2 2280 w/Samsung 970 EVO
nvme0 at pci1 dev 0 function 0 "Samsung SM981/PM981 NVMe" rev 0x00: msix, NVMe 1.3


Works but is somewhat unstable under heavy load:
ROCKPro64 PCI-E to Dual SATA-II Interface Card
ahci0 at pci1 dev 0 function 0 "ASMedia ASM1061 AHCI" rev 0x01: msi, AHCI 1.2


Does not work:
HighPoint Rocket 640L
ahci0 at pci1 dev 0 function 0 "Marvell 88SE9230 AHCI" rev 0x11: msi, AHCI 1.2

Dell PERC 6/ir
mpi0 at pci9 dev 0 function 0 "Symbios Logic SAS1068E" rev 0x08: msi

Cards that don't work panic when first accessing the PCIe configuration
memory during boot. The reason for this is unknown and appears to be an
issue with Linux as well: https://github.com/rockchip-linux/kernel/issues/116
Some cards can be made to work by adding an arbitrary delay into the
rkpci driver after link training but this is a hack without a root
cause known so it is unlikely to be committed.

The current driver does not support cards that have PCI bridge's on
them as well.

-Kurt

> Thank you,
>
> Olivier.
>
> On 11/19/2019 7:12 PM, Stuart Henderson wrote:
> >
> > On 2019/11/19 14:27, Olivier Burelli wrote:
> > >
> > > Hello,
> > >
> > > For previous versions i checked on https://www.openbsd.org/amd64.html or
> > > https://www.openbsd.org/arm64.html to find supported hardware.
> > >
> > > For example for amd64, i could use a megaraid 9240 RAID adapter.
> > >
> > > Now i can not find supported RAID Adapters.
> > >
> > > _ If for amd64, i can use a LSI MEGARAID 9240, may i plug it on arm64
> > > architecture ?
> > This sounds like something that somebody who has suitable hardware
> > (controller and preconfigured drives) would need to test.
> >
> > Presumably you won't be able to boot directly from it if it even works
> > at all...
> >
> > >
> > > _ Does the base kernel is including the drivers or i have to build the
> > > kernel to include it ?
> > None are compiled in the GENERIC / GENERIC.MP kernel on arm64. You
> > can check this by looking in /sys/arch/arm64/conf/GENERIC.
> >
> > >
> > > _ Where, currently, can i find all RAID adapters supported by OpenBSD ?
> > I think it's the union of "man -s 4 -k RAID" and "man -s 4 -k fusion".
> > Some of them are old and crappy and are unlikely to work on much other than
> > (32-bit) i386.
> >
> > On any arch, I would restrict myself to the common ones:
> > mpi/mpii/mfi/mfii/softraid. (For mpi, some changes that went into
> > -current recently make it suck much less).