Help Setting up Linux Raid Server

I just built a home computer with 3TB hard drives I wanted to set up in a RAID 5 and load Ubuntu server onto it.

The first thing I did was set up the drives in a RAID 5 using just the motherboard chipset software to do it, so a 'hardware' RAID basically.

I installed Windows first to see if all the hardware works ok (that seemed the easiest way to verify it) and with the exception of the ethernet card (which needed a driver disk to work) everything was plug n' play and worked wonderfully. After that I booted the Windows install disk again to delete the partitions, hoping Ubuntu 10.10 server would create its own.

The problem I'm having is no matter what I've tried (deleting and recreating the RAID 5 setup, departitioning the drives), whenever I try to install Ubuntu it won't recognize the RAID as a valid disk. Ironically, it did at first, because I installed windows to verify the hardware. The ethernet card wasn't working automatically in the Ubuntu setup, (although it found the unformatted RAID drive), so I installed windows and figured out it was just the drivers that needed to be installed.

So now when I try to install Ubuntu, it finds the ethernet card perfectly and connects to the internet during the installation...but that actually stinks because it's telling me it's still accessing the drivers from the drives that I thought I formatted. Once it gets to the storage part of the installation afterwards, it can't find the RAID drive anymore. I tells me to choose a disk from the list, but the list is blank. So I can't install on it.

If I remove the RAID entirely and just keep the drives as 3 separate IDE drives, it finds every drive perfectly and can install to either one I choose. But I don't want this, I definitely need them RAIDed.

I would appreciate any advice at all on this, or even suggestions on another way of doing it. I've heard many people claim to dislike hardware RAIDs for linux servers and recommend using a software RAID instead. I am new to either, so I'd be happy to consider a software RAID if I knew it would be better/easier.

Any suggestion on a distrobution would be nice, too. I think I like the KDE interface, making me consider Kubuntu, but primarily I just want a server with the trimmings to access it from afar...LAMP,Email,SSH, and Remote Desktop.

Thanks for any advice!

Will P.

Often, the bootstrap is on a simple disk, and the RAID is dedicated to the application. For software RAID, I wonder if that is a requirement, since you need to boot the software to get it together. Remember that raid5 is not churn-friendly or small-block-random efficient, so many shops put high-churn and small block-random data on mirrors, sometimes striped for more bandwidth. Also, the controller(s) can be a bottleneck. Even with lots of RAM, random operations on large data sets will fill RAM uselessly, and fsync() of RDBMS Commit and other critical files (postfix email) waits for magnetic completion. A shot of SSD might be a great complement. Sometimes, you can shadow the SSD with RAID5 hierarchically, so only the most accessed bits move to SSD. Too much modified data in RAM in a liability!

Lore,

The chipset RAID is "NOT" hardware RAID. It is firmware + Software RAID and usually requires a driver for windows.

My suggestion is that you do the following: Leave the disks alone in a JBOD function (Just another bunch of disks), without spanning, and use the operating system's own software RAID. You will then be able to use any current Linux based operating system to manage the devices you created.

On my setup, using OpenSUSE 11.3, I have my device /dev/md0 as my /boot, /dev/md1 as my operating system volumes (in a volume group) and /dev/md3 (I skip md2 in case I need more for the OS, but that's a habit, it is not required) is my file store.