3ware 9690SA on CentOS 5.2 x86_64 with Xen

Posted At : June 30, 2008 5:42 PM | Posted By : Ruslan Sivak
Related Categories: Linux, Xen
Apparently 9690SA support still didn't arrive in CentOS 5.2, so you still need some tricks to get it to work.

First download the driver disk from 3ware. If you are using a Xen kernel, you will need to get it from this knowledgebase article: http://www.3ware.com/KB/article.aspx?id=15399.

Extract the files and put them on a floppy. When installing linux you will need to type in 'linux dd' in the prompt when you boot off the CentOS 5.2 DVD/CD.

After installation, everything appears to be fine, but once you run yum update, and it updates the kernel, you will be unable to boot into the new kernel. We will need to do a few steps before it will work with a new kernel.

First, download the driver disk to your CentOS 5.2 box. (I couldn't get the URL off the page, so I FTPed the file over).

unzip the file:

# unzip 208-3w-95xx-9650_9690_rhel5u2-kernel2.6.18-92.el5-installdisk-x86_64-9.5-GUID28bef5f421164b46ab5d859e5d957eea.zip
Archive: 208-3w-95xx-9650_9690_rhel5u2-kernel2.6.18-92.el5-installdisk-x86_64-9.5-GUID28bef5f421164b46ab5d859e5d957eea.zip
inflating: modinfo
inflating: modules.alias
inflating: modules.cgz
inflating: modules.dep
inflating: modules.pcimap
inflating: pci.ids
inflating: pcitable
inflating: Readme
inflating: rhdd

Now we need to get the kernel modules out of modules.cgz.

# zcat modules.cgz | cpio -ivd
2.6.18-92.el5
2.6.18-92.el5/x86_64
2.6.18-92.el5/x86_64/3w-9xxx.ko
2.6.18-92.el5xen
2.6.18-92.el5xen/x86_64
2.6.18-92.el5xen/x86_64/3w-9xxx.ko
1421 blocks

Since we are updating a regular kernel - not xen, we will use the 2.6.18-92.el5/x86_64/3w-9xxx.ko file.

# cp 2.6.18-92.el5/x86_64/3w-9xxx.ko /lib/modules/2.6.18-92.1.6.el5/updates/

Now we need to make a new initrd

# depmod 2.6.18-92.1.6.el5
# cp /boot/initrd-2.6.18-92.1.6.el5.img /boot/initrd-2.6.18-92.1.6.el5.img.old
# mkinitrd -v -f /boot/initrd-2.6.18-92.1.6.el5.img 2.6.18-92.1.6.el5
Creating initramfs
Looking for deps of module ehci-hcd
Looking for deps of module ohci-hcd
Looking for deps of module uhci-hcd
Looking for deps of module ext3: jbd
Looking for deps of module jbd
Looking for driver for device sda2
Looking for deps of module pci:v000013C1d00001005sv000013C1sd00001005bc01sc04i00: scsi_mod 3w-9xxx
Looking for deps of module scsi_mod
Looking for deps of module sd_mod: scsi_mod
Looking for deps of module 3w-9xxx: scsi_mod
Looking for deps of module ahci: scsi_mod libata
Looking for deps of module libata: scsi_mod
Looking for deps of module usb-storage: scsi_mod
Looking for deps of module ide-disk
Looking for deps of module dm-mod
Looking for deps of module dm-mirror: dm-mod
Looking for deps of module dm-zero: dm-mod
Looking for deps of module dm-snapshot: dm-mod
Using modules: /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/usb/host/ehci-hcd.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/usb/host/ohci-hcd.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/usb/host/uhci-hcd.ko /lib/modules/2.6.18-92.1.6.el5/kernel/fs/jbd/jbd.ko /lib/modules/2.6.18-92.1.6.el5/kernel/fs/ext3/ext3.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/scsi/scsi_mod.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/scsi/sd_mod.ko /lib/modules/2.6.18-92.1.6.el5/updates/3w-9xxx.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/ata/libata.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/ata/ahci.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/usb/storage/usb-storage.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/md/dm-mod.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/md/dm-mirror.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/md/dm-zero.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/md/dm-snapshot.ko
/sbin/nash -> /tmp/initrd.RX6099/bin/nash
/sbin/insmod.static -> /tmp/initrd.RX6099/bin/insmod
`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/usb/host/ehci-hcd.ko' -> `/tmp/initrd.RX6099/lib/ehci-hcd.ko'
`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/usb/host/ohci-hcd.ko' -> `/tmp/initrd.RX6099/lib/ohci-hcd.ko'
`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/usb/host/uhci-hcd.ko' -> `/tmp/initrd.RX6099/lib/uhci-hcd.ko'
`/lib/modules/2.6.18-92.1.6.el5/kernel/fs/jbd/jbd.ko' -> `/tmp/initrd.RX6099/lib/jbd.ko'
`/lib/modules/2.6.18-92.1.6.el5/kernel/fs/ext3/ext3.ko' -> `/tmp/initrd.RX6099/lib/ext3.ko'
`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/scsi/scsi_mod.ko' -> `/tmp/initrd.RX6099/lib/scsi_mod.ko'
`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/scsi/sd_mod.ko' -> `/tmp/initrd.RX6099/lib/sd_mod.ko'
`/lib/modules/2.6.18-92.1.6.el5/updates/3w-9xxx.ko' -> `/tmp/initrd.RX6099/lib/3w-9xxx.ko'
`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/ata/libata.ko' -> `/tmp/initrd.RX6099/lib/libata.ko'
`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/ata/ahci.ko' -> `/tmp/initrd.RX6099/lib/ahci.ko'
`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/usb/storage/usb-storage.ko' -> `/tmp/initrd.RX6099/lib/usb-storage.ko'
`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/md/dm-mod.ko' -> `/tmp/initrd.RX6099/lib/dm-mod.ko'
`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/md/dm-mirror.ko' -> `/tmp/initrd.RX6099/lib/dm-mirror.ko'
`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/md/dm-zero.ko' -> `/tmp/initrd.RX6099/lib/dm-zero.ko'
`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/md/dm-snapshot.ko' -> `/tmp/initrd.RX6099/lib/dm-snapshot.ko'
/sbin/lvm.static -> /tmp/initrd.RX6099/bin/lvm
/etc/lvm -> /tmp/initrd.RX6099/etc/lvm
`/etc/lvm/lvm.conf' -> `/tmp/initrd.RX6099/etc/lvm/lvm.conf'
/sbin/dmraid.static -> /tmp/initrd.RX6099/bin/dmraid
/sbin/kpartx.static -> /tmp/initrd.RX6099/bin/kpartx
Adding module ehci-hcd
Adding module ohci-hcd
Adding module uhci-hcd
Adding module jbd
Adding module ext3
Adding module scsi_mod
Adding module sd_mod
Adding module 3w-9xxx
Adding module libata
Adding module ahci
Adding module usb-storage
Adding module dm-mod
Adding module dm-mirror
Adding module dm-zero
Adding module dm-snapshot

As you can see, it used our version of the 3w-9xxx.ko instead of the one that came with the kernel.

Now we reboot and see that it books successfully into the new kernel.

# shutdown -r now

Now lets say that we have a xen kernel. Either by installing the stock xen or using the 3.2 version from my companion entry, now we need to update the 3w-9xxx.ko for that kernel as well, otherwise it won't boot. The steps are pretty similar, substituting the proper kernel version, we get:

# cp 2.6.18-92.el5xen/x86_64/3w-9xxx.ko /lib/modules/2.6.18-92.1.6.el5xen/updates/

Now we need to make a new initrd

# depmod 2.6.18-92.1.6.el5xen
# cp /boot/initrd-2.6.18-92.1.6.el5xen.img /boot/initrd-2.6.18-92.1.6.el5xen.img.old
# mkinitrd -v -f /boot/initrd-2.6.18-92.1.6.el5xen.img 2.6.18-92.1.6.el5xen
Creating initramfs
Looking for deps of module ehci-hcd
Looking for deps of module ohci-hcd
Looking for deps of module uhci-hcd
Looking for deps of module ext3: jbd
Looking for deps of module jbd
Looking for driver for device sda2
Looking for deps of module pci:v000013C1d00001005sv000013C1sd00001005bc01sc04i00: scsi_mod 3w-9xxx
Looking for deps of module scsi_mod
Looking for deps of module sd_mod: scsi_mod
Looking for deps of module 3w-9xxx: scsi_mod
Looking for deps of module ahci: scsi_mod libata
Looking for deps of module libata: scsi_mod
Looking for deps of module usb-storage: scsi_mod
Looking for deps of module ide-disk
Looking for deps of module dm-mod
Looking for deps of module dm-mirror: dm-mod
Looking for deps of module dm-zero: dm-mod
Looking for deps of module dm-snapshot: dm-mod
Using modules: /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/usb/host/ehci-hcd.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/usb/host/ohci-hcd.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/usb/host/uhci-hcd.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/fs/jbd/jbd.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/fs/ext3/ext3.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/scsi/scsi_mod.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/scsi/sd_mod.ko /lib/modules/2.6.18-92.1.6.el5xen/updates/3w-9xxx.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/ata/libata.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/ata/ahci.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/usb/storage/usb-storage.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/md/dm-mod.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/md/dm-mirror.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/md/dm-zero.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/md/dm-snapshot.ko
/sbin/nash -> /tmp/initrd.sW6636/bin/nash
/sbin/insmod.static -> /tmp/initrd.sW6636/bin/insmod
`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/usb/host/ehci-hcd.ko' -> `/tmp/initrd.sW6636/lib/ehci-hcd.ko'
`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/usb/host/ohci-hcd.ko' -> `/tmp/initrd.sW6636/lib/ohci-hcd.ko'
`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/usb/host/uhci-hcd.ko' -> `/tmp/initrd.sW6636/lib/uhci-hcd.ko'
`/lib/modules/2.6.18-92.1.6.el5xen/kernel/fs/jbd/jbd.ko' -> `/tmp/initrd.sW6636/lib/jbd.ko'
`/lib/modules/2.6.18-92.1.6.el5xen/kernel/fs/ext3/ext3.ko' -> `/tmp/initrd.sW6636/lib/ext3.ko'
`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/scsi/scsi_mod.ko' -> `/tmp/initrd.sW6636/lib/scsi_mod.ko'
`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/scsi/sd_mod.ko' -> `/tmp/initrd.sW6636/lib/sd_mod.ko'
`/lib/modules/2.6.18-92.1.6.el5xen/updates/3w-9xxx.ko' -> `/tmp/initrd.sW6636/lib/3w-9xxx.ko'
`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/ata/libata.ko' -> `/tmp/initrd.sW6636/lib/libata.ko'
`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/ata/ahci.ko' -> `/tmp/initrd.sW6636/lib/ahci.ko'
`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/usb/storage/usb-storage.ko' -> `/tmp/initrd.sW6636/lib/usb-storage.ko'
`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/md/dm-mod.ko' -> `/tmp/initrd.sW6636/lib/dm-mod.ko'
`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/md/dm-mirror.ko' -> `/tmp/initrd.sW6636/lib/dm-mirror.ko'
`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/md/dm-zero.ko' -> `/tmp/initrd.sW6636/lib/dm-zero.ko'
`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/md/dm-snapshot.ko' -> `/tmp/initrd.sW6636/lib/dm-snapshot.ko'
/sbin/lvm.static -> /tmp/initrd.sW6636/bin/lvm
/etc/lvm -> /tmp/initrd.sW6636/etc/lvm
`/etc/lvm/lvm.conf' -> `/tmp/initrd.sW6636/etc/lvm/lvm.conf'
/sbin/dmraid.static -> /tmp/initrd.sW6636/bin/dmraid
/sbin/kpartx.static -> /tmp/initrd.sW6636/bin/kpartx
Adding module ehci-hcd
Adding module ohci-hcd
Adding module uhci-hcd
Adding module jbd
Adding module ext3
Adding module scsi_mod
Adding module sd_mod
Adding module 3w-9xxx
Adding module libata
Adding module ahci
Adding module usb-storage
Adding module dm-mod
Adding module dm-mirror
Adding module dm-zero
Adding module dm-snapshot

Now we reboot, and it should boot sucessfully into xen.

Comments (11) | Print | Send | del.icio.us | Linking Blogs
Comments
[Add Comment]
olik's Gravatar http://www.social21.com/Forum/forum_posts.asp?TID=...
# Posted By olik | 10/12/08 7:35 PM
hilop's Gravatar http://www.social21.com/Forum/forum_posts.asp?TID=...
# Posted By hilop | 10/12/08 7:39 PM
hed's Gravatar http://www.social21.com/Forum/forum_posts.asp?TID=...
# Posted By hed | 10/12/08 7:42 PM
jop's Gravatar http://www.social21.com/Forum/forum_posts.asp?TID=...
# Posted By jop | 10/12/08 7:45 PM
loih's Gravatar http://www.social21.com/Forum/forum_posts.asp?TID=...
# Posted By loih | 10/12/08 7:49 PM
Gerdek's Gravatar http://cizgi-film-izle-seyret.blogspot.com/
http://www.gazetetr.net
http://www.arkadasfm.com
http://www.oyun112.com
http://www.komikce.net
http://www.gazetetr.net
http://www.arkadasfm.com
http://www.oyun112.com
http://www.oyun112.com/Cocuk.html" target="_blank">http://www.oyun112.com/Cocuk.html
http://www.oyun112.com/Macera.html" target="_blank">http://www.oyun112.com/Macera.html
http://www.oyun112.com/Dovus.html" target="_blank">http://www.oyun112.com/Dovus.html
http://www.oyun112.com/Yaris.html" target="_blank">http://www.oyun112.com/Yaris.html
http://www.oyun112.com/Zeka.html" target="_blank">http://www.oyun112.com/Zeka.html" target="_blank">http://www.oyun112.com/Zeka.html" target="_blank">http://www.oyun112.com/Zeka.html
http://www.oyun112.com/Zeka.html" target="_blank">http://www.oyun112.com/Zeka.html" target="_blank">http://www.oyun112.com/Zeka.html" target="_blank">http://www.oyun112.com/Zeka.html
http://www.oyun112.com/Spor.html
http://www.oyun112.com/Komik.html
http://www.oyun112.com/oyunlari.php?t=K?z" target="_blank">http://www.oyun112.com/oyunlari.php?t=K?z" target="_blank">http://www.oyun112.com/oyunlari.php?t=K?z" target="_blank">http://www.oyun112.com/oyunlari.php?t=K?z

http://www.oyunlars.net
http://www.oyunlars.net/games/kiz.html" target="_blank">http://www.oyunlars.net/games/kiz.html" target="_blank">http://www.oyunlars.net/games/kiz.html" target="_blank">http://www.oyunlars.net/games/kiz.html
http://www.oyunlars.net/games/cocuk.html
http://www.oyunlars.net/games/macera.html
http://www.oyunlars.net/games/dovus.html" target="_blank">http://www.oyunlars.net/games/dovus.html" target="_blank">http://www.oyunlars.net/games/dovus.html" target="_blank">http://www.oyunlars.net/games/dovus.html
http://www.oyunlars.net/games/yaris.html" target="_blank">http://www.oyunlars.net/games/yaris.html" target="_blank">http://www.oyunlars.net/games/yaris.html" target="_blank">http://www.oyunlars.net/games/yaris.html
http://www.oyunlars.net/games/zeka.html
http://www.oyunlars.net/games/spor.html
http://www.oyunlars.net/games/aksiyon.html" target="_blank">http://www.oyunlars.net/games/aksiyon.html" target="_blank">http://www.oyunlars.net/games/aksiyon.html" target="_blank">http://www.oyunlars.net/games/aksiyon.html
http://www.oyunlars.net/games/komik.html
http://www.oyunlars.net/games/hedef.html
http://cizgi-film-izle-seyret.blogspot.com/
# Posted By Gerdek | 11/28/08 9:43 AM
[Add Comment]
BlogCFC was created by Raymond Camden.