Apparently 9690SA support still didn't arrive in CentOS 5.2, so you still need some tricks to get it to work.

First download the driver disk from 3ware. If you are using a Xen kernel, you will need to get it from this knowledgebase article: http://www.3ware.com/KB/article.aspx?id=15399.

Extract the files and put them on a floppy. When installing linux you will need to type in 'linux dd' in the prompt when you boot off the CentOS 5.2 DVD/CD.

After installation, everything appears to be fine, but once you run yum update, and it updates the kernel, you will be unable to boot into the new kernel. We will need to do a few steps before it will work with a new kernel.

First, download the driver disk to your CentOS 5.2 box. (I couldn't get the URL off the page, so I FTPed the file over).

unzip the file:

view plain print about
1# unzip 208-3w-95xx-9650_9690_rhel5u2-kernel2.6.18-92.el5-installdisk-x86_64-9.5-GUID28bef5f421164b46ab5d859e5d957eea.zip
2Archive: 208-3w-95xx-9650_9690_rhel5u2-kernel2.6.18-92.el5-installdisk-x86_64-9.5-GUID28bef5f421164b46ab5d859e5d957eea.zip
3 inflating: modinfo
4 inflating: modules.alias
5 inflating: modules.cgz
6 inflating: modules.dep
7 inflating: modules.pcimap
8 inflating: pci.ids
9 inflating: pcitable
10 inflating: Readme
11 inflating: rhdd

Now we need to get the kernel modules out of modules.cgz.

view plain print about
1# zcat modules.cgz | cpio -ivd
22.6.18-92.el5
32.6.18-92.el5/x86_64
42.6.18-92.el5/x86_64/3w-9xxx.ko
52.6.18-92.el5xen
62.6.18-92.el5xen/x86_64
72.6.18-92.el5xen/x86_64/3w-9xxx.ko
81421 blocks

Since we are updating a regular kernel - not xen, we will use the 2.6.18-92.el5/x86_64/3w-9xxx.ko file.

view plain print about
1# cp 2.6.18-92.el5/x86_64/3w-9xxx.ko /lib/modules/2.6.18-92.1.6.el5/updates/

Now we need to make a new initrd

view plain print about
1# depmod 2.6.18-92.1.6.el5
2# cp /boot/initrd-2.6.18-92.1.6.el5.img /boot/initrd-2.6.18-92.1.6.el5.img.old
3# mkinitrd -v -f /boot/initrd-2.6.18-92.1.6.el5.img 2.6.18-92.1.6.el5
4Creating initramfs
5Looking for deps of module ehci-hcd
6Looking for deps of module ohci-hcd
7Looking for deps of module uhci-hcd
8Looking for deps of module ext3: jbd
9Looking for deps of module jbd
10Looking for driver for device sda2
11Looking for deps of module pci:v000013C1d00001005sv000013C1sd00001005bc01sc04i00: scsi_mod 3w-9xxx
12Looking for deps of module scsi_mod
13Looking for deps of module sd_mod: scsi_mod
14Looking for deps of module 3w-9xxx: scsi_mod
15Looking for deps of module ahci: scsi_mod libata
16Looking for deps of module libata: scsi_mod
17Looking for deps of module usb-storage: scsi_mod
18Looking for deps of module ide-disk
19Looking for deps of module dm-mod
20Looking for deps of module dm-mirror: dm-mod
21Looking for deps of module dm-zero: dm-mod
22Looking for deps of module dm-snapshot: dm-mod
23Using modules: /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/usb/host/ehci-hcd.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/usb/host/ohci-hcd.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/usb/host/uhci-hcd.ko /lib/modules/2.6.18-92.1.6.el5/kernel/fs/jbd/jbd.ko /lib/modules/2.6.18-92.1.6.el5/kernel/fs/ext3/ext3.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/scsi/scsi_mod.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/scsi/sd_mod.ko /lib/modules/2.6.18-92.1.6.el5/updates/3w-9xxx.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/ata/libata.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/ata/ahci.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/usb/storage/usb-storage.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/md/dm-mod.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/md/dm-mirror.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/md/dm-zero.ko /lib/modules/2.6.18-92.1.6.el5/kernel/drivers/md/dm-snapshot.ko
24/sbin/nash -> /tmp/initrd.RX6099/bin/nash
25/sbin/insmod.static -> /tmp/initrd.RX6099/bin/insmod
26`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/usb/host/ehci-hcd.ko' -> `/tmp/initrd.RX6099/lib/ehci-hcd.ko'
27`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/usb/host/ohci-hcd.ko' -> `/tmp/initrd.RX6099/lib/ohci-hcd.ko'
28`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/usb/host/uhci-hcd.ko' -> `/tmp/initrd.RX6099/lib/uhci-hcd.ko'
29`/lib/modules/2.6.18-92.1.6.el5/kernel/fs/jbd/jbd.ko' -> `/tmp/initrd.RX6099/lib/jbd.ko'
30`/lib/modules/2.6.18-92.1.6.el5/kernel/fs/ext3/ext3.ko' -> `/tmp/initrd.RX6099/lib/ext3.ko'
31`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/scsi/scsi_mod.ko' -> `/tmp/initrd.RX6099/lib/scsi_mod.ko'
32`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/scsi/sd_mod.ko' -> `/tmp/initrd.RX6099/lib/sd_mod.ko'
33`/lib/modules/2.6.18-92.1.6.el5/updates/3w-9xxx.ko' -> `/tmp/initrd.RX6099/lib/3w-9xxx.ko'
34`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/ata/libata.ko' -> `/tmp/initrd.RX6099/lib/libata.ko'
35`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/ata/ahci.ko' -> `/tmp/initrd.RX6099/lib/ahci.ko'
36`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/usb/storage/usb-storage.ko' -> `/tmp/initrd.RX6099/lib/usb-storage.ko'
37`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/md/dm-mod.ko' -> `/tmp/initrd.RX6099/lib/dm-mod.ko'
38`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/md/dm-mirror.ko' -> `/tmp/initrd.RX6099/lib/dm-mirror.ko'
39`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/md/dm-zero.ko' -> `/tmp/initrd.RX6099/lib/dm-zero.ko'
40`/lib/modules/2.6.18-92.1.6.el5/kernel/drivers/md/dm-snapshot.ko' -> `/tmp/initrd.RX6099/lib/dm-snapshot.ko'
41/sbin/lvm.static -> /tmp/initrd.RX6099/bin/lvm
42/etc/lvm -> /tmp/initrd.RX6099/etc/lvm
43`/etc/lvm/lvm.conf' -> `/tmp/initrd.RX6099/etc/lvm/lvm.conf'
44/sbin/dmraid.static -> /tmp/initrd.RX6099/bin/dmraid
45/sbin/kpartx.static -> /tmp/initrd.RX6099/bin/kpartx
46Adding module ehci-hcd
47Adding module ohci-hcd
48Adding module uhci-hcd
49Adding module jbd
50Adding module ext3
51Adding module scsi_mod
52Adding module sd_mod
53Adding module 3w-9xxx
54Adding module libata
55Adding module ahci
56Adding module usb-storage
57Adding module dm-mod
58Adding module dm-mirror
59Adding module dm-zero
60Adding module dm-snapshot

As you can see, it used our version of the 3w-9xxx.ko instead of the one that came with the kernel.

Now we reboot and see that it books successfully into the new kernel.

view plain print about
1# shutdown -r now

Now lets say that we have a xen kernel. Either by installing the stock xen or using the 3.2 version from my companion entry, now we need to update the 3w-9xxx.ko for that kernel as well, otherwise it won't boot. The steps are pretty similar, substituting the proper kernel version, we get:

view plain print about
1# cp 2.6.18-92.el5xen/x86_64/3w-9xxx.ko /lib/modules/2.6.18-92.1.6.el5xen/updates/

Now we need to make a new initrd

view plain print about
1# depmod 2.6.18-92.1.6.el5xen
2# cp /boot/initrd-2.6.18-92.1.6.el5xen.img /boot/initrd-2.6.18-92.1.6.el5xen.img.old
3# mkinitrd -v -f /boot/initrd-2.6.18-92.1.6.el5xen.img 2.6.18-92.1.6.el5xen
4Creating initramfs
5Looking for deps of module ehci-hcd
6Looking for deps of module ohci-hcd
7Looking for deps of module uhci-hcd
8Looking for deps of module ext3: jbd
9Looking for deps of module jbd
10Looking for driver for device sda2
11Looking for deps of module pci:v000013C1d00001005sv000013C1sd00001005bc01sc04i00: scsi_mod 3w-9xxx
12Looking for deps of module scsi_mod
13Looking for deps of module sd_mod: scsi_mod
14Looking for deps of module 3w-9xxx: scsi_mod
15Looking for deps of module ahci: scsi_mod libata
16Looking for deps of module libata: scsi_mod
17Looking for deps of module usb-storage: scsi_mod
18Looking for deps of module ide-disk
19Looking for deps of module dm-mod
20Looking for deps of module dm-mirror: dm-mod
21Looking for deps of module dm-zero: dm-mod
22Looking for deps of module dm-snapshot: dm-mod
23Using modules: /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/usb/host/ehci-hcd.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/usb/host/ohci-hcd.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/usb/host/uhci-hcd.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/fs/jbd/jbd.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/fs/ext3/ext3.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/scsi/scsi_mod.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/scsi/sd_mod.ko /lib/modules/2.6.18-92.1.6.el5xen/updates/3w-9xxx.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/ata/libata.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/ata/ahci.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/usb/storage/usb-storage.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/md/dm-mod.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/md/dm-mirror.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/md/dm-zero.ko /lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/md/dm-snapshot.ko
24/sbin/nash -> /tmp/initrd.sW6636/bin/nash
25/sbin/insmod.static -> /tmp/initrd.sW6636/bin/insmod
26`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/usb/host/ehci-hcd.ko' -> `/tmp/initrd.sW6636/lib/ehci-hcd.ko'
27`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/usb/host/ohci-hcd.ko' -> `/tmp/initrd.sW6636/lib/ohci-hcd.ko'
28`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/usb/host/uhci-hcd.ko' -> `/tmp/initrd.sW6636/lib/uhci-hcd.ko'
29`/lib/modules/2.6.18-92.1.6.el5xen/kernel/fs/jbd/jbd.ko' -> `/tmp/initrd.sW6636/lib/jbd.ko'
30`/lib/modules/2.6.18-92.1.6.el5xen/kernel/fs/ext3/ext3.ko' -> `/tmp/initrd.sW6636/lib/ext3.ko'
31`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/scsi/scsi_mod.ko' -> `/tmp/initrd.sW6636/lib/scsi_mod.ko'
32`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/scsi/sd_mod.ko' -> `/tmp/initrd.sW6636/lib/sd_mod.ko'
33`/lib/modules/2.6.18-92.1.6.el5xen/updates/3w-9xxx.ko' -> `/tmp/initrd.sW6636/lib/3w-9xxx.ko'
34`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/ata/libata.ko' -> `/tmp/initrd.sW6636/lib/libata.ko'
35`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/ata/ahci.ko' -> `/tmp/initrd.sW6636/lib/ahci.ko'
36`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/usb/storage/usb-storage.ko' -> `/tmp/initrd.sW6636/lib/usb-storage.ko'
37`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/md/dm-mod.ko' -> `/tmp/initrd.sW6636/lib/dm-mod.ko'
38`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/md/dm-mirror.ko' -> `/tmp/initrd.sW6636/lib/dm-mirror.ko'
39`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/md/dm-zero.ko' -> `/tmp/initrd.sW6636/lib/dm-zero.ko'
40`/lib/modules/2.6.18-92.1.6.el5xen/kernel/drivers/md/dm-snapshot.ko' -> `/tmp/initrd.sW6636/lib/dm-snapshot.ko'
41/sbin/lvm.static -> /tmp/initrd.sW6636/bin/lvm
42/etc/lvm -> /tmp/initrd.sW6636/etc/lvm
43`/etc/lvm/lvm.conf' -> `/tmp/initrd.sW6636/etc/lvm/lvm.conf'
44/sbin/dmraid.static -> /tmp/initrd.sW6636/bin/dmraid
45/sbin/kpartx.static -> /tmp/initrd.sW6636/bin/kpartx
46Adding module ehci-hcd
47Adding module ohci-hcd
48Adding module uhci-hcd
49Adding module jbd
50Adding module ext3
51Adding module scsi_mod
52Adding module sd_mod
53Adding module 3w-9xxx
54Adding module libata
55Adding module ahci
56Adding module usb-storage
57Adding module dm-mod
58Adding module dm-mirror
59Adding module dm-zero
60Adding module dm-snapshot

Now we reboot, and it should boot sucessfully into xen.

This entry was posted on June 30, 2008 at 6:42 PM and has received 3410 views. There are currently 7 comments. Print this entry.