VMware Cloud Community
jgabay
Contributor
Contributor

11gR1 RAC Shared Disk Issue on re-boot

I'm setting up a test RAC environment with the following.

WMware Server 2.0

Host OS Windows 7

Guest OS OEL 5.4

Oracle ASMLib

I have been able to do the initial install of the clusterware software on the 2 nodes. My issue appears on reboot. The ASM disks that I created using oracleasm command disappear. As long as I don't reboot I'm fine.

Below is my latest configuration on the vmware side. Any thoughts out there on how to get this to work?

.encoding = "windows-1252"

config.version = "8"

virtualHW.version = "7"

floppy0.present = "FALSE"

mks.enable3d = "TRUE"

pciBridge0.present = "TRUE"

pciBridge4.present = "TRUE"

pciBridge4.virtualDev = "pcieRootPort"

pciBridge4.functions = "8"

pciBridge5.present = "TRUE"

pciBridge5.virtualDev = "pcieRootPort"

pciBridge5.functions = "8"

pciBridge6.present = "TRUE"

pciBridge6.virtualDev = "pcieRootPort"

pciBridge6.functions = "8"

pciBridge7.present = "TRUE"

pciBridge7.virtualDev = "pcieRootPort"

pciBridge7.functions = "8"

vmci0.present = "TRUE"

nvram = "11g - Node1.nvram"

virtualHW.productCompatibility = "hosted"

ft.secondary0.enabled = "TRUE"

tools.upgrade.policy = "useGlobal"

powerType.powerOff = "soft"

powerType.powerOn = "hard"

powerType.suspend = "hard"

powerType.reset = "soft"

displayName = "11g - Node2"

extendedConfigFile = "11g - Node1.vmxf"

scsi0.present = "TRUE"

scsi0.sharedBus = "virtual"

scsi0.virtualDev = "lsilogic"

memsize = "1024"

scsi0:0.present = "TRUE"

scsi0:0.fileName = "11g.vmdk"

scsi0:0.writeThrough = "TRUE"

ide1:0.present = "TRUE"

ide1:0.fileName = "D:"

ide1:0.deviceType = "atapi-cdrom"

ide1:0.allowGuestConnectionControl = "FALSE"

ethernet0.present = "TRUE"

ethernet0.allowGuestConnectionControl = "FALSE"

ethernet0.features = "1"

ethernet0.wakeOnPcktRcv = "FALSE"

ethernet0.networkName = "Bridged"

ethernet0.addressType = "generated"

usb.present = "TRUE"

ehci.present = "TRUE"

guestOS = "other26xlinux"

uuid.location = "56 4d ad ec 03 aa c9 9f-f9 39 f8 7c b0 6b ce 4a"

uuid.bios = "56 4d ad ec 03 aa c9 9f-f9 39 f8 7c b0 6b ce 4a"

vc.uuid = "52 ce 4b 33 90 db f5 fc-f9 02 b4 5c 27 ce bd 5b"

ethernet0.generatedAddress = "00:0c:29:6b:ce:4a"

scsi0:0.redo = ""

vmotion.checkpointFBSize = "134217728"

pciBridge0.pciSlotNumber = "17"

pciBridge4.pciSlotNumber = "21"

pciBridge5.pciSlotNumber = "22"

pciBridge6.pciSlotNumber = "23"

pciBridge7.pciSlotNumber = "24"

scsi0.pciSlotNumber = "16"

usb.pciSlotNumber = "32"

ethernet0.pciSlotNumber = "33"

ehci.pciSlotNumber = "34"

vmci0.pciSlotNumber = "35"

ethernet0.generatedAddressOffset = "0"

vmci0.id = "-85559283"

tools.remindInstall = "TRUE"

tools.syncTime = "FALSE"

ethernet1.present = "TRUE"

ethernet1.allowGuestConnectionControl = "FALSE"

ethernet1.features = "1"

ethernet1.wakeOnPcktRcv = "FALSE"

ethernet1.networkName = "Bridged"

ethernet1.addressType = "generated"

disk.locking = "FALSE"

diskLib.dataCacheMaxSize = "0"

diskLib.dataCacheMaxReadAheadSize = "0"

diskLib.dataCacheMinReadAheadSize = "0"

diskLib.dataCachePageSize = "4096"

diskLib.maxUnsyncedWrites = "0"

scsi0:1.present = "TRUE"

scsi0:1.fileName = "C:\Virtual Machines\11g - Node1\ocr.vmdk"

scsi0:1.writeThrough = "TRUE"

scsi0:1.mode = "independent-persistent"

scsi0:1.deviceType = "disk"

scsi0:2.present = "TRUE"

scsi0:2.fileName = "C:\Virtual Machines\11g - Node1\votingdisk.vmdk"

scsi0:2.writeThrough = "TRUE"

scsi0:2.mode = "independent-persistent"

scsi0:2.deviceType = "disk"

scsi0:3.present = "TRUE"

scsi0:3.fileName = "C:\Virtual Machines\11g - Node1\asm.vmdk"

scsi0:3.writeThrough = "TRUE"

scsi0:3.mode = "independent-persistent"

scsi0:3.deviceType = "disk"

ethernet1.generatedAddress = "00:0c:29:6b:ce:54"

scsi0:1.redo = ""

scsi0:2.redo = ""

scsi0:3.redo = ""

ethernet1.pciSlotNumber = "36"

ethernet1.generatedAddressOffset = "10"

0 Kudos
3 Replies
jgabay
Contributor
Contributor

I didn't mention that the disks do not disappear on re-boot prior to the installation of Clusterware. So, this only appears at that stage.

If I do an oracleasm listdisks they appear. After Clusterware installation and re-boot they don't.

0 Kudos
admin
Immortal
Immortal

If you're presenting the disks as raw devices (iSCSI), after boot, maybe the disk identifiers change... i.e. /dev/sda1 is /dev/sdd1. If this is the case, you can use devlabel or something similar to avoid this situation.

Maybe, you have problems with permissions in the devices. Revise the permissions.

Kind regards.

P.

0 Kudos
jgabay
Contributor
Contributor

Not using raw devices. Permissions all appear correct.

0 Kudos