VMware Cloud Community
jgabay
Contributor
Contributor

11gR1 RAC Shared Disk Issue on re-boot

I'm setting up a test RAC environment with the following.

WMware Server 2.0

Host OS Windows 7

Guest OS OEL 5.4

Oracle ASMLib

I have been able to do the initial install of the clusterware software on the 2 nodes. My issue appears on reboot. The ASM disks that I created using oracleasm command disappear. As long as I don't reboot I'm fine.

Below is my latest configuration on the vmware side. Any thoughts out there on how to get this to work?

.encoding = "windows-1252"

config.version = "8"

virtualHW.version = "7"

floppy0.present = "FALSE"

mks.enable3d = "TRUE"

pciBridge0.present = "TRUE"

pciBridge4.present = "TRUE"

pciBridge4.virtualDev = "pcieRootPort"

pciBridge4.functions = "8"

pciBridge5.present = "TRUE"

pciBridge5.virtualDev = "pcieRootPort"

pciBridge5.functions = "8"

pciBridge6.present = "TRUE"

pciBridge6.virtualDev = "pcieRootPort"

pciBridge6.functions = "8"

pciBridge7.present = "TRUE"

pciBridge7.virtualDev = "pcieRootPort"

pciBridge7.functions = "8"

vmci0.present = "TRUE"

nvram = "11g - Node1.nvram"

virtualHW.productCompatibility = "hosted"

ft.secondary0.enabled = "TRUE"

tools.upgrade.policy = "useGlobal"

powerType.powerOff = "soft"

powerType.powerOn = "hard"

powerType.suspend = "hard"

powerType.reset = "soft"

displayName = "11g - Node2"

extendedConfigFile = "11g - Node1.vmxf"

scsi0.present = "TRUE"

scsi0.sharedBus = "virtual"

scsi0.virtualDev = "lsilogic"

memsize = "1024"

scsi0:0.present = "TRUE"

scsi0:0.fileName = "11g.vmdk"

scsi0:0.writeThrough = "TRUE"

ide1:0.present = "TRUE"

ide1:0.fileName = "D:"

ide1:0.deviceType = "atapi-cdrom"

ide1:0.allowGuestConnectionControl = "FALSE"

ethernet0.present = "TRUE"

ethernet0.allowGuestConnectionControl = "FALSE"

ethernet0.features = "1"

ethernet0.wakeOnPcktRcv = "FALSE"

ethernet0.networkName = "Bridged"

ethernet0.addressType = "generated"

usb.present = "TRUE"

ehci.present = "TRUE"

guestOS = "other26xlinux"

uuid.location = "56 4d ad ec 03 aa c9 9f-f9 39 f8 7c b0 6b ce 4a"

uuid.bios = "56 4d ad ec 03 aa c9 9f-f9 39 f8 7c b0 6b ce 4a"

vc.uuid = "52 ce 4b 33 90 db f5 fc-f9 02 b4 5c 27 ce bd 5b"

ethernet0.generatedAddress = "00:0c:29:6b:ce:4a"

scsi0:0.redo = ""

vmotion.checkpointFBSize = "134217728"

pciBridge0.pciSlotNumber = "17"

pciBridge4.pciSlotNumber = "21"

pciBridge5.pciSlotNumber = "22"

pciBridge6.pciSlotNumber = "23"

pciBridge7.pciSlotNumber = "24"

scsi0.pciSlotNumber = "16"

usb.pciSlotNumber = "32"

ethernet0.pciSlotNumber = "33"

ehci.pciSlotNumber = "34"

vmci0.pciSlotNumber = "35"

ethernet0.generatedAddressOffset = "0"

vmci0.id = "-85559283"

tools.remindInstall = "TRUE"

tools.syncTime = "FALSE"

ethernet1.present = "TRUE"

ethernet1.allowGuestConnectionControl = "FALSE"

ethernet1.features = "1"

ethernet1.wakeOnPcktRcv = "FALSE"

ethernet1.networkName = "Bridged"

ethernet1.addressType = "generated"

disk.locking = "FALSE"

diskLib.dataCacheMaxSize = "0"

diskLib.dataCacheMaxReadAheadSize = "0"

diskLib.dataCacheMinReadAheadSize = "0"

diskLib.dataCachePageSize = "4096"

diskLib.maxUnsyncedWrites = "0"

scsi0:1.present = "TRUE"

scsi0:1.fileName = "C:\Virtual Machines\11g - Node1\ocr.vmdk"

scsi0:1.writeThrough = "TRUE"

scsi0:1.mode = "independent-persistent"

scsi0:1.deviceType = "disk"

scsi0:2.present = "TRUE"

scsi0:2.fileName = "C:\Virtual Machines\11g - Node1\votingdisk.vmdk"

scsi0:2.writeThrough = "TRUE"

scsi0:2.mode = "independent-persistent"

scsi0:2.deviceType = "disk"

scsi0:3.present = "TRUE"

scsi0:3.fileName = "C:\Virtual Machines\11g - Node1\asm.vmdk"

scsi0:3.writeThrough = "TRUE"

scsi0:3.mode = "independent-persistent"

scsi0:3.deviceType = "disk"

ethernet1.generatedAddress = "00:0c:29:6b:ce:54"

scsi0:1.redo = ""

scsi0:2.redo = ""

scsi0:3.redo = ""

ethernet1.pciSlotNumber = "36"

ethernet1.generatedAddressOffset = "10"

Reply
0 Kudos
3 Replies
jgabay
Contributor
Contributor

I didn't mention that the disks do not disappear on re-boot prior to the installation of Clusterware. So, this only appears at that stage.

If I do an oracleasm listdisks they appear. After Clusterware installation and re-boot they don't.

Reply
0 Kudos
admin
Immortal
Immortal

If you're presenting the disks as raw devices (iSCSI), after boot, maybe the disk identifiers change... i.e. /dev/sda1 is /dev/sdd1. If this is the case, you can use devlabel or something similar to avoid this situation.

Maybe, you have problems with permissions in the devices. Revise the permissions.

Kind regards.

P.

Reply
0 Kudos
jgabay
Contributor
Contributor

Not using raw devices. Permissions all appear correct.

Reply
0 Kudos