VMware Cloud Community
ztwy
Contributor
Contributor

VMs Port Group placement issue

Hi,

In my lab configuration, I have machine A with BDE 2.2 appliance installed, and machine B ready to deploy MAPR cluster. The two machines are in two different HA cluster. On each machine, i create a standard switch with a Port Group, . vmnetworkA for machine A, vmnetworkB for machine B. When i deploy the MAPR cluster on the machine B, the zookeeper and mysql VMs were connected on the vmnetworkB without problem. But all the masters and works were automatically connected to the vmnetworkA, whitch lead to the cluster creation failure at the end ? On the resources manager of BDE, I had deleted the defaultNetwork which pointed to the vmnetworkA, and created a new network ressource pointing to the vmnetworkB. But it didn't help.

Thanks

Reply
0 Kudos
9 Replies
jessehuvmw
Enthusiast
Enthusiast

Are you creating a default MapR cluster in vSphere Web Client? By default, the zookeeper and mysql VMs use SHARED storage, and master and worker VMs use LOCAL storage. So how did you add datastores in BDE in vSphere Web Client ? If the LOCAL type of datastores you added only exist on machine A, then master and worker VMs will be placed on machine A. If you only want to place VMs on machine B, then do not add any datastores on machine A. BTW, could you upload /opt/serengeti/logs/serengeti.log and /opt/serengeti/logs/ironfan.log for us to debug ?

Cheers, Jesse Hu
Reply
0 Kudos
ztwy
Contributor
Contributor

Hi jessehuvmw,

- Yes I'm just creating a default MapR cluster in vSphere Web Client.

- I didn't add any SHARED storage in BDE. There is no storage added on the machine A. I have just added 2 LOCAL STORAGE using the local datastore of the machine B.

- Machine A and Machine B are in two different vSphere HA cluster

So  it seems logical to me that all the MapR VM should be created on the Machine B.

Please see the attachments for the logs. The naming is different.

Thanks

Reply
0 Kudos
jessehuvmw
Enthusiast
Enthusiast

Could you navigate to 'Big Data Extentions Home' -> 'Resource' -> 'Datastores' and check how many datastores are listed ? Is SHARED type of datastore listed ? ? And  are the master and worker nodes placed on machine A? are the zookeeper and mysql nodes placed on machine B?

Cheers, Jesse Hu
Reply
0 Kudos
jessehuvmw
Enthusiast
Enthusiast

Both SHARED and LOCAL type of datastores must be added into BDE, otherwise you can not create a default MapR cluster which uses both SHARED and LOCAL storage (specified in the cluster spec file).

Cheers, Jesse Hu
Reply
0 Kudos
ztwy
Contributor
Contributor

If I understand, I must have LOCAL and SHARED storage to create MapR default cluster ?

I have only the LOCAL type storage added into BDE. However the BDE plugin allowed me to proceed the cluster creation.

Can I create a SHARED storage using local datastore ? I have only one machine dedicated for MapR cluster deployment, so I want to deploy all the VMs (master, worker, zookeeper, mysql etc.) on the same machine, is it possible ?

Reply
0 Kudos
ztwy
Contributor
Contributor

My current problem is : The BDE has succeeded to create all the VMs on the Machine B using the LOCAL Storage (of Machine B) only, that is what I want. But the master and worker VMs were attached to a Port Group which belongs to Machine A (nothing to do with Machine B). That is something very strange for me.

Reply
0 Kudos
jessehuvmw
Enthusiast
Enthusiast

yes to all your questions. both local and shared storage are required.  Please add local and shared storage on machine B only into BDE, then create the MapR cluster. If convenient , we'd like to have a webex to debug your issue.

Cheers, Jesse Hu
Reply
0 Kudos
ztwy
Contributor
Contributor

It's the same even if I added both local and shared storage. Certain VMs created on the Machine B were alwayes connected to the port group on Machine A. Continue investigating ...

Reply
0 Kudos
jessehuvmw
Enthusiast
Enthusiast

that's wired. If convenient , we'd like to have a webex to debug your issue. would you send an email to me (huh@vmware.com) with your available time for the webex? we are in GMT+8.

Cheers, Jesse Hu
Reply
0 Kudos