VMware

This Question is Possibly Answered

1 "correct" answer available (10 pts)
1 2 3 Previous Next 31 Replies Last post: Aug 28, 2009 2:32 PM by markdjones82   Go to original post

Re: VCB in SCSI hot-add mode

15. Sep 8, 2008 3:16 PM in response to: alex0
Click to view Ken.Cline's profile Champion 5,146 posts since
Jul 7, 2004
You should not need one per datastore, but you will need to have one per isolated host. So, if you have a cluster of three hosts who all have access to shared storage (iSCSI, NFS, or SAN), then you would need only one VCB Proxy (and associated helper) for the entire cluster (depending upon throughput requirements...you may need to scale out to handle the workload); however, if you had three hosts and each had local storage, then you would need a VCB Proxy (and associated helper) per host - hope this makes sense...

Ken Cline
Technical Director, Virtualization
Wells Landers
TVAR Solutions, A Wells Landers Group Company
VMware Communities User Moderator

Re: VCB in SCSI hot-add mode

16. Sep 8, 2008 3:42 PM in response to: Ken.Cline
Click to view dconvery's profile Virtuoso 1,888 posts since
May 10, 2006

Thanks Ken - been on the road all day making the company some money ;o)

Dave

Re: VCB in SCSI hot-add mode

17. Sep 8, 2008 7:01 PM in response to: dconvery
Click to view Ken.Cline's profile Champion 5,146 posts since
Jul 7, 2004
dconvery wrote:

Thanks Ken - been on the road all day making the company some money ;o)


Now that sounds like a good consultant ;)

Ken Cline
Technical Director, Virtualization
Wells Landers
TVAR Solutions, A Wells Landers Group Company
VMware Communities User Moderator

Re: VCB in SCSI hot-add mode

18. Sep 8, 2008 10:35 PM in response to: Ken.Cline
Click to view soliton's profile Novice 4 posts since
May 20, 2007

Still, since the vendor' documentation of the new feature is practically non-existant, can someone summurise the requierements for the proxy helper machine please. Particularly the details like network connectivity; local disk/s ( and the stores it belong to); scsi controller configuration etc. Does anyone have a working setup he can comment on/share details of?

Re: VCB in SCSI hot-add mode

19. Sep 9, 2008 4:16 AM in response to: soliton
Click to view rahul_bck's profile Novice 5 posts since
Sep 9, 2008

Hi,

The VCB-HELPER VM created for the hotadd operation is just a blank dummy VM. When i say blank, its just the VMs name which is significant. Ie, if you have the proxy VM :- "vcb-proxy" , the helper VM is created with the name : "vcb-proxy(VCB-HELPER)" : Choose any OS; keep the memory size to the minimal : 4MB, keep the disk size to the minimal : 1 MB; because all these arent of any significance. You may even have the VM without any disks. So doesnt Network has any importance too. This VM is just used for VCB as a reference internally for 'hotadd' mode of backup. There is no need of even powering on this VM.

Let me know if any more questions

thanks

Rahul


Re: VCB in SCSI hot-add mode

20. Sep 9, 2008 4:25 AM in response to: rahul_bck
Click to view TechRoh's profile Novice 4 posts since
Aug 26, 2008


Does "shadow copy" means dummy VM --- something existing in perception.


Re: VCB in SCSI hot-add mode

21. Sep 9, 2008 4:57 AM in response to: TechRoh
Click to view rahul_bck's profile Novice 5 posts since
Sep 9, 2008

Yes, that was i meant -> I'm refereing to the shadow copy VM as the dummy VM only.

Re: VCB in SCSI hot-add mode

22. Sep 9, 2008 7:43 AM in response to: depping
Click to view Ken.Cline's profile Champion 5,146 posts since
Jul 7, 2004
Duncan,

Can you please get some details about exactly how this "hot-add" mode works? Since it requires a helper VM, I'm assuming the VCB Proxy is using the helper as a stub for hot-adding the .vmdk of the VM to be backed up. Since you have hot add capability, but not hot remove capability, the helper provides the stub that can be power cycled to release the reservation on the source .vmdk. This all makes some sense to me, but it raises an important question: If the VCB Proxy is able to use another VM (albeit an empty one) to proxy disk drives, what protections are available to prevent someone from using whatever technology enables this "trespassing" between VMs for a nefarious purpose?

Ken Cline
Technical Director, Virtualization
Wells Landers
TVAR Solutions, A Wells Landers Group Company
VMware Communities User Moderator

Re: VCB in SCSI hot-add mode

23. Sep 9, 2008 8:29 AM in response to: Ken.Cline
Click to view dconvery's profile Virtuoso 1,888 posts since
May 10, 2006
I do know that you need to create a second role with the following permissions:

Datastore > Browse Datastore
Virtual Machine > Configuration > Add Existing Disk
Virtual Machine > Configuration > Remove Disk
Virtual Machine > Configuration > Change Resource

Dave

Re: VCB in SCSI hot-add mode

24. Sep 12, 2008 1:34 PM in response to: dconvery
Click to view marcelo.pineyro's profile Novice 2 posts since
Sep 12, 2008
I had decided to install VCB in a physical server, until today I run into this "SCSI hot-add mode" (and the fact that the VCB proxy is now supported in a VM) and I am reconsidering my options. First of all, why is it called SCSI hot-add mode, when it seems like it can be used in a NAS environment? I quote from the latest version of the VM Backup Guide, from the "SCSCI hot-add mode section": "In this mode, you can use Consolidated Backup to protect any virtual disks on any type of storage available to your ESX Server host, including NAS or local storage." It also states: "Although this mode is not as efficient as the SAN mode, which does not cause any overhead on the ESX Server host, it is still more efficient than theLAN mode." If the shared storage in question is a NAS, how is this hot-add mode more efficient than the regular LAN mode? Under the "LAN mode (NBD mode)" section it states that the VCB proxy can be either in a physical server or a VM. So in the case in which the shared storage is a NAS, I see no difference between the hot-add mode and the LAN mode. What am I missing?

Like someone else that contributed to this discussion, I also will not implement this new hot-add feature in VCB unless more thorough documentation is made available. But aside from the documentation, I have one more doubt about how having VCB in a physical server vs. a VM compares. I am concerned with the speed with which backups take place. I have 2 ESX hosts with 4 VMs each. Some VMs have their data store in the NAS, some in the local ESX hosts. I intended to install VCB in a physical server, and connect to this server external hard drives via an eSATA connection. I intended to copy the vmdk files straight into this external drives, which I would rotate during the week and take off-site for the sake of off-site backups. If I have VCB in a VM, I suppose I could copy to external drives that are attached to a physical server in the network that has a share for the external drive. Can someone help me understand how the speed with which backups would take place compares in each scenario? If VCB is in a VM, the transfer of data from the ESX host to the VCB proxy happens within the ESX host virtual network, then the copying of the data to the external drive happens over the LAN. If I have a physical server for VCB, the transfer of the data from the ESX host to the VCB proxy happens over the LAN, but the writing of the data to the external drives happens over an eSATA connection (3GBits/second). My VMs' virtual disks are 40 to 50 GB average. The LAN transfer speed would be 1GBit/sec.

Finally, I would greatly appreciate some feedback on the backup schedule I intend to implement. Does anyone see any problems with only doing backups of the full VM images every day, and no backups of specific data files? I suppose the other alternative is to do data file level backups daily and maybe full image backups weekly or so, mainly for disaster recovery purposes. But from a management point of view, it seems to me it would be much simpler to just backup the entire VMs every night and not mess with file-level backups. Any thoughts on this?

Thank you so much in advance for any thoughts anyone cares to share. I am pretty new to VMware and I could use advice from others with more experience.

PS: I am running VirtualCenter 2.5 and VI 3.5

Marcelo

Re: VCB in SCSI hot-add mode

25. Sep 12, 2008 12:02 PM in response to: marcelo.piney…
Click to view marcelo.pineyro's profile Novice 2 posts since
Sep 12, 2008

Quick addendum to my previous most: I realize that if I go with the option of having VCB in a VM, I'll either need to have VCB in both ESX hosts, or move the data stores of the VMs in the host that does not have the VCB VM to the NAS

Since I have the FOundation edition of VI, and therefore do not have vMotion, I have not bothered with moving all data stores to the NAS.

Marcelo

Re: VCB in SCSI hot-add mode

26. Sep 13, 2008 6:04 AM in response to: marcelo.piney…
Click to view dconvery's profile Virtuoso 1,888 posts since
May 10, 2006

Macelo -

First, Welcome to the forums!

As for the operation of the Hot-Add mode (As everyone says, documentaion is sparse at best and some theories may be changed after the next doc update) The way I understand it, The "helper VM" has the vdisk to be backed up "hot-added" to it. It is called "SCSI" Hot-add, because the vdisk is presented as a SCSI disk. Just like a VMDK on the NAS or FC SAN is presented as a SCSI disk to a regular VM. In order to use VCB to back up a VM, thedisk must be a vdisk. It doesn't matter if the VMDK or RDM is on a NAS, FC SAN, iSCSI SAN or local disk. The key is that it need to be in virtual compatability mode so a snapshot can be taken.

As for throughput, the process is VERY I/O intensive. I have done numerous throughput tests and with a 4GB FC SAN, the best I can get is about 1GB per minute of data throughput for each channel. I have never done timing tests on GbE NAS or iSCSI. It would be more efficient in hot-add mode as opposed to nbd mode because the I/O is at "backplane" speed instead of network speed. The trade-off is that it is one more thing the COS is doing. In your case, it sounds like your VMDKs are on NAS. The decision or physical vs. VM is purely money. Do you really need a separate server when a VM can do it just as well?

The trick with using a VM is where you will place your backups, and ultimately, how are you going to put it on tape....

Dave

Re: VCB in SCSI hot-add mode

27. Nov 18, 2008 10:04 PM in response to: soliton
Click to view chengyee's profile Lurker 1 posts since
Nov 18, 2008
hi all,

I have been working on VCB in SCSI hot-add mode for the last 2 days. Hit some problems. Finally I managed to make it work. I managed to mount the target VM (file level) to VCB-proxy with browse-start.bat. The target vm files are visible in TSM client. Didn't really backup to tape.. most probably will be ok.

I have created the VCB-HELPER VM with 1 vcpu, 256MB ram, 1 NIC, 1 SCSI ctrl, no hdd, no OS . I think the spec of the helper vm does not matter. The helper VM need to be powered off when mounting the target vm to VCB proxy. My experience is if helper VM is powered on, browse-start.bat will fail.

Hope it helps!

Attachments:

Re: VCB in SCSI hot-add mode

28. Dec 15, 2008 7:04 PM in response to: chengyee
Click to view rscherer's profile Novice 20 posts since
May 25, 2006

Well, I got hot-add working too....but only for VMs with a single VMDK -- my VMs that have multiple VMDK files crap out. The error is; date/time 'vcbMounter' 3504 error Error: Failed to hot remove SCSI disk: Incompatible device backing specified for device '1'.

ideas?

~Rick
VMwareTips.com

Re: VCB in SCSI hot-add mode

29. Jul 7, 2009 6:26 AM in response to: rscherer
Click to view Mike_Laverick's profile Virtuoso 4,064 posts since
Jan 5, 2004
This HELPER thing is very similiar to the beta of vDR which required the helper for VDR to work. Interesting when VDR was finally release - we discovered the helper was no longer required. I guess that's because the VDR was always a virtual machine, whereas the original intention of VCB was a dedicated physical proxy...

I'm finding that when I run the vcb commands - although the commands remove the snapshots - I'm being left behind with the mounting point for the VM...

I'm also finding hotadd much reliable than ndb mode...

Regards
Mike Laverick
RTFM Education
http://www.rtfm-ed.co.uk
Author of the SRM Book: http://www.lulu.com/content/4343147
http://communities.vmware.com/servlet/JiveServlet/download/1200101-20223/vExpert_logo_100x57.jpg

VMware Developer

SDKs, APIs, Videos, Learn and much more in the Developer community.

Learn More

Developer Sample Code

Increase your developer productivity with VMware API sample code.

Learn More

VMworld Sessions & Labs

Online access to the latest VMworld Sessions & Labs and online services.

Learn more

Purchase PSO Credits Online

Purchase credits to redeem training and consulting services online.

Buy Now

Community Hardware Software

View reported configurations or report your own.

Learn More

VMware vSphere

Come witness the next giant leap in virtualization.

Register Today

Incoming Links

Communities