VMware

This Question is Possibly Answered

1 "correct" answer available (10 pts) 2 "helpful" answers available (6 pts)
1 ... 9 10 11 12 13 ... 47 Previous Next 704 Replies Last post: Aug 25, 2008 11:18 PM by dipaksharma   Go to original post
Click to view LB@SGI's profile Novice 38 posts since
Dec 18, 2007
Yes...

I know all about this.

This requires console access AND it doesn't handle the issue of developers and others powering off thier VMs etc.

I'm trying to NOT alert the whole company on this issue and merely build a workaround that avoids the licensing issue long enough to get the VM powered on.

I can execute that script all day manually or creat a situation where the call center here doesn't get slammed with "My VM wont power on" calls.
Click to view Bakafish.com's profile Novice 8 posts since
Aug 11, 2008
I'm with you, this is a major screw up, let's just get people back up and running. You seem to be competent, what part of the work around is giving you trouble? The date twiddle workaround is not that complex, and works for almost every installation scenario I can think of. You basically are just setting the clock back during a very short time window where the bad code checks the time. Most (all?) VM's are not even at the stage where they are picking up the time form the ESX host, so they boot and behave as expected. This requires you to be using the command line on the specific ESX host, but I'm sure someone here could hack up some sort of VI plugin that does this through the GUI for the people who really don't know what they are doing.
Click to view Rodos's profile Expert 444 posts since
Apr 20, 2007
As the KB site is not responding here is a capture of it (took me about 40 minutes). Check back on the live KB site when you can in case there are any updates.

Rodos
Attachments:
Click to view LudoS's profile Novice 7 posts since
Aug 12, 2008

KyawH,

You are right, I opened my eyes now and I can see that this could be a solution. Sorry.

But I suppose it has to go through testing and acceptance within VMware and that this may also means downtime on the ESX box.

I suppose or I hope they are working on a fix that would not require reboots of VM or host ( I believe this is achievable because this is a licensing check part of code and should not have nothing to do with the kernel , may be in "vmware-cmd ... start" ??).

Maybe replacing vmware-cmd with the one from 3.5U1 would do the trick, if possible ?????? I'm gonna give a try to this one now.

I also think that announcing the worse, like 36 hours, is a worst case scenario and I hope they will be able to do it in less than that.

Best regards,

Ludovic

Click to view daniel_uk's profile Expert 999 posts since
Oct 24, 2005

Look lets not get into Vmware bashing, how many bloody patches have MSFT released that have needed regression?

Remember this only affects, as The Register article states powering up of VM's and any features licensed, so who on earth if your running VM's in production is going to powering on your VM's in the morning, ok if your a SI or vendor it maybe a tad embarressing and will cost your organisation money on resource but maybe you need to take this up with your VM Account manager/rep.

Also Update 2 adds additional functionality, would you rather you paid through the nose for this or waited a year like you have to with MSFT for such features????????

Shoot me for saying this but its not major as in production affecting, if you are communicating with your relevant internals but this does not mean I encourage such sloppyness and release management on code.

Click to view Bakafish.com's profile Novice 8 posts since
Aug 11, 2008
Right. I wish I had studied the VI plug-in architecture, it may be as simple as modifying the command that the VI console is sending to the ESX hosts. I suppose this is the quick fix that VMware engineers and this community should be looking at. There is a 99% chance that real fix is going to require maintenance mode in my opinion though.
Click to view LB@SGI's profile Novice 38 posts since
Dec 18, 2007
What i need is someone to identify all the places that ESX and Virtualcenter would execute the power on command.

If these are accessable files, I can try to put a workaround in place for this and test it in my lab.

I must trasistion from home-office to real-office now.

Managmetn will want my butt in a chair during this issue.
Click to view berndm's profile Novice 7 posts since
Jan 18, 2005

There is a rollback option, but it only helps if you are able to reset your ESX-Servers. It works with 3i embedded (on usb)
I don't know if it works on the installable.. but here's how it works:

Restart your ESX-Server

At the bootloader screen (the first white progress bar), hit shift+r
(uppercase R), this allows you to
go back to the previous system image. (Thanks to ocremel, http://communities.vmware.com/message/965902)

There you can select to go back to the previous image....

Click to view totgate's profile Novice 6 posts since
Jun 24, 2008

The problem is that we have some customers that are running CNC machinetime systems and they are legally not allowed to change the time on them in any way. Two of those companies had some their servers down för maintenance last night and now they have about fifty Multiaxis cnc machines standing still because of this so yes, this is major. So dont give me some date "twiddles". Some of us need a real fix and we need it ten hours ago. Vmwares staement that they should be the choice for missioncritical environments... seems a little hollow now dont you think?????

/Tobbe.

Click to view Bakafish.com's profile Novice 8 posts since
Aug 11, 2008
LudoS wrote:

KyawH,

You are right, I opened my eyes now and I can see that this could be a solution. Sorry.

But I suppose it has to go through testing and acceptance within VMware and that this may also means downtime on the ESX box.

I suppose or I hope they are working on a fix that would not require reboots of VM or host ( I believe this is achievable because this is a licensing check part of code and should not have nothing to do with the kernel , may be in "vmware-cmd ... start" ??).


No, Macrovision authentication hooks are typically spread far and wide throughout the code so that hackers can't easily patch it out. This likely touches many places.


Maybe replacing vmware-cmd with the one from 3.5U1 would do the trick, if possible ?????? I'm gonna give a try to this one now.


You are making it hard on yourself. Please read the above command line based solutions to launching your VM's by hand.


I also think that announcing the worse, like 36 hours, is a worst case scenario and I hope they will be able to do it in less than that.


That's called managing expectations. Let's hope it is soon. But as I said previously, I'm very aware of the build process, and it will take them almost that long just to branch, modify and compile (Moderator: I hope I'm not giving away any trade secrets, delete my post's if this is too much information.)


Best regards,

Ludovic

Click to view Erik Zandboer's profile Expert 671 posts since
Jun 11, 2007
@daniel_uk: "who on earth is going to power up their VMs in the morning": How about HA? Remember, both DRS and HA are as of now disabled by all means on update2 platforms.... So major? I would think so.
Click to view Anders Gregersen's profile Expert 607 posts since
Jun 16, 2004
In the 4-5 years I've been using vmware this is the first major bug I've encountered. Finding vendors that are major bug free, will be a long journey. Microsoft have done it too, several times at that. Don't judge the products on this problem, but see the big picture. Would it be any different on another virtualization platform? At least it's a software problem that can be solved easily compared to any hardware based problems like the one AMD and Intel did.
Click to view Bakafish.com's profile Novice 8 posts since
Aug 11, 2008
I'm sorry, but if what you are saying is true and you don't have the ability to conceive of an acceptable workaround based on twiddling the ESX host's clock during the VM's launch window, well that's just sad. I think I'd have them up and running by now, but I guess it's hard to find the time to fix things when you are being so helpful and constructive here.

Adding:

I hope your client's will be understanding when they find this thread and realize that you could have had them back in operation hours ago with a little gumption.
Click to view GMellor's profile Enthusiast 155 posts since
Apr 22, 2004
We only have two 3.5u2 hosts, both not yet live, so we've managed to avoid any production issue here.

With the issue of putting the date back then affecting VM timestamps when they boot up would the following work :
1) unconfigure NTP
2) set time back to 1 Aug
3) Turn on all VMs, but press F12 or Del to go into the guest's BIOS config or Choose Boot Device screen - ie prevent bootup into OS.
4) correct time back to 12 Aug
5) Press Ctrl-Alt-Ins in each VM so they then reboot, pick up correct time and start OS bootup

This is presuming that the license check is only done at VM startup, and not at VM reboot (ie ctrl-alt-ins in VM, not a VM reset).

Gary.
Click to view LB@SGI's profile Novice 38 posts since
Dec 18, 2007
togate:

Look, you can adjust the date for the 15 seconds that it takes to allow the power on cycle to occur.

Write a script that executes the power on command for each host manually if you must, but changng the time for these few seconds will NOT effect the time on the VM or even Virtualcenter.

These logs will be accurate.

I certainly hope that you're not allowing this to be worse than it HAS to be, because it focuses attention on what you do.
I know that sounds mean, but we ALL know engineers that LOVE to alert everyone to critical situations.

Just get the CNC machines online, those make the $$ man, the time stamp in the logs that would be effected are NOT an issue for these few seconds!

Be the guy that made this a non-issue.

...from an engineer that administers a SOX compliance NIGHTMARE VMware farm - we control 60% of all lottery back end servers in the WORLD!

VMware Developer

SDKs, APIs, Videos, Learn and much more in the Developer community.

Learn More

Developer Sample Code

Increase your developer productivity with VMware API sample code.

Learn More

VMworld Sessions & Labs

Online access to the latest VMworld Sessions & Labs and online services.

Learn more

Purchase PSO Credits Online

Purchase credits to redeem training and consulting services online.

Buy Now

Community Hardware Software

View reported configurations or report your own.

Learn More

VMware vSphere

Come witness the next giant leap in virtualization.

Register Today

Communities