While running ESX 4 with any OS VM I keep getting the "number of active connections has changed. There are now 2 active connections to this console" message.

I know in ESX 3.5 if you accidentally click on the console tab while you have that VM running in an external box you get that message, but this is happening all the time in ESX4, without me clicking on that tab, and even if the Infrastructure manager is minimized etc. This is in a test environment and no one else is accessing anything so I'm not sure what's causing it. Its not messing anything up but its getting annoying.

Any ideas?