Slow connection to VC from local LAN

[scerazy]

I had NO users on the network for few weeks in holidays. Connection from client to VC 2.0.2 was as fast as one would expect

Now that my users came back the opening of VC is quite longer

I can connect to the same VM running VC using RAdmin almost instantly

But the use of Console within VIC is unworkable

It locks the client solid & eventually a couple of minutes later shows the console of the VM

Once shown the actual use of the console is OK speedwise

It is only the initial display

Anybody has any ideas?

Seb

[masaki]

Are the vmware tools installed?

How many users connected by remote console?

What about the logs (vpxd-*.log)?

Can you post here the main part of it?

[scerazy]

Tools are installed, there is only 1 user (me)

Where is the log? (so I can find it & post it)

Seb

[masaki]

It's under Windows Temp(for example C:\windows)\vpx

post your last vpxd*.log here

Look for Event Viewer Errors too

[scerazy]

From 9:11:52 to 9:13:20 seems too long for me for VIC to open.

Last night I had it opened quicker on 1 Mb ADSL VPN connection

here is the log:

\[startup ] 2007-09-05 09:11:52 Log for Virtual Infrastructure Client, pid=3836, version=2.0.2, build=build-50618, option=release

\[upgrade ] 2007-09-05 09:12:12 This is an unexpected token. The expected token is 'WHITESPACE'. Line 1, position 62.

\[connect ] 2007-09-05 09:12:12.550 Connecting to: vcenter.domain.org

\[Command ] 2007-09-05 09:12:56.356 Executing RetrieveContent on vim.ServiceInstance:ServiceInstance sync'ly

\[Command ] 2007-09-05 09:12:56.372 Return (status=done) for RetrieveContent on vim.ServiceInstance:ServiceInstance

\[transpor] 2007-09-05 09:12:56 Created ManagedObject vim.Folder:group-d1

\[transpor] 2007-09-05 09:12:56 Created ManagedObject vmodl.query.PropertyCollector:propertyCollector

\[transpor] 2007-09-05 09:12:56 Created ManagedObject vim.option.OptionManager:VpxSettings

\[transpor] 2007-09-05 09:12:56 Created ManagedObject vim.UserDirectory:UserDirectory

\[transpor] 2007-09-05 09:12:56 Created ManagedObject vim.SessionManager:SessionManager

\[transpor] 2007-09-05 09:12:56 Created ManagedObject vim.AuthorizationManager:AuthorizationManager

\[transpor] 2007-09-05 09:12:56 Created ManagedObject vim.PerformanceManager:PerfMgr

\[transpor] 2007-09-05 09:12:56 Created ManagedObject vim.scheduler.ScheduledTaskManager:ScheduledTaskManager

\[transpor] 2007-09-05 09:12:56 Created ManagedObject vim.alarm.AlarmManager:AlarmManager

\[transpor] 2007-09-05 09:12:56 Created ManagedObject vim.event.EventManager:EventManager

\[transpor] 2007-09-05 09:12:56 Created ManagedObject vim.TaskManager:TaskManager

\[transpor] 2007-09-05 09:12:56 Created ManagedObject vim.CustomizationSpecManager:CustomizationSpecManager

\[transpor] 2007-09-05 09:12:56 Created ManagedObject vim.CustomFieldsManager:CustomFieldsManager

\[transpor] 2007-09-05 09:12:56 Created ManagedObject vim.DiagnosticManager:DiagMgr

\[transpor] 2007-09-05 09:12:56 Created ManagedObject vim.LicenseManager:LicenseManager

\[transpor] 2007-09-05 09:12:56 Created ManagedObject vim.SearchIndex:SearchIndex

\[Command ] 2007-09-05 09:12:56.388 Executing Login on vim.SessionManager:SessionManager sync'ly

\[Command ] 2007-09-05 09:12:56.575 Return (status=done) for Login on vim.SessionManager:SessionManager

\[Command ] 2007-09-05 09:12:56.591 Executing CreateFilter on vmodl.query.PropertyCollector:propertyCollector async'ly

\[Command ] 2007-09-05 09:12:56.591 Executing CurrentTime on vim.ServiceInstance:ServiceInstance async'ly

\[QuickInf] 2007-09-05 09:12:56.778 Retrieving Permissions data

\[Command ] 2007-09-05 09:12:56.778 Executing CreateFilter on vmodl.query.PropertyCollector:propertyCollector async'ly

\[Command ] 2007-09-05 09:12:56.794 Executing CreateFilter on vmodl.query.PropertyCollector:propertyCollector async'ly

\[Command ] 2007-09-05 09:12:56.997 Executing CreateFilter on vmodl.query.PropertyCollector:propertyCollector async'ly

\[Command ] 2007-09-05 09:12:57.013 Executing GetDescription on vim.alarm.AlarmManager:AlarmManager sync'ly

\[Command ] 2007-09-05 09:12:57.013 Return (status=done) for CreateFilter on vmodl.query.PropertyCollector:propertyCollector

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vmodl.query.PropertyCollector.Filter:session\[29888C4A-835C-47F3-B967-96FBF8188510]EDB613AE-7405-46F9-90A2-C692FB501EBC

\[Command ] 2007-09-05 09:12:57.028 Executing WaitForUpdates on vmodl.query.PropertyCollector:propertyCollector async'ly

\[Command ] 2007-09-05 09:12:57.044 Return (status=done) for GetDescription on vim.alarm.AlarmManager:AlarmManager

\[Command ] 2007-09-05 09:12:57.044 Executing GetDescription on vim.PerformanceManager:PerfMgr sync'ly

\[Command ] 2007-09-05 09:12:57.122 Return (status=done) for CurrentTime on vim.ServiceInstance:ServiceInstance

\[Command ] 2007-09-05 09:12:57.122 Return (status=done) for CreateFilter on vmodl.query.PropertyCollector:propertyCollector

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vmodl.query.PropertyCollector.Filter:session\[29888C4A-835C-47F3-B967-96FBF8188510]2755F3FF-8097-4A6E-B96B-080D7D778C7A

\[Command ] 2007-09-05 09:12:57.122 Return (status=done) for CreateFilter on vmodl.query.PropertyCollector:propertyCollector

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vmodl.query.PropertyCollector.Filter:session\[29888C4A-835C-47F3-B967-96FBF8188510]54D39990-9E47-4D6B-BC91-51D2C7B7D71D

\[Command ] 2007-09-05 09:12:57.122 Return (status=done) for CreateFilter on vmodl.query.PropertyCollector:propertyCollector

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vmodl.query.PropertyCollector.Filter:session\[29888C4A-835C-47F3-B967-96FBF8188510]463B8759-FAE2-451A-9D83-09CA10FD9EA9

\[Command ] 2007-09-05 09:12:57.138 Return (status=done) for WaitForUpdates on vmodl.query.PropertyCollector:propertyCollector

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.HostSystem:host-17

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.HostSystem:host-8

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.Network:network-91

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.VirtualMachine:vm-110

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.Folder:group-v3

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.ResourcePool:resgroup-43

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.ResourcePool:resgroup-26

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.ClusterComputeResource:domain-c24

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.VirtualMachine:vm-22

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.Folder:group-v36

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.ResourcePool:resgroup-41

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.VirtualMachine:vm-93

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.Folder:group-v21

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.Datastore:datastore-10

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.VirtualMachine:vm-265

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.VirtualMachine:vm-302

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.Folder:group-v301

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.ResourcePool:resgroup-307

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.VirtualMachine:vm-311

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.VirtualMachine:vm-328

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.ResourcePool:resgroup-330

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.Datastore:datastore-19

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.Folder:group-h4

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.Datacenter:datacenter-2

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.Network:network-87

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.VirtualMachine:vm-141

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.VirtualMachine:vm-95

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.Datastore:datastore-12

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.Network:network-88

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.Network:network-90

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.VirtualMachine:vm-143

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.VirtualMachine:vm-305

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.Datastore:datastore-14

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.VirtualMachine:vm-63

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.Folder:group-v37

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.VirtualMachine:vm-316

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.VirtualMachine:vm-38

\[transpor] 2007-09-05 09:12:57 Created ManagedObject vim.VirtualMachine:vm-83

\[Critical] 2007-09-05 09:12:57.325 Finished building InventoryData; size = 39

\[Command ] 2007-09-05 09:12:57.325 Executing GetDescription on vim.TaskManager:TaskManager sync'ly

\[Command ] 2007-09-05 09:12:57.388 Return (status=done) for GetDescription on vim.TaskManager:TaskManager

\[Command ] 2007-09-05 09:12:58.028 Executing CreateFilter on vmodl.query.PropertyCollector:propertyCollector async'ly

\[Command ] 2007-09-05 09:12:58.044 Executing GetCurrentSession on vim.SessionManager:SessionManager sync'ly

\[Command ] 2007-09-05 09:12:58.216 Return (status=done) for GetCurrentSession on vim.SessionManager:SessionManager

\[Command ] 2007-09-05 09:12:58.325 Executing GetEffectiveRole on vim.Folder:group-d1 sync'ly

\[Command ] 2007-09-05 09:12:58.341 Return (status=done) for CreateFilter on vmodl.query.PropertyCollector:propertyCollector

\[transpor] 2007-09-05 09:12:58 Created ManagedObject vmodl.query.PropertyCollector.Filter:session\[29888C4A-835C-47F3-B967-96FBF8188510]A53DD13B-AC71-425D-976A-3421C1EBDE8B

\[Command ] 2007-09-05 09:12:58.544 Return (status=done) for GetEffectiveRole on vim.Folder:group-d1

\[Command ] 2007-09-05 09:12:58.653 Executing CreateFilter on vmodl.query.PropertyCollector:propertyCollector async'ly

\[Command ] 2007-09-05 09:12:58.669 Executing CreateFilter on vmodl.query.PropertyCollector:propertyCollector async'ly

\[Command ] 2007-09-05 09:12:59.028 Executing GetEffectiveRole on vim.HostSystem:host-17 sync'ly

\[Command ] 2007-09-05 09:12:59.044 Return (status=done) for CreateFilter on vmodl.query.PropertyCollector:propertyCollector

\[transpor] 2007-09-05 09:12:59 Created ManagedObject vmodl.query.PropertyCollector.Filter:session\[29888C4A-835C-47F3-B967-96FBF8188510]36F615B3-E3BB-4F6D-889F-CFE39B1D9786

\[Command ] 2007-09-05 09:12:59.044 Return (status=done) for CreateFilter on vmodl.query.PropertyCollector:propertyCollector

\[transpor] 2007-09-05 09:12:59 Created ManagedObject vmodl.query.PropertyCollector.Filter:session\[29888C4A-835C-47F3-B967-96FBF8188510]5CB7DA9D-155D-4981-9E14-DB17B44601D9

\[Command ] 2007-09-05 09:12:59.200 Return (status=done) for GetEffectiveRole on vim.HostSystem:host-17

\[Command ] 2007-09-05 09:12:59.231 Executing CreateFilter on vmodl.query.PropertyCollector:propertyCollector async'ly

\[Command ] 2007-09-05 09:12:59.247 Executing CreateFilter on vmodl.query.PropertyCollector:propertyCollector async'ly

\[Command ] 2007-09-05 09:12:59.372 Executing CreateFilter on vmodl.query.PropertyCollector:propertyCollector async'ly

\[Command ] 2007-09-05 09:12:59.387 Executing CreateFilter on vmodl.query.PropertyCollector:propertyCollector async'ly

\[Command ] 2007-09-05 09:12:59.622 Executing CreateFilter on vmodl.query.PropertyCollector:propertyCollector async'ly

\[Command ] 2007-09-05 09:12:59.637 Executing CreateFilter on vmodl.query.PropertyCollector:propertyCollector async'ly

\[Command ] 2007-09-05 09:12:59.872 Executing CreateFilter on vmodl.query.PropertyCollector:propertyCollector async'ly

\[Command ] 2007-09-05 09:12:59.887 Executing CreateFilter on vmodl.query.PropertyCollector:propertyCollector async'ly

\[QuickInf] 2007-09-05 09:13:00 Created a PropertyPoller for HostSummary; total poller count: 1

\[Warning,] 2007-09-05 09:13:00.059 polling requested sooner than the interval; reason: poller restart; target is HostSummary

\[Command ] 2007-09-05 09:13:00.090 Executing WaitForUpdates on vmodl.query.PropertyCollector:propertyCollector async'ly

\[QuickInf] 2007-09-05 09:13:00.090 Permissions data retrieved and processed

\[Command ] 2007-09-05 09:13:00.106 Return (status=done) for GetDescription on vim.PerformanceManager:PerfMgr

\[Command ] 2007-09-05 09:13:00.106 Return (status=done) for CreateFilter on vmodl.query.PropertyCollector:propertyCollector

\[transpor] 2007-09-05 09:13:00 Created ManagedObject vmodl.query.PropertyCollector.Filter:session\[29888C4A-835C-47F3-B967-96FBF8188510]F71203F1-6B17-40A8-ACF2-4089B8EE355A

\[Command ] 2007-09-05 09:13:00.106 Return (status=done) for CreateFilter on vmodl.query.PropertyCollector:propertyCollector

\[transpor] 2007-09-05 09:13:00 Created ManagedObject vmodl.query.PropertyCollector.Filter:session\[29888C4A-835C-47F3-B967-96FBF8188510]2059F6F4-C2DD-4C79-965A-3EDB5262100B

\[Command ] 2007-09-05 09:13:00.106 Return (status=done) for CreateFilter on vmodl.query.PropertyCollector:propertyCollector

\[transpor] 2007-09-05 09:13:00 Created ManagedObject vmodl.query.PropertyCollector.Filter:session\[29888C4A-835C-47F3-B967-96FBF8188510]F4421FC3-AAB5-4A3A-A5A8-8B1298F6F300

\[Command ] 2007-09-05 09:13:00.106 Return (status=done) for CreateFilter on vmodl.query.PropertyCollector:propertyCollector

\[transpor] 2007-09-05 09:13:00 Created ManagedObject vmodl.query.PropertyCollector.Filter:session\[29888C4A-835C-47F3-B967-96FBF8188510]E5CFCDA9-A94F-4909-85D1-3381C474EB37

\[Command ] 2007-09-05 09:13:00.106 Return (status=done) for CreateFilter on vmodl.query.PropertyCollector:propertyCollector

\[transpor] 2007-09-05 09:13:00 Created ManagedObject vmodl.query.PropertyCollector.Filter:session\[29888C4A-835C-47F3-B967-96FBF8188510]25A36D02-2064-4BA7-AFB4-D99464A2C862

\[Command ] 2007-09-05 09:13:00.106 Return (status=done) for CreateFilter on vmodl.query.PropertyCollector:propertyCollector

\[transpor] 2007-09-05 09:13:00 Created ManagedObject vmodl.query.PropertyCollector.Filter:session\[29888C4A-835C-47F3-B967-96FBF8188510]F2D0632C-388A-4CC7-8432-4208CFB6B399

\[Command ] 2007-09-05 09:13:00.106 Return (status=done) for CreateFilter on vmodl.query.PropertyCollector:propertyCollector

\[transpor] 2007-09-05 09:13:00 Created ManagedObject vmodl.query.PropertyCollector.Filter:session\[29888C4A-835C-47F3-B967-96FBF8188510]B18B3091-2A8E-42AE-A71A-830E8B536596

\[Command ] 2007-09-05 09:13:00.106 Return (status=done) for CreateFilter on vmodl.query.PropertyCollector:propertyCollector

\[transpor] 2007-09-05 09:13:00 Created ManagedObject vmodl.query.PropertyCollector.Filter:session\[29888C4A-835C-47F3-B967-96FBF8188510]6093B945-C0BA-484C-9D9E-FF2F660A372C

\[Command ] 2007-09-05 09:13:00.122 Return (status=done) for WaitForUpdates on vmodl.query.PropertyCollector:propertyCollector

\[transpor] 2007-09-05 09:13:00 Created ManagedObject vim.host.CpuSchedulerSystem:cpuScheduler-17

\[Command ] 2007-09-05 09:13:00.184 Executing WaitForUpdates on vmodl.query.PropertyCollector:propertyCollector async'ly

\[QuickInf] 2007-09-05 09:13:00 Destroyed ManagedObject vim.host.CpuSchedulerSystem:cpuScheduler-17

\[Command ] 2007-09-05 09:13:20.072 Executing RetrieveContents on vmodl.query.PropertyCollector:propertyCollector async'ly

\[Command ] 2007-09-05 09:13:20.291 Return (status=done) for RetrieveContents on vmodl.query.PropertyCollector:propertyCollector

[masaki]

No errors only one warning but it seems unrelated to your slow connection.

Ok you must study your network.

If you connect by rdp to the VC server and open the VI client locally is the connection fast?

If so the problems rely on the network bandwidth between client and server.

tracert from VC to ESX hosts to know how many hops and which bandwidth between VC and HOSTS.

tracert from VI client to VC for the same reason.

let me know

[scerazy]

VC is a VM running on same ESX

1 hop each way (flat network)

I do not have VCI on VC machine (no reason to)

Backbone is 1Gb, with no slowness between anything else that is noticeable in any way

[masaki]

Try:

1) Move VC vm to another ESX and check if the slowness is the same.

2) 1 hop from any client???? If not Install VCI on VC vm, connect via rdp and try using VI client from VC. Compare slowness. You can uninstall vi client later.

3) Check network traffic between client and server. You can even have 10 Gb networks but if someone is doing heavy traffic the result could be unpredictable.

A ping from the client to the VC Server (if enabled how many ms?) should tell us something on the slowness.

[scerazy]

Tested again from a VPN connection during the same time of the day

VPN to one of the servers on LAN, connecting to same VC VM server

Connected within 25 seconds

I will have to have a look at my local PC, as it definitely can not be LAN issue

(VPN ping 22ms, LAN ping <1ms)

It just does NOT add up to anything meaningful

Seb

[masaki]

Do you have some local firewall (like Zonealarm or similar)?

In this case the slowness could be dued to the connection scan by the local firewall.

Look with netstat -n during connection time to see the state of your connection.

It could start with a SYN then TIME_WAIT and then ESTABLISHED.

how many seconds for the connection to be established?

[scerazy]

No, no local firewall within internal network

It shows Established almost instantly

It just takes a while for the client window to show

Seb

[masaki]

This is really strange.

Try reinstalling the client.

Which language on your client? Which client version?

If different from English use english.

[begs4399]

I too have the exact same "slowness" after upgrade of the ESX 2.01 to 2.02, and VIC 2.01 to 2.02. All in the client is slow, but the most noticeable is the console takes 30 sec to connect instead of 2-3 sec before. I don't have VC, I connect directly to ESX server.

I did tried to downgrade to VIC 2.01 and it is quick as before.

Plain simple Local 1GB network, Brand new DL380G5 server and clients,

[begs4399]

I found events logs "crypt32 error 8".

It seems Windows tries to update the root certificate from windowsupdate.microsoft.com (that we blocked cause we use WSUS). That's causing the delays.

At the site "http://eventid.net/display.asp?eventid=8&source=crypt32+" there is a solution that refers to disable updating root certificates in add/remove programs then Windows components.

There is no delay now.