Cannot connect to hosts from vSphere client within...

jdickerson · ‎11-05-2015

When I attempt to connect to my hosts from my primary subnet, I get the following error:

vSphere and ESXI are both on 5.1

When I switch to a different subnet I am able to connect to my hosts. I do not have this problem with vCenter.

HariRajan · ‎11-05-2015

Seems like port 443 is not open here , can you check the portqry from your primary subnet to esxi management IP.

Thanks & Regards in Plenteous . Hari Rajan

jdickerson · ‎11-05-2015

Yes I can telnet on port 443 to the esxi host.

SRoland · ‎11-05-2015

That does not look like a network error, because the service responds with HTTP error 500. That's something may be with the vpxa or hostd service on the host.

Could you upgrade to the latest 5.1? Not sure which one you have. recommended to go with the latest.

jdickerson · ‎11-05-2015

Yes, I checked hostd and vpxa and they were both running, I also restarted them and that did not help. Is there any way to resolve this without upgrading?

SRoland · ‎11-05-2015

I have no doubt that they are running, but not healthy.

What do you see if you ssh into the host and execute:

vdf -h

is there 100% use for any of the partitions?

and

tail -f /var/log/vpxa.log

is there any error, failure coming here when you try the connection?

Also can you paste here the outputs of the following commands:

esxcfg-vmknic -l

esxcfg-route -l

esxcfg-vswitch -l

esxcfg-nics -l

Thanks

jdickerson · ‎11-05-2015

Disk use is ok. Here is the output from the commands:

~ # vdf -h

Tardisk Space Used

s.v00 347M 347M

ata_pata.v00 44K 42K

ata_pata.v01 32K 28K

ata_pata.v02 32K 30K

ata_pata.v03 32K 31K

ata_pata.v04 40K 36K

ata_pata.v05 36K 32K

ata_pata.v06 32K 29K

ata_pata.v07 40K 36K

block_cc.v00 84K 82K

ehci_ehc.v00 92K 90K

weaselin.t00 13M 13M

esx_dvfi.v00 368K 366K

xlibs.v00 1M 1M

ima_qla4.v00 1M 1M

ipmi_ipm.v00 44K 41K

ipmi_ipm.v01 112K 111K

ipmi_ipm.v02 104K 101K

misc_cni.v00 28K 25K

misc_dri.v00 3M 3M

net_be2n.v00 348K 346K

net_bnx2.v00 292K 290K

net_bnx2.v01 1M 1M

net_cnic.v00 124K 120K

net_e100.v00 300K 297K

net_e100.v01 248K 246K

net_enic.v00 148K 144K

net_forc.v00 132K 131K

net_igb.v00 244K 240K

net_ixgb.v00 376K 374K

net_nx_n.v00 2M 2M

net_r816.v00 140K 137K

net_r816.v01 84K 82K

net_s2io.v00 244K 242K

net_sky2.v00 116K 112K

net_tg3.v00 324K 321K

net_vmxn.v00 104K 102K

ohci_usb.v00 60K 56K

sata_ahc.v00 100K 99K

sata_ata.v00 60K 58K

sata_sat.v00 88K 86K

sata_sat.v01 44K 41K

sata_sat.v02 44K 43K

sata_sat.v03 44K 40K

sata_sat.v04 36K 32K

scsi_aac.v00 172K 171K

scsi_adp.v00 432K 428K

scsi_aic.v00 296K 295K

scsi_bnx.v00 200K 196K

scsi_fni.v00 160K 159K

scsi_hps.v00 192K 190K

scsi_ips.v00 132K 129K

scsi_lpf.v00 1M 1M

scsi_meg.v00 100K 96K

scsi_meg.v01 168K 165K

scsi_meg.v02 96K 92K

scsi_mpt.v00 392K 389K

scsi_mpt.v01 520K 517K

scsi_mpt.v02 440K 436K

scsi_qla.v00 1M 1M

scsi_qla.v01 288K 285K

scsi_rst.v00 748K 745K

uhci_usb.v00 60K 57K

xorg.v00 3M 3M

imgdb.tgz 252K 250K

state.tgz 28K 25K

-----

Ramdisk Size Used Available Use% Mounted on

root 32M 496K 31M 1% --

etc 28M 228K 27M 0% --

tmp 192M 4K 191M 0% --

hostdstats 834M 4M 829M 0% --

~ # tail -f /var/log/vpxa.log

2015-11-05T20:14:11.500Z [29B52B90 verbose 'hostdstats'] Set internal stats for VM: 6 (vpxa VM id), 27 (vpxd VM id). Is FT primary? false

2015-11-05T20:14:11.503Z [29B52B90 verbose 'hostdstats'] Set internal stats for VM: 7 (vpxa VM id), 46 (vpxd VM id). Is FT primary? false

2015-11-05T20:14:11.506Z [29B52B90 verbose 'hostdstats'] Set internal stats for VM: 8 (vpxa VM id), 3564 (vpxd VM id). Is FT primary? false

2015-11-05T20:14:11.508Z [29B52B90 verbose 'hostdstats'] Set internal stats for VM: 9 (vpxa VM id), 84 (vpxd VM id). Is FT primary? false

2015-11-05T20:14:11.511Z [29B52B90 verbose 'hostdstats'] Set internal stats for VM: 10 (vpxa VM id), 144 (vpxd VM id). Is FT primary? false

2015-11-05T20:14:11.941Z [FFEF06D0 info 'commonvpxLro' opID=SWI-4ba61bc7-41] [VpxLRO] -- BEGIN task-internal-2036 -- -- vpxapi.VpxaService.fetchQuickStats -- 5995262c-9bfa-c655-3ea7-8041f1c58ca5

2015-11-05T20:14:11.949Z [FFEF06D0 verbose 'vpxavpxaVmomi' opID=SWI-4ba61bc7-41] [VpxaVmomi] SetStatusDone was called with syncGenNo (982)

2015-11-05T20:14:11.950Z [FFEF06D0 info 'commonvpxLro' opID=SWI-4ba61bc7-41] [VpxLRO] -- FINISH task-internal-2036 -- -- vpxapi.VpxaService.fetchQuickStats --

2015-11-05T20:14:17.076Z [29A16B90 verbose 'VpxProfiler'] [1+] CheckEnvBrowserChanges

2015-11-05T20:14:17.157Z [29A16B90 verbose 'VpxProfiler'] [1-] CheckEnvBrowserChanges (took 81 ms)

2015-11-05T20:14:22.866Z [FFEF06D0 verbose 'VpxaHalCnxHostagent' opID=WFU-ab686725] [WaitForUpdatesDone] Received callback

2015-11-05T20:14:22.866Z [FFEF06D0 verbose 'VpxaHalCnxHostagent' opID=WFU-ab686725] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 10113 to 10114 (at 10113)

2015-11-05T20:14:22.866Z [FFEF06D0 verbose 'hostdvm' opID=WFU-ab686725] [VpxaHalVmHostagent] 1: GuestInfo changed 'guest.disk'

2015-11-05T20:14:22.867Z [FFEF06D0 verbose 'halservices' opID=WFU-ab686725] [VpxaHalServices] VmGuestDiskChange Event for vm(2) 1

2015-11-05T20:14:22.867Z [FFEF06D0 verbose 'vpxavpxaInvtVm' opID=WFU-ab686725] [VpxaInvtVmChangeListener] Guest DiskInfo Changed

2015-11-05T20:14:22.867Z [FFEF06D0 verbose 'VpxaHalCnxHostagent' opID=WFU-ab686725] [WaitForUpdatesDone] Starting next WaitForUpdates() call to hostd

2015-11-05T20:14:22.867Z [FFEF06D0 verbose 'VpxaHalCnxHostagent' opID=WFU-ab686725] [WaitForUpdatesDone] Completed callback

2015-11-05T20:14:27.577Z [29B52B90 verbose 'VpxaHalCnxHostagent' opID=WFU-a3261290] [WaitForUpdatesDone] Received callback

2015-11-05T20:14:27.578Z [29B52B90 verbose 'VpxaHalCnxHostagent' opID=WFU-a3261290] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 10114 to 10115 (at 10114)

2015-11-05T20:14:27.578Z [29B52B90 verbose 'hostdvm' opID=WFU-a3261290] [VpxaHalVmHostagent] 6: GuestInfo changed 'guest.disk'

2015-11-05T20:14:27.578Z [29B52B90 verbose 'halservices' opID=WFU-a3261290] [VpxaHalServices] VmGuestDiskChange Event for vm(7) 6

2015-11-05T20:14:27.578Z [29B52B90 verbose 'vpxavpxaInvtVm' opID=WFU-a3261290] [VpxaInvtVmChangeListener] Guest DiskInfo Changed

2015-11-05T20:14:27.578Z [29B52B90 verbose 'VpxaHalCnxHostagent' opID=WFU-a3261290] [WaitForUpdatesDone] Starting next WaitForUpdates() call to hostd

2015-11-05T20:14:27.578Z [29B52B90 verbose 'VpxaHalCnxHostagent' opID=WFU-a3261290] [WaitForUpdatesDone] Completed callback

2015-11-05T20:14:31.488Z [29B73B90 verbose 'hostdstats'] Set internal stats for VM: 2 (vpxa VM id), 24 (vpxd VM id). Is FT primary? false

2015-11-05T20:14:31.491Z [29B73B90 verbose 'hostdstats'] Set internal stats for VM: 3 (vpxa VM id), 42 (vpxd VM id). Is FT primary? false

2015-11-05T20:14:31.493Z [29B73B90 verbose 'hostdstats'] Set internal stats for VM: 4 (vpxa VM id), 36 (vpxd VM id). Is FT primary? false

2015-11-05T20:14:31.496Z [29B73B90 verbose 'hostdstats'] Set internal stats for VM: 5 (vpxa VM id), 52 (vpxd VM id). Is FT primary? false

2015-11-05T20:14:31.498Z [29B73B90 verbose 'hostdstats'] Set internal stats for VM: 6 (vpxa VM id), 27 (vpxd VM id). Is FT primary? false

2015-11-05T20:14:31.501Z [29B73B90 verbose 'hostdstats'] Set internal stats for VM: 7 (vpxa VM id), 46 (vpxd VM id). Is FT primary? false

2015-11-05T20:14:31.503Z [29B73B90 verbose 'hostdstats'] Set internal stats for VM: 8 (vpxa VM id), 3564 (vpxd VM id). Is FT primary? false

2015-11-05T20:14:31.505Z [29B73B90 verbose 'hostdstats'] Set internal stats for VM: 9 (vpxa VM id), 84 (vpxd VM id). Is FT primary? false

2015-11-05T20:14:31.508Z [29B73B90 verbose 'hostdstats'] Set internal stats for VM: 10 (vpxa VM id), 144 (vpxd VM id). Is FT primary? false

~ # esxcfg-vmknic -l

Interface Port Group/DVPort IP Family IP Address Netmask Broadcast MAC Address MTU TSO MSS Enabled Type

vmk0 Management Network IPv4 192.168.100.14 255.255.255.0 192.168.100.255 90:b1:1c:4f:c6:a2 1500 65535 true STATIC

vmk0 Management Network IPv6 fe80::92b1:1cff:fe4f:c6a2 64 90:b1:1c:4f:c6:a2 1500 65535 true STATIC, PREFERRED

~ #

~ # esxcfg-vmknic -l [J -l [J -l [J -l [J -l [J -l [J -l [J r -l o -l u -l t -l e -l -l

VMkernel Routes:

Network Netmask Gateway Interface

192.168.100.0 255.255.255.0 Local Subnet vmk0

default 0.0.0.0 192.168.100.1 vmk0

~ #

~ # esxcfg-route -l [J -l [J -l [J -l [J -l [J -l [J v -l s -l w -l i -l t -l c -l h -l -l

Switch Name Num Ports Used Ports Configured Ports MTU Uplinks

vSwitch0 128 4 128 1500 vmnic0

PortGroup Name VLAN ID Used Ports Uplinks

VM Network 0 0 vmnic0

Management Network 0 1 vmnic0

Switch Name Num Ports Used Ports Configured Ports MTU Uplinks

vSwitch1 128 14 128 1500 vmnic1,vmnic2

PortGroup Name VLAN ID Used Ports Uplinks

Proposal Center 151 1 vmnic1,vmnic2

Innovation Center 150 3 vmnic1,vmnic2

Operations 101 1 vmnic1,vmnic2

Infrastructure 100 4 vmnic1,vmnic2

~ #

~ # esxcfg-vswitch -l [J -l [J -l [J -l [J -l [J -l [J -l [J -l [J n -l i -l c -l s -l -l

Name PCI Driver Link Speed Duplex MAC Address MTU Description

vmnic0 0000:01:00.00 tg3 Up 1000Mbps Full 90:b1:1c:4f:c6:a2 1500 Broadcom Corporation NetXtreme BCM5720 Gigabit Ethernet

vmnic1 0000:01:00.01 tg3 Up 1000Mbps Full 90:b1:1c:4f:c6:a3 1500 Broadcom Corporation NetXtreme BCM5720 Gigabit Ethernet

vmnic2 0000:02:00.00 tg3 Up 1000Mbps Full 90:b1:1c:4f:c6:a4 1500 Broadcom Corporation NetXtreme BCM5720 Gigabit Ethernet

vmnic3 0000:02:00.01 tg3 Up 1000Mbps Full 90:b1:1c:4f:c6:a5 1500 Broadcom Corporation NetXtreme BCM5720 Gigabit Ethernet

~ # exit

All

Cannot connect to hosts from vSphere client within my subnet