salasos3's Posts

Hi all, is there a scripted way to get  Device ID, LUN ID, and NAA ID of a all the datastores associated to a specific VM? Not sure how to achieve this, please help.
Hi all, Last week we had an ESXI host that disconnected from the vCenter and was completely unresponsive and same for the VMs(disconnected state and not pingable) running on it, HA did not restarted... See more...
Hi all, Last week we had an ESXI host that disconnected from the vCenter and was completely unresponsive and same for the VMs(disconnected state and not pingable) running on it, HA did not restarted the VMs on another host and any alert was triggered so we did not received any incident for about 3.5 hours. After 3.5 hours we did receive an incident for the VMs reboot(by HA) so that is when we became aware of the issue. Looking at the ESXI logs I see that the host was reconnected and became responsive again after 3.5 hours, HA responded as well so the VMs were restarted onto another host and a alarm was triggered alerting about the VM restart. have you seen something like this? I'm wondering what could have caused the ESXI & VMs to go unresponsive to the point that not even HA responded or became aware that the VMs needed to be restarted into another ESXI host and no alarms were triggered? -Alarm action is enabled. -Vm down/diconnected alarms are active. -ESXI down/disconnected alarm is enabled. -I dont have vmkernel.log, hostd.log etc as they were rotated the same day at night -This is what I have so far: ***************************First Lost access to volume************************* Date Time: 03/01/2021, 1:49:05 PM Type: Information Target: ************ Description: Ask VMware... 03/01/2021, 1:49:05 PM Lost access to volume 5****08a-a34*****-*ad7-a03******e10 (DatastoreName ) due to connectivity issues. Recovery attempt is in progress and outcome will be reported shortly. Related events: There are no related events. Description: 03/01/2021, 1:53:04 PM Bursting event esx.problem.vmfs.heartbeat.recovered occurred 5 times since Monday, March 1, 2021 7:51:37 PM UTC Related events: Description: 03/01/2021, 1:53:04 PM Event burst of esx.problem.vmfs.heartbeat.recovered ended **********Then we see a bunch more of Lost access to volume, more than 100 of these*************************** Description: Ask VMware... 03/01/2021, 1:53:05 PM Lost access to volume 5a**9530-c9****04-0**8-a036******10 (DatastoreName ) due to connectivity issues. Recovery attempt is in progress and outcome will be reported shortly. Description: Ask VMware... 03/01/2021, 1:53:05 PM Successfully restored access to volume 5a**9530-c9****04-0**8-a036******10 (DatastoreSName) following connectivity issues. Date Time: 03/01/2021, 1:58:04 PM Type: Information Target: ************ Description: 03/01/2021, 1:58:04 PM Event burst of esx.problem.vmfs.heartbeat.recovered ended *****************The host becomes unresponsive******************************** Date Time: 03/01/2021, 2:30:58 PM Type: Error Target: ************ Description: 03/01/2021, 2:30:58 PM Host ************ in DatacenterName is not responding Event Type Description: Connection to the host has been lost Possible Causes: The host is not in a state where it can respond Date Time: 03/01/2021, 2:30:58 PM Type: Information Target: ************ Description: 03/01/2021, 2:30:58 PM Alarm Host connection and power state on ************ changed from Green to Red Related events: *******************Vsphere HA was unresponsive***************** Date Time: 03/01/2021, 3:39:19 PM Type: Information Target: ************ Description: 03/01/2021, 3:39:19 PM The vSphere HA availability state of the host ************ in cluster in ClusterName in DatacenterName has changed to Unreachable! Event Type Description: This event is logged when the availability state of a host has changed. Date Time: 03/01/2021, 3:39:28 PM Type: Information Target: ************ Description: 03/01/2021, 3:39:28 PM The vSphere HA availability state of the host ************ in cluster in ClsuterName in DatacenterName has changed to Host Failed Event Type Description: This event is logged when the availability state of a host has changed. Date Time: 03/01/2021, 3:39:28 PM Type: Error Target: ************ Description: 03/01/2021, 3:39:28 PM vSphere HA detected a possible host failure of host ************ in cluster ClusterName in datacenter DatacenterName Event Type Description: This event is logged when vSphere HA detects a possible host failure. Date Time: 03/01/2021, 3:39:28 PM Type: Information Target: ************ Description: 03/01/2021, 3:39:28 PM Alarm vSphere HA host status on ************ changed from Gray to Red ************HA becomes responsive again, arround the time when the host and VMs became responsive****************** Date Time: 03/01/2021, 3:45:52 PM Type: Information Target: ************ Description: 03/01/2021, 3:45:52 PM vSphere HA agent on host ************ in cluster ClusterName in datacenter DatacenterName is healthy Date Time: 03/01/2021, 3:45:53 PM Type: Information Target: ************ Description: 03/01/2021, 3:45:53 PM Alarm vSphere HA host status on ************ changed from Red to Green *************The host recovered connectivity to the VCenter.******************************** Date Time: 03/01/2021, 3:45:58 PM Type: Information Target: ************ Description: 03/01/2021, 3:45:58 PM Connected to ************ in DatacenterName Date Time: 03/01/2021, 3:45:58 PM Type: Information Target: ************ Description: 03/01/2021, 3:45:58 PM Alarm Host connection and power state on ************ changed from Red to Green ************Networking alarms making reference to the external/physial switch************************* Date Time: 03/01/2021, 3:46:39 PM Type: Error Target: ************ Description: 03/01/2021, 3:46:39 PM Not all VLAN MTU settings on the external physical switch allow the vSphere Distributed Switch maximum MTU size packets to pass on the uplink port 408 in vSphere Distributed Switch on host ************ in DatacenterName . Date Time: 03/01/2021, 3:46:39 PM Type: Error Target: ************ Description: 03/01/2021, 3:46:39 PM Not all the configured VLANs in the vSphere Distributed Switch were trunked by the physical switch connected to uplink port 408 in vSphere Distributed Switch on host ************ in DatacenterName . Date Time: 03/01/2021, 3:46:39 PM Type: Error Target: ************ Description: 03/01/2021, 3:46:39 PM Not all VLAN MTU settings on the external physical switch allow the vSphere Distributed Switch maximum MTU size packets to pass on the uplink port 409 in vSphere Distributed Switch on ************ in DatacenterName . Date Time: 03/01/2021, 3:46:39 PM Type: Error Target: ************ Description: 03/01/2021, 3:46:39 PM Not all the configured VLANs in the vSphere Distributed Switch were trunked by the physical switch connected to uplink port 409 in vSphere Distributed Switch on host ************ in DacenterName . ******************VMnics flapping and recovering connectivity**************************** Date Time: 03/01/2021, 3:46:45 PM Type: Warning Target: ************ Description: Ask VMware... 03/01/2021, 3:46:45 PM Physical NIC vmnic0 linkstate is down. Date Time: 03/01/2021, 3:46:45 PM Type: Information Target: ************ Description: Ask VMware... 03/01/2021, 3:46:45 PM Physical NIC vmnic0 linkstate is up. Related events: Date Time: 03/01/2021, 3:46:45 PM Type: Warning Target: ************ Description: Ask VMware... 03/01/2021, 3:46:45 PM Physical NIC vmnic1 linkstate is down. Date Time: 03/01/2021, 3:46:45 PM Type: Information Target: ************ Description: Ask VMware... 03/01/2021, 3:46:45 PM Physical NIC vmnic1 linkstate is up. Related events: Date Time: 03/01/2021, 3:46:45 PM Type: Warning Target: ************ Description: Ask VMware... 03/01/2021, 3:46:45 PM Physical NIC vmnic2 linkstate is down. Date Time: 03/01/2021, 3:46:45 PM Type: Information Target: ************ Description: Ask VMware... 03/01/2021, 3:46:45 PM Physical NIC vmnic2 linkstate is up. *********************The host recovers DS connectivity.*********************************** Date Time: 03/01/2021, 3:46:45 PM Type: Information Target: ************ Description: Ask VMware... 03/01/2021, 3:46:45 PM File system DSName, 5****f63-d33****-*5e6-a03**ed3e10 on volume 5a568f61-7ce7cfa0-a040-a0369fed3e10 has been mounted in rw mode on this host. Related events: Date Time: 03/01/2021, 3:49:48 PM Type: Warning Target: ************ Description: 03/01/2021, 3:49:48 PM Event burst of esx.audit.vmfs.volume.mounted started Date Time: 03/01/2021, 3:50:34 PM Type: Information Target: ************ Description: 03/01/2021, 3:50:34 PM Bursting event esx.audit.vmfs.volume.mounted occurred 44 times since Monday, March 1, 2021 9:49:45 PM UTC Date Time: 03/01/2021, 3:50:34 PM Type: Information Target: ************ Description: 03/01/2021, 3:50:34 PM Event burst of esx.audit.vmfs.volume.mounted ended Related events: There are no related events.
This is what I have for the other metrics. I need the same but for Swap memory usage if that even exists   Get-VM | Where {$_.PowerState -eq "PoweredOn"} | Select Name, Host, NumCpu, MemoryMB, ` @... See more...
This is what I have for the other metrics. I need the same but for Swap memory usage if that even exists   Get-VM | Where {$_.PowerState -eq "PoweredOn"} | Select Name, Host, NumCpu, MemoryMB, ` @{N="CPU Usage (Average), Mhz" ; E={[Math]::Round((($_ | Get-Stat -Stat cpu.usagemhz.average -Start (Get-Date).AddDays(-30) -IntervalMins 5 | Measure-Object Value -Average).Average),2)}}, ` @{N="Memory Usage (Average), %" ; E={[Math]::Round((($_ | Get-Stat -Stat mem.usage.average -Start (Get-Date).AddDays(-30) -IntervalMins 5 | Measure-Object Value -Average).Average),2)}} , ` @{N="Network Usage (Average), KBps" ; E={[Math]::Round((($_ | Get-Stat -Stat net.usage.average -Start (Get-Date).AddDays(-30) -IntervalMins 5 | Measure-Object Value -Average).Average),2)}} , ` @{N="Disk Usage (Average), KBps" ; E={[Math]::Round((($_ | Get-Stat -Stat disk.usage.average -Start (Get-Date).AddDays(-30) -IntervalMins 5 | Measure-Object Value -Average).Average),2)}}  
Hi all, Im trying to get a CPU, MEM, Net and Swap utilization report with powercli and I got the first 3 but I've been looking on how to get the VMs swap utilization with no luck, is there a way/me... See more...
Hi all, Im trying to get a CPU, MEM, Net and Swap utilization report with powercli and I got the first 3 but I've been looking on how to get the VMs swap utilization with no luck, is there a way/metric to get this info with powerCLI?? moderator edit by wila: Moved to PowerCLI discussions forum.  
Hi all, How can I get the max Throughput (MBps) of a VM with powercli? I have been googling but I could not find anything useful. Any clue or idea?       Thanks!
Ok this is what I have now:   Get-VM -Name vmname | Select Name, vmHost, @{N="CPU Usage (Average), Mhz" ; E={[Math]::Round((($_ | Get-Stat -Stat cpu.usagemhz.average -Start (Get-Date).AddDays(-30)... See more...
Ok this is what I have now:   Get-VM -Name vmname | Select Name, vmHost, @{N="CPU Usage (Average), Mhz" ; E={[Math]::Round((($_ | Get-Stat -Stat cpu.usagemhz.average -Start (Get-Date).AddDays(-30) -IntervalMins 5 | Measure-Object Value -Average).Average),2)}}, @{N="CPU Usage (Peak), %" ; E={[Math]::Round(($_ | Get-Stat -Stat cpu.usage.average -Start (Get-Date).AddDays(-30) -IntervalMins 5 | Measure-Object -Property Value -Maximum | Select -ExpandProperty Maximum))}}, @{N="Memory Usage (Average), %" ; E={[Math]::Round((($_ | Get-Stat -Stat mem.usage.average -Start (Get-Date).AddDays(-30) -IntervalMins 5 | Measure-Object Value -Average).Average),2)}}, @{N="Memory Usage (Peak), %" ; E={[Math]::Round(($_ | Get-Stat -Stat mem.usage.average -Start (Get-Date).AddDays(-30) -IntervalMins 5 | Measure-Object -Property Value -Maximum | Select -ExpandProperty Maximum))}}, @{N="Disk Usage (Average), KBps" ; E={[Math]::Round((($_ | Get-Stat -Stat disk.usage.average -Start (Get-Date).AddDays(-30) -IntervalSecs 86400 | Measure-Object Value -Average).Average),2)}}, @{N="Disk Usage (Peak), KBps" ; E={[Math]::Round(($_ | Get-Stat -Stat disk.usage.average -Start (Get-Date).AddDays(-30) -IntervalSecs 86400 | Measure-Object -Property Value -Maximum | Select -ExpandProperty Maximum))}}   I'm not getting any errors, but do you see something wrong or any improvement area? Just want to make sure I'm getting the right results.
Hi all, I have the below script to get Avg CPU Usage and Avg Memory Usage from a VM:   Get-VM -Name vmname | Select Name, vmHost, @{N="CPU Usage (Average), Mhz" ; E={[Math]::Round((($_ | Get-Stat... See more...
Hi all, I have the below script to get Avg CPU Usage and Avg Memory Usage from a VM:   Get-VM -Name vmname | Select Name, vmHost, @{N="CPU Usage (Average), Mhz" ; E={[Math]::Round((($_ | Get-Stat -Stat cpu.usagemhz.average -Start (Get-Date).AddDays(-30) -IntervalMins 5 | Measure-Object Value -Average).Average),2)}}, ` @{N="Memory Usage (Average), %" ; E={[Math]::Round((($_ | Get-Stat -Stat mem.usage.average -Start (Get-Date).AddDays(-30) -IntervalMins 5 | Measure-Object Value -Average).Average),2)}}   How can I add the below ones? Peak CPU Usage Peak Memory Usage Avg Disk I/O Usage Peak Disk I/O Usage
Thanks man!
That worked fine LucD thanks. Googling I found another script that I have modified a little bit to get the vcenter name as well: Get-VM |sort name| Get-NetworkAdapter | Where-object {$_.Co... See more...
That worked fine LucD thanks. Googling I found another script that I have modified a little bit to get the vcenter name as well: Get-VM |sort name| Get-NetworkAdapter | Where-object {$_.ConnectionState.StartConnected -ne "True"} | foreach ($_) {Write-Host $_.Uid.Split('@')[1].Split(':')[0] $_.Parent.Name "("$_.Name") type:" $_.Type "Startconnected:" $_.ConnectionState.StartConnected} | Export-Csv –append –path H:\Desktop\NetAdapterStartUp.csv -NoTypeInformation -UseCulture I'm trying to export the output to a CSV file but seems to be not working, I just get an empty .csv
Hi all, I'm trying to get all the VMs that are "connected" state(to exclude maintenance mode ones) and the "Connect at power on" network adapter setting disabled. This is what I have but seems ... See more...
Hi all, I'm trying to get all the VMs that are "connected" state(to exclude maintenance mode ones) and the "Connect at power on" network adapter setting disabled. This is what I have but seems to be not working properly Im not getting any result even when I know there are VMs with this setting disabled: Get-VM | Get-NetworkAdapter | Where-object {($_.ConnectionState.Connected ) -and ($_.ConnectionState.StartConnected -ne "True")} Any idea?
Thanks for the link good info! I ran this and got this output: PS H:\> Get-StatType -Entity (Get-VM vmname) cpu.usage.average cpu.usagemhz.average cpu.ready.summation mem.usage.average ... See more...
Thanks for the link good info! I ran this and got this output: PS H:\> Get-StatType -Entity (Get-VM vmname) cpu.usage.average cpu.usagemhz.average cpu.ready.summation mem.usage.average mem.swapinRate.average mem.swapoutRate.average mem.vmmemctl.average mem.consumed.average mem.overhead.average disk.usage.average disk.maxTotalLatency.latest net.usage.average sys.uptime.latest disk.used.latest disk.provisioned.latest disk.unshared.latest So I guess if the metric is not in the list it's not being collected.
Hi LucD where can I see whether net.received.average and net.transmitted.average are enabled to be collected or not?
With my code this is the output Im getting: They are being captured. MemoryGB Memory Usage (Average), % CPU Usage (Average), Mhz Network Usage (Average), KBps 12 12.18 2963.24 45.71 12 11... See more...
With my code this is the output Im getting: They are being captured. MemoryGB Memory Usage (Average), % CPU Usage (Average), Mhz Network Usage (Average), KBps 12 12.18 2963.24 45.71 12 11.61 696.15 63.65 8 10.7 279.59 41.18 16 6.61 312.4 47.95 12 21.3 1070.35 74.69 8 11.26 312.46 45.47 12 12.66 738.34 66.47 12 11.51 750.15 46.62
I just ran it but I'm getting a bunch of these: Get-Percentile : Cannot bind argument to parameter 'Sequence' because it is null. At H:\Desktop\vmdata.ps1:127 char:57 + ... e -Sequence ($gro... See more...
I just ran it but I'm getting a bunch of these: Get-Percentile : Cannot bind argument to parameter 'Sequence' because it is null. At H:\Desktop\vmdata.ps1:127 char:57 + ... e -Sequence ($group.Group.Where( { $_.MetricId -eq 'net.received.aver ... +                 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~     + CategoryInfo          : InvalidData: (:) [Get-Percentile], ParameterBindingValidationExcepti    on     + FullyQualifiedErrorId : ParameterArgumentValidationErrorNullNotAllowed,Get-Percentile
Hi there, I have the below code to get some VM stats averages but I need to get the below ones in MB and at 95%: CPU Util (95%) Mem Util (MB) (95%) Net Util-Out (MB/s) (95%) Net Util-In (M... See more...
Hi there, I have the below code to get some VM stats averages but I need to get the below ones in MB and at 95%: CPU Util (95%) Mem Util (MB) (95%) Net Util-Out (MB/s) (95%) Net Util-In (MB/s) (95%) How can I achieve this? $out= "H:\Desktop\report1.csv" $vm = Get-Content H:\Desktop\machines.txt Get-VM -Name $vm | Select Name, MemoryGB, @{N="Memory Usage (Average), %" ; E={[Math]::Round((($_ | Get-Stat -Stat mem.usage.average -Start (Get-Date).AddDays(-30) -IntervalMins 5 | Measure-Object Value -Average).Average),2)}} , ` @{N="CPU Usage (Average), Mhz" ; E={[Math]::Round((($_ | Get-Stat -Stat cpu.usagemhz.average -Start (Get-Date).AddDays(-30) -IntervalMins 5 | Measure-Object Value -Average).Average),2)}}, ` @{N="Network Usage (Average), KBps" ; E={[Math]::Round((($_ | Get-Stat -Stat net.usage.average -Start (Get-Date).AddDays(-30) -IntervalMins 5 | Measure-Object Value -Average).Average),2)}} | Export-Csv -Path $out -NoTypeInformation -UseCulture
Hi all, Im trying to install a NIC driver into my ESXi from ILO remote console with esxi shell as I don't have management connectivity to it. I have created an ISO with the VIB files and mounte... See more...
Hi all, Im trying to install a NIC driver into my ESXi from ILO remote console with esxi shell as I don't have management connectivity to it. I have created an ISO with the VIB files and mounted it into the ILO CDROM and ESXI with the command: vsish -e set /vmkModules/iso9660/mount mpx.vmhba33:C0:T0:L0 The actual content of the ISO is: Everything works fine until I try to install the VIB, when I do an ls -l I cannot see any of the files in the ISO file, I just see this: I have tried the below commands without any luck: esxcli software vib install -v net-nx-nic_6.0.643-1OEM.600.0.0.249.4585.vib esxcli software vib install -v NET-NX-2 esxcli software vib install -v NX_NIC-3 I just keep getting this message for example for NX_NIC-3: What is wrong here? any idea?
Cert issue across all VCs after VRA upgrade. --------------------------------------------------------------------------------------------------------- Was it helpful? Let us know by completin... See more...
Cert issue across all VCs after VRA upgrade. --------------------------------------------------------------------------------------------------------- Was it helpful? Let us know by completing this short survey here.
Hi all, We noticed that we can't open a remote console for a deployed VM from VRA web interface, we get the below error: "Cannot connect to remote console. Verify that the machine is powered ... See more...
Hi all, We noticed that we can't open a remote console for a deployed VM from VRA web interface, we get the below error: "Cannot connect to remote console. Verify that the machine is powered on and connected to the network." The VMs are powered On, on Vcenter side the VMs look healthy. This is what i have tried so far: Ping from Host to vcenter where the VRA VM resides: [root@host:~] ping vcenter PING vcenter (10.93.104.30): 56 data bytes 64 bytes from 10.93.104.30: icmp_seq=0 ttl=64 time=0.186 ms 64 bytes from 10.93.104.30: icmp_seq=1 ttl=64 time=0.282 ms 64 bytes from 10.93.104.30: icmp_seq=2 ttl=64 time=0.343 ms --- vcenter ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.186/0.270/0.343 ms -Curl to port 902 from vRA to host works fine: [replica] vra1:~ # curl -vvv telnet://host.domain.local:902 * Rebuilt URL to: telnet://host.domain.local:902/ * Trying 10.93.104.27... * TCP_NODELAY set * Connected to hosts.domain.local (10.93.104.27) port 902 (#0) 220 VMware Authentication Daemon Version 1.10: SSL Required, ServerDaemonProtocol:SOAP, MKSDisplayProtocol:VNC , VMXARGS supported, NFCSSL supported/t -Connection to port 902 from vRA to host: [root@host:~] esxcli network ip connection list | grep 902 tcp 0 0 10.93.104.27:902 10.245.253.3:40456 ESTABLISHED 67166 newreno busybox tcp 0 0 :::902 :::0 LISTEN 67166 newreno busybox tcp 0 0 0.0.0.0:902 0.0.0.0:0 LISTEN 67166 newreno busybox In Security properties on VRA this is already set: vra1:/etc/vcac # grep -i timeout security.properties consoleproxy.timeout.connectionInitMs=20000 Infrastructure -> DEM status -> all are online All services are up. Infrastructure -> log: Error: The underlying connection was closed: An unexpected error occurred on a receive. Inner Exception: Certificate is not trusted (RemoteCertificateChainErrors). Subject: C=US, CN=vm-vcenter.domain.local Thumbprint: DBDF5C8DDAF5C4AE34A55AB995DFF56C14B13181 Stack trace: at System.Web.Services.Protocols.WebClientProtocol.GetWebResponse(WebRequest request) at System.Web.Services.Protocols.SoapHttpClientProtocol.Invoke(String methodName, Object[] parameters) at VMware.vSphere.VimService.RetrieveServiceContent(ManagedObjectReference _this) at DynamicOps.VMWareModel.Interface.VSphereSession.Connect(String userName, String password) at DynamicOps.VMWareModel.Interface.VSphereInterface.ConnectToVCenter(Uri connectionUri, String userName, String password) at DynamicOps.Web.VMRC.Vmrc.OnInit(EventArgs e) Inner Exception: at DynamicOps.Common.GlobalCertificateValidationManager.ThrowUntrustedCertificateException(SslPolicyErrors sslPolicyErrors, X509Certificate certificate) at DynamicOps.Common.GlobalCertificateValidationManager.ServerCertificateValidation(Object sender, X509Certificate certificate, X509Chain chain, SslPolicyErrors sslPolicyErrors) at System.Net.ServerCertValidationCallback.Callback(Object state) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Net.ServerCertValidationCallback.Invoke(Object request, X509Certificate certificate, X509Chain chain, SslPolicyErrors sslPolicyErrors) at System.Net.Security.SecureChannel.VerifyRemoteCertificate(RemoteCertValidationCallback remoteCertValidationCallback, ProtocolToken& alertToken) at System.Net.Security.SslState.CompleteHandshake(ProtocolToken& alertToken) at System.Net.Security.SslState.CheckCompletionBeforeNextReceive(ProtocolToken message, AsyncProtocolRequest asyncRequest) at System.Net.Security.SslState.ProcessReceivedBlob(Byte[] buffer, Int32 count, AsyncProtocolRequest asyncRequest) at System.Net.Security.SslState.StartReceiveBlob(Byte[] buffer, AsyncProtocolRequest asyncRequest) at System.Net.Security.SslState.CheckCompletionBeforeNextReceive(ProtocolToken message, AsyncProtocolRequest asyncRequest) at System.Net.Security.SslState.ProcessReceivedBlob(Byte[] buffer, Int32 count, AsyncProtocolRequest asyncRequest) at System.Net.Security.SslState.StartReceiveBlob(Byte[] buffer, AsyncProtocolRequest asyncRequest) at System.Net.Security.SslState.CheckCompletionBeforeNextReceive(ProtocolToken message, AsyncProtocolRequest asyncRequest) at System.Net.Security.SslState.ProcessReceivedBlob(Byte[] buffer, Int32 count, AsyncProtocolRequest asyncRequest) at System.Net.Security.SslState.StartReceiveBlob(Byte[] buffer, AsyncProtocolRequest asyncRequest) at System.Net.Security.SslState.CheckCompletionBeforeNextReceive(ProtocolToken message, AsyncProtocolRequest asyncRequest) at System.Net.Security.SslState.ProcessReceivedBlob(Byte[] buffer, Int32 count, AsyncProtocolRequest asyncRequest) at System.Net.Security.SslState.StartReceiveBlob(Byte[] buffer, AsyncProtocolRequest asyncRequest) at System.Net.Security.SslState.CheckCompletionBeforeNextReceive(ProtocolToken message, AsyncProtocolRequest asyncRequest) at System.Net.Security.SslState.ProcessReceivedBlob(Byte[] buffer, Int32 count, AsyncProtocolRequest asyncRequest) at System.Net.Security.SslState.StartReceiveBlob(Byte[] buffer, AsyncProtocolRequest asyncRequest) at System.Net.Security.SslState.CheckCompletionBeforeNextReceive(ProtocolToken message, AsyncProtocolRequest asyncRequest) at System.Net.Security.SslState.ProcessReceivedBlob(Byte[] buffer, Int32 count, AsyncProtocolRequest asyncRequest) at System.Net.Security.SslState.StartReceiveBlob(Byte[] buffer, AsyncProtocolRequest asyncRequest) at System.Net.Security.SslState.CheckCompletionBeforeNextReceive(ProtocolToken message, AsyncProtocolRequest asyncRequest) at System.Net.Security.SslState.ForceAuthentication(Boolean receiveFirst, Byte[] buffer, AsyncProtocolRequest asyncRequest) at System.Net.Security.SslState.ProcessAuthentication(LazyAsyncResult lazyResult) at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx) at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state) at System.Net.TlsStream.ProcessAuthentication(LazyAsyncResult result) at System.Net.TlsStream.Write(Byte[] buffer, Int32 offset, Int32 size) at System.Net.ConnectStream.WriteHeaders(Boolean async) Time configuration is: ESXI where VRA vm resides: MT Vcenter where VRA vm resides: MT VRA1,2,3: UTC(6 hours of difference) Cluster Connection Status: Connected. vra1: Replica UP/Async (This was the Master before upgrade to 7.5) vra2: Master / UP vra3: Replica UP/Async I'm new to VRA and this is my first issue so not sure what all that means but seems a certificate issue what else can I do/check, could the time difference between vra and esxi/vcenter be the cause?