Here is some more information:
This is a successful connection:
17:01:46.583343 IP esx03.domain.local.60917 > 10.40.50.60.31031: F 1:1(0) ack 1 win 130 <nop,nop,timestamp 226394800 609644394>
17:01:46.583408 IP 10.40.50.60.31031 > esx03.domain.local.60917: F 1:1(0) ack 2 win 46 <nop,nop,timestamp 609644395 226394800>
This is a failed connection:
17:02:58.172657 IP esx01.domain.local.50071 > 10.40.50.60.31031: S 3409106686:3409106686(0) win 65535 <mss 1380,nop,wscale 9,sackOK,timestamp 279734603 0>
17:02:58.172671 IP 10.40.50.60.31031 > esx01.domain.local.50071: S 1282637053:1282637053(0) ack 3409106687 win 5792 <mss 1460,sackOK,timestamp 609662293 279734603,nop,wscale 7>