VMware Cloud Community
nettech1
Expert
Expert

slow file transfer to FreeBSD VM

Hello,

We are experiencing extremely slow writes to a FreeBSD 10.3 VM running on an ESXi server [6.0.0, 2494585]. Physical hardware is on the VMWare compatibility list (HPE ProLiant DL20 Gen9 Server)  There is a physical RAID controller (P440) with 4GB of cache (enabled) and 3 SSD drives in a RAID 5 configuration.

BSD VM has 4GB of ram, 2CPUs, LSI Parallel controller, E1000 Nic and open-vm-tools is installed.

When we attempt to copy a file over the network to a BSD VM from a physical machine on the same network the throughput is somewhere around 20 MB/s, however within a few seconds it drops to zero for several seconds (7 – 15 ) and then picks back up and stays around 10 – 15 MB/s

2gb.jpg

There are several post on the internet identifying the problem when ZFS is used on NFS, however our storage is local VMFS5. https://calvin.me/slow-vmware-nfs-zfs-add-zil/

The I/O performance test on a BSD Guest

time dd if=/dev/zero of=/testfile.fle bs=1m count=2000

2000+0 records in
2000+0 records out
2097152000 bytes transferred in 1.592420 secs (1316959010 bytes/sec)
0.000u 0.957s 0:01.59 59.7% 25+171k 0+0io 0pf+0w

Just to rule Virtualization out, we built another BSD system, but on the physical hardware. File transfer from a physical Windows system to a BSD machine is consistent at 35MB/s with 0 drops. (both systems have SSD drives)

phys_zfs.jpg

We also have a Win 2012 Server Guest running on the same ESXi server. Hardware assigned to the Windows box is the almost identical to the BSD guest, however ISCSI controller is paravirtual and the nic is VMXNET 3

Coping the test file to a Win 2012 VM from a physical machine is always rock solid at 115MB/s.

diag.jpg

Does anyone have any ideas what could be causing the delays / drops during the file copy on the BSD VM?

There is only 2 VMs on this ESXi Host and no resource allocation is configured. Iperf test between a physical Windows 7 and FreeBSD VM shows that the network is capable of transfers at 1GB/s

ip3_cl.jpg

Any help is greatly appreciated.

Thank you

2 Replies
mordi
Enthusiast
Enthusiast

are you using standard switch or distributed switch ?

can you share the switch configuration?

If you found this or any other answer useful please consider the use of the Helpful or Correct buttons to award points. Mordi Shushan http://vpentathlon.com @mordi_s
nettech1
Expert
Expert

standard switch

vmswitching.jpg

0 Kudos