Haven't messed with OpenFiler that much, but
just because a something says "iSCSI" or "NFS" on it doesn't mean it is
necessarily compatible with VMware ESX. VMFS is a clustered file
system, and therefore uses locking/reservation features of the iSCSI
protocol that are often not available or poorly implemented in many
iSCSI implementations (low-end NAS devices for example).
If you're running this setup in production, and not just a test lab,
I would strongly suggest finding something from the official VMware
hardware compatibility list. This will cost money, but there are some
less-expensive devices on there.
We use OpenSolaris storage on an old box in our VMware lab, because
it is cheap. Also we are using HP/LeftHand clustered storage in our test
VMware cluster. This isn't ideal, but ponying up $3/GB for the test lab
didn't make it past accounting.