Couple questions:
Do I need alias IP address on the NetApp controllers?
Personally, I set up storage on a dedicated network - with dedicated NICs allocated to storage on the ESX.
this network is also non routable.
so the IP on the NetApp is on the same subnet as the VMKernel port that I create for it - and neither has Default Gateways specified.
this means all Storage traffic remains isolated on that network (so no performance interruption and no security weaknesses)
Do I need multiple vmk kernel ports on the ESX hosts?
I create a dedicated one for storage (as stated above)
Your VMs do not need IP access to the NFS store to function.