I actually added connect-viserver VSERVERNAME to the script and it worked instead of doing it from the powercli prompt first.

Only downside is, its migrating all the VM's and not queuing any up. I was hoping it would just grab the first 4 in the csv file, process them, and when one is done it moves on to the next one.