Check your minimums on the pool. Are you sure that you have enough machines provisioned upfront to satisfy the demand especially in the morning when users start to log on. With NVidia those VMs take much longer to get provisioned.