Hey,
I agree with PJ, temporarly disable DRS for a day or so and if the slowness still occurs you can rule out vmotion and get that out of the equation then start looking at metrics in ESXTOP to see what the VM is doing when it has its "slowness" Can this problem be replicated or is it just random?