This requires deleting individual Alert Schedulers via SSH. If there is an Alert Scheduler from a version previous to what you have installed, they keep generating the new Schedulers. I know a new KB article is being generated for this issue, but as that was just earlier this week it likely isn't published yet, and may require an SR to resolve.