Hi Morten,
There is currently no way to allow you to define a maintenance
window, we are looking at adding that feature within the next few
revisions of the software. There is a way for you to broadly disable
alerts for the entire platform and all of the resources on it by
clicking on "Disable All Alerts On This Agent" link near the top of
the platform resource page. You can re-enable everything again by
clicking on the "Enable All Alerts On This Agent" link.
Charles