[Labs-l] Resolved: Labs and toollabs outage in progress

Wed Oct 8 00:19:33 UTC 2014

On 10/07/2014 07:53 PM, Andrew Bogott wrote:
> As for which jobs died -- that's a question for someone with better grid
> skills than me :)

Since tools-master was not affected, continuous jobs will have been
requeued and will reschedule once the actual nodes return to full health
(which should be in progress now).

Bigbrother /should/ take care of the rest in short order.

The absence of tools-submit means that, for the downtime, no cron jobs
were started; but cron defaults to firing up any schedule it has missed
on startup (but only once; so if an entry would have run twice during
the downtime, it'll be tried only once at boot).

-- Marc