[QA] cloudbees failure emails

Fri Jan 31 23:41:36 UTC 2014

I'm not sure if any of these have bugs but please advise on the best
approach to deal with them.

1) Various tests fail because they rely on code that has been merged
to master but not deployed. e.g. new tests for code that has been
merged to master, will fail on enwiki until enwiki gets the new code
deployed.
Is there anyway we can run the tests from the master branch of the
project they belong to, to stop this from happening?

2) Due to bugs some tests randomly fail e.g.
https://bugzilla.wikimedia.org/show_bug.cgi?id=60338
Is there anyway we can flag these different in the email?

Note: I have actually started filtering out mails from
test2.m.wikipedia.org and en.m.wikipedia.org because of point 1.