[QA] [reading-wmf] browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce - Build # 771 - Failure!

Tue Aug 4 12:21:23 UTC 2015

Thanks Jon for consistently paying attention to the browser tests. You rock.

On Tue, Aug 4, 2015 at 2:21 AM, Jon Robson <jrobson at wikimedia.org> wrote:

> Okay in this case it was actually a failing test. Saucelabs was
> unfortunately masking it. Fix has been merged and Firefox search in pages
> is now working again. Thanks guys!
>
>
> On Mon, Aug 3, 2015 at 2:48 PM, Dan Duvall <dduvall at wikimedia.org> wrote:
>
>> This appears to be an issue solely with the annotation to the SauceLabs
>> job that is supposed to occur after each failed scenario. In other words,
>> trust the Jenkins build status over the SauceLabs status for now.
>>
>> I'm able to reproduce the failure pretty consistently against Beta
>> Cluster with both a local FF WebDriver connection and via SauceLabs, so I
>> would consider it a true failure, possibly a need to refactor the test—I
>> see a `sleep 5` in the step so perhaps it's a timing issue.
>>
>> On Mon, Aug 3, 2015 at 2:30 PM, Jon Robson <jrobson at wikimedia.org> wrote:
>>
>>> QA peeps, this test keeps failing but when I click the sauce labs url
>>> https://saucelabs.com/jobs/211dfa1ec9144961bc099678533bce85 it tells me
>>> it passed so we're having a lot of difficulty trying to debug this.
>>>
>>> Is it possible to grab some help from someone to work out why this keeps
>>> happening? It's responsible for most of our red builds now.
>>>
>>> Context:
>>> https://phabricator.wikimedia.org/T105589
>>> https://phabricator.wikimedia.org/T98476
>>>
>>> On Sun, Aug 2, 2015 at 8:19 PM, jenkins-bot <jenkins-bot at wikimedia.org>
>>> wrote:
>>>
>>>> * FAILURE:
>>>> browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce
>>>> Build #771
>>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/>
>>>> (Mon, 03 Aug 2015 02:42:00 +0000)*
>>>> *Test Result*
>>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/>
>>>> 1 failed, 3 skipped
>>>> Failed Tests *Test Name**Duration**Age* Search.Search with search in
>>>> pages button
>>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/junit/(root)/Search/Search_with_search_in_pages_button>40
>>>> sec1
>>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/770/> All
>>>> Tests *Package**Duration**Fail**Skip**Total* (root)
>>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/771/testReport/junit/(root)>26
>>>> min1368
>>>>
>>>> _______________________________________________
>>>> reading-wmf mailing list
>>>> reading-wmf at lists.wikimedia.org
>>>> https://lists.wikimedia.org/mailman/listinfo/reading-wmf
>>>>
>>>>
>>>
>>> _______________________________________________
>>> QA mailing list
>>> QA at lists.wikimedia.org
>>> https://lists.wikimedia.org/mailman/listinfo/qa
>>>
>>>
>>
>>
>> --
>> Dan Duvall
>> Automation Engineer
>> Wikimedia Foundation <http://wikimediafoundation.org>
>>
>> _______________________________________________
>> reading-wmf mailing list
>> reading-wmf at lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/reading-wmf
>>
>>
>
> _______________________________________________
> reading-wmf mailing list
> reading-wmf at lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/reading-wmf
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/qa/attachments/20150804/2a077b99/attachment.html>