[QA] [reading-wmf] browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce - Build # 685 - Still Failing!

Wed Jun 17 23:03:13 UTC 2015

On Wed, Jun 17, 2015 at 3:44 PM, Dan Duvall <dduvall at wikimedia.org> wrote:

> Both of these failures are legit, actually. The first one fails every time
> because there's no "Settings" menu item for the mobile view on beta ATM.
> The second one is intermittent but fails because clicking "search within
> pages" fails to do anything ~ 20% of the time—I was able to reproduce this
> through repeated executions of the tests and by pausing at the "click
> search" step to initiate it manually.
>
> Is there someone on your team that can own verification of such failures
> before escalating them to QA/RelEng? We're here to help
> troubleshoot/refactor the trickier stuff but that first one seemed pretty
> trivial to repro.
>

My mistake. Looking at the SauceLabs replay of the first one does indeed
show "Settings" in the menu, although it doesn't show when I run the test
locally (still running against beta). Still, it would be nice to establish
a practice of verifying internally before escalating to other teams. (Where
are those illusive QA analysts we saw in the new org chart ... ?)

>
> On Tue, Jun 16, 2015 at 11:03 AM, Jon Robson <jrobson at wikimedia.org>
> wrote:
>
>> More flaky weirdness. cc'ing QA
>>
>> On Tue, Jun 16, 2015 at 10:05 AM, jenkins-bot <jenkins-bot at wikimedia.org>
>> wrote:
>>
>>>   * FAILURE:
>>> browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce
>>> Build #685
>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/>
>>> (Tue, 16 Jun 2015 16:31:43 +0000)*
>>> *Test Result*
>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/>
>>>  2 failed, 3 skipped
>>>   Failed Tests  *Test Name**Duration**Age*  Menus open correct page for
>>> anonymous users.Check links in menu
>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/junit/(root)/Menus%20open%20correct%20page%20for%20anonymous%20users/Check_links_in_menu>23
>>> sec2
>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/683/>  Search.Search
>>> with search in pages button
>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/junit/(root)/Search/Search_with_search_in_pages_button>34
>>> sec1
>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/684/>  All
>>> Tests  *Package**Duration**Fail**Skip**Total*  (root)
>>> <https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/685/testReport/junit/(root)>24
>>> min2356
>>>
>>> _______________________________________________
>>> reading-wmf mailing list
>>> reading-wmf at lists.wikimedia.org
>>> https://lists.wikimedia.org/mailman/listinfo/reading-wmf
>>>
>>>
>>
>> _______________________________________________
>> QA mailing list
>> QA at lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/qa
>>
>>
>
>
> --
> Dan Duvall
> Automation Engineer
> Wikimedia Foundation <http://wikimediafoundation.org>
>

-- 
Dan Duvall
Automation Engineer
Wikimedia Foundation <http://wikimediafoundation.org>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/qa/attachments/20150617/72f82029/attachment.html>