[Engineering] [Train] 1.33.0-wmf.24 status update

Mon Apr 8 20:03:52 UTC 2019

The 1.33.0-wmf.24 version of MediaWiki was successfully promoted to all
wikis today. Thanks to everyone who helped fix outstanding issues from last
week!

Kindly,
Dan

On Thu, Apr 4, 2019 at 2:36 PM Dan Duvall <dduvall at wikimedia.org> wrote:

> The 1.33.0-wmf.24 version of MediaWiki remains blocked[0], holding at
> group0 pending resolution of the following issue:
>
> * RefreshLinksJob::runForTitle: transaction round 'RefreshLinksJob::run'
> already started on commons - https://phabricator.wikimedia.org/T220037
>
> Errors related to the issue were mitigated somewhat by a backported patch
> to the EventBus extension. However, the 90% drop in DBTransactionError
> rates still left us at a hefty ~ 800 errors per minute and the root cause
> is yet unknown.
>
> Thanks to everyone who is helping to resolve this week's issues!
>
> Just a note that since we are well outside today's train deployment window
> and we refrain from Friday deploys, any fixes for the outstanding issue can
> be deployed for group0 but promotion of 1.33.0-wmf.24 will be held until
> Monday.
>
> Kindly,
> Dan
>
>
> On Wed, Apr 3, 2019 at 2:29 PM Dan Duvall <dduvall at wikimedia.org> wrote:
>
>> The 1.33.0-wmf.24 version of MediaWiki is blocked[0].
>>
>> The new version is deployed to group0[1], but can proceed no further
>> until these issues are resolved:
>>
>> * Citoid should only usurp "<ref" / ctrl+shift+k shortcuts if full
>> configured - https://phabricator.wikimedia.org/T219510
>> * RefreshLinksJob::runForTitle: transaction round 'RefreshLinksJob::run'
>> already started on commons - https://phabricator.wikimedia.org/T220037
>>
>> The first issue was deemed noncritical for group1 but the second caused a
>> large spike in DBTransactionError rates. The second issue already has a
>> proposed fix but had not yet merged at the closing of the train deployment
>> window.
>>
>> If both issues are resolved by tomorrow's train window, group1 and group2
>> will be promoted in succession at that time (barring further issues).
>>
>> Thank you for your help resolving these issues!
>>
>> Your humble train toiler,
>> Dan
>>
>> [0]. https://phabricator.wikimedia.org/T206678
>> [1]. <https://tools.wmflabs.org/versions/>
>>
>> --
>> Dan Duvall
>> Software Engineer, Release Engineering
>> Wikimedia Foundation <http://wikimediafoundation.org>
>>
>
>
> --
> Dan Duvall
> Software Engineer, Release Engineering
> Wikimedia Foundation <http://wikimediafoundation.org>
>

-- 
Dan Duvall
Software Engineer, Release Engineering
Wikimedia Foundation <http://wikimediafoundation.org>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/engineering/attachments/20190408/2a802af0/attachment.html>