[Wikitech-l] 2018-05-30 Scrum of Scrums meeting notes

https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-05-30 =2018-05-30= == Callouts == * From last week, all WIndows NT operating systems are under the "Windows" os family in analytics metrics * Security: Security review for Wikidata queries data release proposal https://phabricator.wikimedia.org/T190875 == Audiences == === Readers === ==== iOS native app ==== * Blocked by: * Blocking: * Updates: ** Continuing work on tech debt release, 5.8.2 ( https://phabricator.wikimedia.org/project/view/3358/ ) ** Starting work on next major release, 5.9 ( https://phabricator.wikimedia.org/project/view/3238/ ) ==== Android native app ==== * Blocked by: * Blocking: * Updates: * Released maintenance update to production (improvements to reading list syncing / fix no-such-project errors) * Finalizing multilingual features based on user testing at Hackathon -- on track for release in ~1 week. ==== Readers Web ==== * Blocked by: * Blocking: * Updates: *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome 1, Objective 4]]: Continue improving the ways that users can download articles of interest for later consumption *** Reading Web depends on SRE, RelEng, Reading Infra ==== Readers Infrastructure ==== * No updates this week. *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome 1, Objective 4]]: Continue improving the ways that users can download articles of interest for later consumption *** Reading Web depends on SRE, RelEng, Reading Infra **[[Wikimedia Audiences/2017-18 Q4 Goals#Readers|Increase code sharing of client apps by coalescing and moving more logic to the server]] ***Reading Infra depends on Parsing, Services ===== Maps ===== * Blocked by: * Blocking: * Updates: ==== Multimedia ==== * Blocked by: * Blocking: * Updates: ** Looking into OOUI migration for Wikibase per discussions at the hackathon/elsewhere ** UploadWizard work for multilingual captions pretty much complete ** Indexing wikibase statements (searchable via haswbstatement:XXXX), work continues on quantities *Quarterly goal dependency update: **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 3.1]] Prepare for launch of the first Structured Data on Commons feature (multilingual file captions) ***SDC depends on Multimedia,SRE, WMDE, Search Platform, MediaWiki Platform, Research ** [[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 2.1]] Integrate structured file captions into search *** SDC depends on Search Platform, Multimedia **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Structured_Data#Segment_4:_Programs|Segment 4, Outcome 2]]: Develop a better understanding of existing needs for Structured Commons- T171252 ***Research depends on Multimedia === Contributors === ==== Community Tech ==== * Blocked by: * Blocking: * Updates: ** Working on PageTriage improvements ==== Anti-Harassment Tools ==== * Blocked by: * Blocking: * Updates: ** Working on Blocking Tools ==== Editing ==== * Blocked by: * Blocking: * Updates: ** None ==== Parsing ==== * Blocked by: * Blocking: * Updates: ** Tidy -> RemexHtml: final switch planned for June 27th / July 11th *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal 3.6]] Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team *** Parsing depends on MediaWiki Platform, Services **[[Wikimedia Audiences/2017-18 Q4 Goals#Readers|Increase code sharing of client apps by coalescing and moving more logic to the server]] Increase code sharing of client apps by coalescing and moving more logic to the server. *** Reading Infra depends on Parsing, Services ** [[Wikimedia Technology/Goals/2017-18 Q4#Program 7. Smart tools for better data|Outcome 2: Objective 1]]: Revision storage scaling *** Services depends on SRE, Parsing ==== Collaboration ==== * Blocked by: * Blocking: * Updates: ** Patches to solve most of Echo's multi-DC incompatibilities now awaiting review https://phabricator.wikimedia.org/T164860 ** Deleted Echo's rspec tests to unbreak CI ==== Language ==== * Blocked by: * Blocking: * Updates: *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal 3.1]] Improve and consolidate our unified editing platform so that it's great on all devices ***Language depends on Editing === Audiences Design === ==== UI Standardization ==== * Blocked by: * Blocking: * Updates: ** OOUI – v0.27.1 released yesterday: https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v… *** 1 deprecation in this release. Additionally 9 style amendments, 9 code & 2 accessibility improvement. Among those **** Toolbar: Add a required 'name' property to toolgroup configs; deprecating change (Ed Sanders) **** Clarify and align TabSelectWidget focus (Volker E.) https://phabricator.wikimedia.org/T194863 **** Allow dropdown menus to be larger than their handles (Ed Sanders) https://phabricator.wikimedia.org/T195257 ** Continuing work on Design Style Guide, this week starting 'Resources' page with all repo resources ** Continuing work on a minor UI/UX issues in AdvancedSearch with WMDE team == Technology == === Analytics === * Blocked by: * Blocking: * Updates: ** Updated user agent string parsing regexes in eventlogging and refinery ** Migrated zookeeper to new hardware ** Migrating druid to debian stretch, should be finished this week ** Revision score now available in eventstreams === Cloud Services === * Blocked by: * Blocking: * Updates: === Fundraising Tech === * Blocked by: * Blocking: * Updates: ** Working on getting Ingenico Connect API campaign ready. ** Still working on backend pipeline for CentralNotice EventLogging stats ** Working on a Donor Deletion tool for Civi in response to GDPR === MediaWiki Platform === * Blocked by: * Blocking: * Updates: * MCR: ** ar_rev_id deduplication is merged and maintenance script has been run ** API "templated parameters" patch was merged * TemplateStyles: ** Implemented a feature request. ** An enwiki RFC about enabling it as soon as Remex is enabled there is passing. * MediaWiki core master now requires PHP 7.0 or HHVM * MediaWiki-CodeSniffer 19.0.0 and 20.0.0 released, to allow for safe PHP 7 features to be used * Bug triage and fixes for MassMessage and GlobalUserPage * Finished development of "CoverMe": https://tools.wmflabs.org/coverme/ ( https://blog.legoktm.com/2018/05/29/introducing-coverme-find-the-most-calle…) * Deployed postgres in CI, filed T195807 for failures * Work towards PSR-4 in MediaWiki core, including enabling PSR-4 autoloader for more directories, and implementing a structure test to validate PSR-4 compliance * Hackathon projects: ** MySQL client wrapper to replace "sql" shell script: https://gerrit.wikimedia.org/r/#/c/434188/ ** Refactor API parameter validation: https://gerrit.wikimedia.org/r/q/topic:%2522bug%252FT142080-api-param-valid… ** Script to import Phabricator task information into a wiki: https://gerrit.wikimedia.org/r/#/c/433919/ * The usual code review and bug work *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal 3.6]] Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team ***Parsing depends on MediaWiki Platform, Services *** Planning underway for next FY Platform Evolution program **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the first Structured Data on Commons feature]] (multilingual file captions) ***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research *** MCR capabilities in active development ** [[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 1.1]] Assist with deploying MultiContent Revisions on Commons [[phab:T174022|T174022]] Implement multi-content revisions, [[phab:T174023|T174023]] Implement MCR storage layer, [[phab:T174045|T174045]] DB schema migration for MCR, [[phab:T174044|T174044]] Deploy MCR storage layer, [[phab:T174043|T174043]]Deploy Multi-Content Revisions ***SDC depends on MediaWiki Platform, WMDE *** MCR capabilities in active development === Performance === * Blocked by: * Blocking: Readers Web (review of CitationUsage) - will be done this week * Updates: ** performance perception survey live on several wikis ** Trialing mobile performance testing on SauceLabs device lab ** More fixes to ChronologyProtector ** Still pulling jQuery deps out of base javascript modules ** Bunch of resourceloader bug fixes ** mcrouter expected to be ready in prod this week, will test on testwiki next week === Release Engineering === * Blocking ** * Blocked ** * Updates ** Train status: https://phabricator.wikimedia.org/T191051 ** 1.32.0-wmf.5 got held up last week by an incident that happened during the scheduled Thursday train deployment window. *** https://wikitech.wikimedia.org/wiki/Incident_documentation/20180524-wikidata *** We should be back on track this week, wmf.5 is clear of blockers and wmf.6 should be rolling out as usual *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome 1, Objective 4]]: Continue improving the ways that users can download articles of interest for later consumption *** Reading Web depends on SRE, RelEng, Reading Infra === Research === * Blocked by: Performance: https://gerrit.wikimedia.org/r/#/c/432534/ * Blocking: None * Updates: ** Deploying the gapfinder-tools app and gathering section mappings. ** Have been gathering synonym mappings. ** Analyzed the first incoming labels from WikiLabels citations campaign *Quarterly goal dependency update: **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the first Structured Data on Commons feature]] (multilingual file captions) ***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Structured_Data#Segment_4:_Programs|Segment 4, Outcome 2]]: Develop a better understanding of existing needs for Structured Commons- [[phab:T171252|T171252]] ***Research depends on Multimedia === Scoring Platform === * Blocked by: * Blocking: * Updates: === Search Platform === * Blocked by: Security: https://phabricator.wikimedia.org/T190875 * Blocking: * Updates: ** Wikidata reindexed and now external ID and string properties can be searched for with haswbstatement keyword ** Deep category search enabled on all wikis except private ones: https://phabricator.wikimedia.org/T194260 ** all: keyword enabled on all wikis: https://phabricator.wikimedia.org/T165110 ** Exploring ideas for applying NLP to search: https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Potential_Applicatio… ** Looking into fixing regex highlighting that does not time out as expected: https://phabricator.wikimedia.org/T195491 ** Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108 ** Working on Polish analyzer: https://phabricator.wikimedia.org/T186046 ** Working on fulltext search for Lexemes *Quarterly goal dependency update: **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the first Structured Data on Commons feature]] (multilingual file captions) ***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|*Objective 2.1]] Integrate structured file captions into search *** SDC depends on Search Platform, Multimedia === Security === * Blocked by: * Blocking: * Updates: *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal 3.6]]: Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team ***Parsing depends on MediaWiki Platform, Services === Services === * Blocked by: ** Parsing on language variants transformation support ** Echo on non JSON-serializable job https://phabricator.wikimedia.org/T192945 ** Who knows who's resonsible for GWToolset extension? It has non-json-serializable job https://phabricator.wikimedia.org/T192946 * Blocking: none? * Updates: ** Kafka queue enabled for all jobs everywhere except some exceptions and cirrus search ** revision-score event exposed via event streams *Quarterly goal dependency update: **[[Wikimedia Audiences/2017-18 Q4 Goals#Readers|Increase code sharing of client apps by coalescing and moving more logic to the server.]] ***Reading Infra/Parsing, Services **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Product#Program_3:_Increase_device_support_for_editing|Goal 3.6]] Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team ***Parsing depends on MediaWiki Platform, Services [[Wikimedia Technology/Goals/2017-18 Q4#Program 7. Smart tools for better data|Outcome 2: Objective 1]]: Revision storage scaling *** Services depends on SRE, Parsing === Site Reliability Engineering === * Blocked by: ** Collaboration for flow, T172025 * Blocking: ** None * Updates: ** Had a wikidata outage https://wikitech.wikimedia.org/wiki/Incident_documentation/20180524-wikidata ** row C move+upgrade went quite well ** mcrouter to be deployed this week *Quarterly goal dependency update: **[[metawiki:Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Product#Program_2:_Better_Encyclopedia|Outcome 1, Objective 4]]: Continue improving the ways that users can download articles of interest for later consumption *** Reading Web depends on SRE, RelEng, Reading Infra **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the first Structured Data on Commons feature]] (multilingual file captions) ***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research [[Wikimedia Technology/Goals/2017-18 Q4#Program 7. Smart tools for better data|Outcome 2: Objective 1]]: Revision storage scaling *** Services depends on SRE, Parsing == Wikidata == * Blocked by: * Blocking: * Updates: *Quarterly goal dependency update: **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Prepare for launch of the first Structured Data on Commons feature]] (multilingual file captions) ***SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research **[[Wikimedia Audiences/2017-18 Q4 Goals#Programs|Objective 1.1]] Assist with deploying MultiContent Revisions on Commons [[phab:T174022|T174022]] Implement multi-content revisions, [[phab:T174023|T174023]] Implement MCR storage layer, [[phab:T174045|T174045]] DB schema migration for MCR, [[phab:T174044|T174044]] Deploy MCR storage layer, [[phab:T174043|T174043]]Deploy Multi-Content Revisions ***SDC depends on MediaWiki Platform, WMDE == German Technical Wishlist == * Blocked by: * Blocking: * Updates: == SoS Meeting Bookkeeping == * Updates: