Hi All,
Here are the minutes from this week's TechCom meeting:
* RFC Put on Last Call (closing on 2018-03-14 at 3pm PST (21:00 UTC,
22:00 CET)): Make some aspects of Tidy's whitespace stripping behavior
part of wikitext parsing "spec" <https://phabricator.wikimedia.org/T157418>
* RFC Put on Last Call (closing on 2018-03-21 at 3pm PST (21:00 UTC,
22:00 CET)): Normalize change tag schema
<https://phabricator.wikimedia.org/T185355>
* No RFC IRC Meeting on March 14
* Redis based refreshLinks jobs are switched to EventBus and now running
exclusively from Kafka
* Global preferences moving along, community tech waiting for change to
table names
You can also find our meeting minutes at
<https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes>
See also the TechCom RFC board
<https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>.
--
Kate Chapman
TechCom Facilitator (Contractor)
https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-03-07
= 2018-03-07 =
== Callouts ==
* Fundraising campaigns
*https://meta.wikimedia.org/wiki/CentralNotice/Calendar*
<https://meta.wikimedia.org/wiki/CentralNotice/Calendar>* - next up:
Netherlands *2018-04-03 through 2018-05-01
* Collaboration is planning to move maps server testing from prod (on
out-of-warranty hardware) into labs, tell us if that's a bad idea or if
there's a catch
* Performance: WebPageTest migration to Linux complete, dashboards need to
be updated if they haven't been already. Reach out to Peter Hedenskog if
you need help.
* Performance: FOUC issue when autofocus is used on Firefox has been
addressed, but fix won't be released until FF60 (expected on 8 May). (Has
been reported to affect some Special pages, Roan also reported it.)
==Blockers==
==== iOS native app ====
** No Joe :( Velocity is going to be reduced for a bit.
==== Readers Infrastructure ====
* Blocked by: Wikidata on code review for description overrides
https://phabricator.wikimedia.org/T184000
==== Community Tech ====
* Blocked by: SRE on GlobalPreferences schema T184666 - quarterly goal
==== Collaboration ====
* Blocked by: SRE on reviewing Flow dumps patch
==== UI Standardization ====
* Blocked by: RelEng on repos for Design subdomain
https://www.mediawiki.org/wiki/Gerrit/New_repositories/Requests &
https://phabricator.wikimedia.org/T185282
== Audiences ==
=== Readers ===
==== iOS native app ====
* Blocked by:
** No Joe :( Velocity is going to be reduced for a bit.
* Blocking:
* Updates:
** Bug fixing iOS reading list sync / finishing remaining sync UI bits
==== Android native app ====
* Blocked by:
* Blocking:
* Updates:
** Rolled out Reading List syncing to 10% of beta audience (~25000 users);
Will continue to roll out to 50% then 100% in the next few days, assuming
scalability looks good.
==== Readers Web ====
* Blocked by:
* Blocking:
* Updates:
** Bug fixing to mobile web and page previews (in preparation for release
to all wikis)
*Quarterly goal dependency update:
** Increase learning by lowering the cost of exploration
*** Reading Web/Performance
** Continue improving the ways that users can download articles of interest
for later consumption
*** Reading Web: Tech Ops/RelEng
==== Readers Infrastructure ====
* Blocked by: Wikidata on code review for description overrides
https://phabricator.wikimedia.org/T184000
* Blocking:
* Updates:
**
===== Maps =====
* Blocked by:
* Blocking:
* Updates:
**
==== Multimedia ====
* Updates
** 3D work nearly all complete - some cleanup and optimization that could
be done later
** Search: Draft patch up, looking for feedback but not urgently
** Other SDC: Progressing, complicated code structure slightly impeding
work, but nothing new and hopefully not for long
Quarterly goal dependency update
** Prepare backend infrastructure for structured data search
*** SDC: Search PF/Multimedia/Wikidata
** Wikimedia Technology/Goals/2017-18 Q3#Segment 2: Search integration and
exposure
*** SDC: Research/Multimedia
** Prepare backend infrastructure for structured data search
*** SDC: Search PF/Multimedia/Wikidata
=== Contributors ===
==== Community Tech ====
* Blocked by: SRE on GlobalPreferences schema T184666 - quarterly goal
* Blocking:
* Updates:
** Lots of discussions with community around long edit summaries rollout,
seems like drastic measures will be avoided.
==== Anti-Harassment Tools ====
* Blocked by:
* Blocking:
* Updates:
**
==== Editing ====
* Blocked by:
* Blocking:
** Updates:
==== Parsing ====
* Blocked by:
* Blocking:
* Updates:
** Tidy will be replaced on a bunch of wikis (~100 overall) next week -
sent out an announcement on ambassadors and wikitech-l
** Last week's RFC hearing about https://phabricator.wikimedia.org/T157418 has
been approved and will be announced for last call soon. WIP patches for
both the PHP parser and Parsoid have been uploaded to gerrit. I have to
update tests and verify they all pass before I take it out of WIP. But, I
expect this to be ready for final review before the last call period ends.
*Quarterly goal dependency update:
** Support work towards unifying MediaWiki's parser implementations, in
liaison with Technology's MediaWiki team
*** Parsing:Mediawiki PF/Services
** No new updates on these dependencies since last week's update
==== Collaboration ====
* Blocked by: SRE on reviewing Flow dumps patch
* Blocking: nobody
* Updates:
** "Flow on your talk page" beta feature re-enabled after Roan fixed MCR bug
** Patch up for review that should fix Flow dumps, Ariel will review next
week
** Planning to move maps server testing from prod into labs, tell us if
that's a bad idea or if there's a catch
** IRC meeting today about change tags RFC
==== Language ====
* Blocked by:
* Blocking:
* Updates:
**
=== Audiences Design ===
* Blocked by:
* Blocking:
* Updates:
**
* Quarterly goal dependency update:
** Audiences DesignStandardise our user interfaces to match user
expectation of quality from our products
*** Audiences Design: Ops
==== UI Standardization ====
* Blocked by: RelEng on repos for Design subdomain
https://www.mediawiki.org/wiki/Gerrit/New_repositories/Requests &
https://phabricator.wikimedia.org/T185282
* Blocking:
* Updates:
** OOUI v0.25.3 released with 3 new features, 2 style improvements and 12
code fixes/amendments, among those:
*** Toolbar items' focus is now aligned to widgets elsewhere
https://phabricator.wikimedia.org/T188031 (Volker E.)
*** demos: Use individual oojs-ui-* JS files for sourcemap support (Moriel
Schottlender)
*** Also preparation for v0.26.0 with currently aimed for unification of
base font-size of OOUI's WikimediaUI theme in VE and MW core
https://phabricator.wikimedia.org/T97631
*** And refine icon set https://phabricator.wikimedia.org/T177432
** Style Guide
*** Fixing technical debt,
*** Bringing proper SVG implementation to it
*** Overhauling imagery
== Technology ==
=== Analytics ===
* Blocked by:
* Blocking:
* Updates:
**
* Quarterly goal dependency update:
**Improve, adjust, or create features geared at the needs identified in New
Editors research project.
*** New Editors Experience:Analytics
=== Cloud Services ===
* Blocked by:
* Blocking:
* Updates:
**
=== Fundraising Tech ===
* Blocked by:
* Blocking:
* Updates:
** More work on new API for main card processor
** blocking more PayPal fraud
** CentralNotice: ready to deploy EventLogging update
** Processing batch refunds for donors affected by confusing recurring
toggle
=== MediaWiki Platform ===
* Blocked by:
* Blocking:
* Updates:
* StripState improvements to address out of memory errors in production
(T187833), and general cleanup
* Working to address memcached timeout errors (T187980)
* A few bugs showed up related to the Actor table patch and were fixed.
* MCR:
** Lots of code review
** Lots of design discussion
* Comment table:
** WRITE_BOTH enabled everywhere!
** WRITE_NEW blocked on the follow up schema change (T187089) and on
T181650.
** There was some displeasure on enwiki over longer edit summaries
resulting in T188798 "Decreasing length of the edit summary (until UI
issues are resolved)".
* Progress on running tests with PHP 7.0 in CI (T144962)
* utfnormal update and other ICU upgrade related patches (T188480)
* SPDX 3.0 license identifier updates
* LuaSandbox: fixed test failure in 32-bit mode, released new version
(T188467)
* Published aggregated pingback statistics using reportupdater and dashiki:
https://pingback.wmflabs.org
** Will be announced after final tweaks
** Thanks, Analytics!
* Preparing for EMWCon
* FYI: Daren Welsh from NASA posted
https://www.mediawiki.org/wiki/5_Year_NASA_Wikiversary
*Quarterly goal dependency update:
** Support work towards unifying MediaWiki's parser implementations, in
liaison with Technology's MediaWiki team
*** Parsing:Mediawiki PF/Services
* Reduce product and technical debt to modernise our tools and
technologies, and to make future changes more effective and efficient
*** Parsing/Mediawiki PF
**1.1 It is possible to store structured data within wiki pages, in
particular on media file pages on Commons. We will enable the MediaWiki
storage layer to correctly store and process structured data elements
within wiki pages.
*** SDC: Mediawiki PF/Wikidata
** no new updates on quarterly goal dependencies since last week
=== Performance ===
* Blocked by:
**N/A
* Blocking:
**N/A
* Updates:
** SRE raised concerns about mcrouter project, going back to the drawing
board with an alternative called Dynomite. This puts our quarterly goal to
have WANCache replicated between data centers at risk
** Enabling oversampling of performance metrics from Singapore this week,
to support the new cache center there.
** Thumbor private wiki support being improved further
** WPT migration to Linux complete, dashboards need to be updated if they
haven't been already
** FOUC issue when autofocus is used on Firefox has been addressed, but fix
won't be released until FF60 (expected on 8 May). (Has been reported to
affect some Special pages, Roan also reported it.)
** Coal update from last week was carried over to address some CR issues,
should go out this week instead.
=== Release Engineering ===
* Blocked by:
* Blocking:
* Updates:
**
*Quarterly goal dependency update:
** Continue improving the ways that users can download articles of interest
for later consumption
*** Reading Web: Tech Ops/RelEng
** Update:
*
=== Research ===
* Blocked by:
* Blocking:
* Updates:
*Quarterly goal dependency update:
** Wikimedia Technology/Goals/2017-18 Q3#Segment 2: Search integration and
exposure
*** SDC: Research/Multimedia
** Update:
*
=== Scoring Platform ===
* Blocked by:
* Blocking:
* Updates:
=== Search Platform ===
* Blocked by:
* Blocking:
* Updates:
**Kafka poller for WDQS is in production:
https://phabricator.wikimedia.org/T185951
** Wikidata items appear in completion searches faster - merged:
https://phabricator.wikimedia.org/T183053
** Started testing “query explorer” feature of LTR plugin:
https://phabricator.wikimedia.org/T187148
** Working on query parsing refactoring:
https://phabricator.wikimedia.org/T185108
** Working on Serbian analyzer for ES:
https://phabricator.wikimedia.org/T183015
** Discussing Lexeme search implementation:
https://www.wikidata.org/wiki/User:Smalyshev_(WMF)/Lexeme_search
*Quarterly goal dependency update:
** Prepare backend infrastructure for structured data search
*** SDC: Search PF/Multimedia/Wikidata
** Update:
*
=== Security ===
* Blocked by:
* Blocking:
* Updates:
**
=== Services ===
* Blocked by: none
* Blocking: none
* Updates:
** All refreshLinks jobs processed on kafka queue
*** Some backlogw created by the switch is being cleared now
** All cdnPurge jobs processed on kafka
** Next - switch cirrusSearch jobs
=== Site Reliability Engineering ===
* Blocked by:
** Collab on Flow dumps https://phabricator.wikimedia.org/T172025
*** Roan: not any more, we're blocked on you now
* Blocking:
** None that we know of
* Updates:
** All traffic cluster are now upgraded to Varnish 5
** hardware refreshing ongoing
** A long standing ICMP issue traffic from Google was fixed finally last
week. https://phabricator.wikimedia.org/T165651#4017007
** The Readings lists schema change has been completed by the Data
Persistence SRE (sub)team
*Quarterly goal dependency update:
** Continue improving the ways that users can download articles of interest
for later consumption
*** Reading Web: Tech Ops/RelEng
** Update: It will not happen this quarter due to lack of time from
Services and SRE teams per https://phabricator.wikimedia.org/T187821#4018885
*
** Audiences DesignStandardise our user interfaces to match user
expectation of quality from our products
*** Audiences Design: Ops This is https://phabricator.wikimedia.org/T185282
** Update: This is not in SRE field currently, we are waiting for the code
to be live in gerrit/phab repos
*
== Wikidata ==
* Blocked by:
* Blocking:
* Updates:
**
*Quarterly goal dependency update:
**1.1 It is possible to store structured data within wiki pages, in
particular on media file pages on Commons. We will enable the MediaWiki
storage layer to correctly store and process structured data elements
within wiki pages.
*** SDC: Mediawiki PF/Wikidata
** Update:
*
** Prepare backend infrastructure for structured data search
*** SDC: Search PF/Multimedia/Wikidata
** Update:
*
== German Technical Wishlist ==
* Blocked by:
* Blocking:
* Updates:
**
== SoS Meeting Bookkeeping ==
* Updates:
**please add links to Phab tickets that relate to quarterly goals
Hello everyone,
We are getting close to maximum capacity for the Wikimedia Hackathon in
Barcelona. This is the last week that we will be accepting registrations
from anyone needing accommodation support (registration is already
closed for Wikimedia Foundation staff and those requesting scholarships).
The deadline for any additional registrations is Wednesday, 14 March.
https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2018/Register_and_Attend
Please do not hesitate to mail hackathon(a)wikimedia.cat for any question!
Sorry for cross-posting!
Reminder: Technical Advice IRC meeting again **tomorrow, Wednesday 4-5 pm
UTC** on #wikimedia-tech.
The Technical Advice IRC meeting is open for all volunteer developers,
topics and questions. This can be anything from "how to get started" over
"who would be the best contact for X" to specific questions on your project.
If you know already what you would like to discuss or ask, please add your
topic to the next meeting:
https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting
Hope to see you there!
Michi (for WMDE’s tech team)
--
Michael F. Schönitzer
Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Tel. (030) 219 158 26-0
http://wikimedia.de
Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen
Wissens frei teilhaben kann. Helfen Sie uns dabei!
http://spenden.wikimedia.de/
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/681/51985.
In the past, administrators of MediaWiki installations faced a
challenging installation procedure when they tried to enable rendering
of mathematical formulae. As of February 22, no configuration or
custom installation is required with the latest versions of MediaWiki
core and the Math extension, if your wiki is connected to the
internet.
This is how it’s done:
For wikis connected to the internet: Simply download the latest
versions for both of Mediawiki core [1] and the Math extension [2] and
that's it. The latest version can be obtained by selecting “master” in
the extension distributor.
For wikis not connected to the internet:
Download the latest version of Mediawiki core [1] and the Math extension [2].
Install the node module mathoid [4]. We recommend using Node version 8
LTS [5], if node.js is not installed on the server. Mathoid can be
installed to any location of your server that is accessible to the web
server. For instance, in the location of the Math extension.
After having installed and tested (e.g., by running npm test) the
mathoid installation, point your MediaWiki to this location by adding
the following config to your LocalSettings.php file:
$wgMathoidCli = ['/srv/mathoid/cli.js', '-c', '/srv/mathoid/config.dev.yaml'];
Replace /srv/mathoid with the location of your mathoid installation
and run update.php [6].
If you have any issues with the installation, please file a
phabricator ticket using the following link
https://phabricator.wikimedia.org/maniphest/task/create/?projects=MediaWiki…
Links and further reading:
[1] https://www.mediawiki.org/wiki/Download_from_Git
[2] Documentation of the Math extension
https://www.mediawiki.org/wiki/Extension:Math**
[3] Extension distributor
https://www.mediawiki.org/wiki/Special:ExtensionDistributor/Math
[4] Mathoid node package https://www.npmjs.com/package/mathoid
[5] Node homepage https://nodejs.org/en/
[6] How to run the database update
https://www.mediawiki.org/wiki/Manual:Update.php
Scientific Paper: Moritz Schubotz, Gabriel Wicke: Mathoid: Robust,
Scalable, Fast and Accessible Math Rendering for Wikipedia. CICM 2014:
224-235 https://arxiv.org/pdf/1404.6179.pdf
Required versions:
* For offline Math rendering MediaWiki core must include patch
https://gerrit.wikimedia.org/r/#/c/399768/
** The math extension must include patch
https://gerrit.wikimedia.org/r/#/c/372100/
--
Moritz Schubotz
Researcher
isg.uni-konstanz.de/people/moritz-schubotz
+49 1578 047 1397
Hello everyone,
On behalf of the Parsing Team @ the WMF, I am announcing our plans to
replace Tidy with Remex on the next set of wikis.
On March 13th, we plan to turn off Tidy on about 100 wikis that have
fewer than 25 issues in all high-priority linter categories [1].
On March 14th, we plan to turn off Tidy on mzn, ko, nl, war, ceb
wikipedias [2].
Later in the month, probably March 20th, we plan to turn off Tidy on all
wikiversities [3] and wikimedia chapter / user group wikis [4]. This
step requires a bit more investigation to identify if all those wikis
are ready for the switch.
In February, we replaced Tidy on all wikinews wikis [5], private wikis
[6], and a bunch of miscellaneous wikis [7]. Once we are done with this
round in March, about 600 wikis on the wikimedia cluster would have had
Tidy replaced. We plan to complete this switch on all wikis (about 900)
by July 2018.
If you have any questions or concerns, please leave a comment on the
associated phabricator tickets or leave a message on mw.org [8].
Thanks,
Subbu.
[1] https://phabricator.wikimedia.org/T188010
[2] https://phabricator.wikimedia.org/T188869
[3] https://phabricator.wikimedia.org/T188880
[4] https://phabricator.wikimedia.org/T188881
[5] https://phabricator.wikimedia.org/T188000
[6] https://phabricator.wikimedia.org/T188009
[7] https://phabricator.wikimedia.org/T188008
[8] https://www.mediawiki.org/wiki/Help_talk:Extension:Linter
Hi everyone,
In honour of Women’s History Month, I will be coordinating a series of
conversations with community members about Women in the Wikimedia movement
<https://meta.wikimedia.org/wiki/Community_Engagement/Women_in_the_Wikimedia…>,
and what their experience is like contributing to our projects.
Our conversations will focus on women within three strategic areas of our
work: Programs, Technical Spaces, and Leadership positions. Each
conversation will have two community members presenting on their work, and
15-20 minutes at the end for conversation, follow up questions, and
discussion. The goal of these discussions is to foster understanding of
challenges and inequalities that women face throughout our movement, and to
engage with our communities to help better address them.
These conversations will be online events, streamed on our YouTube channel
<https://www.youtube.com/c/WikimediaLearningandEvaluationCE>, and hosted on
BlueJeans. If you would like to participate in these events, please add the
event to your calendar, or sign up on wiki:
-
Women in Wikimedia programs: Thursday, March 8, 2018, 17:00 UTC (add to
calendar
<https://calendar.google.com/event?action=TEMPLATE&tmeid=NzNqdGxuNWttazNwMGZ…>)
(sign up on wiki
<https://meta.wikimedia.org/wiki/Community_Engagement/Women_in_the_Wikimedia…>
)
Presenters: Monika Sengul-Jones (OCLC Wikipedian in Residence) and Luisina
Ferrante (Wikimedia Argentina education coordinator).
-
Women in leadership: Wednesday, March 14, 2018, 19:00 UTC (add to
calendar
<https://calendar.google.com/event?action=TEMPLATE&tmeid=MGJqaXQzaTlmb3ZpMnJ…>)
(sign up on wiki
<https://meta.wikimedia.org/wiki/Community_Engagement/Women_in_the_Wikimedia…>
)
Presenters: Mervat Salman (Wiki Arabia 2015 organizer) and Natalia
Szafran-Kozakowska (CEE Spring coordinator, and Polish Wikipedia sysop)
-
Women in technical spaces: Wednesday, March 21st, 15:00 UTC (add to
calendar
<https://calendar.google.com/event?action=TEMPLATE&tmeid=MzFqMWV2YXZlc3VrYjJ…>)
(sign up on wiki
<https://meta.wikimedia.org/wiki/Community_Engagement/Women_in_the_Wikimedia…>
)
Presenters: Josephine Lim (Mediawiki contributor) and Ciell (organizer of
all-women hackathon in the Netherlands).
If you find this conversation series interesting, I would greatly
appreciate your support spreading the word. Please feel free to invite
anyone you think might have something to add to the conversations.
I look forward to seeing many of you online!
Best,
María
*María Cruz * \\ Communications and Outreach project manager, L&E
Team \\ Wikimedia
Foundation, Inc.
mcruz(a)wikimedia.org | Twitter: @marianarra_
<https://twitter.com/marianarra_>