Wikitech-l December 2018

wikitech-l@lists.wikimedia.org

49 participants
50 discussions

Patchsets by new Gerrit contributors waiting for code review and/or merge

by Andre Klapper

CR0: Please review and provide guidance if you are familiar with the code, and decide (CR±1 or CR±2): * https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/462155/ ** Adds alternative file icon paths ** 2018-October-14 ** Maintainers/Stewards: MediaWiki Platform team? * https://gerrit.wikimedia.org/r/#/c/avro-php/+/466838/ ** Convert Avro-PHP to PSR-Compliant Project ** 2018-Ocotber-18 ** Maintainers/Stewards: ??? * https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/Echo/+/471909/ ** Test: notify a new user with welcome message ** 2018-November-06 ** Maintainers/Stewards: Growth team * https://gerrit.wikimedia.org/r/#/c/mediawiki/skins/Material/+/471766/ ** Add scrollbar:: to view more content on sidebar ** 2018-November-06 ** Maintainers/Stewards: ??? * https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/472758/ ** Added Id to the input box ** 2018-November-10 ** Maintainers/Stewards: MediaWiki Platform team? * https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/472491/ ** MediaWiki Special Pages CSS : Add indentation to content under header ** 2018-November-08 ** Maintainers/Stewards: MediaWiki Platform team? * https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/474769/ ** Add Special:CategoriesToEmpty ** 2018-November-20 ** Maintainers/Stewards: MediaWiki Platform team? * https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/472184/ ** Avoid hitting DB in Category getters when they have the required info ** 2018-November-23 ** Maintainers/Stewards: MediaWiki Platform team? * https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/475798/ ** Revert Special:PasswordReset: Make the user field a user lookahead field ** 2018-November-26 ** Maintainers/Stewards: MediaWiki Platform team? CR+1: Please help make a decision (CR±1, CR±2) on these CR+1 patches: * https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/PluggableAuth/+/468… ** Adding separate option for local API login ** 2018-October-20 ** Maintainers/Stewards: ??? Read https://www.mediawiki.org/wiki/Gerrit/Code_review#By_project how you can get notified of new patches in your code areas of interest. Thanks in advance for your reviews! Of last time's 15 listed patches, 1 got merged by Yaron Koren, 5 received reviews by Jack Phoenix, Daimona Eaytoy, Legoktm, Anomie, and VolkerE, 3 got abandoned. Maintainers/Stewards data taken from https://www.mediawiki.org/wiki/Developers/Maintainers CR0 source: https://gerrit.wikimedia.org/r/#/q/ownerin:newcomers+status:open+label:Veri… CR+1 source: https://gerrit.wikimedia.org/r/#/q/ownerin:newcomers+status:open+label:Veri… -- Andre Klapper | Bugwrangler / Developer Advocate https://blogs.gnome.org/aklapper/

5 years, 5 months

Thank you Tuesday

by MA

Hi, It's Tuesday (my timezone at least) and this week I'd like to thank the following people for their work and assistance: .- Martin Urbanec: For his tireless work in the Wikimedia-Site-requests & Wiki-Setup Phabricator boards, and for his advice in several technical issues. He does a lot of wmf-config work, and the result is that our requests for site configuration changes no longer takes a lot of time to get applied. Thanks a lot. .- James D. Forrester: For his general work in MediaWiki core and extensions, and for sharing its expertise and knowledge with us. He's also willing to review my patches and I was never able to thank him properly for all the time and advice he's dedicated to help me. .- Raimond Spekking: For his work in translatewiki.net and his i18n expertise, and i18n patch review activities. MediaWiki and its extensions are a success in localisation thanks to his work, and that of Niklas and the staff of translatewiki.net in general. I appreciate your efforts, really. .- Derrick N. Alangi: I'd like to congratulate him for his recent mediawiki +2 access, which is using to actively review lots of patches recently, reducing our backlog of patches for review. Special thanks to the SRE and Security team for their invaluable work as well. The same to WMDE for their technical advice regular meetings which are very helpful. Best regards, M.

5 years, 5 months

Help: setting a property on page save?

by FreedomFighterSparrow

I'm trying to solve the following situation: I need to know, for each article, the last time it was updated by an actual human. MediaWiki keeps track of the last update to the page, but doesn't take into account whether it was performed by a bot or a human. Instead of querying the revision table every time, I thought of saving a page property and updating it on page save: - Is the editor a human*? - Yes: update the property. - No: Do we already have a last real update date saved? - Yes: do nothing (keep the last date) - No: find the latest revision by a human and save the property The most logical hook seemed to be 'PageContentSaveComplete' or maybe 'PageContentInsertComplete', as I only want to do this if the save actually went through (if it is failed by something, we shouldn't update). My problem is, I don't seem to have a way to set a property from there... I really don't want to have to create my own table just for this. Any ideas how to solve this? Maybe I'm going about it in a cockamamie way? Thanks, - Dror

5 years, 5 months

Book scans from Tuebingen Digital Library to Wikimedia Commons

by Shiju Alex

Hello, Recently Tuebingen University <https://uni-tuebingen.de/en/university.html> (with the support from German Research Foundation) ran a project titled *Gundert Legacy project* to digitize close to 137,000 pages from *850 public domain books*. All these public domain books are in the South Indian languages *Malayalam, Kannada, Tamil, Tulu, and Telugu*. In this 293 books are in Malayalam, 187 in Kannada, 25 in Tamil, 4 in Telugu and Tulu. Also there was a separate sub-project which was run as part of this project to convert 136 titles in Malayalam to Malayalam Unicode. The number of pages that were converted to Unicode is close to *25,700* pages.The Unicode conversion project was ran only for Malayalam. For the other languages it is just the scanning of books The project is complete now and the results of the project is available in the Hermman Gundert Portal https://www.gundert-portal.de/?language=en which was released on Nov 20. A news report is available here. <https://timesofindia.indiatimes.com/city/kochi/german-scholars-malayalam-mi…> To view the books in each language you can navigate through the various links in the portal. For example, malayalam books are available here: https://www.gundert-portal.de/?page=malayalam Now we need to upload these scans to Wikimedia Commons and Unicode text to Malayalam Wikisource (25,700 Unicode converted pages) The first priority is for the scans that are converted to Unicode. Is it possible to write a script to migrate the scans from Tuebingen Digital library to Wikimedia Commons? (I can share the exact details of books converted to Unicode if needed) All the digitized files are heavy and the size ranges from 100 MB to 1.5 GB depending on the number of pages in the books. So manually managing this is going to be a big challenge. Can some one help with this? Shiju Alex

5 years, 5 months

wmgMonologChannels

by Amir Sarabadani

Hello, As part of improving of logging for Wikidata, we found this config [1]. There are four things I want to point out: 1- Some of the loggings mentioned here are outdated. Like there is ones that was added more than six years ago and still logging at debug level. Some are needed like 'security' but I'm not sure about "cite", "es-hit", "Cognate", etc. This much of verbosity will reduce our capacity to catch real issues. 2- There are logging channels like "Bug58676" that still in use [2] but it might not be needed any more ([3]) 3- If you define a logger channel in mediawiki [4] and don't add it here, all of its logs will go to vein (using "blackhole" logging manger, I like the name). This should be documented somewhere. 4- There is no way just enable it and fall back its verbosity to default. Please correct me if I'm mistaken. I will make tickets regarding points 3 and 4 but I need dear developers' attention for the log channels. This list of them: https://phabricator.wikimedia.org/P7885 [1] https://noc.wikimedia.org/conf/highlight.php?file=InitialiseSettings.php [2] https://codesearch.wmflabs.org/search/?q=Bug58676&i=nope&files=&repos= [3] https://phabricator.wikimedia.org/T60676 [4] Like LoggerFactory::getInstance( 'ORES' ) Best -- Amir Sarabadani Software Engineer Wikimedia Deutschland e. V. | Tempelhofer Ufer 23-24 | 10963 Berlin Tel. (030) 219 158 26-0 http://wikimedia.de Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen Wissens frei teilhaben kann. Helfen Sie uns dabei! http://spenden.wikimedia.de/ Wikimedia Deutschland – Gesellschaft zur Förderung Freien Wissens e. V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/029/42207.

5 years, 5 months

Upcoming Search Platform Office Hours—December 5th

by Trey Jones

The Search Platform Team <https://www.mediawiki.org/wiki/Wikimedia_Search_Platform> holds office hours the first Wednesday of each month. Come ask us anything about Wikimedia search! We’re particularly interested in: * Opportunities for collaboration—internally or externally to the Wikimedia Foundation * Challenges you have with on-wiki search, in any of the languages we support But we're happy to talk about anything search-related. Feel free to add your items to the Etherpad Agenda for the next meeting. Details for our next meeting: Date: Wednesday, December 5th, 2018 Time: 16:00-17:00 GMT / 08:00-9:00 PST / 11:00-12:00 EST / 17:00-18:00 CET Etherpad: https://etherpad.wikimedia.org/p/Search_Platform_Office_Hours Google Meet link: https://meet.google.com/vyc-jvgq-dww *N.B.:* Google Meet System Requirements <https://support.google.com/meet/answer/7317473> —Trey Trey Jones Sr. Software Engineer, Search Platform Wikimedia Foundation

5 years, 5 months

Discovery Weekly Update for the week starting 2018-11-26

by Chris Koerner

Greetings, This is the weekly update from the Search Platform team for the week starting 2018-11-26. As always, feedback and questions welcome. == Discussions == === Search === * David worked on adding a config var to control which clusters (replica) the sanitizer works on by default, since by switching to multi-instance setup we will be adding temp clusters that the sanitizer doesn't need to run on [0] Note: this will go into production the week of December 11th, 2018 * Erik repaired the transfer_to_es analytics job which had stopped working twice in a row [1] * Erik and David worked on the effort to remedy intermittent json parse failures in completion suggester [2] Note: this will go into production the week of December 11th, 2018 * David fixed an issue where implemented LTR query features that rely on the feature vector were not compatible with the way Elastic implemented their profiling API [3] * Gehel, David, and Mathew worked on refactoring current code base to support multiple elasticsearch instances/multiple elasticsearch clusters [4] * We needed to deploy extra-analysis-surrogates & the experimental highlighter 5.5.2.4 to production before we could reindex the Chinese-language wikis [5] and [6] * An issue was found where characters in CJK extension C were being treated as U+FFFD when searching on zhWP - it's fixed now [7] * The team helped to setup two elasticsearch clusters on relforge to test multi-instance [8] * The team also helped with the Elastica dependencies that needed to be updated to v5.3.2 [9] * David worked on fixing the prefix search that had broken again when using multiple namespaces and namespaces with $wgCapitalLinks = false; [10] * David and Gehel completed work on preparing a debian package with the experimental highlighter 5.5.2.4 [11] and fixed an issue where the experimental highlighter was breaking unicode surrogate pairs when cutting the snippets [12] * David fixed an issue where a precondition failed: while trying to get token image at offset -1 [13] * Mathew worked on issues where parts of WDQS puppet module is written in old puppet and also lacks type constraints [14] * David fixed an issue where elasticsearch_hot_threads on relforge had errors (ImportError: No module named 'yaml') [15] * Mathew and Gehel refactored wdqs::gui - to separate cron tasks from the module [16] * Trey wrote a blog post about stemming, stop words, and thesauri. [17] === Portal === * Jan reverted a change that caused the article count to show 0 for all wikis. [18] * Robin designed and Peter and Jan implemented banners for the big English fundraising campaign. [19] * Volker also fixed some bugs on the portal [20] [21] [0] https://phabricator.wikimedia.org/T210728 [1] https://phabricator.wikimedia.org/T210545 [2] https://phabricator.wikimedia.org/T208248 [3] https://phabricator.wikimedia.org/T205249 [4] https://phabricator.wikimedia.org/T207918 [5] https://phabricator.wikimedia.org/T209155 [6] https://phabricator.wikimedia.org/T209156 [7] https://phabricator.wikimedia.org/T168427 [8] https://phabricator.wikimedia.org/T198352 [9] https://phabricator.wikimedia.org/T208650 [10] https://phabricator.wikimedia.org/T208255 [11] https://phabricator.wikimedia.org/T209293 [12] https://phabricator.wikimedia.org/T208736 [13] https://phabricator.wikimedia.org/T209299 [14] https://phabricator.wikimedia.org/T208201 [15] https://phabricator.wikimedia.org/T209030 [16] https://phabricator.wikimedia.org/T209257 [17] https://wikimediafoundation.org/2018/11/28/the-root-of-the-problem/ [18] https://phabricator.wikimedia.org/T210401 [19] https://phabricator.wikimedia.org/T202497 [20] https://phabricator.wikimedia.org/T209018 [21] https://phabricator.wikimedia.org/T197195 ---- Subscribe to receive on-wiki (or opt-in email) notifications of the Discovery weekly update. https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner Community Relations Specialist Wikimedia Foundation

5 years, 5 months

Announcing: EMWCon Spring 2019, April 3-5 in Daly City, CA

by Yaron Koren

Hi everyone, A few weeks ago I sent out a tentative announcement, but now it's more official: the next EMWCon, or Enterprise MediaWiki Conference, will be taking place five months from now, on April 3-5, 2019, in Daly City, right near San Francisco. For more information, and to indicate that you're interested in attending (if you are), see the page for it here: https://www.mediawiki.org/wiki/EMWCon_Spring_2019 -Yaron P.S. Don't forget about SMWCon Fall 2018, which is happening next week in Regensburg, Germany! ( https://www.semantic-mediawiki.org/wiki/SMWCon_Fall_2018) I sadly can't make it, but it sounds like it's going to have a lot of good talks.

5 years, 5 months

Technical Advice IRC Meeting (Two time slots this Wednesday!)

by Michael Schönitzer

Reminder: Technical Advice IRC meeting again **Wednesday at 4-5 pm UTC AND 11-12 pm UTC** on #wikimedia-tech. The Technical Advice IRC Meeting (TAIM) is a weekly support event for volunteer developers. Every Wednesday, two full-time developers are available to help you with all your questions about Mediawiki, gadgets, tools and more! This can be anything from "how to get started" over "who would be the best contact for X" to specific questions on your project. If you know already what you would like to discuss or ask, please add your topic to the next meeting: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting Hope to see you there! Michi (for the Technical Advice IRC Meeting crew) -- Michael F. Schönitzer Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin Tel. (030) 219 158 26-0 http://wikimedia.de Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen Wissens frei teilhaben kann. Helfen Sie uns dabei! http://spenden.wikimedia.de/ Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/681/51985.

5 years, 5 months

Phabricator monthly statistics - 2018-11

by communitymetrics＠wikimedia.org

Hi Community Metrics team, This is your automatic monthly Phabricator statistics mail. Accounts created in (2018-11): 469 Active Maniphest users (any activity) in (2018-11): 933 Task authors in (2018-11): 495 Users who have closed tasks in (2018-11): 278 Projects which had at least one task moved from one column to another on their workboard in (2018-11): 276 Tasks created in (2018-11): 2424 Tasks closed in (2018-11): 2022 Open and stalled tasks in total: 40342 Median age in days of open tasks by priority: Unbreak now: 10 Needs Triage: 445 High: 770 Normal: 1010 Low: 1351 Lowest: 1292 (How long tasks have been open, not how long they have had that priority) Active Differential users (any activity) in (2018-11): 21 TODO: Numbers which refer to closed tasks might not be correct, as described in https://phabricator.wikimedia.org/T1003 . Yours sincerely, Fab Rick Aytor (via community_metrics.sh on phab1001 at Sat Dec 1 00:00:18 UTC 2018)

5 years, 5 months

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l December 2018