Hi Wikimetrics Team,
I have not been able to login to / use Wikimetrics for 1.5 weeks now. I've
tried every few days, but when I try to sign-in using my Google account,
the next page once I pick my gmail email is an "Internal Server Error"
page.
You might want to look into this.
Thanks,
Dorothy
--
Dorothy Howard, Wikipedian-in-Residence and Open Data Fellow
Metropolitan New York Library Council (METRO)
212.228.2320 x127
Hello again Dan and Marcel,
I'm sorry, I may have spoken too soon last Friday. Small reports were
working, but no big reports went through and I only managed to upload
one large cohort.* Now we are getting the same failures on all
reports and cohort uploads again.
Could you please fix it again?
Many thanks,
Amanda
*Big reports being individual edits on ~5,000 user names over one month
*Large cohort being ~250 users expanded globally
Wikimetrics has been having serious connectivity problems for a few days.
It turned out to be solvable by using some new hostnames (
labsdb1002.eqiad.wmnet). I fixed it just now, please retry your reports
and let me know if anything is still wrong.
On Fri, Jan 23, 2015 at 10:46 AM, Dan Andreescu <dandreescu(a)wikimedia.org>
wrote:
> Hi everyone. I will work on this as soon as I get into the office, in
> about an hour from now. Yuvi suggested one thing that I wasn't aware of
> that might make this a simple fix.
>
>
> On Friday, January 23, 2015, Dan Higgins <dhiggins(a)wikimedia.org> wrote:
>
>> Hi Kevin,
>>
>> Sorry to be a pest but do you have any update on sorting out the
>> Wikimetrics issues? It seems to have gotten worse since we last spoke to
>> you with around 1 in 10 reports going through.
>>
>> Thanks,
>>
>> Dan
>>
>> On Tue, Jan 20, 2015 at 7:17 PM, Kevin Leduc <kevin(a)wikimedia.org> wrote:
>>
>>> All the developers are in transit to SF today. Dan said he'd be in the
>>> office this afternoon. First dev I see I'll notify them of problems in
>>> wikimetrics.
>>>
>>> On Tue, Jan 20, 2015 at 11:10 AM, Amanda Bittaker <
>>> abittaker(a)wikimedia.org> wrote:
>>>
>>>> Hello again gentlemen,
>>>>
>>>> I think Dan might have already pinged you, but just in case, I wanted
>>>> to let you know that we are getting these failures again. It's kind
>>>> of crunch time for getting this data, so we're just banging our heads
>>>> against the wall and retrying the reports until they work (1 out of 4
>>>> times for me.) Is there any way you all could work your magic again?
>>>>
>>>> Many thanks once again,
>>>> Amanda
>>>>
>>>>
>>>>
>>>> On Wed, Dec 10, 2014 at 4:30 PM, Kevin Leduc <kevin(a)wikimedia.org>
>>>> wrote:
>>>> > It's good to hear it's working again. Don't hesitate to reach out to
>>>> us
>>>> > here or at wikimetrics(a)lists.wikimedia.org if you notice this kind of
>>>> > trouble again.
>>>> >
>>>> > On Wed, Dec 10, 2014 at 3:37 PM, Amanda Bittaker <
>>>> abittaker(a)wikimedia.org>
>>>> > wrote:
>>>> >>
>>>> >> It's working perfectly now--a thousand thank yous, Dan and Marcel.
>>>> >>
>>>> >> On Wed, Dec 10, 2014 at 3:24 PM, Edward Galvez <
>>>> egalvez(a)wikimedia.org>
>>>> >> wrote:
>>>> >>>
>>>> >>> Thanks so much Dan and Marcel!
>>>> >>>
>>>> >>> -E
>>>> >>>
>>>> >>>
>>>> >>> On Wed, Dec 10, 2014 at 3:08 PM, Dan Andreescu <
>>>> dandreescu(a)wikimedia.org>
>>>> >>> wrote:
>>>> >>>>
>>>> >>>> forgot Marcel - my fault. Jaime & folks, in general Marcel rules
>>>> and
>>>> >>>> he's probably going to help you out faster / better than I can.
>>>> >>>>
>>>> >>>> On Wed, Dec 10, 2014 at 5:57 PM, Dan Andreescu
>>>> >>>> <dandreescu(a)wikimedia.org> wrote:
>>>> >>>>>
>>>> >>>>> Ok, Amanda and anyone else who had problems. Please try again. I
>>>> >>>>> think I've cleared up some gunk and that might have helped
>>>> things. We'll be
>>>> >>>>> looking at performance more closely soon.
>>>> >>>>>
>>>> >>>>>
>>>> >>>>>
>>>> >>>>> Steps taken, logging mostly for post-mortem purpose
>>>> >>>>>
>>>> >>>>> * delete from report where recurrent_parent_id is null and
>>>> recurrent =
>>>> >>>>> 0 and created < date('2014-12-01');
>>>> >>>>> ** This deleted records that are not visible in the system
>>>> anymore.
>>>> >>>>> They are recoverable from the wikimetrics database backups but we
>>>> don't need
>>>> >>>>> them in the database. These probably slowed some things down, in
>>>> total the
>>>> >>>>> statement deleted 1623628 rows.
>>>> >>>>>
>>>> >>>>> * alter table report add column old_recurrent tinyint(1); update
>>>> report
>>>> >>>>> set recurrent = 0, old_recurrent = 1 where user_id = 461 and
>>>> recurrent = 1;
>>>> >>>>> ** This disables WikimetricsBot recurrent reports, but preserves
>>>> the
>>>> >>>>> data so we can deal with them later. When labs is done
>>>> re-synchronizing, we
>>>> >>>>> will be re-running these reports. They feed data to Vital Signs,
>>>> in case
>>>> >>>>> someone's curious about what they are.
>>>> >>>>>
>>>> >>>>> * Stopped and rebooted the system. The backup system seems to be
>>>> >>>>> hanging or taking a really long time. I'd like to take a look at
>>>> this in
>>>> >>>>> more depth, but my guess is the amount it's transferring has gone
>>>> beyond
>>>> >>>>> what we expected.
>>>> >>>>>
>>>> >>>>> On Wed, Dec 10, 2014 at 5:23 PM, Dan Andreescu
>>>> >>>>> <dandreescu(a)wikimedia.org> wrote:
>>>> >>>>>>
>>>> >>>>>> We're sorry - the problems we were facing last week have probably
>>>> >>>>>> festered. I'm going to turn off some things and reset the
>>>> system. I'll
>>>> >>>>>> report back.
>>>> >>>>>>
>>>> >>>>>> On Wed, Dec 10, 2014 at 4:47 PM, Amanda Bittaker
>>>> >>>>>> <abittaker(a)wikimedia.org> wrote:
>>>> >>>>>>>
>>>> >>>>>>> Oh yes, and Jaime did have me restart my browser and clear the
>>>> cache,
>>>> >>>>>>> but it did not help.
>>>> >>>>>>>
>>>> >>>>>>> Thanks again,
>>>> >>>>>>> Amanda
>>>> >>>>>>>
>>>> >>>>>>> On Wed, Dec 10, 2014 at 1:45 PM, Amanda Bittaker
>>>> >>>>>>> <abittaker(a)wikimedia.org> wrote:
>>>> >>>>>>>>
>>>> >>>>>>>> Hello Kevin,
>>>> >>>>>>>>
>>>> >>>>>>>> Jaime asked me to email you about some trouble I've been
>>>> having with
>>>> >>>>>>>> Wikimetrics. The whole team has been experiencing a pretty
>>>> high rate of
>>>> >>>>>>>> failures in both report creation and cohort uploads. Almost
>>>> nothing has
>>>> >>>>>>>> gotten through for me today: of the last 13 reports I've run,
>>>> 3 were
>>>> >>>>>>>> successful. Of the failures, I would say maybe only two or
>>>> three "pended"
>>>> >>>>>>>> at all before becoming failures. I've been experiencing the
>>>> same problem
>>>> >>>>>>>> with cohort uploads.
>>>> >>>>>>>>
>>>> >>>>>>>> The reports have been: Newly Registered, Edits, and Rolling
>>>> Active
>>>> >>>>>>>> Editor using expanded cohorts. Please find attached an
>>>> example of one of
>>>> >>>>>>>> the reports. I tried uploading cohorts using text files of
>>>> user names and
>>>> >>>>>>>> pasting user names from Notepad into the "Paste Usernames"
>>>> field. I do
>>>> >>>>>>>> expand the cohorts every time.
>>>> >>>>>>>>
>>>> >>>>>>>> Do you know why the failure rate is so high, especially this
>>>> >>>>>>>> morning, and is there a way to eliminate or mitigate this
>>>> problem in the
>>>> >>>>>>>> future?
>>>> >>>>>>>>
>>>> >>>>>>>> Many thanks for the assistance, and please do let me know if
>>>> you
>>>> >>>>>>>> need any more information from me on this.
>>>> >>>>>>>>
>>>> >>>>>>>> Best,
>>>> >>>>>>>> Amanda
>>>> >>>>>>>
>>>> >>>>>>>
>>>> >>>>>>
>>>> >>>>>
>>>> >>>>
>>>> >>>
>>>> >>>
>>>> >>>
>>>> >>> --
>>>> >>> Edward Galvez
>>>> >>> Program Evaluation Associate
>>>> >>> Wikimedia Foundation
>>>> >>
>>>> >>
>>>> >
>>>>
>>>
>>>
>>
Hey guys,
Hope you can help!
Need to run a super simple report on Wikimetrics -- just one user, just one
project, just one language, bytes added and number of edits -- for our QR.
But it keeps crashing.
Please tell me you can help?? :(
<3
Anna
--
Anna Koval, M.Ed.
Manager, Wikipedia Education Program
Wikimedia Foundation
+1.415.839.6885 x6729
akoval(a)wikimedia.org
education.wikimedia.org
Dear Wikimetrics Users:
Wikimetrics was updated last night (2014-01-08) with many new features that
were implemented at the end of 2014. Here is a list of what is live (as of
yesterday) on https://metrics.wmflabs.org/ :
View Members in a Cohort
>From the cohorts page ( https://metrics.wmflabs.org/cohorts ) there is a
new blue button “View Members” which takes you to a new web page with a
list of the first 20 usernames in the cohort. You can also browse the list
using the search field or the drop down to filter out invalid or valid
usernames.
Remove Member from Cohort
>From the web page described above, you can remove a username from a
cohort. On rare occasions a user may request his username be removed from
a cohort; this feature makes the process trivial.
You may also want to remove usernames that failed validation. Usernames
are deemed invalid when there is no such account on the wiki (specified
when creating a cohort). This may happen when the username is incorrect or
when that user has never visited the wiki in question. In the latter case,
you will be presented with a separate button to remove only the invalid
(usernames,wiki) combinations.
Privacy Policy
Wikimetrics runs on Wikimedia Labs infrastructure (
https://www.mediawiki.org/wiki/Wikimedia_Labs ) and is governed by its
terms of use (
https://wikitech.wikimedia.org/wiki/Wikitech:Labs_Terms_of_use ). As such
we have added a new page stating so ( https://metrics.wmflabs.org/policy )
with a link to it on the header of the website.
Updated Support Page
Should you find any bugs, feel free to log it on our bug tracking
platform. For convenience a link is posted on the support page (
https://metrics.wmflabs.org/support ). This link has been updated to
reflect WMF’s migration away from Bugzilla onto Phabricator.
If you have questions or run into issues, you are always free to ask your
questions on this mailing list: wikimetrics(a)lists.wikimedia.org
Dear Wikimetrics users,
I wanted to send out some info about how and where to report bugs (or
request features) for Wikimetrics. The Wikimedia Foundation is working to
make Wikimetrics work better, and do more, and we want your help!
*Reporting bugs:*
If there's something broken with Wikimetrics (for example, if the site
crashes when you're using it, if you can't log in, or if you have
difficulty uploading cohorts or running reports), the best place to log
that information is Bugzilla <https://bugzilla.wikimedia.org/>. This
assures that your bugs are seen by the people (developers!) who can fix
them.
To submit a new Wikimetrics bug to Bugzilla, follow this link
<https://bugzilla.wikimedia.org/enter_bug.cgi?product=Analytics> and select
"Wikimetrics" in the component field. You may have to log in and/or create
a bugzilla account first.
For reference, here is the current list of unresolved Wikimetrics bugs
<https://bugzilla.wikimedia.org/buglist.cgi?component=Wikimetrics&list_id=35…>
.
*Requesting features:*
If you want to request a new feature for Wikimetrics, or a change to an
existing feature, you can post your proposal to the talk page for our Story
tracking log <https://www.mediawiki.org/wiki/Analytics/Wikimetrics/Stories>
on MediaWiki.org. Analytics Product Manager Kevin LeDuc and I both monitor
this page, and are available to field questions and comments there.
And of course, you can always use this mailing list to report bugs, request
features, give feedback, and ask questions as well.
We look forward to hearing from you,
Jonathan
(Wikimetrics PM for Grantmaking)
--
Jonathan T. Morgan
Learning Strategist
Wikimedia Foundation
User:Jmorgan (WMF) <https://meta.wikimedia.org/wiki/User:Jmorgan_(WMF)>
jmorgan(a)wikimedia.org
Right now bugzilla is turned off as we're migrating to Phabricator. We
will update the help text on wikimetrics as soon as we have a new stable
environment, sorry for the in-between confusion time.
Also, note that you're posting this to the usermetrics list, which is old
and replaced by the wikimetrics list:
https://lists.wikimedia.org/mailman/listinfo/wikimetrics (I added it to the
cc)
Now, for your question and the somewhat unfortunate answer
I am trying to run Rolling New Active Editors reports and, having tried on
> two different computers and with two different cohorts,the report pends for
> a while and then comes back as failed. Could you possibly have a look into
> this for me.
>
This is not your fault or your cohort. Basically, we've been having a lot
of troubles with the labs databases which wikimetrics uses to get data. We
are currently trying to migrate to a new database where analytics queries
are isolated from other kinds of work. That should be much more stable
and performant when we get it up. For now, some metrics and some databases
(like Rolling New Active Editor and english wikipedia) are mostly crawling
and not finishing within the allotted time (1 hour). That's why you see
PENDING for so long and then FAILURE. If you see this, you can let us know
but unfortunately there's not much we can do until we fix the current
database or stand up the new one. Fixing the current database seems to be
an effort akin to killing a hydra. Standing up the new one requires lots
of coordination with other teams but it's currently our top priority.
Sorry again for the inconvenience, I'll look at the db again to see if
there's anything simple I can do to help.
Hi, I tried to upload the following list of usernames:
Opice1956
Rowerin
Melanie anna
Bonifac-cz
Jistefi
Bačkovská
Lidabey
NŠO-ČI
Stana123
Pauza
OmaOla
Antonín Ryska
Libuše Kroková
VETA 7O
Ilča53
Wlady
Markéta z e Lhoty
Klenča
VlaMaul
I extracted this list of usernames from the ListStudents API. Strangely,
three usernames are not valid when uploaded to Wikimetrics:
Jistefi invalid user_name Pauza invalid user_name VlaMaul invalid
user_name
Do you have any idea why these? The order of usernames does not seem to
produce any difference, it is always these three.
thanks
Vojtěch Dostál
místopředseda
Wikimedia Česká republika
Konopišťská 790/3, Praha 10
http://www.wikimedia.cz
Hello,
A few hours ago, Wikimetrics ( https://metrics.wmflabs.org/ ) was updated
with the following enhancements:
- Upload (create) a new cohort and select an option to expand your cohort
to include each user's accounts on every other wiki that user has visited
while being logged in. See the details of the user story here
<https://www.mediawiki.org/wiki/Analytics/Wikimetrics/Stories#User_creates_c…>
.
- Bug fix <https://bugzilla.wikimedia.org/show_bug.cgi?id=71255>:
Downloding reports in CVS from large cohorts would timeout/fail. The code
has been fixed and optimized to allow this now.
As always, feel free to comment and ask questions on this list. We're
listening!
Kevin Leduc
Analytics Product Manager
Wikimedia Foundation