Report fails

List overview All Threads
Download

newer

older

Examples of cohorts that fail with

A question from someone new ;)

James Hare

18 Mar 2015 18 Mar '15

8:47 p.m.

Attachments:

attachment.htm (text/html — 688 bytes)

Show replies by date

Nuria Ruiz

18 Mar 18 Mar

10:02 p.m.

James, There are probably better metrics for your purposes, could you let us know what data are you interested on? Once we know that we can take a look to see if there are any issues with the tool itself. Thanks, Nuria On Wed, Mar 18, 2015 at 12:47 PM, James Hare <james.hare(a)wikidc.org> wrote:

...

I am trying to run a report measuring rolling active editor and newly registered for a cohort of about ~20,000 accounts (actually only about ~1,300 Commons usernames, but I opted to have it extended to their global accounts in case they also did stuff outside of Commons). I have now tried to run the report twice and it has failed. Anyone know what is going on? Thanks, James — James Hare President, Wikimedia DC http://wikimediadc.org @wikimediadc _______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimetrics

James Hare

10:04 p.m.

...

I am trying to run a report measuring rolling active editor and newly registered for a cohort of about ~20,000 accounts (actually only about ~1,300 Commons usernames, but I opted to have it extended to their global accounts in case they also did stuff outside of Commons). I have now tried to run the report twice and it has failed. Anyone know what is going on? Thanks, James — James Hare President, Wikimedia DC http://wikimediadc.org @wikimediadc _______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org (mailto:Wikimetrics@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/wikimetrics

_______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org (mailto:Wikimetrics@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/wikimetrics

Nuria Ruiz

19 Mar 19 Mar

12:24 a.m.

James, If you could send the cohort you are using (if it is not private) it will help when troubleshooting. Thanks, Nuria On Wed, Mar 18, 2015 at 2:04 PM, James Hare <james.hare(a)wikidc.org> wrote:

...

I want to know, for a period from July 1 to September 30, which of the ~1,300 contributors are new, and which are active editors, per the global metrics meanings of those terms. Let me know fi you need a list of usernames from me. Thanks, James — James Hare President, Wikimedia DC http://wikimediadc.org @wikimediadc On Wednesday, March 18, 2015 at 5:02 PM, Nuria Ruiz wrote: James, There are probably better metrics for your purposes, could you let us know what data are you interested on? Once we know that we can take a look to see if there are any issues with the tool itself. Thanks, Nuria On Wed, Mar 18, 2015 at 12:47 PM, James Hare <james.hare(a)wikidc.org> wrote: I am trying to run a report measuring rolling active editor and newly registered for a cohort of about ~20,000 accounts (actually only about ~1,300 Commons usernames, but I opted to have it extended to their global accounts in case they also did stuff outside of Commons). I have now tried to run the report twice and it has failed. Anyone know what is going on? Thanks, James — James Hare President, Wikimedia DC http://wikimediadc.org @wikimediadc _______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimetrics _______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimetrics _______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimetrics

Dan Andreescu

5:31 p.m.

James, I'm cc-ing Jonathan as this issue looks to have two components. First, James, I ran the Edits metric on your cohort and it worked ok. I am running the Rolling New Active Editor metric and it seems a bit slow, so we're looking into that. Second, how exactly are these reports run? Like, are you using Rolling New Active Editor and doing it in chunks of 30 days over the period you need? Could you detail this, as these rolling metrics are very slow and were not really meant for this kind of use. We can adjust our system accordingly (maybe we can make faster metrics that get to what you need better). On Wed, Mar 18, 2015 at 5:04 PM, James Hare <james.hare(a)wikidc.org> wrote:

...

James Hare

5:42 p.m.

Rolling new active editor may not be the metric I need. Just, for that period of time, I need to know which of the editors were active editors (5+ edits/month) and which had created their accounts in that period. Thanks, James — James Hare President, Wikimedia DC http://wikimediadc.org @wikimediadc On Thursday, March 19, 2015 at 12:31 PM, Dan Andreescu wrote:

...

I am trying to run a report measuring rolling active editor and newly registered for a cohort of about ~20,000 accounts (actually only about ~1,300 Commons usernames, but I opted to have it extended to their global accounts in case they also did stuff outside of Commons). I have now tried to run the report twice and it has failed. Anyone know what is going on? Thanks, James — James Hare President, Wikimedia DC http://wikimediadc.org @wikimediadc _______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org (mailto:Wikimetrics@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/wikimetrics

Edward Galvez

6:02 p.m.

Hi James and Kevin, Here are the global metrics specifications for newly registered and active editors involved for wmf grantees. James, please let us know if you are looking for other metrics or if these are what you need. I ask because the metrics you are specifying sound different. https://meta.wikimedia.org/wiki/Grants:Learning_patterns/Number_of_newly_re… https://meta.wikimedia.org/wiki/Grants:Learning_patterns/Number_of_active_e… Thanks! Edward

...

On Mar 19, 2015, at 9:42 AM, James Hare <james.hare(a)wikidc.org> wrote: Rolling new active editor may not be the metric I need. Just, for that period of time, I need to know which of the editors were active editors (5+ edits/month) and which had created their accounts in that period. Thanks, James — James Hare President, Wikimedia DC http://wikimediadc.org @wikimediadc

On Thursday, March 19, 2015 at 12:31 PM, Dan Andreescu wrote: James, I'm cc-ing Jonathan as this issue looks to have two components. First, James, I ran the Edits metric on your cohort and it worked ok. I am running the Rolling New Active Editor metric and it seems a bit slow, so we're looking into that. Second, how exactly are these reports run? Like, are you using Rolling New Active Editor and doing it in chunks of 30 days over the period you need? Could you detail this, as these rolling metrics are very slow and were not really meant for this kind of use. We can adjust our system accordingly (maybe we can make faster metrics that get to what you need better).

On Wed, Mar 18, 2015 at 5:04 PM, James Hare <james.hare(a)wikidc.org> wrote: I want to know, for a period from July 1 to September 30, which of the ~1,300 contributors are new, and which are active editors, per the global metrics meanings of those terms. Let me know fi you need a list of usernames from me. Thanks, James — James Hare President, Wikimedia DC http://wikimediadc.org @wikimediadc

On Wednesday, March 18, 2015 at 5:02 PM, Nuria Ruiz wrote: James, There are probably better metrics for your purposes, could you let us know what data are you interested on? Once we know that we can take a look to see if there are any issues with the tool itself. Thanks, Nuria > On Wed, Mar 18, 2015 at 12:47 PM, James Hare <james.hare(a)wikidc.org> wrote: > I am trying to run a report measuring rolling active editor and newly registered for a cohort of about ~20,000 accounts (actually only about ~1,300 Commons usernames, but I opted to have it extended to their global accounts in case they also did stuff outside of Commons). I have now tried to run the report twice and it has failed. Anyone know what is going on? > > > Thanks, > James > > — > James Hare > President, Wikimedia DC > http://wikimediadc.org > @wikimediadc > > > _______________________________________________ > Wikimetrics mailing list > Wikimetrics(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikimetrics _______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimetrics

_______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimetrics

James Hare

7:44 p.m.

...

I want to know, for a period from July 1 to September 30, which of the ~1,300 contributors are new, and which are active editors, per the global metrics meanings of those terms. Let me know fi you need a list of usernames from me. Thanks, James — James Hare President, Wikimedia DC http://wikimediadc.org @wikimediadc On Wednesday, March 18, 2015 at 5:02 PM, Nuria Ruiz wrote: > James, > > There are probably better metrics for your purposes, could you let us know what data are you interested on? Once we know that we can take a look to see if there are any issues with the tool itself. > > Thanks, > > Nuria > > > > > On Wed, Mar 18, 2015 at 12:47 PM, James Hare <james.hare(a)wikidc.org (mailto:james.hare@wikidc.org)> wrote: > > I am trying to run a report measuring rolling active editor and newly registered for a cohort of about ~20,000 accounts (actually only about ~1,300 Commons usernames, but I opted to have it extended to their global accounts in case they also did stuff outside of Commons). I have now tried to run the report twice and it has failed. Anyone know what is going on? > > > > > > Thanks, > > James > > > > — > > James Hare > > President, Wikimedia DC > > http://wikimediadc.org > > @wikimediadc > > > > > > _______________________________________________ > > Wikimetrics mailing list > > Wikimetrics(a)lists.wikimedia.org (mailto:Wikimetrics@lists.wikimedia.org) > > https://lists.wikimedia.org/mailman/listinfo/wikimetrics > > > > _______________________________________________ > Wikimetrics mailing list > Wikimetrics(a)lists.wikimedia.org (mailto:Wikimetrics@lists.wikimedia.org) > https://lists.wikimedia.org/mailman/listinfo/wikimetrics > > > _______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org (mailto:Wikimetrics@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/wikimetrics

Edward Galvez

7:47 p.m.

Sorry - I meant Dan! And thanks for the clarification James (those metrics make sense) On Thu, Mar 19, 2015 at 11:44 AM, James Hare <james.hare(a)wikidc.org> wrote:

...

(Who’s Kevin?) For Rolling Active Editor, I decided to chunk it into month-long periods. So I am trying the first one for 30 days prior to June 1, 2014. Yet that report nonetheless failed. The report for newly registered worked out just fine. — James Hare President, Wikimedia DC http://wikimediadc.org @wikimediadc On Thursday, March 19, 2015 at 1:02 PM, Edward Galvez wrote: Hi James and Kevin, Here are the global metrics specifications for newly registered and active editors involved for wmf grantees. James, please let us know if you are looking for other metrics or if these are what you need. I ask because the metrics you are specifying sound different. https://meta.wikimedia.org/wiki/Grants:Learning_patterns/Number_of_newly_re… https://meta.wikimedia.org/wiki/Grants:Learning_patterns/Number_of_active_e… Thanks! Edward On Mar 19, 2015, at 9:42 AM, James Hare <james.hare(a)wikidc.org> wrote: Rolling new active editor may not be the metric I need. Just, for that period of time, I need to know which of the editors were active editors (5+ edits/month) and which had created their accounts in that period. Thanks, James — James Hare President, Wikimedia DC http://wikimediadc.org @wikimediadc On Thursday, March 19, 2015 at 12:31 PM, Dan Andreescu wrote: James, I'm cc-ing Jonathan as this issue looks to have two components. First, James, I ran the Edits metric on your cohort and it worked ok. I am running the Rolling New Active Editor metric and it seems a bit slow, so we're looking into that. Second, how exactly are these reports run? Like, are you using Rolling New Active Editor and doing it in chunks of 30 days over the period you need? Could you detail this, as these rolling metrics are very slow and were not really meant for this kind of use. We can adjust our system accordingly (maybe we can make faster metrics that get to what you need better). On Wed, Mar 18, 2015 at 5:04 PM, James Hare <james.hare(a)wikidc.org> wrote: I want to know, for a period from July 1 to September 30, which of the ~1,300 contributors are new, and which are active editors, per the global metrics meanings of those terms. Let me know fi you need a list of usernames from me. Thanks, James — James Hare President, Wikimedia DC http://wikimediadc.org @wikimediadc On Wednesday, March 18, 2015 at 5:02 PM, Nuria Ruiz wrote: James, There are probably better metrics for your purposes, could you let us know what data are you interested on? Once we know that we can take a look to see if there are any issues with the tool itself. Thanks, Nuria On Wed, Mar 18, 2015 at 12:47 PM, James Hare <james.hare(a)wikidc.org> wrote: I am trying to run a report measuring rolling active editor and newly registered for a cohort of about ~20,000 accounts (actually only about ~1,300 Commons usernames, but I opted to have it extended to their global accounts in case they also did stuff outside of Commons). I have now tried to run the report twice and it has failed. Anyone know what is going on? Thanks, James — James Hare President, Wikimedia DC http://wikimediadc.org @wikimediadc _______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimetrics _______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimetrics _______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimetrics _______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimetrics _______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimetrics _______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimetrics _______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimetrics

-- Edward Galvez Program Evaluation Associate Wikimedia Foundation

Kevin Leduc

7:55 p.m.

I am Kevin (Product Manager for the Analytics team) and I am keeping an eye on this thread and what we could do better. On Thu, Mar 19, 2015 at 11:47 AM, Edward Galvez <egalvez(a)wikimedia.org> wrote:

...

Sorry - I meant Dan! And thanks for the clarification James (those metrics make sense) On Thu, Mar 19, 2015 at 11:44 AM, James Hare <james.hare(a)wikidc.org> wrote:

-- Edward Galvez Program Evaluation Associate Wikimedia Foundation _______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimetrics

Dan Andreescu

8:19 p.m.

I see the potential problem then. James, try something else for me: Instead of Rolling Active Editor, which is a heavy and scary metric, try using Edits with: Start: *June 1st 2014* End: *October 1st 2014* Time Series by: *month* Namespaces: if you leave this blank, it will get all namespaces, which sounds like what you're looking for Then you can look at the CSV result and do some quick analysis on which editors had 5+ edits per month. The "Time Series by" parameter is key there. Just so you don't think I'm making you a test subject, I tried this myself for 2 months of data and the report finished quickly. So I'm confident that it will work, but let us know if you have trouble. Also, while running Rolling Active Editor we ran into performance issues and failures as we predicted above. This is an infrastructure issue that's very tricky to fix, so there's probably nothing we can do in the short term. Either way we've opened a ticket and are looking at the problem: https://phabricator.wikimedia.org/T93217 On Thu, Mar 19, 2015 at 2:55 PM, Kevin Leduc <kevin(a)wikimedia.org> wrote:

...

Sorry - I meant Dan! And thanks for the clarification James (those metrics make sense) On Thu, Mar 19, 2015 at 11:44 AM, James Hare <james.hare(a)wikidc.org> wrote:

_______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikimetrics

James Hare

8:48 p.m.

That did the trick. Thank you, Dan! — James Hare President, Wikimedia DC http://wikimediadc.org @wikimediadc On Thursday, March 19, 2015 at 3:19 PM, Dan Andreescu wrote:

...

I see the potential problem then. James, try something else for me: Instead of Rolling Active Editor, which is a heavy and scary metric, try using Edits with: Start: June 1st 2014 End: October 1st 2014 Time Series by: month Namespaces: if you leave this blank, it will get all namespaces, which sounds like what you're looking for Then you can look at the CSV result and do some quick analysis on which editors had 5+ edits per month. The "Time Series by" parameter is key there. Just so you don't think I'm making you a test subject, I tried this myself for 2 months of data and the report finished quickly. So I'm confident that it will work, but let us know if you have trouble. Also, while running Rolling Active Editor we ran into performance issues and failures as we predicted above. This is an infrastructure issue that's very tricky to fix, so there's probably nothing we can do in the short term. Either way we've opened a ticket and are looking at the problem: https://phabricator.wikimedia.org/T93217 On Thu, Mar 19, 2015 at 2:55 PM, Kevin Leduc <kevin(a)wikimedia.org (mailto:kevin@wikimedia.org)> wrote:

Sorry - I meant Dan! And thanks for the clarification James (those metrics make sense) On Thu, Mar 19, 2015 at 11:44 AM, James Hare <james.hare(a)wikidc.org (mailto:james.hare@wikidc.org)> wrote:

(Who’s Kevin?) For Rolling Active Editor, I decided to chunk it into month-long periods. So I am trying the first one for 30 days prior to June 1, 2014. Yet that report nonetheless failed. The report for newly registered worked out just fine. — James Hare President, Wikimedia DC http://wikimediadc.org @wikimediadc On Thursday, March 19, 2015 at 1:02 PM, Edward Galvez wrote: > > Hi James and Kevin, > > Here are the global metrics specifications for newly registered and active editors involved for wmf grantees. James, please let us know if you are looking for other metrics or if these are what you need. I ask because the metrics you are specifying sound different. > > https://meta.wikimedia.org/wiki/Grants:Learning_patterns/Number_of_newly_re… > > https://meta.wikimedia.org/wiki/Grants:Learning_patterns/Number_of_active_e… > > Thanks! > Edward > > > > On Mar 19, 2015, at 9:42 AM, James Hare <james.hare(a)wikidc.org (mailto:james.hare@wikidc.org)> wrote: > > > Rolling new active editor may not be the metric I need. Just, for that period of time, I need to know which of the editors were active editors (5+ edits/month) and which had created their accounts in that period. > > > > > > Thanks, > > James > > > > — > > James Hare > > President, Wikimedia DC > > http://wikimediadc.org > > @wikimediadc > > > > > > On Thursday, March 19, 2015 at 12:31 PM, Dan Andreescu wrote: > > > > > James, > > > > > > I'm cc-ing Jonathan as this issue looks to have two components. > > > > > > First, James, I ran the Edits metric on your cohort and it worked ok. I am running the Rolling New Active Editor metric and it seems a bit slow, so we're looking into that. > > > > > > Second, how exactly are these reports run? Like, are you using Rolling New Active Editor and doing it in chunks of 30 days over the period you need? Could you detail this, as these rolling metrics are very slow and were not really meant for this kind of use. We can adjust our system accordingly (maybe we can make faster metrics that get to what you need better). > > > > > > On Wed, Mar 18, 2015 at 5:04 PM, James Hare <james.hare(a)wikidc.org (mailto:james.hare@wikidc.org)> wrote: > > > > I want to know, for a period from July 1 to September 30, which of the ~1,300 contributors are new, and which are active editors, per the global metrics meanings of those terms. Let me know fi you need a list of usernames from me. > > > > > > > > > > > > Thanks, > > > > James > > > > > > > > — > > > > James Hare > > > > President, Wikimedia DC > > > > http://wikimediadc.org > > > > @wikimediadc > > > > > > > > > > > > On Wednesday, March 18, 2015 at 5:02 PM, Nuria Ruiz wrote: > > > > > > > > > James, > > > > > > > > > > There are probably better metrics for your purposes, could you let us know what data are you interested on? Once we know that we can take a look to see if there are any issues with the tool itself. > > > > > > > > > > Thanks, > > > > > > > > > > Nuria > > > > > > > > > > > > > > > > > > > > > > > > > On Wed, Mar 18, 2015 at 12:47 PM, James Hare <james.hare(a)wikidc.org (mailto:james.hare@wikidc.org)> wrote: > > > > > > I am trying to run a report measuring rolling active editor and newly registered for a cohort of about ~20,000 accounts (actually only about ~1,300 Commons usernames, but I opted to have it extended to their global accounts in case they also did stuff outside of Commons). I have now tried to run the report twice and it has failed. Anyone know what is going on? > > > > > > > > > > > > > > > > > > Thanks, > > > > > > James > > > > > > > > > > > > — > > > > > > James Hare > > > > > > President, Wikimedia DC > > > > > > http://wikimediadc.org > > > > > > @wikimediadc > > > > > > > > > > > > > > > > > > _______________________________________________ > > > > > > Wikimetrics mailing list > > > > > > Wikimetrics(a)lists.wikimedia.org (mailto:Wikimetrics@lists.wikimedia.org) > > > > > > https://lists.wikimedia.org/mailman/listinfo/wikimetrics > > > > > > > > > > > > > > > > _______________________________________________ > > > > > Wikimetrics mailing list > > > > > Wikimetrics(a)lists.wikimedia.org (mailto:Wikimetrics@lists.wikimedia.org) > > > > > https://lists.wikimedia.org/mailman/listinfo/wikimetrics > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > _______________________________________________ > > > > Wikimetrics mailing list > > > > Wikimetrics(a)lists.wikimedia.org (mailto:Wikimetrics@lists.wikimedia.org) > > > > https://lists.wikimedia.org/mailman/listinfo/wikimetrics > > > > > > > > > > _______________________________________________ > > > Wikimetrics mailing list > > > Wikimetrics(a)lists.wikimedia.org (mailto:Wikimetrics@lists.wikimedia.org) > > > https://lists.wikimedia.org/mailman/listinfo/wikimetrics > > > > > > > > > > > > > > > _______________________________________________ > > Wikimetrics mailing list > > Wikimetrics(a)lists.wikimedia.org (mailto:Wikimetrics@lists.wikimedia.org) > > https://lists.wikimedia.org/mailman/listinfo/wikimetrics > _______________________________________________ > Wikimetrics mailing list > Wikimetrics(a)lists.wikimedia.org (mailto:Wikimetrics@lists.wikimedia.org) > https://lists.wikimedia.org/mailman/listinfo/wikimetrics > > > _______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org (mailto:Wikimetrics@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/wikimetrics

-- Edward Galvez Program Evaluation Associate Wikimedia Foundation _______________________________________________ Wikimetrics mailing list Wikimetrics(a)lists.wikimedia.org (mailto:Wikimetrics@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/wikimetrics

3347

days inactive

3348

days old

wikimetrics@lists.wikimedia.org

Manage subscription

11 comments

5 participants

tags (0)

participants (5)

Dan Andreescu
Edward Galvez
James Hare
Kevin Leduc
Nuria Ruiz