Dan and I just talked and it looks like a bunch
of editing data in
August that we used to be seeing in the graph are not longer in that graph
(it used to be roughly ~78k I think and now it's ~40k)
On Fri, Dec 13, 2013 at 5:22 PM, Kenan Wang <kwang(a)wikimedia.org> wrote:
Sorry to be clear Dan Tomasz had pointed out a
30% drop between edits
in august and edits in september.
On Fri, Dec 13, 2013 at 5:22 PM, Kenan Wang <kwang(a)wikimedia.org>wrote;wrote:
> I think the graph is updating correctly.
>
> I noticed the discrepancy on Nov 27th.
>
> We only know roughly I think. You can see that Tomasz pointed out on
> October 7th that he noticed "Rough 30% drop month on our report card
> [1] for successful edits." We never explained the drop and I went back to
> investigate.
>
> However if you look at the graph now, that drop is not there anymore.
>
http://mobile-reportcard.wmflabs.org/graphs/edits-monthly-successful
>
>
> On Thu, Dec 12, 2013 at 5:30 PM, Dan Andreescu <
> dandreescu(a)wikimedia.org> wrote:
>
>> I'd like to help but it's a bit hard to follow what we know so far.
>> Some questions:
>>
>> * Is this graph updating properly now, by running this query:
>>
https://git.wikimedia.org/blob/analytics%2Flimn-mobile-data/badeecb133ac67d…
>> ?
>> * I understand the latest graph is different from old versions of it.
>> When was this difference noticed?
>> * What is the difference? Do we know accurately or just roughly?
>>
>>
>> On Wed, Dec 11, 2013 at 6:08 PM, Kenan Wang <kwang(a)wikimedia.org>wrote;wrote:
>>
>>> Anyone know what happened here?
>>>
>>>
>>> On Tue, Dec 3, 2013 at 1:25 PM, Kenan Wang <kwang(a)wikimedia.org>wrote;wrote:
>>>
>>>> Looking at this one:
>>>>
http://mobile-reportcard.wmflabs.org/graphs/edits-monthly-successful
>>>>
>>>>
>>>> On Tue, Dec 3, 2013 at 1:22 PM, Dario Taraborelli <
>>>> dtaraborelli(a)wikimedia.org> wrote:
>>>>
>>>>> Kenan – can you give me a pointer to the graph you are referring
>>>>> to and confirm what data source you are using? If you’re relying on
>>>>> EventLogging data (MobileWebEditing) the log is not affected by
reverts or
>>>>> page deletions.
>>>>>
>>>>> On Dec 2, 2013, at 11:53 AM, Arthur Richards <
>>>>> arichards(a)wikimedia.org> wrote:
>>>>>
>>>>> +analytics
>>>>>
>>>>>
>>>>> On Mon, Dec 2, 2013 at 11:27 AM, Jon Robson
<jrobson(a)wikimedia.org
>>>>> > wrote:
>>>>>
>>>>>> Several theories:
>>>>>> 1) I guess this now reflects reversions/deletions of edits?
>>>>>> 2) We purge data collected before a certain date
>>>>>>
>>>>>> I suspect the former?
>>>>>>
>>>>>> On Wed, Nov 27, 2013 at 11:26 AM, Kenan Wang
<kwang(a)wikimedia.org>
>>>>>> wrote:
>>>>>> > Hey everyone. The monthly successful edits graph no longer
>>>>>> reflects a drop
>>>>>> > in edits between August and September...
>>>>>> >
>>>>>> > Is it possible that we had data issues before that were
causing
>>>>>> us to see an
>>>>>> > issue that wasn't there?
>>>>>> >
>>>>>> > OR
>>>>>> >
>>>>>> > Is there some sort of data issue now that is causing us to
be
>>>>>> missing data
>>>>>> > that we used to be able to see?
>>>>>> >
>>>>>> >
>>>>>> > On Thu, Oct 17, 2013 at 3:27 PM, Arthur Richards <
>>>>>> arichards(a)wikimedia.org>
>>>>>> > wrote:
>>>>>> >>
>>>>>> >> I guess it's tough to draw a baseline considering we
only have
>>>>>> a couple
>>>>>> >> months worth of data - but perhaps a good metric for our
goal
>>>>>> is returning
>>>>>> >> to or exceeding our peak?
>>>>>> >>
>>>>>> >>
>>>>>> >> On Thu, Oct 17, 2013 at 1:52 PM, Kenan Wang <
>>>>>> kwang(a)wikimedia.org> wrote:
>>>>>> >>>
>>>>>> >>> Thanks to Juliusz we now have a graph of mobile
editors that
>>>>>> became
>>>>>> >>> active editors. We can see a drop in the number of
editors
>>>>>> that became
>>>>>> >>> active:
>>>>>> >>>
>>>>>> >>>
>>>>>>
http://mobile-reportcard.wmflabs.org/graphs/edits-monthly-5plus-editors
>>>>>> >>>
>>>>>> >>>
>>>>>> >>> On Tue, Oct 15, 2013 at 2:31 PM, Kenan Wang <
>>>>>> kwang(a)wikimedia.org> wrote:
>>>>>> >>>>
>>>>>> >>>> Well, looks like IndiaSummer95 got blocked
today... but I've
>>>>>> reached out
>>>>>> >>>> to Nick1372 and KurtWags3 via their user talk
pages.
>>>>>> >>>>
>>>>>> >>>>
>>>>>> >>>> On Wed, Oct 9, 2013 at 9:43 PM, Jon Robson <
>>>>>> jrobson(a)wikimedia.org>
>>>>>> >>>> wrote:
>>>>>> >>>>>
>>>>>> >>>>> I hope this is not too stalker-y but I think
it is
>>>>>> interesting.
>>>>>> >>>>>
>>>>>> >>>>> I looked briefly at the top 5 editors for
both August [A]
>>>>>> and
>>>>>> >>>>> September [B], the most prolific editor
"Indiasummer95",
>>>>>> 520 days
>>>>>> >>>>> registered, [1] made 2908 edits in August
but only 694 in
>>>>>> September.
>>>>>> >>>>> The second most profilic editor "La
Avatar Korra",
>>>>>> registered for 88
>>>>>> >>>>> days [2] in September made 954 edits in
August but only 379
>>>>>> in
>>>>>> >>>>> September. Number 3, Nick1372, member for
306d days [3] had
>>>>>> 762 edits
>>>>>> >>>>> in August but only 445 in September, #4 was
이민혁, registered
>>>>>> for 70
>>>>>> >>>>> days, [4] (558 rising to 623), and #5
KurtWags3, registered
>>>>>> for 84
>>>>>> >>>>> days [5] (520 dropping to 102)
>>>>>> >>>>>
>>>>>> >>>>> Out of these Indiasummer95 was the most
interesting so I
>>>>>> looked at the
>>>>>> >>>>> edits per page for August [C]:
>>>>>> >>>>> Tell_Mama_UK 66
>>>>>> >>>>> Abel_Xavier 60
>>>>>> >>>>> Melilla 56
>>>>>> >>>>> Vitória_S.C. 44
>>>>>> >>>>> History_of_Roman_Catholicism_in_Portugal 40
>>>>>> >>>>> Knattspyrnufélag_Reykjavíkur 40
>>>>>> >>>>> Robot_Wars_(TV_series) 38
>>>>>> >>>>> F.C._Paços_de_Ferreira 32
>>>>>> >>>>> Symbols_of_Portugal 32
>>>>>> >>>>> Politics_of_Toledo_(Spain) 32
>>>>>> >>>>>
>>>>>> >>>>> The same in September [D]:
>>>>>> >>>>> Alfonso_I_of_Asturias 21
>>>>>> >>>>> Indiasummer95 13
>>>>>> >>>>> Vitālijs_Astafjevs 12
>>>>>> >>>>> A.C._Perugia_Calcio 10
>>>>>> >>>>> Morangos_com_Açúcar 9
>>>>>> >>>>> Azad_Ali 9
>>>>>> >>>>> Million_Muslim_March 8
>>>>>> >>>>> Islam_in_the_Czech_Republic 7
>>>>>> >>>>> Szilárd_Németh 7
>>>>>> >>>>> Matteo_Ferrari 6
>>>>>> >>>>>
>>>>>> >>>>> Inspecting closing on the dates of his/her
edits to
>>>>>> Tell_Mama_UK (page
>>>>>> >>>>> id 39683645) [E]
>>>>>> >>>>> 2013-08-11 4
>>>>>> >>>>> 2013-08-15 56
>>>>>> >>>>> 2013-08-16 6
>>>>>> >>>>>
>>>>>> >>>>> However if I look at the history page I
don't see 56 edits
>>>>>> from
>>>>>> >>>>> him/her on that page (I count 36 total on
the entire page):
>>>>>> >>>>>
>>>>>> >>>>>
>>>>>>
https://en.m.wikipedia.org/w/index.php?title=Tell_Mama_UK&action=history
>>>>>> >>>>>
>>>>>> >>>>> So.. that makes me wonder...
>>>>>> >>>>> 1) was something broken around 15th August
in EventLogging
>>>>>> - were we
>>>>>> >>>>> reporting successes that weren't and
thus the data is
>>>>>> skewed (e.g.
>>>>>> >>>>> AbuseFilter related) ? Is there a logical
explanation for
>>>>>> this or is
>>>>>> >>>>> something indeed weird - can anyone suggest
a reason?
>>>>>> >>>>> 2) Is this people getting used to the
editor/wikitext -
>>>>>> making lots of
>>>>>> >>>>> mistakes early on and then getting better at
using it?
>>>>>> >>>>> 3) Is it indeed seasonal / people getting
bored after
>>>>>> initial
>>>>>> >>>>> excitement of editing?
>>>>>> >>>>>
>>>>>> >>>>> [1]
>>>>>> >>>>>
>>>>>>
https://en.m.wikipedia.org/wiki/Special:UserProfile/Indiasummer95?mobileact…
>>>>>> >>>>> [2]
>>>>>> >>>>>
>>>>>>
https://es.m.wikipedia.org/wiki/Special:UserProfile/La%20Avatar%20Korra?mob…
>>>>>> >>>>> [3]
>>>>>> >>>>>
>>>>>>
https://en.m.wikipedia.org/wiki/Special:UserProfile/Nick1372?mobileaction=b…
>>>>>> >>>>> [4]
>>>>>> >>>>>
https://ko.m.wikipedia.org/wiki/특수기능:UserProfile/
>>>>>> 이민혁?mobileaction=beta
>>>>>> >>>>> [5]
>>>>>> >>>>>
>>>>>>
https://en.m.wikipedia.org/wiki/Special:UserProfile/KurtWags3?mobileaction=…
>>>>>> >>>>>
>>>>>> >>>>> [A] SELECT event_username, count(*) from
>>>>>> MobileWebEditing_5644223
>>>>>> >>>>> where event_action = 'success' and
timestamp LIKE '201308%'
>>>>>> group by
>>>>>> >>>>> event_username
>>>>>> >>>>> [B] SELECT event_username, count(*) from
>>>>>> MobileWebEditing_5644223
>>>>>> >>>>> where event_action = 'success' and
timestamp LIKE '201309%'
>>>>>> group by
>>>>>> >>>>> event_username
>>>>>> >>>>> [C] SELECT enwiki.page.page_title,
count(*) from
>>>>>> >>>>> MobileWebEditing_5644223 INNER JOIN
enwiki.page on
>>>>>> enwiki.page.page_id
>>>>>> >>>>> = event_pageId where wiki = 'enwiki'
and event_action =
>>>>>> 'success' and
>>>>>> >>>>> event_userName = 'Indiasummer95' and
timestamp LIKE
>>>>>> '201308%' group by
>>>>>> >>>>> event_pageId
>>>>>> >>>>> [D] SELECT enwiki.page.page_title, count(*)
from
>>>>>> >>>>> MobileWebEditing_5644223 INNER JOIN
enwiki.page on
>>>>>> enwiki.page.page_id
>>>>>> >>>>> = event_pageId where wiki = 'enwiki'
and event_action =
>>>>>> 'success' and
>>>>>> >>>>> event_userName = 'Indiasummer95' and
timestamp LIKE
>>>>>> '201309%' group by
>>>>>> >>>>> event_pageId
>>>>>> >>>>> [E] SELECT DATE(timestamp), count(*) from
>>>>>> MobileWebEditing_5644223
>>>>>> >>>>> where wiki = 'enwiki' and
event_action = 'success' and
>>>>>> event_userName
>>>>>> >>>>> = 'Indiasummer95' and timestamp LIKE
'201308%' and
>>>>>> event_pageId =
>>>>>> >>>>> 39683645 group by DATE(timestamp)
>>>>>> >>>>>
>>>>>> >>>>>
>>>>>> >>>>> On Wed, Oct 9, 2013 at 8:09 PM, Kenan Wang
<
>>>>>> kwang(a)wikimedia.org> wrote:
>>>>>> >>>>> > I'll try to block out some time to
look at creating those
>>>>>> two graphs
>>>>>> >>>>> > tomorrow. Let me know if you want to
help.
>>>>>> >>>>> >
>>>>>> >>>>> >
>>>>>> >>>>> > On Wed, Oct 9, 2013 at 8:09 PM, Kenan
Wang <
>>>>>> kwang(a)wikimedia.org>
>>>>>> >>>>> > wrote:
>>>>>> >>>>> >>
>>>>>> >>>>> >> Adding Dario to this thread.
>>>>>> >>>>> >>
>>>>>> >>>>> >> So the main question is why is the
number of edits going
>>>>>> down from
>>>>>> >>>>> >> august
>>>>>> >>>>> >> to september while the number of
unique editors is going
>>>>>> up?
>>>>>> >>>>> >>
>>>>>> >>>>> >> Few theories:
>>>>>> >>>>> >>
>>>>>> >>>>> >> 1) Problem with data - seems
unlikely per Jon's
>>>>>> analysis. Also, both
>>>>>> >>>>> >> numbers come from the same data
source.
>>>>>> >>>>> >>
>>>>>> >>>>> >> 2) Change in the makeup of editors
- not conclusive from
>>>>>> the data
>>>>>> >>>>> >> but it
>>>>>> >>>>> >> seems that the number of edits from
new editors and
>>>>>> experienced
>>>>>> >>>>> >> editors are
>>>>>> >>>>> >> following the same general
pattern.
>>>>>> >>>>> >>
>>>>>> >>>>> >> 3) Change in edits per session - no
analysis done
>>>>>> towards this yet.
>>>>>> >>>>> >>
>>>>>> >>>>> >> I'd like to take a look at:
>>>>>> >>>>> >>
>>>>>> >>>>> >> 1) a daily graph over the same two
month period on
>>>>>> unique daily
>>>>>> >>>>> >> editors
>>>>>> >>>>> >>
>>>>>> >>>>> >> 2) a daily graph of edits per
session over the same two
>>>>>> month
>>>>>> >>>>> >> period
>>>>>> >>>>> >>
>>>>>> >>>>> >> Few things to keep in mind:
>>>>>> >>>>> >>
>>>>>> >>>>> >> -It seems that there is not a
seasonality difference in
>>>>>> desktop
>>>>>> >>>>> >> edits, but
>>>>>> >>>>> >> as pointed out by Steven Walling
it's not necessarily
>>>>>> true that
>>>>>> >>>>> >> desktop
>>>>>> >>>>> >> edits and mobile edits will follow
the same seasonality
>>>>>> patterns.
>>>>>> >>>>> >>
>>>>>> >>>>> >> -Seasonality also wouldn't
account for the skew between
>>>>>> unique
>>>>>> >>>>> >> editors and
>>>>>> >>>>> >> raw edits.
>>>>>> >>>>> >>
>>>>>> >>>>> >> -This effect seems fairly centered
on enwiki, however
>>>>>> mobile captcha
>>>>>> >>>>> >> support was introduced and may
affect numbers for other
>>>>>> projects in
>>>>>> >>>>> >> some off
>>>>>> >>>>> >> setting fashion
>>>>>> >>>>> >>
>>>>>> >>>>> >> -The spike in number of edits
occurs roughly between Aug
>>>>>> 12 - 30,
>>>>>> >>>>> >> particularly 23-30. In that time
section level editing
>>>>>> was
>>>>>> >>>>> >> introduced on
>>>>>> >>>>> >> August 27.
>>>>>> >>>>> >>
>>>>>> >>>>> >>
>>>>>> >>>>> >> On Wed, Oct 9, 2013 at 6:08 PM, Jon
Robson <
>>>>>> jrobson(a)wikimedia.org>
>>>>>> >>>>> >> wrote:
>>>>>> >>>>> >>>
>>>>>> >>>>> >>> If you look at my graphs this
theory doesn't seem to
>>>>>> hold....
>>>>>> >>>>> >>>
>>>>>> >>>>> >>> On 9 Oct 2013 12:24,
"Tomasz Finc" <tfinc(a)wikimedia.org>
>>>>>> wrote:
>>>>>> >>>>> >>>>
>>>>>> >>>>> >>>> On Tue, Oct 8, 2013 at 9:32
AM, Maryana Pinchuk
>>>>>> >>>>> >>>>
<mpinchuk(a)wikimedia.org>
>>>>>> >>>>> >>>> wrote:
>>>>>> >>>>> >>>> > One theory: most of
our enwiki power users tried
>>>>>> mobile editing
>>>>>> >>>>> >>>> > early
>>>>>> >>>>> >>>> > on and
>>>>>> >>>>> >>>> > made their customarily
high number of edits per
>>>>>> session in
>>>>>> >>>>> >>>> > August, but
>>>>>> >>>>> >>>> > they
>>>>>> >>>>> >>>> > weren't retained
on mobile and didn't stick around
>>>>>> through
>>>>>> >>>>> >>>> > September.
>>>>>> >>>>> >>>> > Meanwhile, new users
continue to flood in, but they
>>>>>> only make an
>>>>>> >>>>> >>>> > edit
>>>>>> >>>>> >>>> > or two
>>>>>> >>>>> >>>> > and leave. If this is
the case, it makes a strong
>>>>>> argument for
>>>>>> >>>>> >>>> > working
>>>>>> >>>>> >>>> > on
>>>>>> >>>>> >>>> > things like mobile
GettingStarted/KeepGoing to bump
>>>>>> up early
>>>>>> >>>>> >>>> > engagement for
>>>>>> >>>>> >>>> > newbies, and article
histories/contrib views and
>>>>>> other power
>>>>>> >>>>> >>>> > user
>>>>>> >>>>> >>>> > features
>>>>>> >>>>> >>>> > for oldbies :)
>>>>>> >>>>> >>>>
>>>>>> >>>>> >>>> This could be an
interesting theory. Kenan, what do
>>>>>> you think
>>>>>> >>>>> >>>> about
>>>>>> >>>>> >>>> reaching out to a handful
of those editors that
>>>>>> dropped and ask
>>>>>> >>>>> >>>> them
>>>>>> >>>>> >>>> why?
>>>>>> >>>>> >>>>
>>>>>> >>>>> >>>> --tomasz
>>>>>> >>>>> >>
>>>>>> >>>>> >>
>>>>>> >>>>> >>
>>>>>> >>>>> >>
>>>>>> >>>>> >> --
>>>>>> >>>>> >>
>>>>>> >>>>> >> Kenan Wang
>>>>>> >>>>> >> Product Manager, Mobile
>>>>>> >>>>> >> Wikimedia Foundation
>>>>>> >>>>> >
>>>>>> >>>>> >
>>>>>> >>>>> >
>>>>>> >>>>> >
>>>>>> >>>>> > --
>>>>>> >>>>> >
>>>>>> >>>>> > Kenan Wang
>>>>>> >>>>> > Product Manager, Mobile
>>>>>> >>>>> > Wikimedia Foundation
>>>>>> >>>>
>>>>>> >>>>
>>>>>> >>>>
>>>>>> >>>>
>>>>>> >>>> --
>>>>>> >>>>
>>>>>> >>>> Kenan Wang
>>>>>> >>>> Product Manager, Mobile
>>>>>> >>>> Wikimedia Foundation
>>>>>> >>>
>>>>>> >>>
>>>>>> >>>
>>>>>> >>>
>>>>>> >>> --
>>>>>> >>>
>>>>>> >>> Kenan Wang
>>>>>> >>> Product Manager, Mobile
>>>>>> >>> Wikimedia Foundation
>>>>>> >>
>>>>>> >>
>>>>>> >>
>>>>>> >>
>>>>>> >> --
>>>>>> >> Arthur Richards
>>>>>> >> Software Engineer, Mobile
>>>>>> >> [[User:Awjrichards]]
>>>>>> >> IRC: awjr
>>>>>> >> +1-415-839-6885 x6687
>>>>>> >
>>>>>> >
>>>>>> >
>>>>>> >
>>>>>> > --
>>>>>> >
>>>>>> > Kenan Wang
>>>>>> > Product Manager, Mobile
>>>>>> > Wikimedia Foundation
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Arthur Richards
>>>>> Software Engineer, Mobile
>>>>> [[User:Awjrichards]]
>>>>> IRC: awjr
>>>>> +1-415-839-6885 x6687
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> Kenan Wang
>>>> Product Manager, Mobile
>>>> Wikimedia Foundation
>>>>
>>>
>>>
>>>
>>> --
>>>
>>> Kenan Wang
>>> Product Manager, Mobile
>>> Wikimedia Foundation
>>>
>>> _______________________________________________
>>> Analytics mailing list
>>> Analytics(a)lists.wikimedia.org
>>>
https://lists.wikimedia.org/mailman/listinfo/analytics
>>>
>>>
>>
>
>
> --
>
> Kenan Wang
> Product Manager, Mobile
> Wikimedia Foundation
>
--
Kenan Wang
Product Manager, Mobile
Wikimedia Foundation