fishy browser stats

List overview All Threads
Download

newer

older

Updates the Wikistats For...

Daily merged pageviews stopped ?

Ryan Kaldari

21 Jul 2017 21 Jul '17

11:36 p.m.

According to... https://analytics.wikimedia.org/dashboards/browsers/#all-sites-by-browser/b… ... IE7 accounts for 2.5% of all pageviews in the last month. According to... https://analytics.wikimedia.org/dashboards/browsers/#desktop-site-by-browse… ... IE7 accounts for 5.1% of all desktop pageviews in the last month. If that's true, IE7 (which came out 10 years ago) is more popular than all versions of Safari combined. It also means that we need to roll back a whole slew of features in MediaWiki that aren't supported in IE7. Surely this can't be accurate though as most other sites on the internet report virtually non-existent usage of IE7 (less than 1% everywhere I've checked). Can someone double-check this?

Attachments:

attachment.htm (text/html — 1.8 KB)

Show replies by date

Nuria Ruiz

22 Jul 22 Jul

4:24 a.m.

...

Surely this can't be accurate though as most other sites on the internet

report virtually non-existent usage of IE7 (less than 1% everywhere I've checked). Can someone >double-check this? This is likely bot traffic with IE7 user-agent. See: https://phabricator.wikimedia.org/T148461 We will hopefully be able to tackle distortion of stats by non-labelled bot traffic in the next year: https://phabricator.wikimedia.org/T138207 Issue for dataset noted here: https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Traffic/Browser_gen… On Fri, Jul 21, 2017 at 4:36 PM, Ryan Kaldari <rkaldari(a)wikimedia.org> wrote:

...

According to... https://analytics.wikimedia.org/dashboards/browsers/#all- sites-by-browser/browser-family-and-major-hierarchical-view ... IE7 accounts for 2.5% of all pageviews in the last month. According to... https://analytics.wikimedia.org/dashboards/browsers/# desktop-site-by-browser/browser-family-and-major-hierarchical-view ... IE7 accounts for 5.1% of all desktop pageviews in the last month. If that's true, IE7 (which came out 10 years ago) is more popular than all versions of Safari combined. It also means that we need to roll back a whole slew of features in MediaWiki that aren't supported in IE7. Surely this can't be accurate though as most other sites on the internet report virtually non-existent usage of IE7 (less than 1% everywhere I've checked). Can someone double-check this? _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

Tilman Bayer

3 Aug 3 Aug

3:59 p.m.

For those with NDA access, see also the more detailed investigation at https://phabricator.wikimedia.org/T157404 (nothing super secret about the topic per se, it's just that some partial IP data was examined in the process, so the task was set to non-public to avoid privacy concerns) When filing that task half a year ago, I wrote that "At about 0.5% of our total human views currently, they start to matter for overall traffic trend analysis etc." They have since increased and, as can be gleaned from Kaldari's remarks, do indeed affect our global stats markedly now. I have started to remove them in the pageviews stats and trends I'm preparing, will follow up with more detail on Phabricator. On Fri, Jul 21, 2017 at 9:24 PM, Nuria Ruiz <nuria(a)wikimedia.org> wrote:

...

Surely this can't be accurate though as most other sites on the internet

report virtually non-existent usage of IE7 (less than 1% everywhere I've checked). Can someone >double-check this? This is likely bot traffic with IE7 user-agent. See: https://phabricator.wikimedia.org/T148461 We will hopefully be able to tackle distortion of stats by non-labelled bot traffic in the next year: https://phabricator.wikimedia.org/T138207 Issue for dataset noted here: https://wikitech.wikimed ia.org/wiki/Analytics/Data_Lake/Traffic/Browser_general#Chan ges_and_known_problems_since_2016-03-21 On Fri, Jul 21, 2017 at 4:36 PM, Ryan Kaldari <rkaldari(a)wikimedia.org> wrote:

According to... https://analytics.wikimedia.org/dashboards/browsers/#all-sit es-by-browser/browser-family-and-major-hierarchical-view ... IE7 accounts for 2.5% of all pageviews in the last month. According to... https://analytics.wikimedia.org/dashboards/browsers/#desktop -site-by-browser/browser-family-and-major-hierarchical-view ... IE7 accounts for 5.1% of all desktop pageviews in the last month. If that's true, IE7 (which came out 10 years ago) is more popular than all versions of Safari combined. It also means that we need to roll back a whole slew of features in MediaWiki that aren't supported in IE7. Surely this can't be accurate though as most other sites on the internet report virtually non-existent usage of IE7 (less than 1% everywhere I've checked). Can someone double-check this? _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

_______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

-- Tilman Bayer Senior Analyst Wikimedia Foundation IRC (Freenode): HaeB

Nuria Ruiz

8:29 p.m.

...

"At about 0.5% of our total human views currently, they start to matter

for overall traffic trend analysis etc." Our bot traffic not reported as such is a lot higher than 0.5%, probably more like one order of magnitude higher 2% at least. See: https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Traffic/Pageviews/B… This matters a lot for computations like top pageviews which are so distorted by bot traffic that they almost become not useful. Now, while these are overall numbers the effect is felt mostly on english wikipedia as smaller wikipedias have a lot smaller percentage of non reported bots. On Thu, Aug 3, 2017 at 8:59 AM, Tilman Bayer <tbayer(a)wikimedia.org> wrote:

...

Surely this can't be accurate though as most other sites on the

internet report virtually non-existent usage of IE7 (less than 1% everywhere I've checked). Can someone >double-check this? This is likely bot traffic with IE7 user-agent. See: https://phabricator.wikimedia.org/T148461 We will hopefully be able to tackle distortion of stats by non-labelled bot traffic in the next year: https://phabricator.wikimedia.org/T138207 Issue for dataset noted here: https://wikitech.wikimed ia.org/wiki/Analytics/Data_Lake/Traffic/Browser_general#Chan ges_and_known_problems_since_2016-03-21 On Fri, Jul 21, 2017 at 4:36 PM, Ryan Kaldari <rkaldari(a)wikimedia.org> wrote:

According to... https://analytics.wikimedia.org/dashboards/browsers/#all-sit es-by-browser/browser-family-and-major-hierarchical-view ... IE7 accounts for 2.5% of all pageviews in the last month. According to... https://analytics.wikimedia.org/dashboards/browsers/#desktop -site-by-browser/browser-family-and-major-hierarchical-view ... IE7 accounts for 5.1% of all desktop pageviews in the last month. If that's true, IE7 (which came out 10 years ago) is more popular than all versions of Safari combined. It also means that we need to roll back a whole slew of features in MediaWiki that aren't supported in IE7. Surely this can't be accurate though as most other sites on the internet report virtually non-existent usage of IE7 (less than 1% everywhere I've checked). Can someone double-check this? _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

_______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

-- Tilman Bayer Senior Analyst Wikimedia Foundation IRC (Freenode): HaeB _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

2481

days inactive

2494

days old

analytics@lists.wikimedia.org

Manage subscription

3 comments

3 participants

tags (0)

participants (3)

Nuria Ruiz
Ryan Kaldari
Tilman Bayer