Pageview dumps lagging behind - Analytics - lists.wikimedia.org

List overview All Threads
Download

Pageview dumps lagging behind

Research Showcase Wednesday,...

abnormal traffic...

Spinner Cat

11 Feb 2018 11 Feb '18

9:57 a.m.

Hi all, Noticed that we're not getting any new pageview dumps on https://dumps.wikimedia.org/other/pageviews/2018/2018-02/ since Feb 9th 17:08 UTC. Is this a known issue and when might we expect it to be resolved and files to catch up again? Thanks!

Reply

Show replies by date

Dan Andreescu

16 Feb 16 Feb

4:43 p.m.

Hi, how are you deducing that, I show files up to 2018-02-16 14:00:00 (UTC) which is very up to date, only a few hours ago. On Sun, Feb 11, 2018 at 4:57 AM, Spinner Cat <pogfish(a)gmail.com> wrote:

Hi all, Noticed that we're not getting any new pageview dumps on https://dumps.wikimedia.org/other/pageviews/2018/2018-02/ since Feb 9th 17:08 UTC. Is this a known issue and when might we expect it to be resolved and files to catch up again? Thanks! _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

Reply

Dan Andreescu

4:45 p.m.

Oh, my fault, this message is from a while back. We had to pause the cluster for a few days to do a big upgrade, now everything is operational and you should be seeing data and dumps usually within 24 hours of when you'd expect them. If that's not the case, either we're performing some scheduled maintenance or something could be wrong (but that rarely happens and we usually announce it here if it does). Going forward, would people on this list like to be notified of scheduled maintenance? It might be spam for most people so we usually don't post a message about it. On Fri, Feb 16, 2018 at 11:43 AM, Dan Andreescu <dandreescu(a)wikimedia.org> wrote:

Hi, how are you deducing that, I show files up to 2018-02-16 14:00:00 (UTC) which is very up to date, only a few hours ago. On Sun, Feb 11, 2018 at 4:57 AM, Spinner Cat <pogfish(a)gmail.com> wrote:

Hi all, Noticed that we're not getting any new pageview dumps on https://dumps.wikimedia.org/other/pageviews/2018/2018-02/ since Feb 9th 17:08 UTC. Is this a known issue and when might we expect it to be resolved and files to catch up again? Thanks! _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

Reply

John Urbanik

4:48 p.m.

Our team would greatly appreciate scheduled maintenance notifications for maintenance that would impact analytics services. Perhaps an additional list can be set up? On Fri, Feb 16, 2018 at 11:45 AM, Dan Andreescu <dandreescu(a)wikimedia.org> wrote:

Oh, my fault, this message is from a while back. We had to pause the cluster for a few days to do a big upgrade, now everything is operational and you should be seeing data and dumps usually within 24 hours of when you'd expect them. If that's not the case, either we're performing some scheduled maintenance or something could be wrong (but that rarely happens and we usually announce it here if it does). Going forward, would people on this list like to be notified of scheduled maintenance? It might be spam for most people so we usually don't post a message about it. On Fri, Feb 16, 2018 at 11:43 AM, Dan Andreescu <dandreescu(a)wikimedia.org> wrote:

Hi, how are you deducing that, I show files up to 2018-02-16 14:00:00 (UTC) which is very up to date, only a few hours ago. On Sun, Feb 11, 2018 at 4:57 AM, Spinner Cat <pogfish(a)gmail.com> wrote:

Hi all, Noticed that we're not getting any new pageview dumps on https://dumps.wikimedia.org/other/pageviews/2018/2018-02/ since Feb 9th 17:08 UTC. Is this a known issue and when might we expect it to be resolved and files to catch up again? Thanks! _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

_______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

-- *JOHN URBANIK* Lead Data Engineer jurbanik(a)predata.com 860.878.1010 379 West Broadway New York, NY 10012

Reply

Marcel Ruiz Forns

20 Feb 20 Feb

3:12 p.m.

Hi John! We send all our scheduled maintenance notifications to this mailing list. You can subscribe here: https://lists.wikimedia.org/mailman/listinfo/analytics Cheers! On Fri, Feb 16, 2018 at 5:48 PM, John Urbanik <jurbanik(a)predata.com> wrote:

Our team would greatly appreciate scheduled maintenance notifications for maintenance that would impact analytics services. Perhaps an additional list can be set up? On Fri, Feb 16, 2018 at 11:45 AM, Dan Andreescu <dandreescu(a)wikimedia.org> wrote:

Oh, my fault, this message is from a while back. We had to pause the cluster for a few days to do a big upgrade, now everything is operational and you should be seeing data and dumps usually within 24 hours of when you'd expect them. If that's not the case, either we're performing some scheduled maintenance or something could be wrong (but that rarely happens and we usually announce it here if it does). Going forward, would people on this list like to be notified of scheduled maintenance? It might be spam for most people so we usually don't post a message about it. On Fri, Feb 16, 2018 at 11:43 AM, Dan Andreescu <dandreescu(a)wikimedia.org

wrote:

Hi, how are you deducing that, I show files up to 2018-02-16 14:00:00 (UTC) which is very up to date, only a few hours ago. On Sun, Feb 11, 2018 at 4:57 AM, Spinner Cat <pogfish(a)gmail.com> wrote:

Hi all, Noticed that we're not getting any new pageview dumps on https://dumps.wikimedia.org/other/pageviews/2018/2018-02/ since Feb 9th 17:08 UTC. Is this a known issue and when might we expect it to be resolved and files to catch up again? Thanks! _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

_______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

-- *JOHN URBANIK* Lead Data Engineer jurbanik(a)predata.com 860.878.1010 <(860)%20878-1010> 379 West Broadway New York, NY 10012 _______________________________________________ Analytics mailing list Analytics(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics

-- *Marcel Ruiz Forns* Analytics Developer Wikimedia Foundation

Reply

2280

days inactive

2289

days old

analytics@lists.wikimedia.org

Manage subscription

4 comments

4 participants

tags (0)

participants (4)

Dan Andreescu
John Urbanik
Marcel Ruiz Forns
Spinner Cat