Thanks for this. Forwarding to Analytics and Research
for others who are
curious.
Pine
On Tue, Jul 15, 2014 at 9:29 AM, Rachel Farrand <rfarrand(a)wikimedia.org>
wrote:
This Tech Talk will be starting in 30 minuets.
Thanks!
On Fri, Jul 11, 2014 at 3:30 PM, Rachel Farrand <rfarrand(a)wikimedia.org>
wrote:
Hello!
Please join Nuria Ruiz and Andrew Otto next Tuesday, July 15th at 10am
SF
time/5pm UTC
<
http://www.timeanddate.com/worldclock/fixedtime.html?msg=Analytics+Tech+Tal…
for a 30 min tech talk. You can join our hangout or follow along on
youtube:
https://plus.google.com/u/0/b/103470172168784626509/events/c53ho5esd0luccd0…
(please note that a link to join the hangout will
be posted in the
comments
of this event just as it starts).
You can follow ask questions on IRC during the talk in #wikimedia-dev.
If you are not able to follow along live, a video recording will be
posted
here
<
https://plus.google.com/u/0/b/103470172168784626509/103470172168784626509/v…
,
to the MediaWiki YouTube channel immediately following the tech talk for
you to view at any time.
More information about the tech talk:
*Hadoop and Beyond. An overview of Analytics infrastructure*In this tech
talk we will be presenting the analytics infrastructure that we have
recently rolled out in production. By now probably everybody knows that
wikimedia hosts an instance of hadoop from which we are going to extract
pageview data in the near future. But .. how exactly does the data get
there?
We will go over the path that webrequest log data takes from varnish to
kafka (a distributed log buffer) to hadoop and the challenges of
deploying
this java-based infrastructure in production. We
will also talk about
how
can we query the data with hive, an SQL-like
interface. How can you set
up
this stack on vagrant to play with and, last but
not least, how we used
hive recently to provide GLAM folks with image view stats:
https://commons.wikimedia.org/wiki/Commons:GLAMwiki_Toolset_Project/NARA_an…
Thanks!
_______________________________________________
Wikitech-l mailing list
Wikitech-l(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
_______________________________________________
Wiki-research-l mailing list
Wiki-research-l(a)lists.wikimedia.org