[HipHop] starting import

Tyler Romeo tylerromeo at gmail.com
Thu Jun 13 06:25:26 UTC 2013


Maybe I'm wrong, but wasn't Tool Labs working on something where you could
get access to slave replicas of working databases? If so, maybe an import
isn't even necessary (maybe we can get an answer on this before the 3.5
days is up ;) ).

*-- *
*Tyler Romeo*
Stevens Institute of Technology, Class of 2016
Major in Computer Science
www.whizkidztech.com | tylerromeo at gmail.com


On Thu, Jun 13, 2013 at 2:09 AM, Paul Tarjan <pt at fb.com> wrote:

> I've started an import of the database dump. I had to move the db from
> /var/lib/mysql to /home/mysql since we only have 10 gigs of storage on /.
> The import seems like it will take 3.5 days at 112 pages per second with
> 30M pages, if it stays steady.
>
> Here is the command I'm running:
>
> bzcat ~/dump/enwiki-20130503-pages-articles.xml.bz2 | perl ~/bin/mwimport
> | mysql -f -u<user> -p<pass> --default-character-set=utf8 my_wiki
>
>
> _______________________________________________
> HipHop mailing list
> HipHop at lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/hiphop
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wikimedia.org/pipermail/hiphop/attachments/20130613/67b91a9e/attachment.html>


More information about the HipHop mailing list