[Labs-l] Faster hard disks

• Previous message: [Labs-l] Tools: Mail server outage, submitting jobs from crontabs and cron jobs every minute
• Next message: [Labs-l] Faster hard disks
• Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

Hello;

I'm processing Wikipedia dumps. For now, I'm copying some dumps into the
tool path (/data/project/tool/dumps) to preserve them for my study, because
only the last 2 dumps are in /public/dumps. And when I launch the jsub, the
script read them from there.

But I have a question, is /public/dumps faster than /data/project ? I mean
in r.pm. or any technical feature. Or all are the same?

By the way, when processing dumps, I have found that reading from a 7z dump
is faster than from a bz2, so I think that the hard disks are playing here
a important role, more than CPU.

Thanks
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wikimedia.org/pipermail/labs-l/attachments/20140522/a72b1d7e/attachment.html>

• Previous message: [Labs-l] Tools: Mail server outage, submitting jobs from crontabs and cron jobs every minute
• Next message: [Labs-l] Faster hard disks
• Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]