Date:
Wed, 17 Mar 2010 15:15:24 +0100
From: Platonides
<Platonides(a)gmail.com
Subject: Re:
[Wikitech-l]
[Xmldatadumps-admin-l] 2010-03-11 01:10:08:
enwiki Checksumming
pages-meta-history.xml.bz2 :D
To: wikitech-l(a)lists.wikimedia.org
Message-ID:
<hnqo49$itc$1(a)dough.gmane.org
Content-Type:
text/plain;
charset=ISO-8859-1; format=flowed
Jamie Morken wrote:
Also I wonder if it is possible to convert from
7z to bz2 without having
to make the 5469GB file first? If this can
be done then having only 7z
files would be fine, as the bz2 file could be
created with a "normal"
PC (ie one without a 6TB+ harddrive). This
would be a good solution,
but not sure if it can be done. If it could
though, might as well get
rid of all the large wiki's bz2
pages-meta-history files!
Sure.
7z
e -so DatabaseDump.7z | bzip -9 > DatabaseDump.bz
Hi,
Thanks for the info, I think 7z is the way to go :)
cheers,
Jamie