Thanks Platonides. I have a follow up question.
Suppose I download and import a daily dump into a local test wiki. Then I modify some of
the pages on the local copy. Finally, I subsequently download another daily dump and
import it.
+ For pages I changed on my local copy and that are also marked as changed in the new
daily dump, will importDump overwrite them or will it generate an error?
+ For pages I changed on my local copy that are not marked as changed in the new daily
dump, will importDump leave them alone?
Thanks.
Dan Nessett
--- On Tue, 1/26/10, Platonides <Platonides(a)gmail.com> wrote:
From: Platonides <Platonides(a)gmail.com>
Subject: Re: [Mediawiki-l] updating wiki internal data after importDump
To: mediawiki-l(a)lists.wikimedia.org
Date: Tuesday, January 26, 2010, 2:37 PM
dan nessett wrote:
I have imported a daily dump of 121,000 pages
from a
wiki running 1.13.2. The importDump took 80 hours and when I
ran rebuildAll, the resulting job queue was about 250,000
jobs. It took 10.5 hours to process them. After doing this,
I downloaded a subsequent daily dump (from 6 days subsequent
to the original daily dump) and imported it. That took about
30 minutes.
Now I want to update the internal data structures so
my personal copy of the wiki
is complete. I decided not to
use rebuildAll again, since the daily dump has no images.
Also, the wiki is postgres based, so rebuildtextindex
doesn't work (it is only for MySQL). So, I thought I would
use refreshLinks. However, that is running almost as slowly
as the original importDump. After processing 2200 pages and
interpolating forward, I estimate it will take about 40
hours to complete.
I have several questions:
+ Are there any settings that might make both
importDump and refreshLinks do their
work more quickly?
+ Is it necessary to run refreshLinks after an
incremental importDump?
+ Are there other maintenance scripts I should run?
Thanks,
Dan Nessett
importDump should be already doing everything rebuildAll
does, so you
don't need to run it again.
_______________________________________________
MediaWiki-l mailing list
MediaWiki-l(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mediawiki-l