We'll probably start at 20GB, which means that
WIkidata will be the only
wiki affected for now.
Ariel
On Mon, Mar 5, 2018 at 1:40 PM, Bináris <wikiposta(a)gmail.com> wrote:
Could you please translate "too large"
to megabytes?
2018-03-05 12:10 GMT+01:00 Ariel Glenn WMF <ariel(a)wikimedia.org>rg>:
> Please forward wherever you think appropriate.
>
> For some time we have provided multiple numbered pages-articles bz2
for large
wikis, as well as a single file with all of the contents
combined
into one. This is consuming enough time for
Wikidata that it is no
longer
sustainable. For wikis where the sizes of these
files to recombine is
"too
large", we will skip this recombine step.
This means that downloader
scripts relying on this file will need to check its existence, and if
it's
> not there, fall back to downloading the multiple numbered files.
>
> I expect to get this done and deployed by the March 20th dumps run.
can
follow along here:
https://phabricator.wikimedia.org/T179059
Thanks!
Ariel
_______________________________________________
Wikitech-l mailing list
Wikitech-l(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
--
Bináris
_______________________________________________
Wikitech-l mailing list
Wikitech-l(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l
_______________________________________________
Wikitech-l mailing list
Wikitech-l(a)lists.wikimedia.org