On Sat, 6 Sep 2003, Heikki Orsila wrote:
You may want to investigate using bittorrent to
distribute wikipedia
database dumps. It would save your bandwidth, and increase download speeds
for users:
I doubt it would help very much; it only helps at all if there are
multiple downloaders online and running bittorrent clients simultaneously.
Here are today's accesses:
[05/Sep/2003:07:44:08 +0000] "GET /archives/de/20030823_old_table.sql.bz2
HTTP/1.1" 206 1582285
[05/Sep/2003:08:53:46 +0000] "GET /archives/en/20030830_cur_table.sql.bz2
HTTP/1.1" 200 116876097
[05/Sep/2003:09:40:16 +0000] "GET /archives/ar/20030830_cur_table.sql.bz2
HTTP/1.1" 200 21698
[05/Sep/2003:09:41:30 +0000] "GET /archives/ar/20030830_old_table.sql.bz2
HTTP/1.1" 200 39297
[05/Sep/2003:12:37:20 +0000] "GET /archives/fr/20030830_old_table.sql.bz2
HTTP/1.1" 200 157256
[05/Sep/2003:12:39:13 +0000] "GET /archives/fr/20030830_cur_table.sql.bz2
HTTP/1.1" 200 10276739
[05/Sep/2003:15:00:20 +0000] "GET /archives/en/20030830_cur_table.sql.bz2
HTTP/1.1" 200 116876097
[05/Sep/2003:17:48:51 +0000] "GET /archives/fr/20030830_cur_table.sql.bz2
HTTP/1.1" 200 356701
[05/Sep/2003:18:23:00 +0000] "GET /archives/en/20030830_old_table.sql.bz2
HTTP/1.1" 206 14145696
[05/Sep/2003:19:09:22 +0000] "GET /archives/en/20030830_old_table.sql.bz2
HTTP/1.1" 206 12402688
[05/Sep/2003:19:24:31 +0000] "GET /archives/fr/20030830_cur_table.sql.bz2
HTTP/1.1" 206 9932902
[05/Sep/2003:20:35:37 +0000] "GET /archives/en/20030830_old_table.sql.bz2
HTTP/1.0" 206 10945144
[05/Sep/2003:22:17:29 +0000] "GET /archives/de/20030823_old_table.sql.bz2
HTTP/1.1" 206 16824288
This bandwidth use is only a fraction of that served out on the wikis; the
English Wikipedia's daily bandwidth usage runs 8-11 gigabytes; nearly 2
gigs/day for the German wiki (the second most popular), and so on down
the line.
Of course, there may be more downloads right after a backup, I'll look at
tomorrow's stats for comparison.
-- brion vibber (brion @
pobox.com)