Send Xmldatadumps-l mailing list submissions to xmldatadumps-l(a)lists.wikimedia.org To subscribe or unsubscribe via the World Wide Web, visit https://lists.wikimedia.org/mailman/listinfo/xmldatadumps-l or, via email, send a message with subject or body 'help' to xmldatadumps-l-request(a)lists.wikimedia.org You can reach the person managing the list at xmldatadumps-l-owner(a)lists.wikimedia.org When replying, please edit your Subject line so it is more specific than "Re: Contents of Xmldatadumps-l digest..." Today's Topics: 1. Has anyone had success with data deduplication? (griffin tucker) 2. Re: Has anyone had success with data deduplication? (Count Count) ---------------------------------------------------------------------- Message: 1 Date: Tue, 28 Jul 2020 01:50:09 +0000 From: griffin tucker &lt;gtucker4.une(a)hotmail.com&gt; To: &quot;xmldatadumps-l(a)lists.wikimedia.org&quot; &lt;xmldatadumps-l(a)lists.wikimedia.org&gt; Subject: [Xmldatadumps-l] Has anyone had success with data deduplication? Message-ID: < TY2PR03MB3997DB2177073F2871ABE5E2D2730(a)TY2PR03MB3997.apcprd03.prod.outlook.com Content-Type: text/plain; charset="utf-8" I've tried using freenas/truenas with a data deduplication volume to store multiple sequential dumps, however it doesn't seem to save much space at all - I was hoping someone could point me in the right direction so that I can download multiple dumps and not have it take up so much room (uncompressed). Has anyone tried anything similar and had success with data deduplication? Is there a guide?