I recently had to archive an old website which contain around 500k user uploaded files, totalling around 500GB. Due to the design of the application, the files were all in one folder with no subfolders.
I had assumed I would just take a backup, stick it on an external drive and provide it to the archiver.
Oh ye of little learning.
(more…)