[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Delete archive time



Yeah, same.

I'm moving the bulk of our backup operations to locally encrypted
files stored on S3 because tarsnap just doesn't quite work for me with
large amounts of data in our production environment. Our nightly
backups keep failing because the delete-old-nightly job is still
running 12-18 hours later. :(

--Mark


On Wed, Apr 18, 2012 at 6:34 AM, Michael Stevens <mstevens@etla.org> wrote:
> On Mon, Apr 16, 2012 at 04:54:39PM +0100, Clive Cox wrote:
>> Hi,
>>
>>  We use tarsnap and are very happy with it. The only general problem I
>> have is speed issues. As mentioned before on this list recovering
>> archives can take a very long time for large archives. Also, I find
>> deleting large archives also takes a very long time. The following took
>> around 6 hours. Any thoughts?
>>
>>  Clive
>>
>>
>> # tarsnap -d -f system-2012-03-05
>>                                        Total size  Compressed size
>> All archives                        2950835565304    1264798812093
>>   (unique data)                      222520960668     108610551454
>> This archive                         539980302048     424535788030
>> Deleted data                         285167328292     282647681303
>
> I'm finding deleting archives is very slow and quite bandwidth intensive
> as well.
>
> I've been trying to clear up old archives and deleting about a year's
> worth of one a day - it's been going around 36 hours now and using a
> fair bit of bandwidth.
>
> Michael



-- 
Mark Smith // Operations Lead
mark@bumptechnologies.com