[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Deleting old archives is slow



--As of September 29, 2015 3:06:39 PM -0400, Garance AE Drosehn is alleged to have said:

On Sep 29, 2015, at 2:31 PM, Tom Limoncelli <tal@whatexit.org> wrote:

On Mon, Sep 28, 2015 at 10:17 AM, James Turner <james@calminferno.net>
wrote:
tarsnap -d -f archivename-2014010101 -f archivename-2014010102
-f archivename-2014010103

It is good to know that this works.  However it doesn't seem much
faster.  Also, I noticed that it fails the first time it hits a
non-existent archive, so restarting after a failure requires a binary
search or just reverting to doing them one at a time.

tarsnap: Archive does not exist: archivename-2014010103
tarsnap: Error deleting archive

I assume there isn't much you can do about how long it takes to delete
each archive.  And you probably can't delete multiple archives at once
(in parallel), because they all have to work on the same database of
what data is still referenced by at least one of the remaining archives.

So I suspect the best you can do is stack up the delete requests so
you don't have to wait around for each one to finish before typing
in the next one.  I spend so much time typing in command-lines that
I would just type in a 'for' loop:

--As for the rest, it is mine.

It is slightly faster to have it all in one commandline - there's some repetitive overhead involved in doing it archive-by-archive, that tarsnap will avoid doing if it has the whole list. (It also saves some data transfer - both on your network and on tarsnap.)

Daniel T. Staal

---------------------------------------------------------------
This email copyright the author.  Unless otherwise noted, you
are expressly allowed to retransmit, quote, or otherwise use
the contents for non-commercial purposes.  This copyright will
expire 5 years after the author's death, or in 30 years,
whichever is longer, unless such a period is in excess of
local copyright law.
---------------------------------------------------------------