Front page

understanding obnam's output

7f0072233a0c4dd890f231515ea19650
LOCKUP ADROITNESS HIGHCHAIR

From: Spike <spike@drba.org>
Date: Thu, 21 Jul 2016 07:34:32 -0700

   Dear all,
   
   I'm new to obnam so first off a big thank you for working on this great
   piece of software, I've spent 2 weeks reviewing backup options and obnam is
   the first one I've come across that might fit the bill and save me from
   some horrible hacks around rsync. Many thanks for that.
   
   I've just ran my first backup after installing obnam 1.19 from supplied deb
   packages on ubuntu 16.04. To get familiar with it I've started testing
   backups of my $HOME to a USB drive. $HOME is largely bunch of git
   repositories and some big Virtual box's VM files.
   
   I'd like some help understanding the output of the backup subcommand. This
   is what I got after the first run:
   
   Backed up 14899 files (of 14900 found), containing 68.0 GiB.
   
   Uploaded 45.0 GiB file data in 1h20m13s at 9.7 MiB/s average speed.
   Total download amount 569.0 MiB.
   Total upload amount 45.0 GiB. Overhead was 763.0 MiB (1.6 %).
   
   My questions:
   
   1) it says 14899 files (of 14900 found) , how do I find out what's up with
   the *1* missing? that seems odd
   
   2) it says "containing 68.0 GiB", but then "Uploaded 45.0 GiB", what's up
   with the 23GiB diff? I have a bunch of VMs, wondering if that's the
   deduplication
   
   3) about "Total download amount 569.0 MiB.", download from where? copy is
   local to a USB disk. What is being downloaded?
   
   4) "Overhead was 763.0 MiB (1.6 %).", what's that? deduplication? if so
   that would invalidate the above idea of where the 23GiB are gone
   
   thank you very much for your help,
   
   Spike
From: Spike <spike@drba.org>
Date: Thu, 21 Jul 2016 11:05:26 -0700

   this makes a lot of sense Jan, thank you. Just a clarification, since it's
   a backup from OS disk to USB disk nothing gets downloaded, but I guess it's
   still treated as src/dst and something is copied over to src? where would
   that data be stored? I don't see any cache of sort in ~/.obnam or anything
   like that.
   
   I'll wait to see if somebody else has an idea about 1), it's really
   puzzling.
   
   thanks again,
   
   On Thu, Jul 21, 2016 at 10:38 AM, Jan Brodda <jan@janbrodda.de> wrote:
   
   > Hi Spike,
   > Please note: The following answers are by my best knowledge, but i am just
   > an obnam user.. ;)
   >
   > 1) I don't know..
   >
   > 2) You are right, the difference is because of the deduplication.
   >
   > 3) I think this amount of data has been downloaded by obnam to do
   > deduplication with existing data.
   >
   > 4) The overhead is the total transferred data minus the data which is
   > backed up. So for example obnam parameters and metadata.
   >
   > I hope that everything is correct, if not, someone should correct me.. :)
   >
   > --------
   > janxb
   >
   > Spike <spike@drba.org> schrieb am Do., 21. Juli 2016 um 16:34 Uhr:
   >
   >> Dear all,
   >>
   >> I'm new to obnam so first off a big thank you for working on this great
   >> piece of software, I've spent 2 weeks reviewing backup options and obnam is
   >> the first one I've come across that might fit the bill and save me from
   >> some horrible hacks around rsync. Many thanks for that.
   >>
   >> I've just ran my first backup after installing obnam 1.19 from supplied
   >> deb packages on ubuntu 16.04. To get familiar with it I've started testing
   >> backups of my $HOME to a USB drive. $HOME is largely bunch of git
   >> repositories and some big Virtual box's VM files.
   >>
   >> I'd like some help understanding the output of the backup subcommand.
   >> This is what I got after the first run:
   >>
   >> Backed up 14899 files (of 14900 found), containing 68.0 GiB.
   >>
   >> Uploaded 45.0 GiB file data in 1h20m13s at 9.7 MiB/s average speed.
   >> Total download amount 569.0 MiB.
   >> Total upload amount 45.0 GiB. Overhead was 763.0 MiB (1.6 %).
   >>
   >> My questions:
   >>
   >> 1) it says 14899 files (of 14900 found) , how do I find out what's up
   >> with the *1* missing? that seems odd
   >>
   >> 2) it says "containing 68.0 GiB", but then "Uploaded 45.0 GiB", what's up
   >> with the 23GiB diff? I have a bunch of VMs, wondering if that's the
   >> deduplication
   >>
   >> 3) about "Total download amount 569.0 MiB.", download from where? copy is
   >> local to a USB disk. What is being downloaded?
   >>
   >> 4) "Overhead was 763.0 MiB (1.6 %).", what's that? deduplication? if so
   >> that would invalidate the above idea of where the 23GiB are gone
   >>
   >> thank you very much for your help,
   >>
   >> Spike
   >>
   >> _______________________________________________
   >> obnam-support mailing list
   >> obnam-support@obnam.org
   >>
   >> http://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/obnam-support-obnam.org
   >>
   >
From: Jan Brodda <jan@janbrodda.de>
Date: Thu, 21 Jul 2016 17:38:05 +0000

   Hi Spike,
   Please note: The following answers are by my best knowledge, but i am just
   an obnam user.. ;)
   
   1) I don't know..
   
   2) You are right, the difference is because of the deduplication.
   
   3) I think this amount of data has been downloaded by obnam to do
   deduplication with existing data.
   
   4) The overhead is the total transferred data minus the data which is
   backed up. So for example obnam parameters and metadata.
   
   I hope that everything is correct, if not, someone should correct me.. :)
   
   --------
   janxb
   
   Spike <spike@drba.org> schrieb am Do., 21. Juli 2016 um 16:34 Uhr:
   
   > Dear all,
   >
   > I'm new to obnam so first off a big thank you for working on this great
   > piece of software, I've spent 2 weeks reviewing backup options and obnam is
   > the first one I've come across that might fit the bill and save me from
   > some horrible hacks around rsync. Many thanks for that.
   >
   > I've just ran my first backup after installing obnam 1.19 from supplied
   > deb packages on ubuntu 16.04. To get familiar with it I've started testing
   > backups of my $HOME to a USB drive. $HOME is largely bunch of git
   > repositories and some big Virtual box's VM files.
   >
   > I'd like some help understanding the output of the backup subcommand. This
   > is what I got after the first run:
   >
   > Backed up 14899 files (of 14900 found), containing 68.0 GiB.
   >
   > Uploaded 45.0 GiB file data in 1h20m13s at 9.7 MiB/s average speed.
   > Total download amount 569.0 MiB.
   > Total upload amount 45.0 GiB. Overhead was 763.0 MiB (1.6 %).
   >
   > My questions:
   >
   > 1) it says 14899 files (of 14900 found) , how do I find out what's up with
   > the *1* missing? that seems odd
   >
   > 2) it says "containing 68.0 GiB", but then "Uploaded 45.0 GiB", what's up
   > with the 23GiB diff? I have a bunch of VMs, wondering if that's the
   > deduplication
   >
   > 3) about "Total download amount 569.0 MiB.", download from where? copy is
   > local to a USB disk. What is being downloaded?
   >
   > 4) "Overhead was 763.0 MiB (1.6 %).", what's that? deduplication? if so
   > that would invalidate the above idea of where the 23GiB are gone
   >
   > thank you very much for your help,
   >
   > Spike
   >
   > _______________________________________________
   > obnam-support mailing list
   > obnam-support@obnam.org
   >
   > http://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/obnam-support-obnam.org
   >
From: Lars Kruse <lists@sumpfralle.de>
Date: Fri, 22 Jul 2016 00:05:52 +0200

   Hello Spike,
   
   Am Thu, 21 Jul 2016 11:05:26 -0700
   schrieb Spike <spike@drba.org>:
   
   > this makes a lot of sense Jan, thank you. Just a clarification, since it's
   > a backup from OS disk to USB disk nothing gets downloaded, but I guess it's
   > still treated as src/dst and something is copied over to src?
   
   yes - obnam transparently handles local and remote repositories. "Download"
   refers to content retrieved from the repository (even though everything may
   happen within a single local process).
   
   
   > where would that data be stored? I don't see any cache of sort in ~/.obnam or
   > anything like that.
   
   The downloaded data ist not stored but just processed during runtime. The most
   common dialogs are probably requests for the availability of a specific chunk of
   data (based on its checksum) and responses ("I have it" / "I do not know it").
   Additionally meta data (filenames, attributes) is exchanged.
   
   Obnam does not use any kind of local cache.
   
   Cheers,
   Lars
   
   _______________________________________________
   obnam-support mailing list
   obnam-support@obnam.org
   http://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/obnam-support-obnam.org
From: Lars Wirzenius <liw@liw.fi>
Date: Sat, 23 Jul 2016 19:30:13 +0300

   On Thu, Jul 21, 2016 at 07:34:32AM -0700, Spike wrote:
   > 1) it says 14899 files (of 14900 found) , how do I find out what's up with
   > the *1* missing? that seems odd
   
   Might be a file that gets excluded. The file may have more detailed
   info, at least if you ran it with debugging enabled.