Front page

Performance on a WAN line

97752d47cac04e218c8a87dff855fc42
PRESHRUNK IMPARTIAL BUTTON

From: Markus Bonet <m.bonet@gmx.de>
Date: Tue, 2 Aug 2016 15:23:45 +0200

   Hi,
   
   I am a new user to this tool and I am testing it for my purposes.
   
   I store one copy of my data to a different location. Line speed is
   confirmed to be 20 MBit/s when using scp, for example. Latency is 30-40 ms.
   
   The obnam version installed on my Fedora 23 system is 1.19.1
   
   When running obnam with either
   
   obnam --lru-size=1024 --upload-queue-size=512 backup -r
   sftp://remote/folder /local/folder --exclude /local/folder/exclude
   
   or
   
   obnam backup -r sftp://remote/folder /local/folder --exclude
   /local/folder/exclude
   
   gives me appr. 550 KiB/s.
   
   Is my first setting effective? Or is it due to latency that I don't see
   any better performance?
   
   
   Thanks
   Markus
   
   _______________________________________________
   obnam-support mailing list
   obnam-support@obnam.org
   http://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/obnam-support-obnam.org
From: Lars Wirzenius <liw@liw.fi>
Date: Tue, 2 Aug 2016 17:53:21 +0300

   On Tue, Aug 02, 2016 at 03:23:45PM +0200, Markus Bonet wrote:
   > I store one copy of my data to a different location. Line speed is
   > confirmed to be 20 MBit/s when using scp, for example. Latency is 30-40 ms.
   > 
   > The obnam version installed on my Fedora 23 system is 1.19.1
   > 
   > When running obnam with either
   > 
   > obnam --lru-size=1024 --upload-queue-size=512 backup -r
   > sftp://remote/folder /local/folder --exclude /local/folder/exclude
   > 
   > or
   > 
   > obnam backup -r sftp://remote/folder /local/folder --exclude
   > /local/folder/exclude
   > 
   > gives me appr. 550 KiB/s.
   > 
   > Is my first setting effective? Or is it due to latency that I don't see
   > any better performance?
   
   You may want to try different values for --lru-size
   and--upload-queue-size to see if that helps. Other than that, it may
   be that's as far as you get with Obanm, your data, and your Internet
   connection. If so, sorry.
   
   http://obnam.org/faq/tuning/ has some tuning advice.
From: "Jan Brodda" <obnam@janbrodda.de>
Date: Wed, 03 Aug 2016 08:32:21 +0000

   Hi Markus,
   Just a short remark on your question:
   This are the obnam settings i am using for backup, maybe those will have a better effect on your site as well.
   (Please note, my storage server is in the same datacenter..)
   
    --lru-size=100mb
    --upload-queue-size=50mb
   
   ___________
   Jan Brodda
   
   3. August 2016 09:34 Uhr, "Markus Bonet" <m.bonet@gmx.de> schrieb:
   > Am 02.08.2016 um 16:53 schrieb Lars Wirzenius:
   > 
   >>> obnam --lru-size=1024 --upload-queue-size=512 backup -r
   >>> sftp://remote/folder /local/folder --exclude /local/folder/exclude
   >>>>> or
   >>>>> obnam backup -r sftp://remote/folder /local/folder --exclude
   >>> /local/folder/exclude
   >> 
   >> You may want to try different values for --lru-size
   >> and--upload-queue-size to see if that helps. Other than that, it may
   >> be that's as far as you get with Obanm, your data, and your Internet
   >> connection. If so, sorry.
   > 
   > Hi Lars,
   > 
   > thanks for your quick response.
   > Just to verify: I am using those two options as they're supposed to be used, right?
   > 
   > I will test other various options later, right now I am waiting for the initial backup to finish.
   > 
   > Can you confirm that this is related to the latency on the line?
   > 
   > Thanks
   > Markus
   > 
   > _______________________________________________
   > obnam-support mailing list
   > obnam-support@obnam.org
   > http://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/obnam-support-obnam.org
   
   _______________________________________________
   obnam-support mailing list
   obnam-support@obnam.org
   http://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/obnam-support-obnam.org
From: Markus Bonet <m.bonet@gmx.de>
Date: Wed, 03 Aug 2016 09:34:33 +0200

   Am 02.08.2016 um 16:53 schrieb Lars Wirzenius:
   >> obnam --lru-size=1024 --upload-queue-size=512 backup -r
   >> sftp://remote/folder /local/folder --exclude /local/folder/exclude
   >> 
   >> or
   >> 
   >> obnam backup -r sftp://remote/folder /local/folder --exclude
   >> /local/folder/exclude
   
   > You may want to try different values for --lru-size
   > and--upload-queue-size to see if that helps. Other than that, it may
   > be that's as far as you get with Obanm, your data, and your Internet
   > connection. If so, sorry.
   
   Hi Lars,
   
   thanks for your quick response.
   Just to verify: I am using those two options as they're supposed to be 
   used, right?
   
   I will test other various options later, right now I am waiting for the 
   initial backup to finish.
   
   Can you confirm that this is related to the latency on the line?
   
   
   Thanks
   Markus
   
   _______________________________________________
   obnam-support mailing list
   obnam-support@obnam.org
   http://listmaster.pepperfish.net/cgi-bin/mailman/listinfo/obnam-support-obnam.org
From: Lars Wirzenius <liw@liw.fi>
Date: Wed, 3 Aug 2016 11:30:27 +0300

   On Wed, Aug 03, 2016 at 09:34:33AM +0200, Markus Bonet wrote:
   > Just to verify: I am using those two options as they're supposed to be used,
   > right?
   
   Looks like it, yes. As I said, you may want to try various values to
   see if they affect performance.
   
   > Can you confirm that this is related to the latency on the line?
   
   More or less. I tend to say that Obnam is just slow, but latency
   affects a lot. In the future, I hope to avoid how much effect latency
   has on Obnam performance, but that work is still ongoing.