Well I've been bashing away at this rsync problem I've had and have finally found the cause, if not the cure.
I was trying to to a big rsync upload of data from my home Linux box to a remote system, a total of 35Mb or so and the rsync was simply hanging after a fairly short while, usually on big files.
It turns out that my router loses sync when doing the upload, it looks like it can't cope when saturated in the upload direction. It's a Zyxel 660H, I've fired off a report to their support people but I'm not sure how much good that's going to do.
A workaround for the moment is simply to limit the bandwidth that rsync uses, it has a convenient --bwlimit option to do exactly this. As it's just an overnight backup, making it a bit slower doesn't really matter. I'm testing it with the limit set to 64kb/s at the moment and it seems to be going OK.
Chris Green wrote:
Well I've been bashing away at this rsync problem I've had and have finally found the cause, if not the cure.
I was trying to to a big rsync upload of data from my home Linux box to a remote system, a total of 35Mb or so and the rsync was simply hanging after a fairly short while, usually on big files.
It turns out that my router loses sync when doing the upload, it looks like it can't cope when saturated in the upload direction. It's a Zyxel 660H, I've fired off a report to their support people but I'm not sure how much good that's going to do.
Fascinating. Do you know what chipset it uses? I wonder if it is a hardware limitation or something in the router SW?
Ian
On Thu, Jan 12, 2006 at 07:59:51PM +0000, Ian bell wrote:
Chris Green wrote:
Well I've been bashing away at this rsync problem I've had and have finally found the cause, if not the cure.
I was trying to to a big rsync upload of data from my home Linux box to a remote system, a total of 35Mb or so and the rsync was simply hanging after a fairly short while, usually on big files.
It turns out that my router loses sync when doing the upload, it looks like it can't cope when saturated in the upload direction. It's a Zyxel 660H, I've fired off a report to their support people but I'm not sure how much good that's going to do.
Fascinating. Do you know what chipset it uses? I wonder if it is a hardware limitation or something in the router SW?
I've no idea what chipset it uses.
It could very easily be a software/firmware problem I think, all it needs is some part of the housekeeping that can't quite keep up when the router is working flat out.
On Thu, 2006-01-12 at 21:09 +0000, Chris Green wrote:
It could very easily be a software/firmware problem I think, all it needs is some part of the housekeeping that can't quite keep up when the router is working flat out.
I've had similar problems with a couple of Netgear's in the past (only it was when I saturated a PPTP VPN running over them) In that case updating to the latest firmware image did the trick...I take it you are running the most current firmware version.
I also had (years ago it is in the list archives somewhere) a really strange problem where I could make my Alcatel Frog ADSL modem drop the line by listening to a shoutcast stream...anything else would be rock solid...but open up any stream and it would always drop within the hour. In the end the problem vanished when I added kernel modules to link up my Zaurus (should have been unrelated but they were to do with USB networking so who knows)....before that I had spent ages with MTU's etc to no avail.
-
Chris Green -
Ian bell -
Wayne Stallwood