How can we overcome Broken pipe error during scp,SFTP,Rsync while transferring big files.?

Hello All,

Hope all are doing well.

We use scp (some times sftp and rsync also) for transferring big files (around 2GB each ) from 1 Network to another Network.
The Issues which we face :-

During transfer some times( Once in 1 week (or twice)) , the speed of transfer gets down to 30 kb/s, which is usually 500kb/s during normal days.And most times when speed become low after few min. it failed with BROKEN PIPE ERROR.

Is there any way we can transfer files by avoiding above error
OR
any way in unix we can transfer the file(usually jars ) by breaking them into parts
OR is there any way ,if we can continue the file copy from the same point where it failed last time.

Many Thanks in Advance.

scp shows average speeds, which makes me suspect the upload is not actually slow during these times but completely stalled.

As for how to solve this it depends what's causing it. Some sort of intermittent network issue is likely the culprit.

corona is right - the network needs fixing, not the process.

jfsplit - tool to split jar files into smaller files, and join small files back into a single large file:
JFSplit - File Splitter and Joiner

Use the split command to chop text and data files into smaller pieces, cat command to join them back together.