rsync with new backup system
Completed
Would like new backup system to use rsync
I like this idea 
cPanel, WebHost Manager and WHM are registered trademarks of cPanel, L.L.C. for providing its computer software that facilitates the management and configuration of Internet web servers.
We have added rsync as a remote destination in version 66. You will see it listed here: https://documentation.cpanel.net/display/66Docs/Backup+Configuration#BackupConfiguration-AdditionalDestinations
You can read about all the improvements on the version 66 Release Site.
We have added rsync as a remote destination in version 66. You will see it listed here: https://documentation.cpanel.net/display/66Docs/Backup+Configuration#BackupConfiguration-AdditionalDestinations
You can read about all the improvements on the version 66 Release Site.
It would be great to use rsync to send files across to an offsite location - all from within the WHM interface.
That said, something's changed between the old and new backup systems. There's now hardly any bandwidth saving in using rsync - somehow the compression isn't incrementally efficient. It always used to be - I used to get away with transferring only a third of the size of the total backup.
So there are two parts to this request, in my opinion.
1. Allow rsync as an offsite location in the new backup system.
2. Make the new backup system compression algorithm work with rsync, so that we don't have to transfer 100% of the backups every time.
It would be great to use rsync to send files across to an offsite location - all from within the WHM interface.
That said, something's changed between the old and new backup systems. There's now hardly any bandwidth saving in using rsync - somehow the compression isn't incrementally efficient. It always used to be - I used to get away with transferring only a third of the size of the total backup.
So there are two parts to this request, in my opinion.
1. Allow rsync as an offsite location in the new backup system.
2. Make the new backup system compression algorithm work with rsync, so that we don't have to transfer 100% of the backups every time.
Agreed, I'm not even sure why rsync wasn't the primary focus of the new backup system since that is what almost everyone is using for off-server backups. We don't use rsync for the compression (though many do), we use it for the ability to keep transfers of home directory files to a minimum (delta changes only) and for much greater control over how files can be stored.
Honestly, I don't see any improvement in the new backup system over the old unless it has tight rsync integration in it. For now we just keep paying for cpremote plugin, bundled with our own separate pkgacct+rsync scripts.
Agreed, I'm not even sure why rsync wasn't the primary focus of the new backup system since that is what almost everyone is using for off-server backups. We don't use rsync for the compression (though many do), we use it for the ability to keep transfers of home directory files to a minimum (delta changes only) and for much greater control over how files can be stored.
Honestly, I don't see any improvement in the new backup system over the old unless it has tight rsync integration in it. For now we just keep paying for cpremote plugin, bundled with our own separate pkgacct+rsync scripts.
This is tough for larger deployments, it would take so long to do backups that when one was done it would be time for another backup. This is a great solution for smaller installs but doesn't work for our use cases.
This is tough for larger deployments, it would take so long to do backups that when one was done it would be time for another backup. This is a great solution for smaller installs but doesn't work for our use cases.
Is the issue with rsync not being efficiënt resolved?
Is the issue with rsync not being efficiënt resolved?
@ralfonso, I use rsync ssh with just over a dozen web sites, two of them with very large content bases to an appropriate resourced NAS in my office.
NOTE: I am NOT using the rsync feature within WHM but my own scripts. The WHM feature just kept confusing me and causing authentication problems -- which is on me, not on cPanel.
The first backup did take a significant amount of time, but from then on it is barely noticeable. I use the link-dest parameter so literally only those bytes that have changed are transmitted.
I've been running this process for many years and it has yet to let me down.
The challenging part was getting the ssh keys working so that the two machines would talk to one another.
I think all of this can be done with a relatively simple script for a moderately skilled cPanel tech because I did it as an unskilled hobbyists.
@ralfonso, I use rsync ssh with just over a dozen web sites, two of them with very large content bases to an appropriate resourced NAS in my office.
NOTE: I am NOT using the rsync feature within WHM but my own scripts. The WHM feature just kept confusing me and causing authentication problems -- which is on me, not on cPanel.
The first backup did take a significant amount of time, but from then on it is barely noticeable. I use the link-dest parameter so literally only those bytes that have changed are transmitted.
I've been running this process for many years and it has yet to let me down.
The challenging part was getting the ssh keys working so that the two machines would talk to one another.
I think all of this can be done with a relatively simple script for a moderately skilled cPanel tech because I did it as an unskilled hobbyists.
We have added rsync as a remote destination in version 66. You will see it listed here: https://documentation.cpanel.net/display/66Docs/Backup+Configuration#BackupConfiguration-AdditionalDestinations
You can read about all the improvements on the version 66 Release Site.
We have added rsync as a remote destination in version 66. You will see it listed here: https://documentation.cpanel.net/display/66Docs/Backup+Configuration#BackupConfiguration-AdditionalDestinations
You can read about all the improvements on the version 66 Release Site.
Replies have been locked on this page!