Technical Support Pages


How Can I Make S3CLOUD Backups Go Faster?
Product Release(s)
03.04.0x 03.03.0x 03.02.0x
Operating System(s)
All Supported
Problem Description
I would like to increase the performace of Internet / Intranet Backups using S3CLOUD Resources
S3CLOUD Resources in BackupEDGE Releases before 03.02.01 build 3 had some limitations in Segement size and overall efficiency.
Use BackupEDGE 03.02.01 build 7 or later.

BackupEDGE 03.02.01 build 3 and later have had the S3 Resource code re-written and optimized for higher performance. In addition, the new default segment size is 512000 instead of 51200 1k Blocks, which provides additional benefits.
BackupEDGE 03.02.01 build 7 and later further increase efficiencies, especially for servers with very memory resources.

After upgrading from a release prior to 03.02.01 build 3, all newly created S3CLOUD Resources will get the larger segment size automatically.

While performance of existing Resources will increase immediately with the installation of the new release, additional increases can be had by manually updating the segment size of previously created Resources.

Edit the file /usr/lib/edge/config/devices.def using a text editor like vi or nano.
- Search for "TYPE s3cloud".
- Within each s3cloud entry, change "SEGMENT_SIZE=51200" to "SEGMENT_SIZE=512000".
- Exit the editor and type "edge.tape". This will re-compile the Resource database in BackupEDGE.

Do not exceed 512000 as memory usage issues will result. BackupEDGE will still deal with older backups just fine, but newer backups will have segments 10 times larger, which will also reduce segment overhead.

If you have a system with 1GB or less RAM, try setting SEGMENT_SIZE to 256000 or 128000. Perform multiple backups to see which SEGMENT_SIZE has the fastest net backup and verify time.

Get a printer-friendly version of this document



Last Updated - 2022/01/03