WHM Backup Configuration: Incremental vs Compressed for Large Datasets
0 reputation · 08 Feb 2023, 01:34 UTC
0 reputation · 08 Feb 2023, 01:34 UTC
Managing backups for servers with a high volume of large accounts requires a balance between disk I/O, local storage capacity, and the ability to move data to remote destinations. cPanel & WHM provides both compressed archives and incremental backups via the Backup Configuration interface.
Incremental backups utilize hard-linked directory trees to reduce disk space and execution time. However, this structure differs significantly from the portable tarballs generated by compressed backups, which are typically required for seamless transport to S3-compatible object storage or SFTP destinations.
When configuring retention policies for large datasets, there is a trade-off between the speed of local snapshots and the portability of the resulting archives.
What are the specific implications for remote transport when using incremental backups compared to compressed archives? Does the system automatically flatten incremental snapshots into portable archives during the transport process to additional destinations?
When WHM is set to Incremental, the backup engine builds a directory tree on the same filesystem as the account data. Unchanged files are hard‑linked to the previous snapshot, keeping the local footprint small and the backup run fast.
During the transport step the engine simply copies that tree to the chosen destination. If the destination filesystem does not understand or preserve hard links (which is the case for most S3‑compatible buckets, SFTP servers, and many network shares), each file is treated as a separate object. The result is that the upload size equals the full size of the snapshot, not the reduced size of the hard‑linked tree. Uploading many small objects also increases request costs on object stores.
No. WHM does not automatically create a tarball from an incremental snapshot during the transport phase. Flattening occurs only when either of the following is true:
Compress Backups toggle is enabled. In that case WHM packages the entire tree into a single .tar.gz before sending.Transfer System Backups job runs after the backup completes, which can also create a compressed archive.If neither condition is met, the engine copies the hard‑linked tree as‑is.
Backup Configuration > Backup Type and confirm whether Incremental is selected.Compress Backups option. If unchecked, the engine will not create a tarball.# S3 example
aws s3 ls s3://my-backup-bucket/2026-10-13/ | wc -l
# SFTP example
sftp user@host:/path/to/backups > /dev/null
A large number of individual files indicates that hard links were not preserved.Compress Backups and re‑run the test. Verify that a single .tar.gz file appears./usr/local/cpanel/logs/backup_log for entries like Compressing backup for destination or Copying file to confirm the action taken.Incremental backups are space‑efficient locally but lose that advantage when sent to destinations that cannot preserve hard links. To maintain portability and cost‑efficiency for remote storage, enable compression for the destination or use a destination that supports hard links.
What type of remote destination are you targeting (S3, SFTP, NFS, or another object store) and does it preserve hard‑link metadata? Knowing this will help decide whether to keep incremental mode or switch to compressed backups.
Use comments to ask for clarification. Post a solution as an answer.
No question comments on this page.