Backups

Warning

This documentation is for internal use. It may be of interest to users who are curious about our internal processes and architecture, but should not be mistaken for describing services that we offer or stable infrastructure that end users should rely upon. If you find yourself submitting a ticket about something on this page, you are probably making a mistake.

Proxmox Backup Server new PI backup configuration

Hive

For Hive, the PBS server is phoenix, the backups can be configured on any Hive system (or fs6), and the initial backup should be started from fs6.

Phoenix

./pbs/new-PI-group.sh {CLUSTER} {PI-group-name} and take note of the token value.

Note

root@phoenix.hpc: ~ # ./pbs/new-PI-group.sh hive {PIgrp}
Checking / creating datastore: hive-group-{PIgrp} in /phoenix/proxmox-backup-service/hive/{PIgrp} (slow)

!!!!! SAVE the value field of this token to the location indicated by the backup script. !!!!!
Result: {
"tokenid": "{PIgrp}@pbs!pbs-hive-{PIgrp}",
"value": "TOKEN-VALUE-HERE"
}

Hive

root@hive: ~ # /quobyte/pbs/bin/backup.sh group {PIgrp}

backup.sh: ERROR: no API password at $PBS_PASSWORD_FILE: /quobyte/pbs/group/{PIgrp}/backup.token
Generate an API token and put the 'value' part in that file.

Paste the token into the indicated file:

root@hive: ~ # vim /quobyte/pbs/group/{PIgrp}/backup.token

Generate the default config file and other required files.

root@hive: ~ # /quobyte/pbs/bin/backup.sh group {PIgrp}
/quobyte/{PIgrp}/.pbs/config does not exist, creating default.
Now you need to edit /quobyte/{PIgrp}/.pbs/config to set the QUOTA_IN_TB.

Edit the config file to set the quota, adjust the snapshots to keep, and set the email addresses of users who will receive the backup status.

root@hive: ~ # vim /quobyte/{PIgrp}/.pbs/config

Default config file

# This is the amount of backup or archive space you have purchased.
# See https://docs.hpc.ucdavis.edu/backups for details.
QUOTA_IN_TB="0" # <--- EDIT

# How many snapshots to keep. Available types are:
# --keep-last
# --keep-daily
# --keep-weekly
# --keep-monthly
# --keep-yearly
# Simulator: https://pbs.proxmox.com/docs/prune-simulator/
### NOTE: leave empty to indicate no snapshots of that type.
KEEP_LAST=
KEEP_DAILY=14  # <--- EDIT
KEEP_WEEKLY=5  # <--- EDIT
KEEP_MONTHLY=3 # <--- EDIT
KEEP_YEARLY=

# A list of space separated email addresses to send PBS output to.
MAIL_TO="" # <--- EDIT

Finally, start the backup. Depending on the amount of data already in {PIgrp}/BACKED-UP, this may take multiple days, so run the initial backup in screen and monitor closely.

root@fs6: ~ # screen
root@fs6: ~ # /quobyte/pbs/bin/backup.sh group {PIgrp}

Puppet

Once the initial backup finishes, edit data/backups.yaml and add {PIgrp} to the list so it is backed up automatically.

TODO: explain the layout