UBC PHAS Backup Strategy

BACKUP POLICY


BACKUP SCHEDULES

Backup Schedules

BACKUP STRATEGY

EduCloud Backups

Basically, for a production VM, there is 7 days of local backup copies, and 28 days and 12 weekly copies saved to the Okanagan. If we need to restore the VM, we can submit a request to have the VM restored from backup and specify a date. 1.) VSS environment is backed up daily for 7 days locally and then vaulted to the okanagan with 12 weekly backups. 2.) The Home drive service is different and copies are only kept for 30 days. You can findrestore details on home driver here: https://it.ubc.ca/services/web-servers-storage/home-drive-storage-service/setup-documents And the VSS environment here: (same as educloud retention) https://it.ubc.ca/services/web-servers-storage/educloud-server-service/educloud-faq#backup

MySQL-zrm Backups

root@mysql2# mysql-zrm-scheduler --query
schedule:INFO: ZRM for MySQL Community Edition - version 3.0
Logging to /var/log/mysql-zrm/mysql-zrm-scheduler.log
30 4 * * 1-5 /usr/bin/zrm-pre-scheduler --action backup --backup-set Omega_Set01 --backup-level 1 --interval weekly
30 4 * * 6 /usr/bin/zrm-pre-scheduler --action backup --backup-set Omega_Set01 --backup-level 0 --interval weekly
30 5 * * 1-5 /usr/bin/zrm-pre-scheduler --action backup --backup-set Delta_Set01 --backup-level 1 --interval weekly
30 5 * * 6 /usr/bin/zrm-pre-scheduler --action backup --backup-set Delta_Set01 --backup-level 0 --interval weekly
30 8 * * 6 /usr/bin/zrm-pre-scheduler --action backup --backup-set Foggy_Set01 --backup-level 0 --interval weekly
[root@borg ~]# mysql-zrm-scheduler --query
schedule:INFO: ZRM for MySQL Community Edition - version 3.0
Logging to /var/log/mysql-zrm/mysql-zrm-scheduler.log
45 4 * * 1-5 /usr/bin/zrm-pre-scheduler --action backup --backup-set Omega_Set01 --backup-level 1 --interval weekly
45 4 * * 6 /usr/bin/zrm-pre-scheduler --action backup --backup-set Omega_Set01 --backup-level 0 --interval weekly
45 5 * * 1-5 /usr/bin/zrm-pre-scheduler --action backup --backup-set Delta_Set01 --backup-level 1 --interval weekly
45 5 * * 6 /usr/bin/zrm-pre-scheduler --action backup --backup-set Delta_Set01 --backup-level 0 --interval weekly 

snapshot Backups

phas-fs
snapshot_root   /ut01/rSnapShots/
interval        hourly  6
interval        daily   7
interval        weekly  4
interval        monthly 12
verbose         2
loglevel        3
logfile /var/log/rsnapshot
one_fs          1
link_dest       1

backup  /etc/           phas-fs/
backup  /usr/local/     phas-fs/
backup  /root/          phas-fs/
backup  /var/spool/cron/        phas-fs/

backup  root@alpha.phas.ubc.ca:/etc/                                    alpha/
backup  root@alpha.phas.ubc.ca:/root/                                   alpha/
backup  root@alpha.phas.ubc.ca:/var/spool/cron/                         alpha/
backup  root@alpha.phas.ubc.ca:/opt/sysadmin/                           alpha/

backup  root@beta.phas.ubc.ca:/etc/                                     beta/
backup  root@beta.phas.ubc.ca:/root/                                    beta/
backup  root@beta.phas.ubc.ca:/var/spool/cron/                          beta/
backup  root@beta.phas.ubc.ca:/var/spool/mqueue/                        beta/
backup  root@beta.phas.ubc.ca:/opt/sysadmin/                            beta/

backup  root@borg.phas.ubc.ca:/etc/                                     borg/
backup  root@borg.phas.ubc.ca:/root/                                    borg/
backup  root@borg.phas.ubc.ca:/usr/local/bin/                           borg/
backup  root@borg.phas.ubc.ca:/usr/local/MegaRAID_Storage_Manager/      borg/
backup  root@borg.phas.ubc.ca:/var/spool/cron/                          borg/
backup  root@borg.phas.ubc.ca:/opt/                                     borg/

backup  root@delta.phas.ubc.ca:/etc/                                    delta/
backup  root@delta.phas.ubc.ca:/root/                                   delta/
backup  root@delta.phas.ubc.ca:/var/spool/cron/                         delta/

backup  root@dns.phas.ubc.ca:/etc/                                      dns/
backup  root@dns.phas.ubc.ca:/root/                                     dns/    exclude=gconf,exclude=firmware
backup  root@dns.phas.ubc.ca:/usr/local/bin/                            dns/
backup  root@dns.phas.ubc.ca:/var/spool/cron/                           dns/
backup  root@dns.phas.ubc.ca:/var/named/chroot/                         dns/    exclude=dev,exclude=proc

backup  root@foggy.phas.ubc.ca:/etc/                                    foggy/
backup  root@foggy.phas.ubc.ca:/root/.ssh/                              foggy/
backup  root@foggy.phas.ubc.ca:/opt/fog/                                foggy/
backup  root@foggy.phas.ubc.ca:/tftpboot/                               foggy/
backup  root@foggy.phas.ubc.ca:/var/spool/cron/                         foggy/
backup  root@foggy.phas.ubc.ca:/var/www/                                foggy/

backup  root@gamma.phas.ubc.ca:/etc/                                    gamma/
backup  root@gamma.phas.ubc.ca:/root/.ssh/                              gamma/
backup  root@gamma.phas.ubc.ca:/var/spool/cron/                         gamma/
backup  root@gamma.phas.ubc.ca:/var/www/                                gamma/  exclude="pubHtml/",exclude=00_archive/,exclude=00_DeleteThisStuff/

backup  root@hyper.phas.ubc.ca:/etc/                                    hyper/
backup  root@hyper.phas.ubc.ca:/root/                                   hyper/
backup  root@hyper.phas.ubc.ca:/var/spool/cron/                         hyper/
backup  root@hyper.phas.ubc.ca:/opt/sysadmin/                           hyper/
backup  root@hyper.phas.ubc.ca:/usr/local/bin/                          hyper/
backup  root@hyper.phas.ubc.ca:/usr/local/src/                          hyper/

backup  root@ipa.phas.ubc.ca:/etc/                                      ipa/
backup  root@ipa.phas.ubc.ca:/opt/                                      ipa/
backup  root@ipa.phas.ubc.ca:/root/.ssh/                                ipa/
backup  root@ipa.phas.ubc.ca:/var/db/                                   ipa/
backup  root@ipa.phas.ubc.ca:/var/kerberos/                             ipa/
backup  root@ipa.phas.ubc.ca:/var/lib/                                  ipa/
backup  root@ipa.phas.ubc.ca:/var/named/                                ipa/
backup  root@ipa.phas.ubc.ca:/var/spool/cron/                           ipa/
backup  root@ipa.phas.ubc.ca:/var/www/                                  ipa/

backup  root@kratos.phas.ubc.ca:/etc/                                   kratos/
backup  root@kratos.phas.ubc.ca:/root/                                  kratos/
backup  root@kratos.phas.ubc.ca:/var/spool/cron/                        kratos/
backup  root@kratos.phas.ubc.ca:/opt/sysadmin/                          kratos/
backup  root@kratos.phas.ubc.ca:/usr/local/bin/                         kratos/
backup  root@kratos.phas.ubc.ca:/usr/local/src/                         kratos/

backup  root@ldap2.phas.ubc.ca:/etc/                                    ldap2/
backup  root@ldap2.phas.ubc.ca:/root/.ssh/                              ldap2/
backup  root@ldap2.phas.ubc.ca:/var/db/                                 ldap2/
backup  root@ldap2.phas.ubc.ca:/var/lib/ldap/                           ldap2/
backup  root@ldap2.phas.ubc.ca:/var/spool/cron/                         ldap2/

backup  root@mail.phas.ubc.ca:/etc/                                     mail/
backup  root@mail.phas.ubc.ca:/root/.ssh/                                       mail/
backup  root@mail.phas.ubc.ca:/var/spool/cron/                          mail/
backup  root@mail.phas.ubc.ca:/var/spool/mqueue/                        mail/
backup  root@mail.phas.ubc.ca:/opt/                                     mail/   exclude="DS3200_SupportCD_V1.5"

backup  root@mirgserver.phas.ubc.ca:/etc/                               mirgserver/
backup  root@mirgserver.phas.ubc.ca:/root/.ssh/                         mirgserver/
backup  root@mirgserver.phas.ubc.ca:/var/spool/cron/                    mirgserver/

backup  root@omega.phas.ubc.ca:/etc/                                    omega/
backup  root@omega.phas.ubc.ca:/root/.ssh/                              omega/
backup  root@omega.phas.ubc.ca:/root/drush-backups/                     omega/
backup  root@omega.phas.ubc.ca:/var/spool/cron/                         omega/
backup  root@omega.phas.ubc.ca:/opt/sysadmin/                           omega/  exclude="IBM/"

backup  root@tau.phas.ubc.ca:/etc/                                      tau/
backup  root@tau.phas.ubc.ca:/root/.ssh/                                tau/
backup  root@tau.phas.ubc.ca:/var/db/                                   tau/
backup  root@tau.phas.ubc.ca:/var/lib/libvirt/                          tau/
backup  root@tau.phas.ubc.ca:/var/spool/cron/                           tau/
backup  root@tau.phas.ubc.ca:/usr/local/                                tau/

rsync Backups

qmi: /usr/local/bin/rsyncFromgamma
03:10 am starts - typically less than 1m
backup from gamma to qmi:
/var/lib/mysql/
/var/www

phas-fs:  /usr/local/sbin/mailRsyncBackup
04:30 am starts - typically approx 85 mins
backup from mail to phas-fs:
/etc
/opt/sysadmin
/var/named
/var/spool
/mail/home
/mail/home2
/mail/mailman
/mail/slist

kratos: /usr/local/sbin/rsyncFromAlpha
17:30 hrs begins  - typically 60mins
backup from alpha to kratos:
/newton
/ahome
/home
home2 

Bacula

  1. FULL backups are done the first Saturday of each month.
  2. DIFFERENTIAL backups are done every Saturday (except the first one) of each month.
  3. INCREMENTAL backups are done every day except Saturday.
DIFFERENTIAL backups include all files that have changed since the last FULL backup. INCREMENTAL backups include all files that have changed since the last backup of any kind.
  1. FULL backups are done to dedicated tapes that are archived indefinitely. The most recent tapes are stored in the server room and the rest are stored in a metal cabinet in the Hebb building.
  2. DIFFERENTIAL and INCREMENTAL backups are done to the same tapes. These tapes are re-used after eight (8) weeks.

WHAT THIS MEANS...
  1. Data is not backed up until sometime after 10:30pm daily so any data saved between when the last backup finished and the new backup starts will be lost if the system goes down.
  2. After eight weeks, only the data on the MONTHLY backup tapes is available. No data from between MONTHLY backups is available.
Since data is only backed up on a daily basis, it is possible to lose email that arrives and is deleted, removed, changed, lost, etc. before the next backup is performed.

Bacula

BackupPC

Home Dirs Rsync

Mail Dirs Rsync



DIRECTORY AND FILE EXCLUDE LISTS

The following files and directories are excluded from all backups.
Directories: cache Cache core Desktop junk Junk temp tmp trash Trash
Files: *.aux *.avi *.bak cache Cache core core.* *.desktop *.help *.iso *.log *.mp3 .netscape *.ogg *.old *.OLD *.pcf *.rpm spam SPAM SPAM_PMX SPAM_PMX.old *.temp *.tmp *.ttf *.wav
Paths: /home/backups
alpha:
::::::::::::::
/usr/netvault/etc/backuppathexclusions.txt
::::::::::::::
/home/backups
/home/backups/
::::::::::::::
/usr/netvault/etc/backuppatternonlyexclusions.txt
::::::::::::::
cache/
Cache/
core/
Desktop/
junk/
Junk/
lost+found/
tmp/
temp/
trash/
Trash/
TT_DB/
.Trash/
*.aux
*.avi
*.bak
*.bac
*.cache
*.Cache
core
core.*
*.desktop
*.help
*.iso
*.log
*.mp3
.netscape
*.ogg
*.old
*.OLD
*.pcf
*.rpm
spam
SPAM
SPAM_PMX
SPAM_PMX.old
*.temp
*.tmp
*.ttf
*.wav

TAPE BACKUP EQUIPMENT
These backups are all done to the following equipment:
  1. StorageTek L20 (with 10 slots) attached to one Adaptec 29160 SCSI controller, sync at 80MB/sec, 68-pin HD LVDS connector Ultrium-230: 200/400Gb, 16MB Buffer, Sustained rate 15 MB/s (54 GB/hr) native, 30 MB/s (108 GB/hr) compressed, Burst rate of xxMB/s, data rate-matching range xxxMB/s
  2. HP Ultrium-215 attached to second Adaptec 29160 SCSI controller, sync at 80MB/sec, 68-pin HD LVDS connector Ultrium-215: 100/200Gb, 16MB Buffer, Sustained rate 7.5 MB/s (27 GB/hr) native, 15 MB/s (54 GB/hr) compressed, Burst rate of 80MB/s, data rate-matching range 6-7.5MB/s

For more assistance contact Ron Parachoniak, rap@phas.ubc.ca ( Sysadmin)
 
webmaster@phas.ubc.ca [Dept. Home Page] last updated: 14 Sep 06