Other aop/backups

Table Of Contents

Previous topic

SVN/Trac

Next topic

Monitoring

This Page

Daya Bay Links

Content Skeleton

Backups Overview

Availability of Backups

Although IHEP claims to perform file level backup, simple file copying is not a reliable way to backup databases (or Trac/SVN repositories) as no locking is done. Also as far as I am aware there is no way that users can verify the backups. For me, backups that are not auto-verified and rapidly accessible are effectively useless.

Anyone who is responsible for a server should be in control of the backups of that server. It is invaluable to be able to recover the server onto a remote node as a debugging aid to help to check a migration for example.

Backup requires creation of archive tarballs and scp/rsync-ing them off the original servers.

SVN/Trac backups

digraph replication {
size="8,8" ;
pad=0.6 ;

subgraph tw {
   style = "filled" ;

   cms01 [ label="cms01.phys.ntu.edu.tw" ]
   cms02 [ label="cms02.phys.ntu.edu.tw" ]
   hep1  [ label="hep1.phys.ntu.edu.tw" ]
   belle7 [ label="belle7+1.nuu.edu.tw" ]

   cms02 -> hep1 [ color="green", label="env" ];
   cms02 -> cms01 [ color="green", label="env"  ];
   cms02 -> belle7 [ color="red" ];

   label = "TW" ;
}

subgraph ihep {

   dayabay [ label="dayabay.ihep.ac.cn" ]

   label = "IHEP" ;
}

dayabay -> cms01 [ label="dybsvn" ] ;
}

  • dybsvn instance is backed up and the tarballs transferred to NTU daily
  • dybaux is not currently backed up
  • env aberdeen instances are backed up and transferred to several other NTU nodes daily

Trac+SVN backup/transfer describes in detail how the scripts for backup/transfer/monitoring operate. Monitoring describes how these are automated with cron tasks.

MySQL backups

  • offline_db is backed up daily and tarballs transferred to NTU with scp
  • channelquality_db is backed up in a partitioned manner due to its large size and the tarballs transferred to NTU daily

digraph replication {
size="8,8" ;
pad=0.6 ;

subgraph tw {
   style = "filled" ;

   cms01 [ label="cms01.phys.ntu.edu.tw" ]

   label = "TW" ;
}

subgraph ihep {

   dybdb1 [ label="dybdb1.ihep.ac.cn"] ;
   dybdb2 [ label="dybdb2.ihep.ac.cn"] ;

   label = "IHEP" ;
}

dybdb1 -> cms01 [ label="offline_db" ] ;
dybdb2 -> cms01 [ label="offline_db" ] ;
dybdb2 -> cms01 [ label="channelquality_db" ] ;
}