tau.phas.ubc.ca

UBC Physics & Astronomy
tau.phas.ubc.ca
142.103.236.2 (PUBLIC) - 192.168.1.2 (server)

Machine Type: 7944-AC1, Serial No.: KQ872CY, Product name: IBM System x3550 M3 server
Warranty expires January 13 2014, 1-800-426-7378

MegaRAID Applications -> System Tools -> MegaRAID Storage Manager StartUpGuiUsername: rootPwd:root passwd
/usr/local/MegaRAID Storage Manager/startupui.sh

Local system engineers: Dave Peterson 604-297-2410(o), 604-551-5116(c) or Duncan Furniss
F1 - Setup Alt-F1 - Sysboot
To start IBM Director Server manually, run /opt/ibm/director/bin/twgstart
ServeRAID Adapter Quick Reference

System Info:
MegaRaid Storage Manager - /usr/local/MegaRAID\ Storage\ Manager/startupui.sh
MegaRAID_monitorconfig.xml file
MegaRaid Guide MegaCLI Guide

System Info

------------------------------------------------------------------
| 146GB | 146GB |                                                |
--------------------------------                                 |
| 146GB | empty |      DVD     |                                 |
------------------------------------------------------------------

11-03-08 Currently 12 cores - 24 threads, 24GB RAM, mirrored 146GB disks with hot spare. 9 free memory slots. 146 GB, 10K disks are FRU 43W7538.

RHEL6 Virtual Networking Setup

Sales Order Number: 2006952124,  Date: 2011-01-11
MAC Address 1: E4:1F:13:B6:88:B0 
MAC Address 2: E4:1F:13:B6:88:B2 

PartNo/
Feature  Qty   Description
-------  ---   ---------------------------------------------------------------
7944J2U   1    x3550 M3, Xeon 6C X5650 95W 2.66GHz/1333MHz/12MB, 3x4GB, 
               O/Bay 2.5in HS SAS/SATA, SR M5015, 675W p/s, Rack
   5076   1    PCI- Express (1 x 16 slot; LP) Riser Card 1            
   4375   1    PCI- Express (1 x 16; FH/HL)Riser Card 2            
   5088   1    IBM System x3650 M2 PCI- Expres      
   5663   1    System Common Planar for 1U/2U
   5693   1    IBM System x3550 M3 Base with 675W AC power supply
   5744   1    ServeRAID-M5000 Series Battery Assembly
   5770   1    IBM System x3550 M3 riser braket low profile
   8936   3    4GB (1x4GB, 2Rx4, 1.5V) PC3-10600 CL9 ECC DDR3-1333 
59Y4009   1    Addl Intel Xeon 6C Processor Model X5650 95W 2.66GHz/1333MHz/12MB cache
49Y1435   1    4GB (1x4GB, 2Rx4, 1.5V) PC3-10600 CL9 ECC DDR3 1333MHz LP RDIMM
42D0632   3    IBM 146GB 10K 6Gbps SAS 2.5" SSF Slim-HS HDD
46M0901   1    IBM UltraSlim Enhanced SATA DVD-ROM 
46M1075   1    IBM 675W Redundant AC Power Supply
          1    3 year Onsite Repair next day

Disaster Recovery

MySQL Backups Using ZRM

13-08-12 TLS error -8179:Peer's Certificate issuer is not recognized.

[root@tau]# ldapsearch -D "cn=manager,dc=phas,dc=ubc,dc=ca" -ZZ -W uid=rapugrad
ldap_start_tls: Connect error (-11)
	additional info: TLS error -8179:Peer's Certificate issuer is not recognized.

This was after I had installed the phas wildcard certificate from GoDaddy.
Solution

[root@tau]# pwd
/etc/pki/tls/certs
[root@tau]# cp phas.ubc.ca.crt phas.ubc.ca.crt.orig
[root@tau]# cat gd_bundle-g2.crt >> phas.ubc.ca.crt

12-11-21 Install AjaXplorer

  rpm -Uvh http://www.muug.mb.ca/pub/epel/6/i386/epel-release-6-7.noarch.rpm
  yum update
  yum install php-mcrypt
  yum reinstall http://dl.ajaxplorer.info/repos/el6/ajaxplorer-stable/ajaxplorer-release-4-1.noarch.rpm
  yum update
  yum install ajaxplorer
  service httpd restart
  diff /etc/ajaxplorer/bootstrap_conf.php /etc/ajaxplorer/bootstrap_conf.php.orig
32c32
< define("AJXP_LOCALE", "en_US.UTF-8");
---
> //define("AJXP_LOCALE", "en_EN.UTF-8");
59c59
< define("AJXP_FORCE_SSL_REDIRECT", true);
---
> //define("AJXP_FORCE_SSL_REDIRECT", true);
\ No newline at end of file

11-06-28 Run IBM UpdateXpress.

[root@tau]# /opt/IBM/UpdateXpress/uxspi440.rhel6

Hard Disk Drive		ibm_fw_hdd_sas-1.08.01_linux_32-64			32,927
IMM			ibm_fw_imm_yuoo91k-1.25_linux_32-64			36,050
Converged Netwk Adapter	qlgc_fw_nic_qle8142-1.01.94_linux_32-64			4,323
UXSP			ibm_utl_uxsp_d6sp07a-1.60_rhel6_32-64			1,328
SAS			ibm_fw_mpt2sas_1.07_linux_32-64				1,466
SAS			ibm_fw_sraidbr_10i-2.72_linux_32-64			1,264
SAS			ibm_fw_mptsas_3g-sashba-2.72_linux_32-64		1,109
SAS			ibm_fw_sraidbr_10il-v2-2.72_linux_32-64			1,058
SATA			ibm_fw_pmcraid_1.03_linux_32-64				2,002
ServeRAID		ibm_fw_sraidmr_10i-10is-11.0.1-0033a_linux_32-64	4,643
SAS			ibm_fw_sraidmr_10m-11.0.1-0033a_linux_32-64		4,636
SAS			ibm_fw_sraidmr_m5000-12.12.0-0039_linux_32-64		3,208
Diagnostics		ibm_fw_dsa_dsyt83d-3.33_linux_32-64			96,853
UEFI			ibm_fw_uefi_d6e150c-1.11_linux_32-64			3,653
SAS			ibm_fw_sraidmr_1015-20.10.1-0022_linux_32-64		2,951
Network			brcm_fw_nic_2.1.6a_linux_32-64				8,821
IMM			ibm_fw_imm_yuoo57h_linux_32-64				29,997

11-05-27 Needed to increase disk size on RHEL6 virtual server.

[root@tau]# cd /var/lib/libvirt/images/
[root@tau]# virt-filesystems --long -h --all -a RHEL6.img 
Using CPU model "cpu64-rhel6"
Name                      Type       VFS  Label Size Parent
/dev/sda1                 filesystem ext4 -     500M -
/dev/vg_taurhel01/lv_root filesystem ext4 -     5.6G -
/dev/vg_taurhel01/lv_swap filesystem swap -     3.9G -
/dev/vg_taurhel01/lv_root lv         -    -     5.6G /dev/vg_taurhel01
/dev/vg_taurhel01/lv_swap lv         -    -     3.9G /dev/vg_taurhel01
/dev/vg_taurhel01         vg         -    -     9.5G -
/dev/sda2                 pv         -    -     9.5G -
/dev/sda1                 partition  -    -     500M /dev/sda
/dev/sda2                 partition  -    -     9.5G /dev/sda
/dev/sda                  device     -    -     40G  -

[root@tau ~]# truncate -s 40G outdisk
[root@tau ~]# virt-resize --expand /dev/sda2 RHEL6.img outdisk
[root@tau ~]# ls -l
[root@tau ~]# mv RHEL6.img RHEL6.img.old
[root@tau ~]# mv outdisk RHEL6.img
[root@tau ~]# chown root:root RHEL6.img
[root@tau ~]# chmod go-r RHEL6.img
[root@tau ~]# ls -l

Now, boot RHEL6 server system.

[root@tau-rhel01] /usr/sbin/system-config-lvm&
-> Logical View
  -> Click on the LogVol
    -> Edit Properties
      -> Drag button to resize

11-03-16 Run UpdateXpress. First download uxspi430.rhel6 from http://www-947.ibm.com/support/entry/portal/docdisplay?lndocid=SERV-XPRESS

[root@tau ~]# cd /tmp
[root@tau tmp]# chmod +x uxspi430.rhel6 
[root@tau tmp]# ./uxspi430.rhel6 
-bash: ./uxspi430.rhel6: /lib/ld-linux.so.2: bad ELF interpreter: No such file or directory
[root@tau tmp]# yum install compat-libstdc++-296
[root@tau tmp]# ./uxspi430.rhel6

11-03-16 Needed to increase disk size on Win2008 virtual server.

[root@tau ~]# cd /var/lib/libvirt/images/
[root@tau ~]# truncate -s 40G Win2008-1.img

Now, boot Win2008 server system but boot from Gparted Live image.
Resize the partition using all the available free space.
Reboot the Win2008 virtual server.  It will automatically run checks 
on the file the file system and then boot normally.

Force page loads to go through HTTPS
Assuming you already have SSL installed and configured correctly in your webserver for whatever directory phpMyAdmin is in, open up the index.php file, and at the very top, just after the comments end, but before the includes, add these few lines:

if '$_SERVER["SERVER_PORT"] != 443'{
$head = "Location: https://" . $_SERVER["HTTP_HOST"] .  $_SERVER["REQUEST_URI"];
header'$head';
exit;
}

11-02-02
Turned off iptables - control all access through FWSM.

bacula-5.0.2 installed

mod_evasive installed

FIX Installed RAID monitoring Software ( ServeRAID MR Support CD)

cd /usr/local/src
mount -o loop ibm_sw_sraidmr_10.35_anyos_32-64.iso /mnt/iso
yum install libXp
yum install net-snmp
cd /mnt/iso/MSM/Linux/
./install.sh 
[root@omega Linux]# rpm -qa | grep -i mega
MegaRAID_Storage_Manager-2.91-03

YYY home

ZZZ home

NOTES:
passwd, shadow, group files: rsync'd from alpha hourly via /etc/cron.hourly/passwd
/www: samba shared (/var/httpd/htdocs only to trek/ada2)
WWW STATS

After editing httpd.conf, run the apachectl configtest to test your config.

RSYNC info:
[root@www sysadmin]# crontab -l

09-06-26 Ran UpdateXpress:

[root@omega]# cd /opt/sysadmin/IBM/UpdateXpress
[root@omega UpdateXpress]# ./uxspi300.rhel5 &

(1) Broadcom BNX2 RHEL5 Driver
	Name: Broadcom BNX2 RHEL5 Driver
	New Version: 	bnx2-1.8.2b
	Reboot: 	Reboot Required to take effect
	Status: 	Successfully Installed

(2) IBM and LSI Basic or Integrated RAID SAS Controller Driver
	Name: IBM and LSI Basic or Integrated RAID SAS Controller Driver
	New Version: 	4.16.80.01
	Reboot: 	Reboot Required to take effect
	Status: 	Successfully Installed

Installed phpMyAdmin

DISASTER RECOVERY

Install a new server.
Load RHEL V5.

Additional, non-critical items to take care of:

Install APCUPSD
Check webalizer installation (web stats).

DISASTER RECOVERY

Install a new server.
Load RHEL V5 (or newer).
Make sure you select to install the web server and associated modules.
Make sure you select to install the mysql server and associated modules.
Copy over backup files from alpha:/home/backups/www (these files are rsync'd daily).
Make sure mysqld and httpd are started.
Make sure to set a root password for mysqld (admin -u root password newpassword).
Install phpMyAdmin. Create phpMyAdmin dbases: mysql -u root -p < create_tables_mysql_4_1_2+.sql
Install php-mbstring package from redhat network package archive so phpMyAdmin doesn't complain.
Get include files installed into /php/includes.
Check /etc/php.ini configuration file.

Check /etc/http/conf configuration files including certificate files.

/etc/http/conf/ssl.crt/www.phas.ubc.ca.crt
               /etc/http/conf/ssl.crt/gd_bundle.crt
               /etc/http/conf/ssl.key/www.phas.ubc.ca.key

Install MySQL-zrm.

Additional, non-critical items to take care of:

Install APCUPSD
Check webalizer installation (web stats).

MySQL Backups
Using Zmanda (ZRM for MySQL Community Edition - version 1.2.1)

The MySQL databases are backed up nightly (see crontab -l output below).
Configuration data is kept in files in /etc/mysql-zrm.
Backups are kept in /home/backups/omega/var/lib/mysql-zrm
Logs are kept in /var/log/mysql-zrm

To run a backup immediately: mysql-zrm-scheduler --now --backup-set BackupSet01[02,03]
To Schedule a (daily at 5am) backup: mysql-zrm-scheduler --add --interval daily --start 05:00 --backup-level 0 --backup-set BackupSet01
Verification that scheduler has been configured: mysql-zrm-scheduler --query

Backup Reports:

mysql-zrm-reporter --help (to see all options)
mysql-zrm-reporter --destination /home/backups/omega/var/lib/mysql-zrm/ --where backup-set=daily --show backup-method-info
mysql-zrm-reporter --destination /home/backups/omega/var/lib/mysql-zrm/ --where backup-set=daily --show backup-retention-info
mysql-zrm-reporter --destination /home/backups/omega/var/lib/mysql-zrm/ --where backup-set=monthly --show backup-performance-info
mysql-zrm-reporter --destination /home/backups/omega/var/lib/mysql-zrm/ --where backup-set=monthly --show restore-full-info
mysql-zrm-reporter --destination /home/backups/omega/var/lib/mysql-zrm/ --where backup-set=daily --show restore-incr-info

Restoring Databases:

Find our which backups are available:

mysql-zrm-reporter --destination /home/backups/omega/var/lib/mysql-zrm/ --where backup-set=daily -show restore-info
mysql-zrm-reporter --destination /home/backups/omega/var/lib/mysql-zrm/ --where backup-set=monthly -show restore-info

Assuming you want to restore the backup which is in /home/backups/omega/var/lib/mysql-zrm/monthly/20061114144656:

mysql-zrm --action restore --backup-set monthly --source-directory /home/backups/omega/var/lib/mysql-zrm/monthly/20061114144656

webmaster@phas.ubc.ca

[Dept. Home Page]

last updated: 11-03-08

System Info: MegaRaid Storage Manager - /usr/local/MegaRAID\ Storage\ Manager/startupui.sh MegaRAID_monitorconfig.xml file MegaRaid Guide MegaCLI Guide

System Info

System Info:
MegaRaid Storage Manager - /usr/local/MegaRAID\ Storage\ Manager/startupui.sh
MegaRAID_monitorconfig.xml file
MegaRaid Guide MegaCLI Guide