LDOM migration on sparc T- series servers

Prechecks:-
1)cross verify both physical boxes have enough resources to migrate one to anoter
2)make vds device serivces availbe on both nodes.(storeage will be visible to both nodes)
3)it is always better similar configurations on both boxes. i.e colone to one another
4)always go for navtive multipathing to avoid unexpected problems.



1)To know the list of ldoms

#ldm list
NAME             STATE      FLAGS   CONS    VCPU  MEMORY   UTIL  NORM  UPTIME
primary          active     -n-cv-  UART    8     16G      6.1%  6.1%  89d 21h 50m
secondary        active     -n--v-  5000    8     16G       15%   15%  89d 21h 50m
testdomain       active     -n----  5003    64    128G     1.6%  1.6%  82d 21h 23m


2)To Migrate domain form source server to destination.

#ldm migrate -n  testdomain   targetserver
Target Password:


3)To know the status
#ldm list testdomain
NAME             STATE      FLAGS   CONS    VCPU  MEMORY   UTIL  NORM  UPTIME
testdomain         bound      -----t  5003    64    128G


#date
Saturday, February  4, 2017 01:08:34 AM EST

#ldm list -o status testdomain
NAME
testdomain

STATUS
    OPERATION   PROGRESS        SOURCE
    migration    7%             targetcontroldomain

#ldm list -o status testdomain
NAME
testdomain

STATUS
    OPERATION   PROGRESS        SOURCE
    migration    99%             targetcontroldomain


#ldm list -o status testdomain
NAME
testdomain

OVMAPI_6000E Internal Error: Connection refused Connection refused (or) unable to login OVMM through web browser?

1)check the logs related to error on ovmm console.

login to ovmm server and check below file

[root@ovmmanager01 logs]# pwd
/u01/app/oracle/ovm-manager-3/machine1/base_adf_domain/servers/AdminServer/logs
[root@ovmmanager01 logs]# ls -l AdminServer-diagnostic.log
-rw-r----- 1 oracle dba 227846 Jan  5 03:32 AdminServer-diagnostic.log



identified ovs user expired.

2)stop oracle vm manager.

[root@ovmmanager01 bin]# /etc/init.d/ovmm stop
Stopping Oracle VM Manager                                 [  OK  ]
[root@ovmmanager01 bin]# /etc/init.d/ovmm start
Starting Oracle VM ManagerTime out...




[root@ovmmanager01 bin]# pwd
/u01/app/oracle/ovm-manager-3/bin

[root@ovmmanager01 bin]# ./ovm_admin

Oracle VM Manager Release 3.1.1 Admin tool

Usage:  ./ovm_admin [options]

options
 --help                            Shows this message
 --createuser                      Create new Oracle VM Manager admin user
 --deleteuser <admin>              Delete Oracle VM Manager admin user
 --listusers                       List Oracle VM Manager users
 --modifyuser                      Modify Oracle VM Manager user password
 --lockusers <tries>               Max login tries before locking account.
                                   This setting is global.
 --unlockuser <admin>              Unlock user account
 --modifyds <SID> <host> <port>    Modify Data Store 'OVMDS'
 --listconfig                      List configuration
 --rotatelogsdaily <time>          Rotate Logs Daily (HH:MM)
 --rotatelogsbysize <size>         Rotate Logs By Size (KB)









3)check oracle instance & Listener information.

[root@ovmmanager01 bin]# ps -aef|grep pmon
oracle    3824     1  0 15:44 ?        00:00:02 xe_pmon_XE
root      7043  6718  0 19:06 pts/2    00:00:00 grep pmon

4)switch into oracle user & release OVS expired user information.

[root@ovmmanager01 bin]# su - oracle
[oracle@ovmmanager01 ~]$ ps -ef|grep pmon
oracle    3824     1  0 15:44 ?        00:00:02 xe_pmon_XE
oracle    7068  7045  0 19:07 pts/2    00:00:00 grep pmon
[oracle@ovmmanager01 ~]$ ps -ef|grep tns
root         9     2  0 15:42 ?        00:00:00 [netns]
oracle    3699     1  0 15:44 ?        00:00:00 /u01/app/oracle/product/11.2.0/xe/bin/tnslsnr LISTENER -inherit
oracle    7071  7045  0 19:07 pts/2    00:00:00 grep tns

[oracle@ovmmanager01 ~]$ uname -a
Linux ovmmanager01.eu.sony.com 2.6.32-300.10.1.el5uek #1 SMP Wed Feb 22 17:37:40 EST 2012 x86_64 x86_64 x86_64 GNU/Linux
[oracle@ovmmanager01 ~]$ cat /etc/oratab
XE:/u01/app/oracle/product/11.2.0/xe:N
[oracle@ovmmanager01 ~]$ export ORACLE_SID=XE
[oracle@ovmmanager01 ~]$ export ORACLE_HOME=/u01/app/oracle/product/11.2.0/xe
[oracle@ovmmanager01 ~]$ sqlplus / as sysdba
-bash: sqlplus: command not found
[oracle@ovmmanager01 ~]$ export PATH=$ORACLE_HOME/bin:$PATH
[oracle@ovmmanager01 ~]$ sqlplus / as sysdba
Connected to:
Oracle Database 11g Express Edition Release 11.2.0.2.0 - 64bit Production

SQL> select name,open_mode from v$database;

NAME      OPEN_MODE
--------- --------------------
XE        READ WRITE

SQL> select username from dba_users where account_status like '%EXPIRED%';

USERNAME
------------------------------
OVS
XDB
HR
OUTLN
CTXSYS
MDSYS
XS$NULL
FLOWS_FILES




SQL> select name,password from sys.user$ where name='OVS';

NAME                           PASSWORD
------------------------------ ------------------------------
OVS                            D9854745A6D893F6

SQL> select account_status from dba_users where username='OVS';

ACCOUNT_STATUS
--------------------------------
EXPIRED

SQL> alter user OVS identified by values 'D9854745A6D893F6';

User altered.

SQL>  select account_status from dba_users where username='OVS';

ACCOUNT_STATUS
--------------------------------
OPEN

SQL> select username from dba_users where account_status like '%EXPIRED%';

USERNAME
------------------------------
XS$NULL
OUTLN
XDB
CTXSYS
MDSYS
FLOWS_FILES
HR

7 rows selected.

SQL>


5)NOW START OVMM SERVER.
# service ovmm start

6)Now  able to login  ovmm console

How to clear old Oracle VM Manager Configuration(guestvms/storagepools/networks...)(or) drop entire database?

1)stop ovmm

#service ovmm stop
# service ovmm status
Oracle VM Manager is not running...


2)delete database(oracle)
#cd /u01/app/oracle/ovm-manager-3/ovm_upgrade/bin

Database is oracle:-
# sh ovm_upgrade.sh --deletedb --dbsid=XE --dbport=1521 --dbpass=Passw0rd

COMMAND: ovm_upgrade.sh --deletedb --dbsid=XE --dbport=1521 --dbpass=Passw0rd

Using existing transform XSL files
Copying deleted classes files to patch path location
`./deletedClasses.xml' -> `/tmp/ovmpatches/deletedClasses.xml'
 INFO (OvmUpgrade.java:206) Oracle OVM Manager Upgrade Processor
 INFO (OvmUpgrade.java:207)
 INFO (OvmUpgrade.java:488) Upgrade Initialization Starting
 INFO (OdofDirector.java:220) Oracle Distributed Object Fabric (ODOF): Copyright (C) 2007, 2012 Oracle.  All rights reserved.
 INFO (OdofDirector.java:221) ODOF Version: 1.0.0.0
 INFO (OdofDirector.java:222) Initializing...
 INFO (OdofDirector.java:279) Initialization Complete!
 INFO (OvmUpgrade.java:490) Upgrade Initialization Complete
 INFO (WipeDbStage.java:23) Database Wipe Starting
 INFO (ObjectStore.java:613) Wiping Exchange
 INFO (RelationalStore.java:542) Initializing / Clearing Database Tables
 INFO (ObjectStore.java:641) Wiping Complete!
 INFO (WipeDbStage.java:26) Database Wipe Complete

3)start Database

# service ovmm status
Oracle VM Manager is not running...

# service ovmm start
Starting Oracle VM Manager


Now login to ovm manager every thing looks like a new (i.e fresh installation on ovm server)

script for changing root password for LINUX and AIX server

1)Need password less central server architecture.

#cat /tmp/servers
server1
server2
server3
server4
server5

For AIX/LINUX

#cat passwdchg.sh
##!/usr/bin/bash
########################################################
###############Imp BY : CHITTIBABU MIRIYALA ###########
#############version:1.0####################
###########################################################
for  i in `cat /tmp/servers`
do
echo "==========$i===========";
ssh -q $i 'echo "root:sony@123"|chpasswd';
done

OR
Linux servers:-
#cat passwdchg.sh
##!/usr/bin/bash
########################################################
###############Imp BY : CHITTIBABU MIRIYALA ###########
#############version:1.0####################
###########################################################
for  i in `cat /tmp/servers`
do
echo "==========$i===========";
ssh -q $i 'echo "sony@123"|passwd --stdin root'
done

problem joining slave node to master node after VCS upgrade

if problem in mismatching of volboot file

# cat volboot
# vxdctl stop
# mv /etc/vx/volboot /etc/vx/volboot.<date>.save
# vxconfigd -m disable -x syslog
# vxdctl init
# vxdctl enable

IF problem with Protocol version

# vxdctl support
# vxdctl upgrade

to list
#vxdctl support

VCS upgrade from 6.x to infoscale 7.x on both nodes parallely

1)To check with compatibility
http://sort.veritas.com/
For linux Compatability

2)Select Knowledge base & select kernel

https://sort.veritas.com/kernel

3)Take backup of all configuration files
/etc/llttab
/etc/gabtab
/etc/llthosts
/etc/VCRTSvcs directory

4)installation process

# cd dvd1-redhatlinux/
# ls
rhel6_x86_64  rhel7_x86_64
# cd rhel6_x86_64
# hasys -list
NODEa
NODEb

# ls
copyright  docs  EULA  installer  perl  rpms  scripts  tools  windows

NOte:- -patch_path will give any support patches suggested by veritas .
extract them and perform patching.

# ./installer  -patch_path /tmp NODEa NODEb

                                                               Veritas InfoScale Storage and Availability Solutions 7.1 Install Program
                                                                                     NODEa NODEb


Logs are being written to /var/tmp/installer-201612230320HYJ while installer is in progress.


                                                               Veritas InfoScale Storage and Availability Solutions 7.1 Install Program
                                                                                     NODEa NODEb


Task Menu:

    P) Perform a Pre-Installation Check     I) Install a Product
    C) Configure a Product Component        G) Upgrade a Product
    O) Perform a Post-Installation Check    U) Uninstall a Product
    L) License a Product                    S) Start a Product
    D) View Product Descriptions            X) Stop a Product
    R) View Product Requirements            ?) Help

Enter a Task: [P,I,C,G,O,U,L,S,D,X,R,?] G


                                                               Veritas InfoScale Storage and Availability Solutions 7.1 Upgrade Program
                                                                                     NODEa NODEb

     1)  Full Upgrade
     2)  Rolling Upgrade
     3)  Online Upgrade [VCS only]
     b)  Back to previous menu

Select the method by which you want to upgrade the product: [1-3,b,q] (1)


                                                               Veritas InfoScale Storage and Availability Solutions 7.1 Upgrade Program
                                                                                     NODEa NODEb

Logs are being written to /var/tmp/installer-201612230320HYJ while installer is in progress

    Verifying systems: 100%

    Estimated time remaining: (mm:ss) 0:00                                                                                                                                                  8 of 8

 
The following notes were discovered on the systems:

CPI NOTE V-9-30-1309 SFCFSHA version 6.0.500.200 will be upgraded to InfoScale Enterprise version 7.1.0.000 on NODEa

CPI NOTE V-9-30-1309 SFCFSHA version 6.0.500.200 will be upgraded to InfoScale Enterprise version 7.1.0.000 on NODEb

The following warnings were discovered on the systems:

CPI WARNING V-9-0-0 Kernel Release 2.6.32-642.6.2.el6.x86_64 is detected on NODEa, which is not recognizable by the installer. It is strongly recommended to check it on SORT
(https://sort.veritas.com) before continue.

Do you want to continue? [y,n,q] (y) y

Do you agree with the terms of the End User License Agreement as specified in the EULA/en/EULA.pdf file present on media? [y,n,q,?] y

All SFCFSHA processes that are currently running must be stopped

Do you want to stop SFCFSHA processes now? [y,n,q,?] (y)


                                                                           Veritas InfoScale Enterprise 7.1 Upgrade Program
                                                                                     NODEa NODEb

Logs are being written to /var/tmp/installer-201612230320HYJ while installer is in progress

    Stopping SFCFSHA: 100%

    Estimated time remaining: (mm:ss) 0:00                                                                                                                                                31 of 31

Storage Foundation Cluster File System HA Shutdown completed successfully


                                                                           Veritas InfoScale Enterprise 7.1 Upgrade Program
                                                                                     NODEa NODEb

Logs are being written to /var/tmp/installer-201612230320HYJ while installer is in progress

    Uninstalling SFCFSHA: 100%

Storage Foundation Cluster File System HA Uninstall completed successfully


                                                                           Veritas InfoScale Enterprise 7.1 Upgrade Program
                                                                                     NODEa NODEb

Logs are being written to /var/tmp/installer-201612230320HYJ while installer is in progress

    Installing InfoScale Enterprise: 75%                                                                                                                  
Veritas InfoScale Enterprise Install completed successfully

Found vxkeyless key(s) for previous release(s). They will be automatically updated to the current version.

Registering keyless key ENTERPRISE on Veritas InfoScale Enterprise
Successfully registered ENTERPRISE keyless key on NODEa
Successfully registered ENTERPRISE keyless key on NODEb


                                                                           Veritas InfoScale Enterprise 7.1 Upgrade Program
                                                                                     NODEa NODEb

Logs are being written to /var/tmp/installer-201612230320HYJ while installer is in progress

    Starting SFCFSHA: 100%

    Estimated time remaining: (mm:ss) 0:00                                                                                                                                                27 of 27

Storage Foundation Cluster File System HA Startup completed successfully

        A connection attempt to https://sort.veritas.com to check for product updates failed.
        Visit https://sort.veritas.com to check for available product updates and information.

installer log files, summary file, and response file are saved at:

        /opt/VRTS/install/logs/installer-201612230320HYJ

Would you like to view the summary file? [y,n,q] (n) y

installer Summary

System verification checks completed

The following notes were discovered on the systems:
CPI NOTE V-9-30-1309 SFCFSHA version 6.0.500.200 will be upgraded to InfoScale Enterprise version 7.1.0.000 on NODEa
CPI NOTE V-9-30-1309 SFCFSHA version 6.0.500.200 will be upgraded to InfoScale Enterprise version 7.1.0.000 on NODEb

The following warnings were discovered on the systems:
CPI WARNING V-9-0-0 Kernel Release 2.6.32-642.6.2.el6.x86_64 is detected on NODEa, which is not recognizable by the installer. It is strongly recommended to check it on SORT


5)Reboot both servers

#  reboot
#
Broadcast message from 1000314601@NODEa.am.sony.com
        (/dev/pts/1) at 3:31 ...

The system is going down for reboot NOW!





6)POST TESTINGS:-
if problem in missmatching of volboot file

# cat volboot
# vxdctl stop
# mv /etc/vx/volboot /etc/vx/volboot.<date>.save
# vxconfigd -m disable -x syslog
# vxdctl init
# vxdctl enable

IF problem with Protocol version

# vxdctl support
# vxdctl upgrade

to list
#vxdctl support



# vxdctl support