One .1  BLOG Document structure chart

wps51CF.tmp 

wps51E0.tmp 

 

One .2   Preface

 

One .2.1   Guidance and notes

Technology enthusiasts , After reading this article , You can master the following skills , You can also learn something else you don't know ,~O(∩_∩)O~:

① rac in OCR The brief introduction and function of

② rac in OCR Backup and restore

③ rac Forgetfulness and brain cleft

④ grid Log file under user :$ORACLE_HOME/log The contents of the folder are deleted, so that the cluster can not be started. How to recover ?( a key )

⑤ How to repair 11.2 Grid Permission misoperation 【(How to check and fix file permissions on Grid Infrastructure environment ( file  ID 1931142.1)】

⑥ How to repair ASM Instance name and node name are inconsistent 【How to Change 11.2 ASM Configuration to Match ASM Instance Name to the Node Where It Runs? (example, +ASM2 on Node2, etc) ( file  ID 1419424.1)】

⑦ permission.pl Use of scripts

  Tips:

① In this paper ITpub(http://blog.itpub.net/26736162) And blog Park (http://www.cnblogs.com/lhrbest) There are synchronous updates

② All the code used in this article , Related software , Please go to Xiaomai Miao's cloud disk to download relevant information (http://blog.itpub.net/26736162/viewspace-1624453/)

③  If the article code format is wrong , Recommend Sogou 、360 or QQ browser , You can also download pdf Format to view ,pdf Document download address :http://blog.itpub.net/26736162/viewspace-1624453/

④  This article BLOG I use gray background and pink font to show the output part of the command that needs special attention , For example, in the following example ,thread 1 The maximum archive log number for is 33,thread 2 The maximum archive log number for is 43 It's something that needs special attention ; Commands are usually marked with yellow background and red font ; Comments on the code or the output part of the code are generally in blue font .

 

  List of Archived Logs in backup set 11

  Thrd Seq     Low SCN    Low Time            Next SCN   Next Time

  ---- ------- ---------- ------------------- ---------- ---------

  1    32      1621589    2015-05-29 11:09:52 1625242    2015-05-29 11:15:48

  1    33      1625242    2015-05-29 11:15:48 1625293    2015-05-29 11:15:58

  2    42      1613951    2015-05-29 10:41:18 1625245    2015-05-29 11:15:49

  2    43      1625245    2015-05-29 11:15:49 1625253    2015-05-29 11:15:53

 

 

 

 

[ZHLHRDB1:root]:/>lsvg -o

T_XDESK_APP1_vg

rootvg

[ZHLHRDB1:root]:/>

00:27:22 SQL> alter tablespace idxtbs read write;

 

 

====》2097152*512/1024/1024/1024=1G 

 

 

 

If there are any mistakes or imperfections in this article, please correct them ,ITPUB Message or QQ All can , Your criticism is the biggest motivation of my writing .

 

 

One .2.2   Links to related reference articles

A good article about physical and logical backup :https://gjilevski.com/2010/12/20/backup-and-restore-of-ocr-in-grid-infrastructure-11g-r2-11-2-2/

 

wps51E1.tmp

One .2.3   Brief introduction

Write this blog This is the case ,rac There's a problem with starting , however $GRID_HOME/log There are too many files in the file , I just emptied the contents below , The result is that the cluster can't be started, even the basic log is gone , restart OS Invalid , Finally, I thought about it carefully and looked at the normal library $GRID_HOME/log File structure under , I found that some of the folders ended up with T or t Authority , It is thought that it may be caused by the authority , So I went to MOS After searching articles, we found several articles ,11.2.0.3.6 The above is easy to solve , But smaller than this version is not easy to get , The way to sum up is to run again root.sh Script , After running, many resources registered in the cluster no longer exist , So this is about OCR Backup and recovery of . Another implementation root.sh If it's not in the right order , Or some other reason may lead to asm Instance number and host number are inconsistent , Namely rac1 The instance name on is +ASM2, It doesn't make any difference , But it doesn't look good , So it's important to change their direct correspondence , Therefore, in general, it leads to the proposition at the beginning of the article 6 A question .

 

One .3   Related knowledge points literacy ( From the Internet + Personal summary )

Clusterware  Two files are required during run time : OCR  and  Voting Disk.  this  2  Files must be stored on shared storage . OCR  To solve the problem of forgetfulness , Voting Disk  It's used to solve the brain fissure problem .

One .3.1  OCR Disk

Oracle Clusterware Put the configuration information of the whole cluster on shared storage , This storage is OCR Disk.  In the whole cluster , Only one node can be used for OCR Disk  Read and write , This node is called Master Node, All nodes keep a copy in memory OCR A copy of the , There's a OCR Process  Read from this memory . OCR  When the content changes , from Master Node Of OCR Process Responsible for synchronizing to other nodes OCR Process.

The forgetfulness problem is that each node has a copy of the configuration information , The configuration information of the modified node is not synchronized .Oracle  The solution is to put the configuration file on the shared storage , This file is  OCR Disk.OCR  Save the configuration information of the whole cluster in , Configure information to "Key-Value"  In the form of . stay  Oracle10g  before , This document is called  Server Manageability Repository(SRVM).  stay  Oracle 10g, This part has been redesigned , And renamed  OCR.. stay  Oracle Clusterware  During installation , The installation program will prompt the user to specify  OCR  Location . And the user specified location will be recorded in /etc/oracle/ocr.loc(Linux System、AIX)  perhaps /var/opt/oracle/ocr.loc(Solaris System) In file . And in the  Oracle 9i RAC  in , The equivalent is  srvConfig.Loc file . Oracle Clusterware At startup, it will be read in from the specified location according to the contents  OCR  Content .

[zfzhlhrdb3:root]:/>cd /etc/oracle

[zfzhlhrdb3:root]:/etc/oracle>ls -l

total 3160

drwxrwx---    2 root     dba             256 Dec 29 14:16 lastgasp

-rw-r--r--    1 root     dba              37 Dec 29 14:10 ocr.loc

-rw-r--r--    1 root     system            0 Dec 29 14:10 ocr.loc.orig

-rw-r--r--    1 root     dba              92 Dec 29 14:10 olr.loc

-rw-r--r--    1 root     system            0 Dec 29 14:10 olr.loc.orig

drwxrwxr-x    5 root     dba             256 Dec 29 14:09 oprocd

drwxr-xr-x    3 root     dba             256 Dec 29 14:09 scls_scr

-rws--x---    1 root     dba         1606037 Dec 29 14:09 setasmgid

[zfzhlhrdb3:root]:/etc/oracle>

[zfzhlhrdb3:root]:/etc/oracle>more /etc/oracle/ocr.loc

ocrconfig_loc=+DATA

local_only=FALSE

[zfzhlhrdb3:root]:/etc/oracle>

 

OCR key

Whole  OCR  It's a tree structure , Yes  3  A big branch . Namely  SYSTEM,DATABASE  and  CRS. There are many small branches under each branch . These recorded information can only be provided by  root  The user to change .

One .3.1.1  OCR Included content  

OCR It usually contains the following contents :

v  Node member information

v  Database instance , node , And other mapping relationships

v ASM

v  Resource allocation information (vip,services wait )

v  Service features (Service characteristics)

v Oracle Information about related processes in the cluster

v CRS Control of third party application information

 

[zfzhlhrdb1:root]:/>ocrdump -local -stdout -xml|more|grep -i \<name\>|sed -e 's/\<NAME\>//g' -e 's/\<\/NAME\>//g'|awk -F . '{print 1,1,2,$3}'|uniq

SYSTEM 

SYSTEM crs

SYSTEM crs usersecurity

SYSTEM crs deny

SYSTEM crs user_default_dir

SYSTEM ORA_CRS_HOME

SYSTEM WALLET

SYSTEM GNS

SYSTEM version

SYSTEM version localhost

SYSTEM version activeversion

SYSTEM GPnP

SYSTEM GPnP profiles

SYSTEM css

SYSTEM css nodenum_hint

SYSTEM network

SYSTEM network haip

SYSTEM OHASD

SYSTEM OHASD DM

SYSTEM OHASD SERVERPOOLS

SYSTEM OHASD SERVERS

SYSTEM OHASD TYPES

SYSTEM OHASD RESOURCES

SYSTEM CRS

SYSTEM CRS JOIN_SIGNATURE

SYSTEM OLR

SYSTEM OLR MANUALBACKUP

SYSTEM OCR

SYSTEM OCR BACKUP

DATABASE 

DATABASE NODEAPPS

DATABASE VIP_RANGE

DATABASE LOG

DATABASE ASM

DATABASE DATABASES

CRS 

[zfzhlhrdb1:root]:/>ocrdump -stdout -xml|more|grep -i \<name\>|sed -e 's/\<NAME\>//g' -e 's/\<\/NAME\>//g'|awk -F . '{print 1,1,2,$3}'|uniq

SYSTEM 

SYSTEM version

SYSTEM version activeversion

SYSTEM version hostnames

SYSTEM versionstring

SYSTEM WALLET

SYSTEM WALLET APPQOSADMIN

SYSTEM GNS

SYSTEM css

SYSTEM css interfaces

SYSTEM crs

SYSTEM crs versions

SYSTEM crs usersecurity

SYSTEM crs deny

SYSTEM crs user_default_dir

SYSTEM crs e2eport

SYSTEM crs uiport

SYSTEM crs 11

SYSTEM ACFS

SYSTEM ORA_CRS_HOME

SYSTEM evm

SYSTEM evm debug

SYSTEM evm cevmkey

SYSTEM evm rmport

SYSTEM evm cevmport

SYSTEM DIAG

SYSTEM DIAG status

SYSTEM local_only

SYSTEM WLM

SYSTEM GPnP

SYSTEM GPnP profiles

SYSTEM JAZNFILE

                <name>jazn com</name>

                                <name>qosadmin</name> 

                                <name>oc4jadmin</name> 

<name>JtaAdmin</name> 

                                <name>ascontrol_appadmin</name> 

                                <name>oc4j-administrators</name> 

                                                <name>qosadmin</name> 

                                                <name>oc4jadmin</name> 

                                                <name>JtaAdmin 

                                <name>qos_admin</name> 

                                                <name>qosadmin</name> 

                                <name>oc4j-app-administrators</name> 

                                <name>users</name> 

                                <name>ascontrol_monitor</name> 

                                <name> 

                                                <name>qosadmin</name> 

                                                <name>oc4jadmin</name> 

                                                <name>qos_admin</name> 

                                        <name>jazn com/oc4j-administrators</name>

                                <name>login</name> 

                                <name>subject propagation</name>

                                <name>oracle security jazn

                                <name>jazn com/*</name>

                                <name>administration</name> 

                                <name>jazn com</name>

                                        <name>jazn com/ascontrol_admin</name>

                                <name>login</name> 

                                <name>subject propagation</name>

                                <name>oracle security jazn

                                <name>oracl 

                                <name>oracle security jazn

                                <name>jazn com/*</name>

                                <name>administration</name> 

                                <name>jazn com</name>

                                        <name>jazn com/oc4j-app-administrators</name>

                                <name>login</name> 

                                        <name>jazn com/users</name>

                                <name>login</name> 

                <name>oracle security jazn

                                                <name>coreid password header</name>

                                                <name>coreid resource operation</name>

                                                <name>addAllRoles</name> 

                                                <name>coreid password attribute</name>

                                                <name>coreid resource type</name>

                                                <name>coreid name attribute</name>

                                                <name>coreid resource name</name>

                                                <name>core 

                <name>oracle security jazn

                                                <name>addAllRoles</name> 

                <name>oracle security wss

                                                <name>addAllRoles</name> 

                <name>oracle security jazn

                                                <name>addAllRoles</name> 

                <name>oracle security jazn

                                                <name>addAllRoles</name> 

                <name>oracle security jazn

                                                <name>addAllRoles</name> 

                <name>oracle security wss

                                                <name>addAllRoles</name> 

                                                <name>issuer name 1</name>

SYSTEM JAZNFILE STATE

SYSTEM CRSADMIN

SYSTEM CRSUSER

SYSTEM CRSD

SYSTEM CRSD DM

SYSTEM CRSD SERVERPOOLS

SYSTEM CRSD SERVERS

SYSTEM CRSD TYPES

SYSTEM CRSD RESOURCES

SYSTEM OCR

SYSTEM OCR BACKUP

DATABASE 

DATABASE NODEAPPS

DATABASE NODEAPPS zfzhlhrdb1

DATABASE NODEAPPS zfzhlhrdb2

DATABASE VIP_RANGE

DATABASE LOG

DATABASE ASM

DATABASE ASM zfzhlhrdb1

DATABASE ASM zfzhlhrdb2

DATABASE DATABASES

CRS 

CRS CUR

CRS HIS

CRS SEC

CRS STAGE

CRS STAGE node1

CRS STAGE node2

[zfzhlhrdb1:root]:/>

 

 

One .3.1.2  OCR The presentation of stored content

1.  In the same way as Windows To compare ,OCR The form of its stored content is the same , It is shown in the form of key value pairs .

2.  Whole OCR  It's a tree structure , Yes 3 A big branch . Namely SYSTEM,DATABASE  and CRS.

3.  There are many small branches under each branch . These recorded information can only be provided by root The user to change .

4.  have access to ocrdump Command to export all of its contents or by branch .

 

 

One .3.2  Voting Disk

Voting Disk  This file is mainly used to record the status of node members , When there's a cleft in the brain , Decide that  Partion  Take control , Other  Partion It has to be removed from the cluster . In the installation  Clusterware  You will also be prompted to specify this location . After installation, you can view it through the following command  Voting Disk  Location .

$crsctl query css votedisk

 [zfzhlhrdb3:root]:/dev>crsctl query css votedisk

##  STATE    File Universal Id                File Name Disk group

--  -----    -----------------                --------- ---------

1. ONLINE   83cb4909d3254f4ebf1181b024aaf539 (/dev/rhdisk2) [DATA]

Located 1 voting disk(s).

[zfzhlhrdb3:root]:/dev>ls -l /dev/rhdisk*

crw-------    2 root     system       19,  0 Dec 29 10:02 /dev/rhdisk0

crw-------    1 root     system       19,  4 Dec 29 11:15 /dev/rhdisk1

crw-rw----    1 grid     asmadmin     19,  6 Jan 08 15:17 /dev/rhdisk2

crw-rw----    1 root     system       19,  3 Dec 29 11:15 /dev/rhdisk3

crw-rw----    1 root     system       19,  1 Dec 29 11:15 /dev/rhdisk4

crw-------    1 root     system       19,  7 Dec 29 11:15 /dev/rhdisk5

crw-------    1 root     system       19,  8 Dec 29 11:15 /dev/rhdisk6

crw-------    1 root     system       19,  2 Dec 29 11:15 /dev/rhdisk7

crw-------    1 root     system       19,  5 Dec 29 11:15 /dev/rhdisk8

[zfzhlhrdb3:root]:/dev>

 

One .3.3   Amnesia (Amnesia)

It's not a centralized environment for storing configuration files , Instead, each node has a local copy , When the cluster is running normally , Users can change the configuration of the cluster at any node , And this change is automatically synchronized to other nodes . There is a special case : node  A  Normally shut down , At the node  B  Modify the configuration on the , Close the node  A, Start node B. In this case , The modified configuration file is missing , It's called amnesia .OCR  To solve the problem of forgetfulness .

Forgetfulness is due to a node update OCR The content in , And some other nodes in the cluster are shutting down , Maintenance or restart phase ,OCR Master Inconsistencies caused by processes having no time to update their information to these exception node caches . for example , stay A The node issued an add ocr Mirror command , At this time B The node is in the restart phase . After restart A Has been updated , And then B I don't know why ocr Added a new mirror disk , Forgetfulness comes from this .

Here's an example , node bo2dbp Add a new ocr after , The configuration file has changed , Now the node bo2dbs Of ocr.loc Will be updated , If bo2dbs In the shutdown or restart phase , The file cannot be updated , This is an example of amnesia .

 

One .3.4   Split brain (Split Brain)

In the cluster , There is a mechanism between nodes ( heartbeat ) Get to know each other's health , To ensure that all nodes work together . Assuming that only the " heartbeat " Problems arise , The nodes are still running , At this time , Each node thinks the others are down , I am in the whole cluster environment " The only one built on ", I should get the whole cluster " control power ". In a clustered environment , Storage devices are all shared , This means data disaster , This situation is " Split brain " The usual way to solve this problem is to use a voting algorithm (Quorum Algorithm).  Its algorithm mechanism is as follows : Each node in the cluster needs a heartbeat mechanism to inform each other of " A healthy state ", Suppose that every time you receive a node's " notification " One vote on behalf of . For a three node cluster , In normal operation , Each node will have  3  ticket . When the node  A  The heartbeat failed, but the node  A  It's still running , Then the whole cluster will split into  2  Small  partition. node  A  It's a , The rest  2  One is one . This is one that has to be eliminated  partition  In order to ensure the healthy operation of the cluster . For having  3 Cluster of nodes , A  When the heart rate goes wrong , B  and  C  It's a  partion, Yes  2  ticket , A Only  1  ticket . According to the voting algorithm , B  and  C  A cluster of people gets control , A  To be eliminated . If only  2  Nodes , The voting algorithm fails . Because every node has only  1  ticket . A third device needs to be introduced : Quorum Device. Quorum Device  It's usually a shared disk , This disk is also called Quorum disk. This  Quorum Disk  It also represents one vote . When  2  When there is a problem with the heartbeat of nodes , 2  Two nodes at the same time to fight for  Quorum Disk  This vote , The earliest requests are satisfied first . So the first to get  Quorum Disk The node of the 2  ticket . Another node will be removed .

 

One .3.5  OCR Command series

 

One .3.5.1  ocrdump

This command can be used to ASCII Print it out in the same way OCR The content of , But this command cannot be used as OCR Backup recovery of , In other words, the generated file can only be used for reading , Not for recovery .

Command format : ocrdump [-stdout] [filename] [-keyname name] [-xml]

Parameter description :

-stdout:  Print out the content to the screen

Filename: Output the content to a file

-keyname: Print only the contents of a key and its subkeys

-xml: With xml Format printout

   Example : hold system.css The content of the key is .xml Format printout to screen

[root@raw1 bin]# ./ocrdump -stdout -keyname system.css -xml|more

<OCRDUMP>

 

<TIMESTAMP>03/08/2010 04:28:41</TIMESTAMP>

<DEVICE>/dev/raw/raw1</DEVICE>

<COMMAND>./ocrdump.bin -stdout -keyname system.css -xml </COMMAND>

......

 

This command is in progress , Will be in $CRS_HOME/log/<node_name>/client  Log files are generated in the directory , file name ocrdump_<pid>.log, If there is a problem with command execution , You can see the cause of the problem from this log .

 

One .3.5.2  ocrcheck

Ocrcheck  Command for checking OCR Consistency of content , The command execution process will take place in $CRS_HOME/log/nodename/client  Create... In the directory ocrcheck_pid.log  Log files . This command doesn't need parameters .

[zfzhlhrdb1:root]:/>ocrcheck

Status of Oracle Cluster Registry is as follows :

         Version                  :          3

         Total space (kbytes)     :     262120

         Used space (kbytes)      :       3176

         Available space (kbytes) :     258944

         ID                       :  362503260

         Device/File Name         :      +DATA

                                    Device/File integrity check succeeded

 

                                    Device/File not configured

 

                                    Device/File not configured

 

                                    Device/File not configured

 

                                    Device/File not configured

 

         Cluster registry integrity check succeeded

 

         Logical corruption check succeeded

 

One .3.5.3  ocrconfig

This command is used to maintain OCR  disk , install clusterware In the process , If you choose External Redundancy Redundancy mode , Only one OCR Disk location . however Oracle Allow configuration of two OCR  Disks mirror each other , To prevent OCR  Single point of disk failure . OCR  Disk and Votedisk The disks are different ,OCR There can only be two disks at most , One Primary OCR  And a Mirror OCR.

[root@raw1 bin]# ./ocrconfig --help

Name:

        ocrconfig - Configuration tool for Oracle Cluster Registry.

Synopsis:

        ocrconfig [option]

        option:

                -export <filename> [-s online]

                                                    - Export cluster register contents to a file

                -import <filename>                  - Import cluster registry contents from a file

                -upgrade [<user> [<group>]]

                                                    - Upgrade cluster registry from previous version

                -downgrade [-version <version string>]

                                                    - Downgrade cluster registry to the specified version

                -backuploc <dirname>                - Configure periodic backup location

                -showbackup                         - Show backup information

                -restore <filename>                 - Restore from physical backup

                -replace ocr|ocrmirror [<filename>] - Add/replace/remove a OCR device/file

                -overwrite                          - Overwrite OCR configuration on disk

                -repair ocr|ocrmirror <filename>    - Repair local OCR configuration

                -help                               - Print out this help information

Note:

        A log file will be created in

        $ORACLE_HOME/log/<hostname>/client/ocrconfig_<pid>.log. Please ensure

        you have file creation privileges in the above directory before

        running this tool.

 

One .3.6  Oracle RAC OCR Backup and recovery of

 

 Oracle Clusterware Put the configuration information of the whole cluster on shared storage , This information includes a list of cluster nodes 、 Cluster database instance to node mapping and CRS Application resource information . It's stored in ocr  disk ( perhaps ocfs file ) On . So the importance of this configuration file is self-evident . Make at will ocr If the configuration changes, it is recommended to back up immediately between or after the operations ocr.

because OCR It's so important ,Oracle  Every time 4 Make a backup every two hours , And keep the last 3 Backup , And the day before , Last backup of the previous week . This backup is made by Master Node CRSD Process complete , The default location for backup is $CRS_HOME/crs/cdata/<cluster_name> Under the table of contents . After every backup , The backup file name changes automatically , To reflect the backup time sequence , The last backup is called backup00.ocr. These backup files are saved locally ,DBA You should also keep a copy on other storage devices , To prevent unexpected storage failures .

And Oracle Database backup recovery is similar ,OCR There is also the concept of physical backup or logical backup , So there are two ways to back up , Two ways to recover .

 

Common commands :

crsctl query css votedisk

lquerypv -h /dev/rhdisk2

crsctl stop has -f

crsctl start has

crsctl stat res -t

 

One .3.6.1  dd Backup recovery

Backup voting disk :

dd if=/dev/raw/raw3 of=/tmp/votedisk_lhr.bak bs=1024k count=4

Resume voting disk :

dd if=/tmp/votedisk_lhr.bak of=/dev/raw/raw3 bs=1024k count=4

 

notes :11g It is not recommended to use dd For backup and recovery , The head is usually the front 4K

One .3.6.2  kfed Restore the disk head

dd if=/dev/rhdisk2 of=/asm_rhdisk2_dd.bak bs=1024 count=4

dd if=/dev/zero of=/dev/rhdisk2 bs=1024 count=4

kfed repair /dev/rhdisk2

About kfed、kfod、amdu You can refer to :http://blog.itpub.net/26736162/viewspace-1694198/

http://blog.itpub.net/26736162/viewspace-1694199/

 

One .3.6.3  md_backup and md_restore Restore the disk head

 

asmcmd md_backup /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/asm_md_backup.bak

asmcmd md_restore /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/asm_md_backup.bak

 

 

dd if=/dev/rhdisk2 of=/asm_rhdisk2_dd.bak bs=1024k count=4

dd if=/dev/zero of=/dev/rhdisk2 bs=1024k count=4

crsctl stop has -f

crsctl start has

ASMCMD [+] > startup force nomount;

ASMCMD [+] > md_restore /asm_rhdisk2_dd.bak

 

 

ASMCMD [+] > md_backup /rman/asm_md.bak

dd if=/dev/zero  of=/dev/rhdisk2 bs=1024 count=4

crsctl stop has -f

crsctl start has

ASMCMD [+] > startup force nomount;

ASMCMD [+] > md_restore /rman/asm_md.bak

 

About md_backup and md_restore For more information, please refer to :http://blog.itpub.net/26736162/viewspace-2121309/

 

One .3.6.4   Physical backup and recovery ( Automatic backup )

By default ,Oracle  Every time 4 Make a backup every two hours , And keep the last 3 Copies , And the day before , Last backup copy of the previous week . Users cannot customize the backup frequency and the number of copies of backup files .

about OCR The backup of is by Master Node CRSD Process complete , So the default location for backup is $CRS_HOME/crs/cdata/<cluster_name> Under the table of contents .

The backup file will be renamed automatically , To reflect the backup time sequence , The last backup is called backup00.ocr.

Because it is in Master Node Backup on the same node , So the backup file only exists in Master Node node .

about Master Node The node of crash Then the remaining nodes take over .

The backup directory can be accessed through ocrconfig -backuploc <directory_name>  Command to change .

OCR There can only be two disks at most , One Primary OCR  And a Mirror OCR. They mirror each other to avoid a single point of failure .

For physical backup recovery , You can't simply use operating system level replication commands ( Use ocr When you file ) To complete , This operation will result in ocr Unavailable .

For physical backup , Just use restore How to recover , Without support import The way

1, Look at the backup disk  

[zfzhlhrdb2:grid]:/home/grid>ocrconfig -showbackup

 

zfzhlhrdb1     2016/06/30 15:13:46     /oracle/app/11.2.0/grid/cdata/zfzhlhrdb-crs/backup00.ocr

 

zfzhlhrdb1     2016/06/30 11:13:45     /oracle/app/11.2.0/grid/cdata/zfzhlhrdb-crs/backup01.ocr

 

zfzhlhrdb1     2016/06/30 07:13:45     /oracle/app/11.2.0/grid/cdata/zfzhlhrdb-crs/backup02.ocr

 

zfzhlhrdb1     2016/06/29 03:13:41     /oracle/app/11.2.0/grid/cdata/zfzhlhrdb-crs/day.ocr

 

zfzhlhrdb1     2016/06/20 03:13:08     /oracle/app/11.2.0/grid/cdata/zfzhlhrdb-crs/week.ocr

PROT-25: Manual backups for the Oracle Cluster Registry are not available

[zfzhlhrdb2:grid]:/home/grid>oerr prot 25

00025, 0, "Manual backups for the Oracle Cluster Registry are not available"

// *Cause: Manual backups for the Oracle Cluster Registry were not yet created.

// *Action: Manual backups can be created using 'ocrconfig -manualbackup'

//          command.

[zfzhlhrdb2:grid]:/home/grid>ocrconfig -manualbackup

PROT-20: Insufficient permission to proceed. Require privileged user

[zfzhlhrdb2:grid]:/home/grid>exit

[zfzhlhrdb2:root]:/>

[zfzhlhrdb2:root]:/>

[zfzhlhrdb2:root]:/>ocrconfig -manualbackup

 

zfzhlhrdb1     2016/06/30 16:21:34     /oracle/app/11.2.0/grid/cdata/zfzhlhrdb-crs/backup_20160630_162134.ocr

[zfzhlhrdb2:root]:/>ocrconfig -showbackup

 

zfzhlhrdb1     2016/06/30 15:13:46     /oracle/app/11.2.0/grid/cdata/zfzhlhrdb-crs/backup00.ocr

 

zfzhlhrdb1     2016/06/30 11:13:45     /oracle/app/11.2.0/grid/cdata/zfzhlhrdb-crs/backup01.ocr

 

zfzhlhrdb1     2016/06/30 07:13:45     /oracle/app/11.2.0/grid/cdata/zfzhlhrdb-crs/backup02.ocr

 

zfzhlhrdb1     2016/06/29 03:13:41     /oracle/app/11.2.0/grid/cdata/zfzhlhrdb-crs/day.ocr

 

zfzhlhrdb1     2016/06/20 03:13:08     /oracle/app/11.2.0/grid/cdata/zfzhlhrdb-crs/week.ocr

 

zfzhlhrdb1     2016/06/30 16:21:34     /oracle/app/11.2.0/grid/cdata/zfzhlhrdb-crs/backup_20160630_162134.ocr

   Execute... On node one , You can see 2 The content of each node is the same :

[zfzhlhrdb1:root]:/>ocrconfig -showbackup

 

zfzhlhrdb1     2016/06/30 15:13:46     /oracle/app/11.2.0/grid/cdata/zfzhlhrdb-crs/backup00.ocr

 

zfzhlhrdb1     2016/06/30 11:13:45     /oracle/app/11.2.0/grid/cdata/zfzhlhrdb-crs/backup01.ocr

 

zfzhlhrdb1     2016/06/30 07:13:45     /oracle/app/11.2.0/grid/cdata/zfzhlhrdb-crs/backup02.ocr

 

zfzhlhrdb1     2016/06/29 03:13:41     /oracle/app/11.2.0/grid/cdata/zfzhlhrdb-crs/day.ocr

 

zfzhlhrdb1     2016/06/20 03:13:08     /oracle/app/11.2.0/grid/cdata/zfzhlhrdb-crs/week.ocr

 

zfzhlhrdb1     2016/06/30 16:21:34     /oracle/app/11.2.0/grid/cdata/zfzhlhrdb-crs/backup_20160630_162134.ocr

[zfzhlhrdb1:root]:/> 

2, recovery

ocrconfig -restore /app/crs/product/11.0.6/crs/cdata/racluster/backup01.ocr

 

3, Check the configuration

[grid@rac1 ~]$ more /etc/oracle/ocr.loc

ocrconfig_loc=+DATA

local_only=FALSE

[grid@rac1 ~]$

 

4, Check the process

[grid@rac1 ~]$ ps -ef | grep d.bin

 

root      4694     1  0 10:00 ?        00:00:13 /u01/grid/bin/ohasd.bin reboot

grid      4821     1  0 10:00 ?        00:00:28 /u01/grid/bin/oraagent.bin

root      4823     1  0 10:00 ?        00:00:04 /u01/grid/bin/orarootagent.bin

grid      4846     1  0 10:00 ?        00:00:00 /u01/grid/bin/gipcd.bin

grid      4859     1  0 10:00 ?        00:00:00 /u01/grid/bin/mdnsd.bin

grid      4874     1  0 10:00 ?        00:00:01 /u01/grid/bin/gpnpd.bin

root      8645     1  0 10:47 ?        00:00:04 /u01/grid/bin/cssdmonitor

root      8662     1  0 10:48 ?        00:00:05 /u01/grid/bin/cssdagent

grid      8664     1  0 10:48 ?        00:00:01 /u01/grid/bin/diskmon.bin -d -f

grid      8688     1  0 10:48 ?        00:00:40 /u01/grid/bin/ocssd.bin

root      8754     1  0 10:50 ?        00:00:01 /u01/grid/bin/octssd.bin

grid      8770     1  0 10:50 ?        00:00:02 /u01/grid/bin/evmd.bin

grid      8888     1  0 10:51 ?        00:00:00 /u01/grid/bin/oclskd.bin

root      8920     1  0 10:51 ?        00:00:07 /u01/grid/bin/crsd.bin reboot

root      8966     1  0 10:51 ?        00:00:00 /u01/grid/bin/oclskd.bin

grid      9013  8770  0 10:51 ?        00:00:00 /u01/grid/bin/evmlogger.bin -o /u01/grid/evm/log/evmlogger.info -l /u01/grid/evm/log/evmlogger.log

grid      9055     1  0 10:51 ?        00:00:06 /u01/grid/bin/oraagent.bin

root      9059     1  0 10:51 ?        00:00:42 /u01/grid/bin/orarootagent.bin

grid      9283     1  0 10:52 ?        00:00:00 /u01/grid/bin/tnslsnr LISTENER -inherit

oracle    9549     1  0 10:58 ?        00:00:26 /u01/grid/bin/oraagent.bin

oracle    9773     1  0 11:00 ?        00:00:00 /u01/grid/bin/oclskd.bin

grid     18618     1  0 13:46 ?        00:00:00 /u01/grid/bin/tnslsnr LISTENER_SCAN1 -inherit

grid     22527 21370  0 14:58 pts/2    00:00:00 grep d.bin

[grid@rac1 ~]$

notes :

ocssd: It is used to manage and coordinate the relationship of each node in the cluster , And used for node communication . The process is very important , If the process aborts abnormally , It will cause the system to restart automatically . In some extreme cases , If ocssd Unable to start properly , It will cause the operating system to cycle and restart .

crsd: Monitor the resources of the node , When an exception occurs to a resource, it is , Automatically restart or switch the resource .

evmd: Is a background based event detection program .

oclskd: The daemon is Oracle 11g(11.10.6) A new background process , Mainly for monitoring RAC Database node instance , When an instance hangs , Restart the node .    

One .3.6.5   Logical backup and recovery ( Manual backup )

Actually OCR It can also be exported manually 、 Import 、 The method is as follows :

ocrconfig -export /tmp/ocr_bak

ocrconfig -import /tmp/ocr_bak

Use ocrconfig -export  Backup generated in this way , It is called logical backup .

For major ocr Before and after the configuration changes , Such as adding or deleting nodes , Modify cluster resources , Create a database, etc , Logical backup is recommended .

For... Due to misconfiguration ocr In the case of damage , We can use ocrconfig -import To recover in the same way .

It is also possible to restore the lost or damaged ocr disk ( file ).

 

One .3.7   How to repair 11.2 Grid Permission misoperation

About Oracle GRID HOME File directory permission problem

① chown -R Wrong operation , Will the whole /u01/app How to restore the permissions of ?

②  Deleted $GRID_HOME/log Everything under the folder , The cluster cannot start , How to restore ?

Use chown -R  Wrong operation , Will the whole /u01/app I've fixed my permissions , Lead to grid Can't start ., Search down mos Found a document :Tips for checking file permissions on GRID environment(ID 1931142.1)

wps51F1.tmp

This document describes ,$GRID_HOME/crs/utl The following files record the whole GRID_HOME The following file and directory permissions .

Check the permissions from the following 2 files which are created during Grid Infrastructure installation.

In $GRID_HOME/crs/utl (for 11.2 and 12.1.0.1) and <GRID_HOME>/crs/utl/<hostname> (for 12.1.0.2) directory:

crsconfig_dirs :which has all directories listed in <GRID_HOME> and their permissions

crsconfig_fileperms :which has list of files and their permissions and locations in <GRID_HOME>.

 

Let's see if it's like this ,cd $ORACLE_HOME/crs/utl:

[root@rac2 bin]# cd  /home/grid/app/11.2/grid/crs/utl

[root@rac2 utl]# ls -ltr

total 324

-rw-r–r– 1 root root  1128 Aug 11 09:48 usrvip

-rw-r–r– 1 root root  8437 Aug 11 09:48 srvctl

……

-rw-r–r– 1 root root 12102 Aug 11 09:48 crsconfig_files

-rw-r–r– 1 root root 13468 Aug 11 09:48 crsconfig_fileperms

-rw-r–r– 1 root root  8666 Aug 11 09:48crsconfig_dirs

-rw-r–r– 1 root root   699 Aug 11 09:48 crfsetenv

-rw-r–r– 1 root root  1280 Aug 11 09:48 cmdllroot.sh

-rw-r–r– 1 root root  3680 Aug 11 09:48 cluutil

-rw-r–r– 1 root root  1648 Aug 11 09:48 clsrwrap

-rw-r–r– 1 root root   540 Aug 11 09:48 appvipcfg

[zfzhlhrdb1:grid]:/oracle/app/11.2.0/grid/crs/utl>more crsconfig_dirs

# Copyright (c) 2009, 2013, Oracle and/or its affiliates. All rights reserved.

# The values in each line use the following format:

#

# OSLIST DIRNAME OWNER GROUP CLOSED-PERMS OPEN-PERMS

#

# Note:

# 1) OSLIST is a comma-separated list of platforms on which the directory

#    needs to be created.  'all' indicates that the directory needs to be

#    created on every platform.  OSLIST MUST NOT contain whitespace.

# 2) Permissions need to be specified AS OCTAL NUMBERS.  If permissions are

#    not specified, default (umask) values will be used.

#

# TBD: OPEN-PERMS need to be added for each dir

 

all /oracle/app/11.2.0/grid/cdata grid dba 0775

all /oracle/app/11.2.0/grid/cdata/zfzhlhrdb-crs grid dba 0775

all /oracle/app/11.2.0/grid/cfgtoollogs grid dba 0775

all /oracle/app/11.2.0/grid/cfgtoollogs/crsconfig grid dba 0775

all /oracle/app/11.2.0/grid/log grid dba 0775

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1 root dba 01755

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/crsd root dba 0750

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/ctssd root dba 0750

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/evmd grid dba 0750

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/cssd grid dba 0750

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/mdnsd grid dba 0750

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/gpnpd grid dba 0750

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/gnsd root dba 0750

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/srvm grid dba 0750

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/gipcd grid dba 0750

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/diskmon grid dba 0750

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/cvu grid dba 0750

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/cvu/cvulog grid dba 0750

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/cvu/cvutrc grid dba 0750

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/acfssec root dba 0755

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/acfsrepl grid dba 0750

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/acfslog grid dba 0750

all /oracle/app/11.2.0/grid/cdata/localhost grid dba 0755

all /oracle/app/11.2.0/grid/cdata/zfzhlhrdb1 grid dba 0755

all /oracle/app/11.2.0/grid/cv grid dba 0775

all /oracle/app/11.2.0/grid/cv/log grid dba 0775

all /oracle/app/11.2.0/grid/cv/init grid dba 0775

all /oracle/app/11.2.0/grid/cv/report grid dba 0775

all /oracle/app/11.2.0/grid/cv/report/html grid dba 0775

all /oracle/app/11.2.0/grid/cv/report/text grid dba 0775

all /oracle/app/11.2.0/grid/cv/report/xml grid dba 0775

 

# These dirs must be owned by crsuser in SIHA, and $SUPERUSER in cluster env.

# 'HAS_USER' is set appropriately in roothas.pl and rootcrs.pl for this

# purpose

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/ohasd root dba 0750

all /oracle/app/11.2.0/grid/lib root dba 0755

all /oracle/app/11.2.0/grid/bin root dba 0755

 

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/agent root dba 01775

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/agent/crsd root dba 01777

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/agent/ohasd root dba 01775

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/client grid dba 01777

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/racg grid dba 01775

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/racg/racgmain grid dba 01777

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/racg/racgeut grid dba 01777

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/racg/racgevtf grid dba 01777

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/admin grid dba 0750

all /oracle/app/11.2.0/grid/log/diag/clients grid asmadmin 01770

all /oracle/app/11.2.0/grid/evm grid dba 0750

all /oracle/app/11.2.0/grid/evm/init grid dba 0750

all /oracle/app/11.2.0/grid/auth/evm/zfzhlhrdb1 root dba 01777

all /oracle/app/11.2.0/grid/evm/log grid dba 01770

all /oracle/app/11.2.0/grid/eons/init grid dba 0750

all /oracle/app/11.2.0/grid/auth/ohasd/zfzhlhrdb1 root dba 01777

all /oracle/app/11.2.0/grid/mdns grid dba 0750

all /oracle/app/11.2.0/grid/mdns/init grid dba 0750

all /oracle/app/11.2.0/grid/gipc grid dba 0750

all /oracle/app/11.2.0/grid/gipc/init grid dba 0750

all /oracle/app/11.2.0/grid/gnsd root dba 0750

all /oracle/app/11.2.0/grid/gnsd/init root dba 0750

all /oracle/app/11.2.0/grid/gpnp grid dba 0750

all /oracle/app/11.2.0/grid/gpnp/init grid dba 0750

all /oracle/app/11.2.0/grid/ohasd grid dba 0750

all /oracle/app/11.2.0/grid/ohasd/init grid dba 0750

all /oracle/app/11.2.0/grid/gpnp grid dba 0750

all /oracle/app/11.2.0/grid/gpnp/profiles grid dba 0750

all /oracle/app/11.2.0/grid/gpnp/profiles/peer grid dba 0750

all /oracle/app/11.2.0/grid/gpnp/wallets grid dba 01750

all /oracle/app/11.2.0/grid/gpnp/wallets/root grid dba 01700

all /oracle/app/11.2.0/grid/gpnp/wallets/prdr grid dba 01750

all /oracle/app/11.2.0/grid/gpnp/wallets/peer grid dba 01700

all /oracle/app/11.2.0/grid/gpnp/wallets/pa grid dba 01700

all /oracle/app/11.2.0/grid/mdns grid dba 0750

all /oracle/app/11.2.0/grid/gpnp grid dba 0750

all /oracle/app/11.2.0/grid/gpnp/zfzhlhrdb1/profiles grid dba 0750

all /oracle/app/11.2.0/grid/gpnp/zfzhlhrdb1/profiles/peer grid dba 0750

all /oracle/app/11.2.0/grid/gpnp/zfzhlhrdb1/wallets grid dba 01750

all /oracle/app/11.2.0/grid/gpnp/zfzhlhrdb1/wallets/root grid dba 01700

all /oracle/app/11.2.0/grid/gpnp/zfzhlhrdb1/wallets/prdr grid dba 01750

all /oracle/app/11.2.0/grid/gpnp/zfzhlhrdb1/wallets/peer grid dba 01700

all /oracle/app/11.2.0/grid/gpnp/zfzhlhrdb1/wallets/pa grid dba 01700

all /oracle/app/11.2.0/grid/css grid dba 0711

all /oracle/app/11.2.0/grid/css/init grid dba 0711

all /oracle/app/11.2.0/grid/css/log grid dba 0711

all /oracle/app/11.2.0/grid/auth/css/zfzhlhrdb1 root dba 01777

all /oracle/app/11.2.0/grid/crs root dba 0755

all /oracle/app/11.2.0/grid/crs/init root dba 0755

all /oracle/app/11.2.0/grid/crs/profile root dba 0755

all /oracle/app/11.2.0/grid/crs/script root dba 0755

all /oracle/app/11.2.0/grid/crs/template root dba 0755

all /oracle/app/11.2.0/grid/auth/crs/zfzhlhrdb1 root dba 01777

all /oracle/app/11.2.0/grid/crs/log grid dba 01750

all /oracle/app/11.2.0/grid/crs/trace grid dba 01750

all /oracle/app/11.2.0/grid/crs/public grid dba 01777

all /oracle/app/11.2.0/grid/ctss root dba 0755

all /oracle/app/11.2.0/grid/ctss/init root dba 0755

all /oracle/app/11.2.0/grid/racg/usrco grid dba

all /oracle/app/11.2.0/grid/racg/dump grid dba 0775

all /oracle/app/11.2.0/grid/srvm/admin grid dba 0775

all /oracle/app/11.2.0/grid/srvm/log grid dba 0775

all /oracle/app/11.2.0/grid/evm/admin/conf grid dba 0750

all /oracle/app/11.2.0/grid/evm/admin/logger grid dba 0750

all /oracle/app/11.2.0/grid/crf root dba 0750

all /oracle/app/11.2.0/grid/crf/admin root dba 0750

all /oracle/app/11.2.0/grid/crf/admin/run grid dba 0750

all /oracle/app/11.2.0/grid/crf/admin/run/crfmond root dba 0700

all /oracle/app/11.2.0/grid/crf/admin/run/crflogd root dba 0700

all /oracle/app/11.2.0/grid/crf/db root dba 0750

all /oracle/app/11.2.0/grid/crf/db/zfzhlhrdb1 root dba 0750

all /oracle/app/11.2.0/grid/osysmond root dba 0755

all /oracle/app/11.2.0/grid/osysmond/init root dba 0755

all /oracle/app/11.2.0/grid/ologgerd root dba 0755

all /oracle/app/11.2.0/grid/ologgerd/init root dba 0755

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/crfmond root dba 0750

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/crflogd root dba 0750

 

unix /etc/oracle/oprocd root dba 0775

unix /etc/oracle/oprocd/check root dba 0770

unix /etc/oracle/oprocd/stop root dba 0770

unix /etc/oracle/oprocd/fatal root dba 0770

unix /etc/oracle/scls_scr root dba 0755

unix /etc/oracle/scls_scr/zfzhlhrdb1 root dba 0755

unix /var/tmp/.oracle root dba 01777

unix /tmp/.oracle root dba 01777

unix /oracle/app/11.2.0/grid/log/zfzhlhrdb1/acfsreplroot root dba 0750

# create $ID, if it doesn't exist (applicable only in dev env)

unix /etc root root 0755

unix /oracle/app/11.2.0/grid root dba 0755

 

# Last Gasp files directory - change "unix" to "all"

# once Windows makes a directory decision.

unix /etc/oracle/lastgasp root dba 0770

unix /etc/rc.d/rc2.d root root 0755

[zfzhlhrdb1:grid]:/oracle/app/11.2.0/grid/crs/utl> more crsconfig_fileperms

# Copyright (c) 2009, 2013, Oracle and/or its affiliates. All rights reserved.

# The values in each line use the following format:

#

# OSLIST FILENAME OWNER GROUP PERMS

#

# Note:

# 1) OSLIST is a comma-separated list of platforms on which the file

#    permissions need to be set.  'all' indicates that the directory needs

#    to be created on every platform.  OSLIST MUST NOT contain whitespace.

# 2) Permissions need to be specified AS OCTAL NUMBERS.  If permissions

#    are not specified, default (umask) values will be used.

# 3) The fields within each line of this file must be delimited by a single space

#

unix /oracle/app/11.2.0/grid/log/zfzhlhrdb1/alertzfzhlhrdb1.log grid dba 0664

unix /oracle/app/11.2.0/grid/bin/usrvip root dba 0755

unix /oracle/app/11.2.0/grid/bin/appvipcfg root dba 0755

unix /oracle/app/11.2.0/grid/crs/install/preupdate.sh grid dba 0755

unix /oracle/app/11.2.0/grid/crs/install/s_crsconfig_defs grid dba 0755

unix /oracle/app/11.2.0/grid/bin/cluutil grid dba 0755

unix /oracle/app/11.2.0/grid/bin/ocrcheck root dba 0755

unix /oracle/app/11.2.0/grid/bin/ocrcheck.bin root dba 0755

unix /oracle/app/11.2.0/grid/bin/ocrconfig root dba 0755

unix /oracle/app/11.2.0/grid/bin/ocrconfig.bin root dba 0755

unix /oracle/app/11.2.0/grid/bin/ocrdump root dba 0755

unix /oracle/app/11.2.0/grid/bin/ocrdump.bin root dba 0755

unix /oracle/app/11.2.0/grid/bin/ocrpatch root dba 0755

unix /oracle/app/11.2.0/grid/bin/appagent grid dba 0755

unix /oracle/app/11.2.0/grid/bin/clssproxy grid dba 0755

unix /oracle/app/11.2.0/grid/bin/cssvfupgd root dba 0755

unix /oracle/app/11.2.0/grid/bin/cssvfupgd.bin root dba 0755

unix /oracle/app/11.2.0/grid/bin/racgwrap grid dba 0755

unix /oracle/app/11.2.0/grid/bin/cemutls grid dba 0755

unix /oracle/app/11.2.0/grid/bin/cemutlo grid dba 0755

unix /oracle/app/11.2.0/grid/bin/crs_getperm grid dba 0755

unix /oracle/app/11.2.0/grid/bin/crs_profile grid dba 0755

unix /oracle/app/11.2.0/grid/bin/crs_register grid dba 0755

unix /oracle/app/11.2.0/grid/bin/crs_relocate grid dba 0755

unix /oracle/app/11.2.0/grid/bin/crs_setperm grid dba 0755

unix /oracle/app/11.2.0/grid/bin/crs_start grid dba 0755

unix /oracle/app/11.2.0/grid/bin/crs_stat grid dba 0755

unix /oracle/app/11.2.0/grid/bin/crs_stop grid dba 0755

unix /oracle/app/11.2.0/grid/bin/crs_unregister grid dba 0755

unix /oracle/app/11.2.0/grid/bin/gipcd grid dba 0755

unix /oracle/app/11.2.0/grid/bin/mdnsd grid dba 0755

unix /oracle/app/11.2.0/grid/bin/gpnpd grid dba 0755

unix /oracle/app/11.2.0/grid/bin/gpnptool grid dba 0755

unix /oracle/app/11.2.0/grid/bin/oranetmonitor grid dba 0755

unix /oracle/app/11.2.0/grid/bin/rdtool grid dba 0755

unix /oracle/app/11.2.0/grid/bin/octssd root dba 0741

unix /oracle/app/11.2.0/grid/bin/octssd.bin root dba 0741

unix /oracle/app/11.2.0/grid/bin/ohasd root dba 0741

unix /oracle/app/11.2.0/grid/bin/ohasd.bin root dba 0741

unix /oracle/app/11.2.0/grid/bin/crsd root dba 0741

unix /oracle/app/11.2.0/grid/bin/crsd.bin root dba 0741

unix /oracle/app/11.2.0/grid/bin/evmd grid dba 0755

unix /oracle/app/11.2.0/grid/bin/evminfo grid dba 0755

unix /oracle/app/11.2.0/grid/bin/evmlogger grid dba 0755

unix /oracle/app/11.2.0/grid/bin/evmmkbin grid dba 0755

unix /oracle/app/11.2.0/grid/bin/evmmklib grid dba 0755

unix /oracle/app/11.2.0/grid/bin/evmpost grid dba 0755

unix /oracle/app/11.2.0/grid/bin/evmshow grid dba 0755

unix /oracle/app/11.2.0/grid/bin/evmsort grid dba 0755

unix /oracle/app/11.2.0/grid/bin/evmwatch grid dba 0755

unix /oracle/app/11.2.0/grid/bin/lsnodes grid dba 0755

unix /oracle/app/11.2.0/grid/bin/oifcfg grid dba 0755

unix /oracle/app/11.2.0/grid/bin/olsnodes grid dba 0755

unix /oracle/app/11.2.0/grid/bin/oraagent grid dba 0755

unix /oracle/app/11.2.0/grid/bin/orarootagent root dba 0741

unix /oracle/app/11.2.0/grid/bin/orarootagent.bin root dba 0741

unix /oracle/app/11.2.0/grid/bin/scriptagent grid dba 0755

unix /oracle/app/11.2.0/grid/bin/lsdb grid dba 0755

unix /oracle/app/11.2.0/grid/bin/emcrsp grid dba 0755

unix /oracle/app/11.2.0/grid/bin/onsctl grid dba 0755

unix /oracle/app/11.2.0/grid/crs/install/onsconfig grid dba 0554

unix /oracle/app/11.2.0/grid/bin/gnsd root dba 0741

unix /oracle/app/11.2.0/grid/bin/gnsd.bin root dba 0741

unix /oracle/app/11.2.0/grid/bin/gsd.sh grid dba 0755

unix /oracle/app/11.2.0/grid/bin/gsdctl grid dba 0755

unix /oracle/app/11.2.0/grid/bin/scrctl grid dba 0750

unix /oracle/app/11.2.0/grid/bin/vipca grid dba 0755

unix /oracle/app/11.2.0/grid/bin/oc4jctl grid dba 0755

unix /oracle/app/11.2.0/grid/bin/cvures grid dba 0755

unix /oracle/app/11.2.0/grid/bin/odnsd grid dba 0755

unix /oracle/app/11.2.0/grid/bin/qosctl grid dba 0755

unix /oracle/app/11.2.0/grid/crs/install/cmdllroot.sh grid dba 0755

unix /oracle/app/11.2.0/grid/crs/utl/rootdelete.sh root root 0755

unix /oracle/app/11.2.0/grid/crs/utl/rootdeletenode.sh root root 0755

unix /oracle/app/11.2.0/grid/crs/utl/rootdeinstall.sh root root 0755

unix /oracle/app/11.2.0/grid/crs/utl/rootaddnode.sh root root 0755

unix /oracle/app/11.2.0/grid/lib/libskgxpcompat.so grid dba 0644

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/client/olsnodes.log grid dba 0666

all /oracle/app/11.2.0/grid/log/zfzhlhrdb1/client/oifcfg.log grid dba 0666

unix /oracle/app/11.2.0/grid/bin/srvctl root dba 0755

unix /oracle/app/11.2.0/grid/bin/cluvfy root dba 0755

unix /oracle/app/11.2.0/grid/bin/clsecho root dba 0755

unix /oracle/app/11.2.0/grid/bin/clsecho.bin root dba 0755

unix /oracle/app/11.2.0/grid/bin/clscfg root dba 0755

unix /oracle/app/11.2.0/grid/bin/clscfg.bin root dba 0755

unix /oracle/app/11.2.0/grid/bin/clsfmt root dba 0755

unix /oracle/app/11.2.0/grid/bin/clsfmt.bin root dba 0755

unix /oracle/app/11.2.0/grid/bin/clsid grid dba 0755

unix /oracle/app/11.2.0/grid/bin/crsctl root dba 0755

unix /oracle/app/11.2.0/grid/bin/crsctl.bin root dba 0755

unix /oracle/app/11.2.0/grid/bin/ndfnceca grid dba 0750

unix /oracle/app/11.2.0/grid/bin/oclskd root dba 0755

unix /oracle/app/11.2.0/grid/bin/oclskd.bin root dba 0751

unix /oracle/app/11.2.0/grid/bin/oclsomon grid dba 0755

unix /oracle/app/11.2.0/grid/bin/oclsvmon grid dba 0755

unix /oracle/app/11.2.0/grid/bin/ocssd grid dba 0755

unix /oracle/app/11.2.0/grid/bin/cssdagent root dba 0741

unix /oracle/app/11.2.0/grid/bin/cssdagent.bin root dba 0741

unix /oracle/app/11.2.0/grid/bin/cssdmonitor root dba 0741

unix /oracle/app/11.2.0/grid/bin/cssdmonitor.bin root dba 0741

unix /oracle/app/11.2.0/grid/bin/diskmon root dba 0741

unix /oracle/app/11.2.0/grid/bin/diskmon.bin root dba 0741

unix /oracle/app/11.2.0/grid/bin/diagcollection.sh root dba 0755

unix /oracle/app/11.2.0/grid/bin/oradnssd grid dba 0755

unix /oracle/app/11.2.0/grid/bin/oradnssd.bin grid dba 0755

unix /oracle/app/11.2.0/grid/bin/setasmgidwrap grid dba 0755

unix /oracle/app/11.2.0/grid/bin/oclumon root dba 0750

unix /oracle/app/11.2.0/grid/bin/oclumon.bin root dba 0750

unix /oracle/app/11.2.0/grid/bin/oclumon.pl grid dba 0750

unix /oracle/app/11.2.0/grid/bin/crswrapexece.pl root dba 0744

unix /oracle/app/11.2.0/grid/bin/crfsetenv root dba 0750

unix /oracle/app/11.2.0/grid/bin/osysmond root dba 0750

unix /oracle/app/11.2.0/grid/bin/osysmond.bin root dba 0750

unix /oracle/app/11.2.0/grid/bin/ologgerd root dba 0750

unix /oracle/app/11.2.0/grid/bin/ologdbg grid dba 0750

unix /oracle/app/11.2.0/grid/bin/ologdbg.pl grid dba 0750

unix /etc/oracle/setasmgid root dba 4710

 

# Jars and shared libraries used by the executables invoked by the root script

 

unix /oracle/app/11.2.0/grid/jlib/srvm.jar root dba 0644

unix /oracle/app/11.2.0/grid/jlib/srvmasm.jar root dba 0644

unix /oracle/app/11.2.0/grid/jlib/srvctl.jar root dba 0644

unix /oracle/app/11.2.0/grid/jlib/srvmhas.jar root dba 0644

unix /oracle/app/11.2.0/grid/jlib/gns.jar root dba 0644

unix /oracle/app/11.2.0/grid/jlib/ons.jar root dba 0644

unix /oracle/app/11.2.0/grid/jlib/netcfg.jar root dba 0644

unix /oracle/app/11.2.0/grid/jlib/i18n.jar root dba 0644

unix /oracle/app/11.2.0/grid/jlib/supercluster.jar root dba 0644

unix /oracle/app/11.2.0/grid/jlib/supercluster-common.jar root dba 0644

unix /oracle/app/11.2.0/grid/jlib/antlr-complete.jar root dba 0644

unix /oracle/app/11.2.0/grid/jlib/antlr-3.3-complete.jar root dba 0644

 

unix /oracle/app/11.2.0/grid/lib/libhasgen11.so root dba 0644

unix /oracle/app/11.2.0/grid/lib/libocr11.so root dba 0644

unix /oracle/app/11.2.0/grid/lib/libocrb11.so root dba 0644

unix /oracle/app/11.2.0/grid/lib/libocrutl11.so root dba 0644

unix /oracle/app/11.2.0/grid/lib/libclntsh.so.11.1 root dba 0644

unix /oracle/app/11.2.0/grid/lib/libclntshcore.so.11.1 root dba 0644

unix /oracle/app/11.2.0/grid/lib/libskgxn2.so root dba 0644

unix /oracle/app/11.2.0/grid/lib/libskgxp11.so root dba 0644

unix /oracle/app/11.2.0/grid/lib/libasmclntsh11.so root dba 0644

unix /oracle/app/11.2.0/grid/lib/libcell11.so root dba 0644

unix /oracle/app/11.2.0/grid/lib/libnnz11.so root dba 0644

unix /oracle/app/11.2.0/grid/lib/libclsra11.so root dba 0644

unix /oracle/app/11.2.0/grid/lib/libgns11.so root dba 0644

unix /oracle/app/11.2.0/grid/lib/libeons.so root dba 0644

unix /oracle/app/11.2.0/grid/lib/libonsx.so root dba 0644

unix /oracle/app/11.2.0/grid/lib/libeonsserver.so root dba 0644

 

unix /oracle/app/11.2.0/grid/lib/libsrvm11.so root dba 0644

unix /oracle/app/11.2.0/grid/lib/libsrvmhas11.so root dba 0644

unix /oracle/app/11.2.0/grid/lib/libsrvmocr11.so root dba 0644

unix /oracle/app/11.2.0/grid/lib/libuini11.so root dba 0644

 

unix /oracle/app/11.2.0/grid/lib/libgnsjni11.so root dba 0644

unix /oracle/app/11.2.0/grid/lib/librdjni11.so root dba 0644

unix /oracle/app/11.2.0/grid/lib/libgnsjni11.so root dba 0644

unix /oracle/app/11.2.0/grid/lib/libclsce11.so root dba 0644

unix /oracle/app/11.2.0/grid/lib/libcrf11.so root dba 0644

 

unix /oracle/app/11.2.0/grid/bin/diagcollection.pl root dba 0755

 

# crs configuration scripts invoked from rootcrs.pl

unix /oracle/app/11.2.0/grid/crs/install/crsconfig_lib.pm root dba 0755

unix /oracle/app/11.2.0/grid/crs/install/s_crsconfig_lib.pm root dba 0755

unix /oracle/app/11.2.0/grid/crs/install/crsdelete.pm root dba 0755

unix /oracle/app/11.2.0/grid/crs/install/crspatch.pm root dba 0755

unix /oracle/app/11.2.0/grid/crs/install/oracss.pm root dba 0755

unix /oracle/app/11.2.0/grid/crs/install/oraacfs.pm root dba 0755

unix /oracle/app/11.2.0/grid/crs/install/hasdconfig.pl root dba 0755

unix /oracle/app/11.2.0/grid/crs/install/rootcrs.pl root dba 0755

unix /oracle/app/11.2.0/grid/crs/install/roothas.pl root dba 0755

unix /oracle/app/11.2.0/grid/crs/install/preupdate.sh root dba 0755

unix /oracle/app/11.2.0/grid/crs/install/rootofs.sh root dba 0755

 

 

# XXX: required only for dev env, where inittab ($IT) is not present already

unix /etc/inittab root root 0644

 

# USM FILES

# Only files which will be installed with executable permissions need

# to be listed.

unix /oracle/app/11.2.0/grid/bin/acfsdriverstate root dba 0755

unix /oracle/app/11.2.0/grid/bin/acfsload root dba 0755

unix /oracle/app/11.2.0/grid/bin/acfsregistrymount root dba 0755

unix /oracle/app/11.2.0/grid/bin/acfsroot root dba 0755

unix /oracle/app/11.2.0/grid/bin/acfssinglefsmount root dba 0755

unix /oracle/app/11.2.0/grid/bin/acfsrepl_apply root dba 0755

unix /oracle/app/11.2.0/grid/bin/acfsrepl_apply.bin root dba 0755

unix /oracle/app/11.2.0/grid/bin/acfsreplcrs grid dba 0755

unix /oracle/app/11.2.0/grid/bin/acfsreplcrs.pl grid dba 0755

unix /oracle/app/11.2.0/grid/bin/acfsrepl_initializer root dba 0755

unix /oracle/app/11.2.0/grid/bin/acfsrepl_monitor grid dba 0755

unix /oracle/app/11.2.0/grid/bin/acfsrepl_preapply grid dba 0755

unix /oracle/app/11.2.0/grid/bin/acfsrepl_transport grid dba 0755

unix /oracle/app/11.2.0/grid/lib/acfsdriverstate.pl root dba 0644

unix /oracle/app/11.2.0/grid/lib/acfsload.pl root dba 0644

unix /oracle/app/11.2.0/grid/lib/acfsregistrymount.pl root dba 0644

unix /oracle/app/11.2.0/grid/lib/acfsroot.pl root dba 0644

unix /oracle/app/11.2.0/grid/lib/acfssinglefsmount.pl root dba 0644

unix /oracle/app/11.2.0/grid/lib/acfstoolsdriver.sh root dba 0755

unix /oracle/app/11.2.0/grid/lib/libusmacfs11.so grid dba 0644

 

#EVM config files

unix /oracle/app/11.2.0/grid/evm/admin/conf/evm.auth root dba 0644

unix /oracle/app/11.2.0/grid/evm/admin/conf/evmdaemon.conf root dba 0644

unix /oracle/app/11.2.0/grid/evm/admin/conf/evmlogger.conf root dba 0644

 

# TFA files

unix /oracle/app/11.2.0/grid/crs/install/tfa_setup.sh root dba 0755

unix /oracle/app/11.2.0/grid/cdata/zfzhlhrdb1.olr root dba 0600

unix /etc/oracle/olr.loc root dba 0644

unix /etc/oracle/ocr.loc root dba 0644

[zfzhlhrdb1:grid]:/oracle/app/11.2.0/grid/crs/utl>

We can see , That's true ,crsconfig_dirs It records all the $GRID_HOME Permission of related directory .crsconfig_fileperms File permissions are recorded in .

One .3.7.1   Verification authority

We can check it by command :Validate the <GRID_HOME> by using cluvfy tool.

$ cluvfy comp software -n all -verbose

 

[zfzhlhrdb1:grid]:/home/grid>cluvfy comp software -n all -verbose

 

Verifying software

 

Check: Software

 

  Component: crs                     

 

  Node Name: zfzhlhrdb2              

    /oracle/app/11.2.0/grid/bin/racgeut..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/racgeut" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/racgmain..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/racgmain" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/asmproxy..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/asmproxy" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/lib/oc4jctl_common.pm..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/lib/oc4jctl_common.pm" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/lib/oc4jctl_lib.pm..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/lib/oc4jctl_lib.pm" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/appagent.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/appagent.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/clssproxy.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/clssproxy.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/crs_getperm.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/crs_getperm.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/crs_profile.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/crs_profile.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/crs_register.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/crs_register.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/crs_relocate.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/crs_relocate.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/crs_setperm.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/crs_setperm.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/crs_start.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/crs_start.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/crs_stat.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/crs_stat.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/crs_stop.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/crs_stop.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/crs_unregister.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/crs_unregister.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/gipcd.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/gipcd.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/mdnsd.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/mdnsd.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/gpnpd.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/gpnpd.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/gpnptool.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/gpnptool.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/oranetmonitor.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/oranetmonitor.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/evmd.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/evmd.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/evminfo.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/evminfo.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/evmlogger.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/evmlogger.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/evmmkbin.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/evmmkbin.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/evmmklib.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/evmmklib.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/evmpost.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/evmpost.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/evmshow.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/evmshow.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/evmsort.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/evmsort.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/evmwatch.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/evmwatch.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/oraagent.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/oraagent.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/racgevtf..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/racgevtf" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/racgvip..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/racgvip" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/sclsspawn..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/sclsspawn" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/scriptagent.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/scriptagent.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/oprocd..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/oprocd" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/emcrsp.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/emcrsp.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/clsid.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/clsid.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/ocssd.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/ocssd.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/crstmpl.scr..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/crstmpl.scr" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/evt.sh..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/evt.sh" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/cemutls.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/cemutls.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/cemutlo.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/cemutlo.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/lsdb.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/lsdb.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/oifcfg.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/oifcfg.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/olsnodes.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/olsnodes.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/gsd..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/gsd" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/oc4jctl.pl..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/oc4jctl.pl" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/lib/s_oc4jctl_lib.pm..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/lib/s_oc4jctl_lib.pm" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/appvipcfg.pl..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/appvipcfg.pl" did not match the expected value. [Expected = "0750" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/lxinst..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/lxinst" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/clone/rootpre/ORCLcluster/lib/libskgxnr.a...No such file or directory

  Node Name: zfzhlhrdb1              

    /oracle/app/11.2.0/grid/bin/racgeut..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/racgeut" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/racgmain..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/racgmain" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/asmproxy..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/asmproxy" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/lib/oc4jctl_common.pm..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/lib/oc4jctl_common.pm" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/lib/oc4jctl_lib.pm..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/lib/oc4jctl_lib.pm" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/appagent.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/appagent.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/clssproxy.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/clssproxy.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/crs_getperm.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/crs_getperm.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/crs_profile.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/crs_profile.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/crs_register.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/crs_register.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/crs_relocate.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/crs_relocate.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/crs_setperm.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/crs_setperm.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/crs_start.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/crs_start.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/crs_stat.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/crs_stat.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/crs_stop.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/crs_stop.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/crs_unregister.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/crs_unregister.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/gipcd.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/gipcd.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/mdnsd.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/mdnsd.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/gpnpd.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/gpnpd.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/gpnptool.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/gpnptool.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/oranetmonitor.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/oranetmonitor.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/evmd.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/evmd.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/evminfo.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/evminfo.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/evmlogger.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/evmlogger.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/evmmkbin.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/evmmkbin.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/evmmklib.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/evmmklib.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/evmpost.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/evmpost.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/evmshow.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/evmshow.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/evmsort.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/evmsort.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/evmwatch.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/evmwatch.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/oraagent.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/oraagent.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/racgevtf..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/racgevtf" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/racgvip..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/racgvip" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/sclsspawn..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/sclsspawn" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/scriptagent.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/scriptagent.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/oprocd..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/oprocd" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/emcrsp.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/emcrsp.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/clsid.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/clsid.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/ocssd.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/ocssd.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/crstmpl.scr..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/crstmpl.scr" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/evt.sh..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/evt.sh" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/cemutls.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/cemutls.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/cemutlo.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/cemutlo.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/lsdb.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/lsdb.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/oifcfg.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/oifcfg.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/olsnodes.bin..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/olsnodes.bin" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/gsd..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/gsd" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/oc4jctl.pl..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/oc4jctl.pl" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/lib/s_oc4jctl_lib.pm..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/lib/s_oc4jctl_lib.pm" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/appvipcfg.pl..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/appvipcfg.pl" did not match the expected value. [Expected = "0750" ; Found = "0775"]

    /oracle/app/11.2.0/grid/bin/lxinst..."Permissions" did not match reference

        Permissions of file "/oracle/app/11.2.0/grid/bin/lxinst" did not match the expected value. [Expected = "0755" ; Found = "0775"]

    /oracle/app/11.2.0/grid/clone/rootpre/ORCLcluster/lib/libskgxnr.a...No such file or directory

 

  1227 files verified                

 

Software check failed

 

Verification of software was unsuccessful on all the specified nodes.

 

One .3.7.2   solve

So it's not difficult to solve this problem , We can solve it in the following ways :

1. According to the previous several permission configuration scripts, you can modify them for reference , It's not really hard , direct UE The editor's going to take care of it very quickly .

2. according to Mos The document provides advice through  $GRID_HOME/crs/install/rootcrs.pl -init  or  roothas.pl -init Solve . rootcrs.pl –init Is in PSU>11.2.0.3.6 Executed under , If PSU<11.2.0.3.6 You can execute the following two commands to achieve the same effect

<GRID_HOME>/crs/install/rootcrs.pl -unlock

<GRID_HOME>/crs/install/rootcrs.pl -patch

 

For 11.2: 
For clustered Grid Infrastructure, as root user

# cd <GRID_HOME>/crs/install/ 
# ./rootcrs.pl -init

For Standalone Grid Infrastructure, as root user

# cd <GRID_HOME>/crs/install/ 
# ./roothas.pl  -init


For 12c: 
For clustered Grid Infrastructure, as root user

# cd <GRID_HOME>/crs/install/ 
# ./rootcrs.sh -init

For Standalone Grid Infrastructure, as root user

# cd <GRID_HOME>/crs/install/ 
# ./roothas.sh -init

 

3. use MOS1515018.1 The script provided by the document generates the script on the normal Library , Then the generated script is executed on the exception library to fix the permission problem ( It should be and method 2 Use a combination of ).

 

4. 11gR2 Sure deconfig crs Configuration of , And run again root.sh that will do . Run again root.sh Scripts don't affect the database , So don't worry about ( A way of personal recommendation ).

$ORACLE_HOME/crs/install/rootcrs.pl -deconfig -force -verbose

$ORACLE_HOME/root.sh

 

5. If it is rac Misoperation of a node of , Well, it can also be done through delete node then add node To do it , But this is too much trouble , But maybe the safest way .oracle It's also recommended , Because if you modify the file permissions artificially , It's hard to guarantee that there won't be any problems in the future .

Add :

Linux In the environment, you can also use getfacl and setfacl To operate , Here is an example :

1) getfacl   /home/grid/app/11.2/grid  > dir_privs.txt

2) set –restore dir_privs.txt

 

summary :

There are GI Under the environment of , jurisdiction 、 The owner is strictly set , Any wrong modification of them can easily lead to a series of problems , And these problems are often very strange, it is difficult to diagnose according to the conventional way of thinking . In case the authority or owner is modified, you can go through rootcrs.pl -init And permission.pl Make repairs ,rootcrs.pl –init Just fix GI The core directory of , So it's faster to repair , If you encounter GI Can't start problem , It is suggested that this method is the first choice to make GI It can start quickly , But the disadvantage is that it can't be fully repaired ,GI Although it's normal , There is no guarantee that there will be no such or such problems in the later operation process , It's time to permission.pl Appearance. ,permission.pl The source library is determined by the running mode of ( Libraries with the right permissions ) And the target library ( Library with wrong permissions ) Try to be consistent between software versions , So the source database must be selected , Otherwise the problem will be worse , In addition, if the source 、 The installation directories of the two target libraries are not the same permission* Adjust the script after execution .

So I suggest running root.sh Come safely .

 

One .3.7.3  MOS 1515018.1  permission.pl Use of scripts

wps5212.tmp

wps5213.tmp

chmod 755 permission.pl

oracle User access ORACLE_HOME: ./permission.pl $ORACLE_HOME

root User access GRID_HOME: ./permission.pl $ORACLE_HOME

 

Script generates two files 
a. permission-<time stamp> - This contains file permission in octal value, owner and group information of the files captured 
b. restore-perm-<time stamp>.cmd - This contains command to change the permission, owner, and group of the captured files

 

 

After copying to the target host, execute :

chmod 755 restore-perm-<timestamp>.cmd

    ./restore-perm-<timestamp>.cmd

 

 

One .3.8   How to repair ASM Instance name and node name are inconsistent wps5214.tmpwps5215.tmp

about 10g The situation of , We can refer to Dave The great god blog:RAC modify ASM Steps for instance name :http://blog.csdn.net/tianlesoftware/article/details/6275827

about 11g The situation of , We can only do it again root.sh Script to fix this .

 

 

One .3.9   How to get rid of CRS Information

wps5216.tmp

[ZFTPCCDB1:root]:/>$ORACLE_HOME/crs/install/rootcrs.pl -h

Unknown option: h

Usage:

      rootcrs.pl [-verbose] [-upgrade [-force] | -patch]

                 [-paramfile <parameter-file>]

                 [-deconfig [-deinstall] [-keepdg] | -downgrade] [-force] [-lastnode]

                 [-downgrade] [-oldcrshome <old crshome path>] [-version <old crs version>] 

                 [-unlock [-crshome <path to crs home>] [-nocrsstop]]

 

      Options:

       -verbose    Run this script in verbose mode

       -upgrade    Oracle HA is being upgraded from previous version

       -patch      Oracle HA is being upgraded to a patch version

       -paramfile  Complete path of file specifying HA parameter values

       -lastnode   Force the node this is executing on to be considered the

                   last node of the install and perform actions associated

                   with configuring the last node

       -downgrade  Downgrade the clusterware

       -version    For use with downgrade; special handling is required if

                   downgrading to 9i. This is the old crs version in the format

                   A.B.C.D.E (e.g 11.1.0.6.0).

       -deconfig   Remove Oracle Clusterware to allow it to be uninstalled or reinstalled.

       -force      Force the execution of steps in delete that cannot be verified

                   to be safe

       -deinstall  Reset the permissions on CRS home during de-configuration

       -keepdg     Keep existing diskgroups during de-configuration

       -unlock     Unlock CRS home

       -crshome    Complete path of crs home. Use with unlock option.

       -oldcrshome For use with downgrade. Complete path of the old crs home.

       -nocrsstop  used with unlock option to reset permissions on an inactive grid home

 

      If neither -upgrade nor -patch is supplied, a new install is performed

 

      To see the full manpage for this program, execute:

        perldoc rootcrs.pl

 

[ZFTPCCDB1:root]:/>

 

according to MOS How to Proceed from Failed 11gR2 Grid Infrastructure (CRS) Installation ( file  ID 942166.1)  file , To redo root.sh Script , We can do the following :

Execute... On all nodes except the last one :$ORACLE_HOME/crs/install/rootcrs.pl -deconfig -force -verbose

Execute... On the last node :$ORACLE_HOME/crs/install/rootcrs.pl -deconfig -force -verbose -lastnode

restart OS Post execution :$ORACLE_HOME/root.sh

One thing to note is that , We're at the end of the execution $ORACLE_HOME/crs/install/rootcrs.pl -deconfig -force -verbose The following files need to be deleted after execution :

ls -l $ORACLE_BASE/Clusterware/ckptGridHA*

find $ORACLE_HOME/gpnp/* -type f

find $ORACLE_HOME/gpnp/* -type f -exec rm -rf {} \;

 

among (find $ORACLE_HOME/gpnp/* -type f) After deleting the file in , We are re executing root.sh The following prompt will appear only when the time is up :

root wallet

root wallet cert

root cert export

peer wallet

profile reader wallet

pa wallet

peer wallet keys

pa wallet keys

peer cert request

pa cert request

peer cert

pa cert

peer root cert TP

profile reader root cert TP

pa root cert TP

peer pa cert TP

pa peer cert TP

profile reader pa cert TP

profile reader peer cert TP

peer user cert

pa user cert

 

---------------------------------------------------------------------------------------------------------------------

 

 

Chapter two   Experimental part

Two .1   Introduction to the experimental environment

project

primary db

db  type

Single instance

db version

11.2.0.2.0

db  Storage

ASM

 

 

Two .2   The goal of the experiment

This time we simulate 6 An experiment :

1、dd Backup recovery OCR

2、OCR Physical backup and recovery of

3、OCR Logical backup and recovery of

4、 Delete grid Under the user $ORACLE_HOME/log Under the folder , Try resuming execution root.sh To recover data

5、permission.pl Use of scripts

6、 eliminate crs And replace the repair instance name , Because it's all about execution root.sh Script

Two .3   Experimental process

Two .3.1   Experiment 1 :dd Backup recovery OCR

First, turn off the cluster and dd Backup ocr Disk header content :

[zfzhlhrdb1:root]:/>crsctl query css votedisk

##  STATE    File Universal Id                File Name Disk group

--  -----    -----------------                --------- ---------

1. ONLINE   7e59ff6d88ba4fc0bfe5b6ccdd27ba55 (/dev/rhdisk2) [DATA]

Located 1 voting disk(s).

[zfzhlhrdb1:root]:/>dd if=/dev/rhdisk2 of=/tmp/votedisk_lhr.bak bs=1024k count=4

4+0 records in.

4+0 records out.

 

After shutting down the cluster , Use dd Command simulation ocr  damage   

[zfzhlhrdb1:root]:/>dd if=/dev/zero of=/dev/rhdisk2 bs=1024k count=4

4+0 records in.

4+0 records out.

 

[zfzhlhrdb2:root]:/>sh disk*

------------------------------------------------------------------------------------------------------------------------------

|                 disk                      |        PVID       |  no_reserve  | size(G) |    disktype      |  disk_storage  |

------------------------------------------------------------------------------------------------------------------------------

| crw------- root   system   /dev/rhdisk0   | 00f60f2b47d4b56f  | no_reserve   | 128     |  rootvg          | EMC,vscsi,3    |

| crw------- root   system   /dev/rhdisk1   | 00f60f2bd2147554  | single_path  | 128     |  T_XDESK_APP2_vg | EMC,fscsi,32   |

| crw-rw---- grid   asmadmin /dev/rhdisk2   | 0000000000000000  | no_reserve   | 128     |  Not_Used        | EMC,fscsi,32   |

| crw-rw---- grid   asmadmin /dev/rhdisk3   | 0000000000000000  | no_reserve   | 128     |  ASM:+FRA        | EMC,fscsi,32   |

| crw-rw---- root   system   /dev/rhdisk4   | 0000000000000000  | no_reserve   | 128     |  gpfs1nsd        | EMC,fscsi,32   |

| crw------- root   system   /dev/rhdisk5   | 00f60f2b6046c20d  | single_path  | 0       |  HeadDisk        | EMC,fscsi,32   |

| crw------- root   system   /dev/rhdisk6   | 00f60f2b6046ca7d  | single_path  | 0       |  HeadDisk        | EMC,fscsi,32   |

| crw------- root   system   /dev/rhdisk7   | 00f60f2b6046d2f8  | single_path  | 0       |  HeadDisk        | EMC,fscsi,32   |

| crw------- root   system   /dev/rhdisk8   | 00f60f2b6046dae6  | single_path  | 0       |  HeadDisk        | EMC,fscsi,32   |

------------------------------------------------------------------------------------------------------------------------------

| ASMDISK_TOTAL:1      TOTAL_SIZE(GB):128                                                                                    |

------------------------------------------------------------------------------------------------------------------------------

[zfzhlhrdb2:root]:/>

[zfzhlhrdb2:root]:/>cat disk*

if [ 1 = 1 ] ;then

  sum=0;asmnum=0

  awk  'BEGIN {printf "------------------------------------------------------------------------------------------------------------------------------\n"; printf "%-43s %-18s %-14s %-8s %-15s %-14s\n","|                 disk              ","|        PVID      ","|  no_reserve ","| size(G)","|    disktype     ","|  disk_storage  |"; printf "------------------------------------------------------------------------------------------------------------------------------\n";}'

  for diskname in `lspv | grep disk | awk '{print $1}'`;do

    mydiskname=`ls -l /dev/rdiskname|grep−w/dev/rdiskname|grep−w/dev/rdiskname| cut -c 1-12,17-38,59-76`

    mydiskpvid=`lquerypv -H /dev/$diskname | cut -c 1-16`

    if  [ "${mydiskpvid}" = "" ];then mydiskpvid="0000000000000000" ;  fi 2>/dev/null

    mydiskreserve=`lsattr -El $diskname | grep -i reserve_policy | cut -c 17-30`

    mydisksize=`bootinfo -s diskname2>/dev/null‘;let"mydisksize1=diskname2>/dev/null‘;let"mydisksize1=mydisksize/1024" 2>/dev/null

    mydiskvg=`lspv | grep -w $diskname | awk '{print $3}'`

    mydiskasmgroup=`lquerypv -h /dev/r$diskname|head -n 7|tail -n 1|awk -F ' ' '{print $NF}'|sed -e 's/\.//g' -e 's/\|//g' | awk '{ if (1!="")printf"+"1!="")printf"+"1 ; else print "NULL"}'`

    mydiskflag=`lquerypv -h /dev/r$diskname 2>/dev/null|grep -i orcldisk|wc -l`

    if  [ mydisksize−lt1000];thenmydisktype="HeadDisk";elif[mydisksize−lt1000];thenmydisktype="HeadDisk";elif[{mydisksize} -gt 1000 -a mydiskflag−gt0];thenmydisktype="ASM:"mydiskflag−gt0];thenmydisktype="ASM:"mydiskasmgroup; elif  [ mydisksize−gt1000−amydisksize−gt1000−a{mydiskflag} -eq 0 -a mydiskvg!="None"];thenmydisktype=mydiskvg!="None"];thenmydisktype=mydiskvg ; else  mydisktype="Not_Used"; fi 2>/dev/null

    mydiskpath=`lspath -l diskname2>/dev/null|head−1|awk′print$NF′|sed"s/.diskname2>/dev/null|head−1|awk′print$NF′|sed"s/.//"`

    mydiskstring=`odmget -q attribute="unique_id" CuAt|egrep "name|value"|paste - -|tr  '\t' ' '|grep -w ${diskname}|sed 's/\"//g'`

    mydiskstorage=`echo ${mydiskstring} 2> /dev/null|awk '{ if(NF /EMC/)print"EMC"elseif(NF /EMC/)print"EMC"elseif(NF ~ /NETAPP/) {print "NETAPP"} else if($NF ~ /HITACHI/) {print "HDS"}}'`

    mydiskdepth=`lsattr -El ${diskname}|grep queue_depth|awk '{print $2}'`

    mydiskstorage1=mydiskstorage","mydiskstorage","mydiskpath","$mydiskdepth

    [ mydisksize1−gt1−amydisksize1−gt1−a{mydiskflag} -gt 0 ] && { (( sum=sum+mydisksize1));((asmnum=mydisksize1));((asmnum=asmnum+1 )) ;}

    echo  "mydiskname""mydiskname""mydiskpvid"  "mydiskreserve""mydiskreserve""{mydisksize1%.*}"  "mydisktype""mydisktype""mydiskstorage1" | awk '{printf "| %-10s %-6s %-8s %-14s | %-17s | %-12s | %-8s|  %-15s | %-14s |\n",1,1,2,3,3,4,5,5,6,7,7,8,$9}'

  done   

  awk  'BEGIN {printf "------------------------------------------------------------------------------------------------------------------------------\n";}'

  echo  "ASMDISK_TOTAL:asmnum""TOTALSIZE(GB):asmnum""TOTALSIZE(GB):sum" |awk '{printf "| %-20s %-101s |\n", 1,1,2}'

  awk  'BEGIN {printf "------------------------------------------------------------------------------------------------------------------------------\n";}'

fi

[zfzhlhrdb2:root]:/>

 

[zfzhlhrdb1:root]:/>crsctl start has

CRS-4123: Oracle High Availability Services has been started.

[zfzhlhrdb1:root]:/>crsctl stat res -t

CRS-4535: Cannot communicate with Cluster Ready Services

CRS-4000: Command Status failed, or completed with errors.

[zfzhlhrdb1:root]:/>

[zfzhlhrdb1:root]:/>crsctl stat res -t -init

--------------------------------------------------------------------------------

NAME           TARGET  STATE        SERVER                   STATE_DETAILS      

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.asm

      1        ONLINE  OFFLINE                               Instance Shutdown  

ora.cluster_interconnect.haip

      1        ONLINE  OFFLINE                                                  

ora.crf

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.crsd

      1        ONLINE  OFFLINE                                                  

ora.cssd

      1        ONLINE  OFFLINE                               STARTING           

ora.cssdmonitor

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.ctssd

      1        ONLINE  OFFLINE                                                  

ora.diskmon

      1        OFFLINE OFFLINE                                                  

ora.drivers.acfs

      1        ONLINE  OFFLINE                                                  

ora.evmd

      1        ONLINE  OFFLINE                                                  

ora.gipcd

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.gpnpd

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.mdnsd

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

[zfzhlhrdb1:root]:/>

 

[zfzhlhrdb1:grid]:/home/grid>cluvfy comp ocr -n all

 

Verifying OCR integrity

Unable to retrieve nodelist from Oracle Clusterware

 

Verification cannot proceed

 

[zfzhlhrdb2:root]:/>ocrcheck

KGFCHECK kgfnStmtExecute01c: ret == OCI_SUCCESS: FAILED at kgfn.c:1563

KGFCHECK kgfpOpen01c: ok: FAILED at kgfp.c:519

-- trace dump on error exit --

Error [kgfoOpen01] in [kgfokge] at kgfo.c:1697

ORA-17503: ksfdopn:2 Failed to open file +DATA.255.4294967295

ORA-15001: diskgroup "DATA" does not exist or is not mounted

ORA-06512: at line 4

 

Category: 8

DepInfo: 15056

ADR is not properly configured

-- trace dump end --

-- trace dump on error exit --

Error [kgfoOpen01] in [kgfokge] at kgfo.c:1546

ORA-17503: ksfdopn:2 Failed to open file +DATA.255.4294967295

ORA-15001: diskgroup "DATA" does not exist or is not mounted

ORA-06512: at line 4

 

Category: 8

DepInfo: 15056

ADR is not properly configured

-- trace dump end --

KGFCHECK kgfnStmtSingle3: ret == OCI_SUCCESS: FAILED at kgfn.c:1770

-- trace dump on error exit --

Error [kgfo] in [kgfoCkMt03] at kgfo.c:2080

diskgroup DATA not mounted ()

Category: 6

DepInfo: 0

ADR is not properly configured

-- trace dump end --

KGFCHECK kgfnStmtSingle3: ret == OCI_SUCCESS: FAILED at kgfn.c:1770

-- trace dump on error exit --

Error [kgfo] in [kgfoCkMt03] at kgfo.c:2080

diskgroup DATA not mounted ()

Category: 6

DepInfo: 0

ADR is not properly configured

-- trace dump end --

PROT-602: Failed to retrieve data from the cluster registry

PROC-26: Error while accessing the physical storage

 

It means that the cluster can no longer be started , The disk head is also removed , Next, let's restore the cluster :

[zfzhlhrdb1:root]:/>crsctl stop has -f

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'zfzhlhrdb1'

........

 

[zfzhlhrdb1:root]:/>dd if=/tmp/votedisk_lhr.bak of=/dev/rhdisk2 bs=1024k count=4

4+0 records in.

4+0 records out.

[zfzhlhrdb1:root]:/>sh disk*

------------------------------------------------------------------------------------------------------------------------------

|                 disk                      |        PVID       |  no_reserve  | size(G) |    disktype      |  disk_storage  |

------------------------------------------------------------------------------------------------------------------------------

| crw------- root   system   /dev/rhdisk0   | 00f63a6147ced87a  | no_reserve   | 128     |  rootvg          | EMC,vscsi,3    |

| crw------- root   system   /dev/rhdisk1   | 00f63a61d2143e86  | single_path  | 128     |  T_XDESK_APP1_vg | EMC,fscsi,32   |

| crw-rw---- grid   asmadmin /dev/rhdisk2   | 0000000000000000  | no_reserve   | 128     |  ASM:+DATA       | EMC,fscsi,32   |

| crw-rw---- grid   asmadmin /dev/rhdisk3   | 0000000000000000  | no_reserve   | 128     |  ASM:+FRA        | EMC,fscsi,32   |

| crw-rw---- root   system   /dev/rhdisk4   | 0000000000000000  | no_reserve   | 128     |  gpfs1nsd        | EMC,fscsi,32   |

| crw------- root   system   /dev/rhdisk5   | 00f63a61c89dbd11  | single_path  | 0       |  HeadDisk        | EMC,fscsi,32   |

| crw------- root   system   /dev/rhdisk6   | 00f63a6160469425  | single_path  | 0       |  HeadDisk        | EMC,fscsi,32   |

| crw------- root   system   /dev/rhdisk7   | 00f63a6160469c21  | single_path  | 0       |  HeadDisk        | EMC,fscsi,32   |

| crw------- root   system   /dev/rhdisk8   | 0000000000000000  | single_path  | 0       |  HeadDisk        | EMC,fscsi,32   |

------------------------------------------------------------------------------------------------------------------------------

| ASMDISK_TOTAL:2      TOTAL_SIZE(GB):256                                                                                    |

------------------------------------------------------------------------------------------------------------------------------

[zfzhlhrdb1:root]:/>

[zfzhlhrdb1:root]:/>crsctl stat res -t -init

--------------------------------------------------------------------------------

NAME           TARGET  STATE        SERVER                   STATE_DETAILS      

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.asm

      1        ONLINE  ONLINE       zfzhlhrdb1               Started            

ora.cluster_interconnect.haip

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.crf

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.crsd

      1        ONLINE  ONLINE       zfzhlhrdb1               STOPPING           

ora.cssd

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.cssdmonitor

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.ctssd

      1        ONLINE  ONLINE       zfzhlhrdb1               OBSERVER           

ora.diskmon

      1        OFFLINE OFFLINE                                                  

ora.drivers.acfs

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.evmd

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.gipcd

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.gpnpd

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.mdnsd

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

[zfzhlhrdb1:root]:/>

[zfzhlhrdb1:root]:/>crsctl stop has -f

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.crsd' on 'zfzhlhrdb1'

CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.oc4j' on 'zfzhlhrdb1'

CRS-2675: Stop of 'ora.oc4j' on 'zfzhlhrdb1' failed

CRS-2679: Attempting to clean 'ora.oc4j' on 'zfzhlhrdb1'

CRS-2681: Clean of 'ora.oc4j' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.ons' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.ons' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.net1.network' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.net1.network' on 'zfzhlhrdb1' succeeded

CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'zfzhlhrdb1' has completed

CRS-2677: Stop of 'ora.crsd' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.mdnsd' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.crf' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.ctssd' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.evmd' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.asm' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.mdnsd' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.crf' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.evmd' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.ctssd' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.asm' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.cssd' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.cssd' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.gipcd' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.gipcd' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.gpnpd' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.gpnpd' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.drivers.acfs' on 'zfzhlhrdb1' succeeded

CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'zfzhlhrdb1' has completed

CRS-4133: Oracle High Availability Services has been stopped.

[zfzhlhrdb1:root]:/>ps -ef|grep d.bin

    root  4718784  7667788   0 19:47:26  pts/2  0:00 grep d.bin

[zfzhlhrdb1:root]:/>crsctl start has 

CRS-4123: Oracle High Availability Services has been started.

[zfzhlhrdb1:root]:/>

[zfzhlhrdb2:root]:/>crsctl stat res -t

--------------------------------------------------------------------------------

NAME           TARGET  STATE        SERVER                   STATE_DETAILS      

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.DATA.dg

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.FRA.dg

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.LISTENER.lsnr

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.LISTENER_LHRDG.lsnr

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.asm

               ONLINE  ONLINE       zfzhlhrdb1               Started            

               ONLINE  ONLINE       zfzhlhrdb2               Started            

ora.gsd

               OFFLINE OFFLINE      zfzhlhrdb1                                  

               OFFLINE OFFLINE      zfzhlhrdb2                                  

ora.net1.network

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.ons

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.registry.acfs

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.cvu

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.lhrdg.db

      1        ONLINE  OFFLINE                               Instance Shutdown  

      2        ONLINE  OFFLINE                               Instance Shutdown  

ora.oc4j

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.oraesdb.db

      1        ONLINE  OFFLINE                               Corrupted Controlfi

                                                             le                 

      2        ONLINE  OFFLINE                               Corrupted Controlfi

                                                             le                 

ora.oraeskdb.db

      1        ONLINE  OFFLINE                               Instance Shutdown  

      2        ONLINE  OFFLINE                               Instance Shutdown  

ora.raclhr.db

      1        ONLINE  OFFLINE                               Instance Shutdown  

      2        ONLINE  OFFLINE                               Instance Shutdown  

ora.scan1.vip

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.zfzhlhrdb1.vip

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.zfzhlhrdb2.vip

      1        ONLINE  ONLINE       zfzhlhrdb2                                  

[zfzhlhrdb2:root]:/>       

 

You can see that the cluster can start normally , Next, fix a few db I'll just ask you a question .

Two .3.2   Experiment two : adopt kfed Repair the disk head

Backup ASM Disk head

# dd if=/dev/rhdisk2 of=/tmp/asm_dd.bak bs=1024 count=4

 

[zfzhlhrdb1:root]:/>dd if=/dev/rhdisk2 of=/tmp/asm_dd.bak bs=1024 count=4

4+0 records in.

4+0 records out.

 

damage ASM Disk head

# dd if=/dev/zero  of=/dev/rhdisk2 bs=1024 count=4

[zfzhlhrdb1:root]:/>dd if=/dev/zero  of=/dev/rhdisk2 bs=1024 count=4

4+0 records in.

4+0 records out.

 

see ASM Disk header information ( Empty )

# lquerypv -h /dev/rhdisk2

[zfzhlhrdb1:root]:/>lquerypv -h /dev/rhdisk2

00000000   00000000 00000000 00000000 00000000  |................|

00000010   00000000 00000000 00000000 00000000  |................|

00000020   00000000 00000000 00000000 00000000  |................|

00000030   00000000 00000000 00000000 00000000  |................|

00000040   00000000 00000000 00000000 00000000  |................|

00000050   00000000 00000000 00000000 00000000  |................|

00000060   00000000 00000000 00000000 00000000  |................|

00000070   00000000 00000000 00000000 00000000  |................|

00000080   00000000 00000000 00000000 00000000  |................|

00000090   00000000 00000000 00000000 00000000  |................|

000000A0   00000000 00000000 00000000 00000000  |................|

000000B0   00000000 00000000 00000000 00000000  |................|

000000C0   00000000 00000000 00000000 00000000  |................|

000000D0   00000000 00000000 00000000 00000000  |................|

000000E0   00000000 00000000 00000000 00000000  |................|

000000F0   00000000 00000000 00000000 00000000  |................|

 

stop it HAS service

# crsctl stop has -f

[zfzhlhrdb1:root]:/>crsctl stop has -f

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.crsd' on 'zfzhlhrdb1'

CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.LISTENER_LHRDG.lsnr' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.oc4j' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.cvu' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.registry.acfs' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.FRA.dg' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.oralhrq.db' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.cvu' on 'zfzhlhrdb1' succeeded

CRS-2672: Attempting to start 'ora.cvu' on 'zfzhlhrdb2'

CRS-2677: Stop of 'ora.FRA.dg' on 'zfzhlhrdb1' succeeded

CRS-2676: Start of 'ora.cvu' on 'zfzhlhrdb2' succeeded

CRS-2677: Stop of 'ora.oralhrq.db' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.DATA.dg' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.scan1.vip' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.LISTENER_LHRDG.lsnr' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.registry.acfs' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.zfzhlhrdb1.vip' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.scan1.vip' on 'zfzhlhrdb1' succeeded

CRS-2672: Attempting to start 'ora.scan1.vip' on 'zfzhlhrdb2'

CRS-2677: Stop of 'ora.zfzhlhrdb1.vip' on 'zfzhlhrdb1' succeeded

CRS-2672: Attempting to start 'ora.zfzhlhrdb1.vip' on 'zfzhlhrdb2'

CRS-2676: Start of 'ora.scan1.vip' on 'zfzhlhrdb2' succeeded

CRS-2672: Attempting to start 'ora.LISTENER_SCAN1.lsnr' on 'zfzhlhrdb2'

CRS-2676: Start of 'ora.zfzhlhrdb1.vip' on 'zfzhlhrdb2' succeeded

CRS-2676: Start of 'ora.LISTENER_SCAN1.lsnr' on 'zfzhlhrdb2' succeeded

CRS-2677: Stop of 'ora.DATA.dg' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.asm' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.asm' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.oc4j' on 'zfzhlhrdb1' succeeded

CRS-2672: Attempting to start 'ora.oc4j' on 'zfzhlhrdb2'

CRS-2676: Start of 'ora.oc4j' on 'zfzhlhrdb2' succeeded

CRS-2673: Attempting to stop 'ora.ons' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.ons' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.net1.network' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.net1.network' on 'zfzhlhrdb1' succeeded

CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'zfzhlhrdb1' has completed

CRS-2677: Stop of 'ora.crsd' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.mdnsd' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.crf' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.ctssd' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.evmd' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.asm' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.mdnsd' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.ctssd' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.evmd' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.crf' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.asm' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.cssd' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.cssd' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.gipcd' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.gipcd' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.gpnpd' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.gpnpd' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.drivers.acfs' on 'zfzhlhrdb1' succeeded

CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'zfzhlhrdb1' has completed

CRS-4133: Oracle High Availability Services has been stopped.

[zfzhlhrdb1:root]:/>crsctl start has

CRS-4123: Oracle High Availability Services has been started.

[zfzhlhrdb1:root]:/>crsctl stat res -t -init

--------------------------------------------------------------------------------

NAME           TARGET  STATE        SERVER                   STATE_DETAILS      

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.asm

      1        ONLINE  OFFLINE                               Instance Shutdown  

ora.cluster_interconnect.haip

      1        ONLINE  OFFLINE                                                  

ora.crf

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.crsd

      1        ONLINE  OFFLINE                                                  

ora.cssd

      1        ONLINE  OFFLINE                               STARTING           

ora.cssdmonitor

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.ctssd

      1        ONLINE  OFFLINE                                                  

ora.diskmon

      1        OFFLINE OFFLINE                                                  

ora.drivers.acfs

      1        ONLINE  OFFLINE                                                  

ora.evmd

      1        ONLINE  OFFLINE                                                  

ora.gipcd

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.gpnpd

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.mdnsd

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

[zfzhlhrdb1:root]:/>

adopt KFED The command to repair ASM Disk head

# kfed repair /dev/rhdisk2

[zfzhlhrdb1:root]:/>kfed repair /dev/rhdisk2

[zfzhlhrdb1:root]:/>

see ASM Disk header information

[zfzhlhrdb1:root]:/>lquerypv -h /dev/rhdisk2

00000000   00820101 00000000 80000000 9D6A73D5  |.............js.|

00000010   00000000 00000000 00000000 00000000  |................|

00000020   4F52434C 4449534B 00000000 00000000  |ORCLDISK........|

00000030   00000000 00000000 00000000 00000000  |................|

00000040   0B200000 00000103 44415441 5F303030  |. ......DATA_000|

00000050   30000000 00000000 00000000 00000000  |0...............|

00000060   00000000 00000000 44415441 00000000  |........DATA....|

00000070   00000000 00000000 00000000 00000000  |................|

00000080   00000000 00000000 44415441 5F303030  |........DATA_000|

00000090   30000000 00000000 00000000 00000000  |0...............|

000000A0   00000000 00000000 00000000 00000000  |................|

000000B0   00000000 00000000 00000000 00000000  |................|

000000C0   00000000 00000000 01F81BD3 40FE1000  |............@...|

000000D0   01F81BD4 50600800 02001000 00100000  |....P`..........|

000000E0   0001BC80 0002001C 00000003 00000001  |................|

000000F0   00000002 00000002 00000000 00000000  |................|

[zfzhlhrdb1:root]:/>

 

start-up HAS service

# crsctl start has

View service startup information

# crsctl stat res -t

[zfzhlhrdb1:root]:/>crsctl stat res -t

--------------------------------------------------------------------------------

NAME           TARGET  STATE        SERVER                   STATE_DETAILS      

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.DATA.dg

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.FRA.dg

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.LISTENER.lsnr

               ONLINE  OFFLINE      zfzhlhrdb1               STARTING           

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.LISTENER_LHRDG.lsnr

               ONLINE  OFFLINE      zfzhlhrdb1               STARTING           

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.asm

               ONLINE  ONLINE       zfzhlhrdb1               Started            

               ONLINE  ONLINE       zfzhlhrdb2               Started            

ora.gsd

               OFFLINE OFFLINE      zfzhlhrdb1                                  

               OFFLINE OFFLINE      zfzhlhrdb2                                  

ora.net1.network

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.ons

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.registry.acfs

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

      1        ONLINE  ONLINE       zfzhlhrdb2                                  

ora.cvu

      1        ONLINE  ONLINE       zfzhlhrdb2                                  

ora.lhrdg.db

      1        ONLINE  OFFLINE                               Instance Shutdown  

      2        ONLINE  OFFLINE                                                  

ora.oc4j

      1        ONLINE  ONLINE       zfzhlhrdb2                                  

ora.oraesdb.db

      1        ONLINE  OFFLINE                               Corrupted Controlfi

                                                             le                 

      2        ONLINE  OFFLINE                                                  

ora.oraeskdb.db

      1        ONLINE  OFFLINE                               Instance Shutdown  

      2        ONLINE  OFFLINE                                                  

ora.oralhrq.db

      1        ONLINE  ONLINE       zfzhlhrdb2               Open               

      2        ONLINE  OFFLINE                               Instance Shutdown  

ora.raclhr.db

      1        ONLINE  OFFLINE                               Instance Shutdown  

      2        ONLINE  OFFLINE                                                  

ora.scan1.vip

      1        ONLINE  ONLINE       zfzhlhrdb2                                  

ora.zfzhlhrdb1.vip

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.zfzhlhrdb2.vip

      1        ONLINE  ONLINE       zfzhlhrdb2                                  

[zfzhlhrdb1:root]:/>

 

 

Two .3.3   Experiment three : Physical backup and recovery ( Automatic backup )

ocrconfig -manualbackup

ocrconfig -showbackup

crsctl query css votedisk

crsctl stop crs -f

crsctl start crs -excl

crsctl stop resource ora.crsd -init

ocrconfig -restore /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/backup_20160701_152358.ocr

 

[ZFTPCCDB1:root]:/>su - grid

[ZFTPCCDB1:grid]:/home/grid>cluvfy comp ocr -n all -verbose

 

Verifying OCR integrity

 

Checking OCR integrity...

 

Checking the absence of a non-clustered configuration...

All nodes free of non-clustered, local-only configurations

 

 

ASM Running check passed. ASM is running on all specified nodes

 

Checking OCR config file "/etc/oracle/ocr.loc"...

 

OCR config file "/etc/oracle/ocr.loc" check successful

 

 

Disk group for ocr location "+DATA1" available on all the nodes

 

 

NOTE:

This check does not verify the integrity of the OCR contents. Execute 'ocrcheck' as a privileged user to verify the contents of OCR.

 

OCR integrity check passed

 

Verification of OCR integrity was successful.

[ZFTPCCDB1:grid]:/home/grid>

[ZFTPCCDB1:grid]:/home/grid>

[ZFTPCCDB1:grid]:/home/grid>exit

[ZFTPCCDB1:root]:/>ocrconfig -showbackup

PROT-24: Auto backups for the Oracle Cluster Registry are not available

 

zftpccdb1     2016/07/01 15:23:58     /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/backup_20160701_152358.ocr

[ZFTPCCDB1:root]:/>ocrconfig -manualbackup 

 

zftpccdb2     2016/07/01 16:08:22     /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/backup_20160701_160822.ocr

 

zftpccdb1     2016/07/01 15:23:58     /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/backup_20160701_152358.ocr

[ZFTPCCDB1:root]:/>ocrconfig -showbackup

PROT-24: Auto backups for the Oracle Cluster Registry are not available

 

zftpccdb2     2016/07/01 16:08:22     /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/backup_20160701_160822.ocr

 

zftpccdb1     2016/07/01 15:23:58     /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/backup_20160701_152358.ocr

[ZFTPCCDB1:root]:/>

 

 

 

2 All nodes stop CRS:

[ZFTPCCDB1:root]:/>crsctl query css votedisk

##  STATE    File Universal Id                File Name Disk group

--  -----    -----------------                --------- ---------

1. ONLINE   2da6f80ec3e64f45bfca9dabe0dd65eb (/dev/rhdisk1) [DATA1]

Located 1 voting disk(s).

 

[ZFTPCCDB1:root]:/>ocrconfig -restore /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/backup_20160701_152358.ocr

PROT-19: Cannot proceed while the Cluster Ready Service is running

 

[ZFTPCCDB1:root]:/>crsctl stop crs -f

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.crsd' on 'zftpccdb1'

CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.zftpccdb2.vip' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.oc4j' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.cvu' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.registry.acfs' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.oralhr.db' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'zftpccdb1'

CRS-2677: Stop of 'ora.zftpccdb2.vip' on 'zftpccdb1' succeeded

CRS-2672: Attempting to start 'ora.zftpccdb2.vip' on 'zftpccdb2'

CRS-2677: Stop of 'ora.cvu' on 'zftpccdb1' succeeded

CRS-2672: Attempting to start 'ora.cvu' on 'zftpccdb2'

CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.scan1.vip' on 'zftpccdb1'

CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'zftpccdb1' succeeded

CRS-2677: Stop of 'ora.scan1.vip' on 'zftpccdb1' succeeded

CRS-2672: Attempting to start 'ora.scan1.vip' on 'zftpccdb2'

CRS-2676: Start of 'ora.cvu' on 'zftpccdb2' succeeded

CRS-2677: Stop of 'ora.oralhr.db' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.DATA1.dg' on 'zftpccdb1'

CRS-2676: Start of 'ora.zftpccdb2.vip' on 'zftpccdb2' succeeded

CRS-2672: Attempting to start 'ora.LISTENER.lsnr' on 'zftpccdb2'

CRS-2676: Start of 'ora.scan1.vip' on 'zftpccdb2' succeeded

CRS-2672: Attempting to start 'ora.LISTENER_SCAN1.lsnr' on 'zftpccdb2'

CRS-2676: Start of 'ora.LISTENER.lsnr' on 'zftpccdb2' succeeded

CRS-2673: Attempting to stop 'ora.zftpccdb1.vip' on 'zftpccdb1'

CRS-2677: Stop of 'ora.zftpccdb1.vip' on 'zftpccdb1' succeeded

CRS-2672: Attempting to start 'ora.zftpccdb1.vip' on 'zftpccdb2'

CRS-2676: Start of 'ora.LISTENER_SCAN1.lsnr' on 'zftpccdb2' succeeded

CRS-2677: Stop of 'ora.registry.acfs' on 'zftpccdb1' succeeded

CRS-2676: Start of 'ora.zftpccdb1.vip' on 'zftpccdb2' succeeded

CRS-2677: Stop of 'ora.oc4j' on 'zftpccdb1' succeeded

CRS-2672: Attempting to start 'ora.oc4j' on 'zftpccdb2'

CRS-2676: Start of 'ora.oc4j' on 'zftpccdb2' succeeded

CRS-2677: Stop of 'ora.DATA1.dg' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.asm' on 'zftpccdb1'

CRS-2677: Stop of 'ora.asm' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.ons' on 'zftpccdb1'

CRS-2677: Stop of 'ora.ons' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.net1.network' on 'zftpccdb1'

CRS-2677: Stop of 'ora.net1.network' on 'zftpccdb1' succeeded

CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'zftpccdb1' has completed

CRS-2677: Stop of 'ora.crsd' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.mdnsd' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.crf' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.ctssd' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.evmd' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.asm' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'zftpccdb1'

CRS-2677: Stop of 'ora.mdnsd' on 'zftpccdb1' succeeded

CRS-2677: Stop of 'ora.evmd' on 'zftpccdb1' succeeded

CRS-2677: Stop of 'ora.crf' on 'zftpccdb1' succeeded

CRS-2677: Stop of 'ora.asm' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'zftpccdb1'

CRS-2677: Stop of 'ora.ctssd' on 'zftpccdb1' succeeded

CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.cssd' on 'zftpccdb1'

CRS-2677: Stop of 'ora.cssd' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.gipcd' on 'zftpccdb1'

CRS-2677: Stop of 'ora.gipcd' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.gpnpd' on 'zftpccdb1'

CRS-2677: Stop of 'ora.gpnpd' on 'zftpccdb1' succeeded

CRS-2677: Stop of 'ora.drivers.acfs' on 'zftpccdb1' succeeded

CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'zftpccdb1' has completed

CRS-4133: Oracle High Availability Services has been stopped.

 

[ZFTPCCDB1:root]:/>ps -ef|grep d.bin

    root 4391306 6094924   0 16:31:03  pts/0  0:00 grep d.bin

[ZFTPCCDB1:root]:/>

 

[ZFTPCCDB1:root]:/>ocrconfig -restore /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/backup_20160701_152358.ocr

-- trace dump on error exit --

Error [kgfoAl06] in [kgfokge] at kgfo.c:1529

ORA-29701: unable to connect to Cluster Synchronization Service

 

Category: 7

DepInfo: 29701

ADR is not properly configured

-- trace dump end --

-- trace dump on error exit --

Error [kgfoAl06] in [kgfokge] at kgfo.c:1255

ORA-29701: unable to connect to Cluster Synchronization Service

 

Category: 7

DepInfo: 29701

ADR is not properly configured

-- trace dump end --

-- trace dump on error exit --

Error [kgfoAl06] in [kgfokge] at kgfo.c:2063

ORA-29701: unable to connect to Cluster Synchronization Service

 

Category: 7

DepInfo: 29701

ADR is not properly configured

-- trace dump end --

PROT-35: The configured Oracle Cluster Registry locations are not accessible

 

[ZFTPCCDB1:root]:/>crsctl start crs -excl

CRS-4123: Oracle High Availability Services has been started.

CRS-2672: Attempting to start 'ora.mdnsd' on 'zftpccdb1'

CRS-2676: Start of 'ora.mdnsd' on 'zftpccdb1' succeeded

CRS-2672: Attempting to start 'ora.gpnpd' on 'zftpccdb1'

CRS-2676: Start of 'ora.gpnpd' on 'zftpccdb1' succeeded

CRS-2672: Attempting to start 'ora.cssdmonitor' on 'zftpccdb1'

CRS-2672: Attempting to start 'ora.gipcd' on 'zftpccdb1'

CRS-2676: Start of 'ora.cssdmonitor' on 'zftpccdb1' succeeded

CRS-2676: Start of 'ora.gipcd' on 'zftpccdb1' succeeded

CRS-2672: Attempting to start 'ora.cssd' on 'zftpccdb1'

CRS-2672: Attempting to start 'ora.diskmon' on 'zftpccdb1'

CRS-2676: Start of 'ora.diskmon' on 'zftpccdb1' succeeded

CRS-2676: Start of 'ora.cssd' on 'zftpccdb1' succeeded

CRS-2672: Attempting to start 'ora.ctssd' on 'zftpccdb1'

CRS-2672: Attempting to start 'ora.drivers.acfs' on 'zftpccdb1'

CRS-2679: Attempting to clean 'ora.cluster_interconnect.haip' on 'zftpccdb1'

CRS-2681: Clean of 'ora.cluster_interconnect.haip' on 'zftpccdb1' succeeded

CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'zftpccdb1'

CRS-2676: Start of 'ora.ctssd' on 'zftpccdb1' succeeded

CRS-2676: Start of 'ora.drivers.acfs' on 'zftpccdb1' succeeded

CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'zftpccdb1' succeeded

CRS-2672: Attempting to start 'ora.asm' on 'zftpccdb1'

CRS-2674: Start of 'ora.asm' on 'zftpccdb1' failed

CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'zftpccdb1'

CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'zftpccdb1'

tempting to stop 'ora.drivers.acfs' on 'zftpccdb1'

CRS-2677: Stop of 'ora.drivers.acfs' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.ctssd' on 'zftpccdb1'

CRS-2677: Stop of 'ora.ctssd' on 'zftpccdb1' succeeded

CRS-4000: Command Start failed, or completed with errors.

[ZFTPCCDB1:root]:/>

 

 

 

 

[ZFTPCCDB1:root]:/>crsctl stat res -t -init

--------------------------------------------------------------------------------

NAME           TARGET  STATE        SERVER                   STATE_DETAILS      

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.asm

      1        ONLINE  ONLINE       zftpccdb1                Started            

ora.cluster_interconnect.haip

      1        ONLINE  ONLINE       zftpccdb1                                   

ora.crf

      1        OFFLINE OFFLINE                                                  

ora.crsd

      1        ONLINE  INTERMEDIATE zftpccdb1                EXCLUSIVE          

ora.cssd

      1        ONLINE  ONLINE       zftpccdb1                                   

ora.cssdmonitor

      1        ONLINE  ONLINE       zftpccdb1                                   

ora.ctssd

      1        ONLINE  ONLINE       zftpccdb1                OBSERVER           

ora.diskmon

      1        OFFLINE OFFLINE                                                  

ora.drivers.acfs

      1        ONLINE  ONLINE       zftpccdb1                                   

ora.evmd

      1        OFFLINE OFFLINE                                                  

ora.gipcd

      1        ONLINE  ONLINE       zftpccdb1                                   

ora.gpnpd

      1        ONLINE  ONLINE       zftpccdb1                                   

ora.mdnsd

      1        ONLINE  ONLINE       zftpccdb1         

 

[ZFTPCCDB1:root]:/>ocrconfig -restore /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/backup_20160701_152358.ocr

PROT-19: Cannot proceed while the Cluster Ready Service is running

[ZFTPCCDB1:root]:/>crsctl stop resource ora.crsd -init

CRS-2673: Attempting to stop 'ora.crsd' on 'zftpccdb1'

CRS-2677: Stop of 'ora.crsd' on 'zftpccdb1' succeeded

[ZFTPCCDB1:root]:/>ocrconfig -restore /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/backup_20160701_152358.ocr

[ZFTPCCDB1:root]:/>

[ZFTPCCDB1:root]:/>crsctl stop has -f

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.mdnsd' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'zftpccdb1'

CRS-2677: Stop of 'ora.mdnsd' on 'zftpccdb1' succeeded

CRS-2677: Stop of 'ora.drivers.acfs' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.ctssd' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'zftpccdb1'

CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'zftpccdb1' succeeded

CRS-2677: Stop of 'ora.ctssd' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.cssd' on 'zftpccdb1'

CRS-2677: Stop of 'ora.cssd' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.gipcd' on 'zftpccdb1'

CRS-2677: Stop of 'ora.gipcd' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.gpnpd' on 'zftpccdb1'

CRS-2677: Stop of 'ora.gpnpd' on 'zftpccdb1' succeeded

CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'zftpccdb1' has completed

CRS-4133: Oracle High Availability Services has been stopped.

[ZFTPCCDB1:root]:/>crsctl start has

CRS-4123: Oracle High Availability Services has been started.

 

[ZFTPCCDB1:root]:/>crsctl stat res -t

--------------------------------------------------------------------------------

NAME           TARGET  STATE        SERVER                   STATE_DETAILS      

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.DATA1.dg

               ONLINE  ONLINE       zftpccdb1                                   

               ONLINE  ONLINE       zftpccdb2                                   

ora.LISTENER.lsnr

               ONLINE  ONLINE       zftpccdb1                                   

               ONLINE  ONLINE       zftpccdb2                                   

ora.asm

               ONLINE  ONLINE       zftpccdb1                Started            

               ONLINE  ONLINE       zftpccdb2                Started            

ora.gsd

               OFFLINE OFFLINE      zftpccdb1                                   

               OFFLINE OFFLINE      zftpccdb2                                   

ora.net1.network

               ONLINE  ONLINE       zftpccdb1                                   

               ONLINE  ONLINE       zftpccdb2                                   

ora.ons

               ONLINE  ONLINE       zftpccdb1                                   

               ONLINE  ONLINE       zftpccdb2                                   

ora.registry.acfs

               ONLINE  ONLINE       zftpccdb1                                   

               ONLINE  ONLINE       zftpccdb2                                   

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

      1        ONLINE  ONLINE       zftpccdb2                                   

ora.cvu

      1        ONLINE  ONLINE       zftpccdb2                                   

ora.oc4j

      1        ONLINE  ONLINE       zftpccdb2                                   

ora.oralhr.db

      1        ONLINE  ONLINE       zftpccdb1                Open               

      2        ONLINE  ONLINE       zftpccdb2                Open               

ora.scan1.vip

      1        ONLINE  ONLINE       zftpccdb2                                   

ora.zftpccdb1.vip

      1        ONLINE  ONLINE       zftpccdb1                                   

ora.zftpccdb2.vip

      1        ONLINE  ONLINE       zftpccdb2                                   

[ZFTPCCDB1:root]:/>

 

 

Successful recovery .

 

 

 

 

Two .3.4   Experiment four : Logical backup and recovery ( Manual backup )

ocrconfig -export /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/export_asm_lhr.bak

ocrconfig -import /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/export_asm_lhr.bak

crsctl stop crs

crsctl start crs -excl -nocrs

ocrconfig -import /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/export_asm_lhr.bak

crsctl start crs

 

 

[ZFTPCCDB1:root]:/>ocrconfig -export /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/export_asm_lhr.bak

[ZFTPCCDB1:root]:/>ocrconfig -import /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/export_asm_lhr.bak

PROT-19: Cannot proceed while the Cluster Ready Service is running

[ZFTPCCDB1:root]:/>crsctl stop crs

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.crsd' on 'zftpccdb1'

CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.registry.acfs' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.oralhr.db' on 'zftpccdb1'

CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.zftpccdb1.vip' on 'zftpccdb1'

CRS-2677: Stop of 'ora.zftpccdb1.vip' on 'zftpccdb1' succeeded

CRS-2672: Attempting to start 'ora.zftpccdb1.vip' on 'zftpccdb2'

CRS-2677: Stop of 'ora.oralhr.db' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.DATA1.dg' on 'zftpccdb1'

CRS-2676: Start of 'ora.zftpccdb1.vip' on 'zftpccdb2' succeeded

CRS-2677: Stop of 'ora.registry.acfs' on 'zftpccdb1' succeeded

CRS-2677: Stop of 'ora.DATA1.dg' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.asm' on 'zftpccdb1'

CRS-2677: Stop of 'ora.asm' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.ons' on 'zftpccdb1'

CRS-2677: Stop of 'ora.ons' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.net1.network' on 'zftpccdb1'

CRS-2677: Stop of 'ora.net1.network' on 'zftpccdb1' succeeded

CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'zftpccdb1' has completed

CRS-2677: Stop of 'ora.crsd' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.mdnsd' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.crf' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.ctssd' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.evmd' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.asm' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'zftpccdb1'

CRS-2677: Stop of 'ora.mdnsd' on 'zftpccdb1' succeeded

CRS-2677: Stop of 'ora.evmd' on 'zftpccdb1' succeeded

CRS-2677: Stop of 'ora.crf' on 'zftpccdb1' succeeded

CRS-2677: Stop of 'ora.asm' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'zftpccdb1'

CRS-2677: Stop of 'ora.ctssd' on 'zftpccdb1' succeeded

CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.cssd' on 'zftpccdb1'

CRS-2677: Stop of 'ora.cssd' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.gipcd' on 'zftpccdb1'

CRS-2677: Stop of 'ora.gipcd' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.gpnpd' on 'zftpccdb1'

CRS-2677: Stop of 'ora.drivers.acfs' on 'zftpccdb1' succeeded

CRS-2677: Stop of 'ora.gpnpd' on 'zftpccdb1' succeeded

CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'zftpccdb1' has completed

CRS-4133: Oracle High Availability Services has been stopped.

[ZFTPCCDB1:root]:/>

[ZFTPCCDB1:root]:/>ocrconfig -import /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/export_asm_lhr.bak

-- trace dump on error exit --

Error [kgfoAl06] in [kgfokge] at kgfo.c:1529

ORA-15077: could not locate ASM instance serving a required diskgroup

 

Category: 7

DepInfo: 15077

ADR is not properly configured

-- trace dump end --

-- trace dump on error exit --

Error [kgfoAl06] in [kgfokge] at kgfo.c:1255

ORA-15077: could not locate ASM instance serving a required diskgroup

 

Category: 7

DepInfo: 15077

ADR is not properly configured

-- trace dump end --

-- trace dump on error exit --

Error [kgfoAl06] in [kgfokge] at kgfo.c:2063

ORA-15077: could not locate ASM instance serving a required diskgroup

 

Category: 7

DepInfo: 15077

ADR is not properly configured

-- trace dump end --

PROT-1: Failed to initialize ocrconfig

PROC-26: Error while accessing the physical storage

ORA-15077: could not locate ASM instance serving a required diskgroup

 

[ZFTPCCDB1:root]:/>

[ZFTPCCDB1:root]:/>crsctl start crs -excl -nocrs

CRS-4123: Oracle High Availability Services has been started.

CRS-2672: Attempting to start 'ora.mdnsd' on 'zftpccdb1'

CRS-2676: Start of 'ora.mdnsd' on 'zftpccdb1' succeeded

CRS-2672: Attempting to start 'ora.gpnpd' on 'zftpccdb1'

CRS-2676: Start of 'ora.gpnpd' on 'zftpccdb1' succeeded

CRS-2672: Attempting to start 'ora.cssdmonitor' on 'zftpccdb1'

CRS-2672: Attempting to start 'ora.gipcd' on 'zftpccdb1'

CRS-2676: Start of 'ora.cssdmonitor' on 'zftpccdb1' succeeded

CRS-2676: Start of 'ora.gipcd' on 'zftpccdb1' succeeded

CRS-2672: Attempting to start 'ora.cssd' on 'zftpccdb1'

CRS-2672: Attempting to start 'ora.diskmon' on 'zftpccdb1'

CRS-2676: Start of 'ora.diskmon' on 'zftpccdb1' succeeded

CRS-2676: Start of 'ora.cssd' on 'zftpccdb1' succeeded

CRS-2672: Attempting to start 'ora.drivers.acfs' on 'zftpccdb1'

CRS-2679: Attempting to clean 'ora.cluster_interconnect.haip' on 'zftpccdb1'

CRS-2672: Attempting to start 'ora.ctssd' on 'zftpccdb1'

CRS-2681: Clean of 'ora.cluster_interconnect.haip' on 'zftpccdb1' succeeded

CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'zftpccdb1'

CRS-2676: Start of 'ora.ctssd' on 'zftpccdb1' succeeded

CRS-2676: Start of 'ora.drivers.acfs' on 'zftpccdb1' succeeded

CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'zftpccdb1' succeeded

CRS-2672: Attempting to start 'ora.asm' on 'zftpccdb1'

CRS-2676: Start of 'ora.asm' on 'zftpccdb1' succeeded

[ZFTPCCDB1:root]:/>ocrconfig -import /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/export_asm_lhr.bak

[ZFTPCCDB1:root]:/>crsctl stop has -f

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.mdnsd' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.ctssd' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.asm' on 'zftpccdb1'

CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'zftpccdb1'

CRS-2677: Stop of 'ora.mdnsd' on 'zftpccdb1' succeeded

CRS-2677: Stop of 'ora.asm' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'zftpccdb1'

CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'zftpccdb1' succeeded

CRS-2677: Stop of 'ora.ctssd' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.cssd' on 'zftpccdb1'

CRS-2677: Stop of 'ora.drivers.acfs' on 'zftpccdb1' succeeded

CRS-2677: Stop of 'ora.cssd' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.gipcd' on 'zftpccdb1'

CRS-2677: Stop of 'ora.gipcd' on 'zftpccdb1' succeeded

CRS-2673: Attempting to stop 'ora.gpnpd' on 'zftpccdb1'

CRS-2677: Stop of 'ora.gpnpd' on 'zftpccdb1' succeeded

CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'zftpccdb1' has completed

CRS-4133: Oracle High Availability Services has been stopped.

[ZFTPCCDB1:root]:/>crsctl start has

CRS-4123: Oracle High Availability Services has been started.

[ZFTPCCDB1:root]:/>

[ZFTPCCDB1:root]:/>crsctl stat res -t

--------------------------------------------------------------------------------

NAME           TARGET  STATE        SERVER                   STATE_DETAILS      

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.DATA1.dg

               ONLINE  ONLINE       zftpccdb1                                   

               ONLINE  ONLINE       zftpccdb2                                   

ora.LISTENER.lsnr

               ONLINE  ONLINE       zftpccdb1                                   

               ONLINE  ONLINE       zftpccdb2                                   

ora.asm

               ONLINE  ONLINE       zftpccdb1                Started            

               ONLINE  ONLINE       zftpccdb2                Started            

ora.gsd

               OFFLINE OFFLINE      zftpccdb1                                   

               OFFLINE OFFLINE      zftpccdb2                                   

ora.net1.network

               ONLINE  ONLINE       zftpccdb1                                   

               ONLINE  ONLINE       zftpccdb2                                   

ora.ons

               ONLINE  ONLINE       zftpccdb1                                   

               ONLINE  ONLINE       zftpccdb2                                   

ora.registry.acfs

               ONLINE  ONLINE       zftpccdb1                                   

               ONLINE  ONLINE       zftpccdb2                                   

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

      1        ONLINE  ONLINE       zftpccdb2                                   

ora.cvu

      1        ONLINE  ONLINE       zftpccdb1                                   

ora.oc4j

      1        ONLINE  ONLINE       zftpccdb1                                   

ora.oralhr.db

      1        ONLINE  ONLINE       zftpccdb1                Open               

      2        ONLINE  ONLINE       zftpccdb2                Open               

ora.scan1.vip

      1        ONLINE  ONLINE       zftpccdb2                                   

ora.zftpccdb1.vip

      1        ONLINE  ONLINE       zftpccdb1                                   

ora.zftpccdb2.vip

      1        ONLINE  ONLINE       zftpccdb2                                   

[ZFTPCCDB1:root]:/>

 

Successful recovery .

Two .3.5   Experiment five : Delete $ORACLE_HOME/log After the repair of the folder under

In this experiment , We delete grid Log file under user :$ORACLE_HOME/log, The contents of the folder are deleted, causing the cluster to fail to start .

 

[zfzhlhrdb1:root]:/>crsctl stat res -t

--------------------------------------------------------------------------------

NAME           TARGET  STATE        SERVER                   STATE_DETAILS      

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.DATA.dg

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.asm

               ONLINE  ONLINE       zfzhlhrdb1               Started            

               ONLINE  ONLINE       zfzhlhrdb2               Started            

ora.gsd

               OFFLINE OFFLINE      zfzhlhrdb1                                  

               OFFLINE OFFLINE      zfzhlhrdb2                                  

ora.net1.network

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.ons

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.registry.acfs

               ONLINE  OFFLINE      zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.cvu

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.oc4j

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.oraesdb.db

      1        ONLINE  ONLINE       zfzhlhrdb1               Open               

      2        ONLINE  ONLINE       zfzhlhrdb2               Open               

ora.oraeskdb.db

      1        ONLINE  ONLINE       zfzhlhrdb1               Open               

      2        ONLINE  ONLINE       zfzhlhrdb2               Open               

ora.scan1.vip

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.zfzhlhrdb1.vip

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.zfzhlhrdb2.vip

      1        ONLINE  ONLINE       zfzhlhrdb2                         

[zfzhlhrdb1:root]:/>cd $ORACLE_HOME/log

[zfzhlhrdb1:root]:/oracle/app/11.2.0/grid/log>l

total 32

drwxr-xr-x    2 grid     dba             256 Nov 05 2014  crs

drwxrwx--T    6 grid     asmadmin        256 Nov 06 2014  diag

drwxr-xr-t   25 root     dba            4096 Nov 19 2014  yjyltest2

drwxr-xr-t   25 root     dba            4096 Jul 15 2015  zfmcisudb5

drwxr-xr-t   25 root     dba            4096 Jul 01 10:51 zfzhlhrdb1

drwxr-xr-t   25 root     dba            4096 Nov 05 2014  zt1nuwdb1

[zfzhlhrdb1:root]:/oracle/app/11.2.0/grid/log>cd ..

[zfzhlhrdb1:root]:/oracle/app/11.2.0/grid>mv log log_bk

[zfzhlhrdb1:root]:/oracle/app/11.2.0/grid>crsctl stop has

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.crsd' on 'zfzhlhrdb1'

CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.zfzhlhrdb1.vip' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.oc4j' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.cvu' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.oraesdb.db' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.oraeskdb.db' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.cvu' on 'zfzhlhrdb1' succeeded

CRS-2672: Attempting to start 'ora.cvu' on 'zfzhlhrdb2'

CRS-2676: Start of 'ora.cvu' on 'zfzhlhrdb2' succeeded

CRS-2677: Stop of 'ora.zfzhlhrdb1.vip' on 'zfzhlhrdb1' succeeded

CRS-2672: Attempting to start 'ora.zfzhlhrdb1.vip' on 'zfzhlhrdb2'

CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.scan1.vip' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.scan1.vip' on 'zfzhlhrdb1' succeeded

CRS-2672: Attempting to start 'ora.scan1.vip' on 'zfzhlhrdb2'

CRS-2677: Stop of 'ora.oraeskdb.db' on 'zfzhlhrdb1' succeeded

CRS-2676: Start of 'ora.zfzhlhrdb1.vip' on 'zfzhlhrdb2' succeeded

CRS-2676: Start of 'ora.scan1.vip' on 'zfzhlhrdb2' succeeded

CRS-2672: Attempting to start 'ora.LISTENER_SCAN1.lsnr' on 'zfzhlhrdb2'

CRS-2677: Stop of 'ora.oraesdb.db' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.DATA.dg' on 'zfzhlhrdb1'

CRS-2676: Start of 'ora.LISTENER_SCAN1.lsnr' on 'zfzhlhrdb2' succeeded

CRS-2677: Stop of 'ora.oc4j' on 'zfzhlhrdb1' succeeded

CRS-2672: Attempting to start 'ora.oc4j' on 'zfzhlhrdb2'

CRS-2677: Stop of 'ora.DATA.dg' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.asm' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.asm' on 'zfzhlhrdb1' succeeded

CRS-2676: Start of 'ora.oc4j' on 'zfzhlhrdb2' succeeded

CRS-2673: Attempting to stop 'ora.ons' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.ons' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.net1.network' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.net1.network' on 'zfzhlhrdb1' succeeded

CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'zfzhlhrdb1' has completed

CRS-2677: Stop of 'ora.crsd' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.mdnsd' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.crf' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.ctssd' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.evmd' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.asm' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.mdnsd' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.evmd' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.ctssd' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.crf' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.asm' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.cssd' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.cssd' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.gipcd' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.drivers.acfs' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.gipcd' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.gpnpd' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.gpnpd' on 'zfzhlhrdb1' succeeded

CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'zfzhlhrdb1' has completed

CRS-4133: Oracle High Availability Services has been stopped.

[zfzhlhrdb1:root]:/oracle/app/11.2.0/grid>crsctl start has

 

《《《《........ There's no output here , I return many times , Can only ctrl+c sign out ........》》》》

 

 

[zfzhlhrdb1:root]:/oracle/app/11.2.0/grid>l log

total 0

drwxr-xr-x    4 root     system          256 Jul 01 17:35 zfzhlhrdb1

[zfzhlhrdb1:root]:/oracle/app/11.2.0/grid>

 

You can see log Folders are created automatically , But the cluster can't start ,log Other folders under the file cannot be created automatically , Next, according to the previous theoretical knowledge, we can recover the problem that the cluster cannot be started due to the permission problem , Because our environment is 11.2.0.4, It's easier to fix , Execute the script $GRID_HOME/crs/install/rootcrs.pl -init.

 

--- Fast execution ...

[zfzhlhrdb1:root]:/oracle/app/11.2.0/grid>$ORACLE_HOME/crs/install/rootcrs.pl -init

Using configuration parameter file: /oracle/app/11.2.0/grid/crs/install/crsconfig_params

[zfzhlhrdb1:root]:/oracle/app/11.2.0/grid>

[zfzhlhrdb1:root]:/oracle/app/11.2.0/grid>l log

total 8

drwxrwx--T    3 grid     asmadmin        256 Jul 01 17:40 diag

drwxr-xr-t   24 root     dba            4096 Jul 01 17:40 zfzhlhrdb1

[zfzhlhrdb1:root]:/oracle/app/11.2.0/grid>

[zfzhlhrdb1:root]:/oracle/app/11.2.0/grid>crsctl start has

CRS-4123: Oracle High Availability Services has been started.

[zfzhlhrdb1:root]:/oracle/app/11.2.0/grid>

 

You can see crs It's ready to start , After a while, you can see that all the resources are started :

[zfzhlhrdb1:root]:/oracle/app/11.2.0/grid>crsctl stat res -t     

--------------------------------------------------------------------------------

NAME           TARGET  STATE        SERVER                   STATE_DETAILS      

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.DATA.dg

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.asm

               ONLINE  ONLINE       zfzhlhrdb1               Started            

               ONLINE  ONLINE       zfzhlhrdb2               Started            

ora.gsd

               OFFLINE OFFLINE      zfzhlhrdb1                                  

               OFFLINE OFFLINE      zfzhlhrdb2                                  

ora.net1.network

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.ons

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.registry.acfs

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

      1        ONLINE  ONLINE       zfzhlhrdb2                                  

ora.cvu

      1        ONLINE  ONLINE       zfzhlhrdb2                                  

ora.oc4j

      1        ONLINE  ONLINE       zfzhlhrdb2                                  

ora.oraesdb.db

      1        ONLINE  ONLINE       zfzhlhrdb1               Open               

      2        ONLINE  ONLINE       zfzhlhrdb2               Open               

ora.oraeskdb.db

      1        ONLINE  ONLINE       zfzhlhrdb1               Open               

      2        ONLINE  ONLINE       zfzhlhrdb2               Open               

ora.scan1.vip

      1        ONLINE  ONLINE       zfzhlhrdb2                                  

ora.zfzhlhrdb1.vip

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.zfzhlhrdb2.vip

      1        ONLINE  ONLINE       zfzhlhrdb2                                  

[zfzhlhrdb1:root]:/oracle/app/11.2.0/grid>

The cluster has basically recovered , Let's see experiment six .

Two .3.6   Experiment six :permission.pl Use of scripts

According to the operation of experiment five , Carry out orders $GRID_HOME/crs/install/rootcrs.pl -init, It's just fixed $GRID_HOME In order to avoid the sequelae , We need to rootcrs.pl Ignore the directory and file permissions 、 The owner also repaired it , How to fix it ?MOS1515018.1 Provide ready-made perl Script , This script is easy to use : Grab from a server with normal permissions GRID_HOME、ORACLE_HOME All file and directory permissions under , Generate shell Script , Then execute the script on the host with the wrong permissions , Just to show you :

<1>  The first permission.pl Download it and copy it to a server with normal permissions , And give Execution Authority , This host must have perl Execution environment , We're here directly on another host rac2 Generate scripts on , Grab GRID_HOME The owner of all directories and files under 、 jurisdiction , You have to use root User execution :

[zfzhlhrdb2:root]:/>l /tmp/permission*

-rw-r-----    1 root     system         2326 Jul 01 00:05 /tmp/permission.pl

[zfzhlhrdb2:root]:/>chmod 755 /tmp/permission.pl

[zfzhlhrdb2:root]:/>

[zfzhlhrdb2:root]:/>/tmp/permission.pl $ORACLE_HOME

Following log files are generated

logfile      : permission-Fri-Jul-01-18-16-20-2016

Command file : restore-perm-Fri-Jul-01-18-16-20-2016.cmd

Linecount : 18126

[zfzhlhrdb2:root]:/>l *18-16-20-2016*

-rw-r--r--    1 root     system      1457428 Jul 01 18:16 permission-Fri-Jul-01-18-16-20-2016

-rw-r--r--    1 root     system      2928380 Jul 01 18:16 restore-perm-Fri-Jul-01-18-16-20-2016.cmd

[zfzhlhrdb2:root]:/>

 

Two files generated , among permission* The first is /oracle/app/oracle/product/11.2.0/db_1 Directory and all its subdirectories and file lists , for example :

[zfzhlhrdb2:root]:/>more permission-Fri-Jul-01-18-16-20-2016

755 root dba /oracle/app/11.2.0/grid

755 grid dba /oracle/app/11.2.0/grid/JRE

640 grid dba /oracle/app/11.2.0/grid/oraInst.loc

750 grid dba /oracle/app/11.2.0/grid/root.sh

755 grid dba /oracle/app/11.2.0/grid/rootupgrade.sh

750 grid dba /oracle/app/11.2.0/grid/.patch_storage

644 grid dba /oracle/app/11.2.0/grid/.patch_storage/LatestOPatchSession.properties

644 grid dba /oracle/app/11.2.0/grid/.patch_storage/interim_inventory.txt

644 grid dba /oracle/app/11.2.0/grid/.patch_storage/patch_free

644 grid dba /oracle/app/11.2.0/grid/.patch_storage/record_inventory.txt

755 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50

710 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/rollback.sh

755 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files

755 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/bin

755 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/bin/lxinst

755 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib

755 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib/libclient11.a

664 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib/libclient11.a/knoggcap.o

755 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib/libgeneric11.a

664 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib/libgeneric11.a/qcd.o

664 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib/libgeneric11.a/qcs.o

755 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib/libpls11.a

664 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib/libpls11.a/pevmexe.o

755 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib/libpls11_pic.a

664 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib/libpls11_pic.a/pevmexe_pic.o

755 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib/libserver11.a

664 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib/libserver11.a/kcfis.o

664 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib/libserver11.a/kf.o

664 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib/libserver11.a/kfd.o

664 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib/libserver11.a/kfds.o

664 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib/libserver11.a/kff.o

664 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib/libserver11.a/kjb.o

664 grid dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib/libserver11.a/kjbl.o

 

《《《《........ The space for , With Ellipsis ........》》》》

 

 

 

restore* The first one contains the scripts needed to perform the modification permission repair , for example :

[zfzhlhrdb2:root]:/>more restore-perm-Fri-Jul-01-18-16-20-2016.cmd

chown  root:dba /oracle/app/11.2.0/grid

chmod  755 /oracle/app/11.2.0/grid

chown  grid:dba /oracle/app/11.2.0/grid/JRE

chmod  755 /oracle/app/11.2.0/grid/JRE

chown  grid:dba /oracle/app/11.2.0/grid/oraInst.loc

chmod  640 /oracle/app/11.2.0/grid/oraInst.loc

chown  grid:dba /oracle/app/11.2.0/grid/root.sh

chmod  750 /oracle/app/11.2.0/grid/root.sh

chown  grid:dba /oracle/app/11.2.0/grid/rootupgrade.sh

chmod  755 /oracle/app/11.2.0/grid/rootupgrade.sh

chown  grid:dba /oracle/app/11.2.0/grid/.patch_storage

chmod  750 /oracle/app/11.2.0/grid/.patch_storage

chown  grid:dba /oracle/app/11.2.0/grid/.patch_storage/LatestOPatchSession.properties

chmod  644 /oracle/app/11.2.0/grid/.patch_storage/LatestOPatchSession.properties

chown  grid:dba /oracle/app/11.2.0/grid/.patch_storage/interim_inventory.txt

chmod  644 /oracle/app/11.2.0/grid/.patch_storage/interim_inventory.txt

chown  grid:dba /oracle/app/11.2.0/grid/.patch_storage/patch_free

chmod  644 /oracle/app/11.2.0/grid/.patch_storage/patch_free

chown  grid:dba /oracle/app/11.2.0/grid/.patch_storage/record_inventory.txt

chmod  644 /oracle/app/11.2.0/grid/.patch_storage/record_inventory.txt

chown  grid:dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50

chmod  755 /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50

chown  grid:dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/rollback.sh

chmod  710 /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/rollback.sh

chown  grid:dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files

chmod  755 /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files

chown  grid:dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/bin

chmod  755 /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/bin

chown  grid:dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/bin/lxinst

chmod  755 /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/bin/lxinst

chown  grid:dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib

chmod  755 /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib

chown  grid:dba /oracle/app/11.2.0/grid/.patch_storage/17478514_Dec_30_2013_03_38_50/files/lib/libclient11.a

《《《《........ The space for , With Ellipsis ........》》》》

 

 

 

<3>  Grab $ORACLE_HOME The owner of all directories and files 、 jurisdiction , have access to oracle perhaps root user

[zfzhlhrdb2:root]:/>su - oracle

[zfzhlhrdb2:oracle]:/oracle>echo $ORACLE_HOME

/oracle/app/oracle/product/11.2.0/db

[zfzhlhrdb2:oracle]:/oracle>exit

[zfzhlhrdb2:root]:/>/tmp/permission.pl /oracle/app/oracle/product/11.2.0/db

Following log files are generated

logfile      : permission-Fri-Jul-01-18-21-50-2016

Command file : restore-perm-Fri-Jul-01-18-21-50-2016.cmd

Linecount : 41627

[zfzhlhrdb2:root]:/> 

 

<4>  The generated 4 File copy To the target host , Execute... On the target host restore* The first two scripts ,root User execution

[zfzhlhrdb1:root]:/permissions>l

total 32600

-rw-r-----    1 root     system      1457428 Jul 01 18:16 permission-Fri-Jul-01-18-16-20-2016

-rw-r-----    1 root     system      4114174 Jul 01 18:22 permission-Fri-Jul-01-18-21-50-2016

-rw-r-----    1 root     system      2928380 Jul 01 18:16 restore-perm-Fri-Jul-01-18-16-20-2016.cmd

-rw-r-----    1 root     system      8184311 Jul 01 18:22 restore-perm-Fri-Jul-01-18-21-50-2016.cmd

[zfzhlhrdb1:root]:/permissions>chmod 755 *.cmd

[zfzhlhrdb1:root]:/permissions>l

total 32600

-rw-r-----    1 root     system      1457428 Jul 01 18:16 permission-Fri-Jul-01-18-16-20-2016

-rw-r-----    1 root     system      4114174 Jul 01 18:22 permission-Fri-Jul-01-18-21-50-2016

-rwxr-xr-x    1 root     system      2928380 Jul 01 18:16 restore-perm-Fri-Jul-01-18-16-20-2016.cmd

-rwxr-xr-x    1 root     system      8184311 Jul 01 18:22 restore-perm-Fri-Jul-01-18-21-50-2016.cmd

[zfzhlhrdb1:root]:/permissions>./restore-perm-Fri-Jul-01-18-16-20-2016.cmd

chown: /oracle/app/11.2.0/grid/auth/crs/zfzhlhrdb2: A file or directory in the path name does not exist.

chmod: /oracle/app/11.2.0/grid/auth/crs/zfzhlhrdb2: A file or directory in the path name does not exist.

chown: /oracle/app/11.2.0/grid/auth/css/zfzhlhrdb2: A file or directory in the path name does not exist.

chmod: /oracle/app/11.2.0/grid/auth/css/zfzhlhrdb2: A file or directory in the path name does not exist.

chown: /oracle/app/11.2.0/grid/auth/evm/zfzhlhrdb2: A file or directory in the path name does not exist.

.............

[zfzhlhrdb1:root]:/permissions>./restore-perm-Fri-Jul-01-18-21-50-2016.cmd

chown: /oracle/app/oracle/product/11.2.0/db/ccr/state/ORADEDB-RAC.ccr: A file or directory in the path name does not exist.

chmod: /oracle/app/oracle/product/11.2.0/db/ccr/state/ORADEDB-RAC.ccr: A file or directory in the path name does not exist.

chown: /oracle/app/oracle/product/11.2.0/db/ccr/state/ORADEDB-RAC.ll: A file or directory in the path name does not exist.

chmod: /oracle/app/oracle/product/11.2.0/db/ccr/state/ORADEDB-RAC.ll: A file or directory in the path name does not exist.

chown: /oracle/app/oracle/product/11.2.0/db/ccr/state/ORADEDB-RAC.ll-stat: A file or directory in the path name does not exist.

chmod: /oracle/app/oracle/product/11.2.0/db/ccr/state/ORADEDB-RAC.ll-stat: A file or directory in the path name does not exist.

chown: /oracle/app/oracle/product/11.2.0/db/cfgtoollogs/opatch/opatch2016-07-01_12-50-49PM_1.log: A file or directory in the path name does not exist.

chmod: /oracle/app/oracle/product/11.2.0/db/cfgtoollogs/opatch/opatch2016-07-01_12-50-49PM_1.log: A file or directory in the path name does not exist.

chown: /oracle/app/oracle/product/11.2.0/db/dbs/hc_oraESDB2.dat: A file or directory in the path name does not exist.

 

.................

 

Try starting and shutting down the cluster :

[zfzhlhrdb1:root]:/>crsctl stop has

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.crsd' on 'zfzhlhrdb1'

CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.LISTENER_LHRDG.lsnr' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.oraesdb.db' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.registry.acfs' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.oraeskdb.db' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.LISTENER_LHRDG.lsnr' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.zfzhlhrdb1.vip' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.oraesdb.db' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.zfzhlhrdb1.vip' on 'zfzhlhrdb1' succeeded

CRS-2672: Attempting to start 'ora.zfzhlhrdb1.vip' on 'zfzhlhrdb2'

CRS-2677: Stop of 'ora.registry.acfs' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.oraeskdb.db' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.DATA.dg' on 'zfzhlhrdb1'

CRS-2676: Start of 'ora.zfzhlhrdb1.vip' on 'zfzhlhrdb2' succeeded

CRS-2677: Stop of 'ora.DATA.dg' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.asm' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.asm' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.ons' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.ons' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.net1.network' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.net1.network' on 'zfzhlhrdb1' succeeded

CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'zfzhlhrdb1' has completed

CRS-2677: Stop of 'ora.crsd' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.mdnsd' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.crf' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.ctssd' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.evmd' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.asm' on 'zfzhlhrdb1'

CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.mdnsd' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.evmd' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.crf' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.ctssd' on 'zfzhlhrdb1' succeeded

crsctl start has

CRS-2677: Stop of 'ora.asm' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.cssd' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.cssd' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.gipcd' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.gipcd' on 'zfzhlhrdb1' succeeded

CRS-2673: Attempting to stop 'ora.gpnpd' on 'zfzhlhrdb1'

CRS-2677: Stop of 'ora.gpnpd' on 'zfzhlhrdb1' succeeded

CRS-2677: Stop of 'ora.drivers.acfs' on 'zfzhlhrdb1' succeeded

CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'zfzhlhrdb1' has completed

CRS-4133: Oracle High Availability Services has been stopped.

[zfzhlhrdb1:root]:/>crsctl start has

CRS-4123: Oracle High Availability Services has been started.

[zfzhlhrdb1:root]:/>crsctl stat res -t

--------------------------------------------------------------------------------

NAME           TARGET  STATE        SERVER                   STATE_DETAILS      

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.DATA.dg

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.LISTENER_LHRDG.lsnr

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.asm

               ONLINE  ONLINE       zfzhlhrdb1               Started            

               ONLINE  ONLINE       zfzhlhrdb2               Started            

ora.gsd

               OFFLINE OFFLINE      zfzhlhrdb1                                  

               OFFLINE OFFLINE      zfzhlhrdb2                                  

ora.net1.network

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.ons

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

ora.registry.acfs

               ONLINE  ONLINE       zfzhlhrdb1                                  

               ONLINE  ONLINE       zfzhlhrdb2                                  

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.cvu

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.oc4j

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.oraesdb.db

      1        ONLINE  ONLINE       zfzhlhrdb1               Open               

      2        ONLINE  ONLINE       zfzhlhrdb2               Open               

ora.oraeskdb.db

      1        ONLINE  ONLINE       zfzhlhrdb1               Open               

      2        ONLINE  ONLINE       zfzhlhrdb2               Open               

ora.scan1.vip

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.zfzhlhrdb1.vip

      1        ONLINE  ONLINE       zfzhlhrdb1                                  

ora.zfzhlhrdb2.vip

      1        ONLINE  ONLINE       zfzhlhrdb2                                  

[zfzhlhrdb1:root]:/>

 

 

good , Get it done , end , finishing , get home .

 

 

 

Two .4   Summary of the experiment

This article blog The content is more , It mainly includes OCR Backup and recovery of and GRID_HOME Directory permission repair 2 Big problems , In the experiment dd Command remember to experiment in the test library , Remember to have multiple backups .

 

 

The third chapter   What's used in the experiment SQL summary

 

ocrconfig -export /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/export_asm.bak

dd if=/dev/rhdisk1 of=/oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/asm_rhdisk1_dd.bak bs=1024k count=4

asmcmd md_backup /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/asm_md_backup.bak

 

ocrconfig -manualbackup

ocrconfig -showbackup

 

 

ocrconfig -export /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/export_asm.bak

ocrconfig -import /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/export_asm.bak

 

 

dd if=/dev/rhdisk1 of=/oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/asm_rhdisk1_dd.bak bs=1024k count=4

dd if=/oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/asm_rhdisk1_dd.bak of=/dev/rhdisk1 bs=1024k count=4

kfed repair /dev/rhdisk1

 

asmcmd md_backup /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/asm_md_backup.bak

asmcmd md_restore /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/asm_md_backup.bak

 

 

ocrconfig -manualbackup

ocrconfig -showbackup

crsctl query css votedisk

crsctl stop crs -f

crsctl start crs -excl

crsctl stop resource ora.crsd -init

ocrconfig -restore /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/backup_20160701_152358.ocr

 

cluvfy comp ocr -n all -verbose

 

 

ocrconfig -export /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/export_asm_lhr.bak

ocrconfig -import /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/export_asm_lhr.bak

 

 

crsctl stop crs

crsctl start crs -excl -nocrs

ocrconfig -import /oracle/app/11.2.0/grid/cdata/ZFTPCCDB-crs/export_asm_lhr.bak

crsctl start crs

 

 

$ORACLE_HOME/crs/install/rootcrs.pl -init