ORA-15032: not all alterations performedORA-15017: diskgroup “MGMTX” cannot be mountedORA-15063: ASM discovered an insufficient number of disks for diskgroup “MGMTX”

One of the ASM disk group which contains the spfile, could not be mounted and database instance also depends on the disk group due to spfile. This is not a RAC but single instance with oracle restart.

[root@x3dbzx36 ~]# crsctl stat res -t
--------------------------------------------------------------------------------
NAME           TARGET  STATE        SERVER                   STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DATAX.dg
               ONLINE  OFFLINE      x3dbzx36
ora.DATAX2.dg
               ONLINE  OFFLINE      x3dbzx36
ora.INDX.dg
               ONLINE  OFFLINE      x3dbzx36
ora.LISTENER.lsnr
               ONLINE  ONLINE       x3dbzx36
ora.MGMTX.dg
               ONLINE  OFFLINE      x3dbzx36
ora.RECOX.dg
               ONLINE  OFFLINE      x3dbzx36
ora.REDOX.dg
               ONLINE  OFFLINE      x3dbzx36
ora.asm
               ONLINE  OFFLINE      x3dbzx36                 Instance Shutdown,S
                                                             TARTING
ora.ons
               OFFLINE OFFLINE      x3dbzx36
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.cssd
      1        ONLINE  ONLINE       x3dbzx36
ora.diskmon
      1        ONLINE  ONLINE       x3dbzx36
ora.evmd
      1        ONLINE  INTERMEDIATE x3dbzx36
ora.x3z6zx9.db

Tried to mount the diskgroup but ended up with error

SQL> alter diskgroup MGMTX mount;
alter diskgroup MGMTX mount
*
ERROR at line 1:
ORA-15032: not all alterations performed
ORA-15017: diskgroup "MGMTX" cannot be mounted
ORA-15063: ASM discovered an insufficient number of disks for diskgroup "MGMTX"

After checking the mount status, it is closed

sqlplus / as sysasm
SQL> select path,state,mount_status from v$asm_disk;

PATH
--------------------------------------------------------------------------------
STATE    MOUNT_S
-------- -------
o/192.168.56.66/XS_CD_CELL018_xstcell
NORMAL   CLOSED  <<==

o/192.168.56.66/XS_CD_CELL019_xstcell
NORMAL   CLOSED  <<==

o/192.168.56.66/XS_CD_CELL013_xstcell
NORMAL   CACHED


PATH
--------------------------------------------------------------------------------
STATE    MOUNT_S
-------- -------
o/192.168.56.66/XS_CD_CELL001_xstcell
NORMAL   CACHED

This should be due to disk header corruption. Hence cleared the disk header.

[root@x3cel33 raw]# dd if=/dev/zero of=/opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/CELL018 bs=1024k count=1000
1000+0 records in
1000+0 records out
1048576000 bytes (1.0 GB) copied, 2.24994 seconds, 466 MB/s
[root@x3cel33 raw]# dd if=/dev/zero of=/opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/disks/raw/CELL019 bs=1024k count=1000
1000+0 records in
1000+0 records out
1048576000 bytes (1.0 GB) copied, 2.90482 seconds, 361 MB/s

Again created new disk group with the same name.

sqlplus / as sysasm
SQL> CREATE DISKGROUP MGMTX EXTERNAL REDUNDANCY  DISK 'o/192.168.1.77/XS_CD_CELL018_xstcell' SIZE 1488M ,
'o/192.168.1.77/XS_CD_CELL019_xstcell' SIZE 1488M  ATTRIBUTE 'compatible.asm'='11.2.0.4.0','compatible.rdbms'='11.1.0.7.0','au_size'='4M','cell.smart_scan_capable'='TRUE' /* ASMCA */

Created a dummy pfile with basic parameters for ASM

[oracle@x3dbzx36 ~]$ cd /u01/app/oracle/product/11.2.0/grid/dbs/
[oracle@x3dbzx36 dbs]$ cat init+ASM.ora
+ASM.asm_diskgroups='DATAX','DATAX2','RECOX','REDOX','MGMTX','INDX'
*.asm_diskstring='o/*/*'
*.asm_power_limit=1
*.diagnostic_dest='/u01/app/oracle'
*.instance_type='asm'
*.large_pool_size=12M
#*.local_listener='LISTENER_+ASM'
*.remote_login_passwordfile='EXCLUSIVE'

Create spfile from the dummy pfile.

SQL> create spfile='+MGMTX' from pfile='/u01/app/oracle/product/11.2.0/grid/dbs/init+ASM.ora';

File created.

Restarted the has service

[root@x3dbzx36 ~]# crsctl stop has
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'x3dbzx36'
CRS-2673: Attempting to stop 'ora.INDX.dg' on 'x3dbzx36'
CRS-2673: Attempting to stop 'ora.MGMTX.dg' on 'x3dbzx36'
CRS-2673: Attempting to stop 'ora.REDOX.dg' on 'x3dbzx36'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'x3dbzx36'
CRS-2677: Stop of 'ora.INDX.dg' on 'x3dbzx36' succeeded
CRS-2677: Stop of 'ora.MGMTX.dg' on 'x3dbzx36' succeeded
CRS-2677: Stop of 'ora.REDOX.dg' on 'x3dbzx36' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'x3dbzx36'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'x3dbzx36' succeeded
CRS-2677: Stop of 'ora.asm' on 'x3dbzx36' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'x3dbzx36'
CRS-2677: Stop of 'ora.cssd' on 'x3dbzx36' succeeded
CRS-2673: Attempting to stop 'ora.diskmon' on 'x3dbzx36'
CRS-2677: Stop of 'ora.diskmon' on 'x3dbzx36' succeeded
CRS-2673: Attempting to stop 'ora.evmd' on 'x3dbzx36'
CRS-2677: Stop of 'ora.evmd' on 'x3dbzx36' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'x3dbzx36' has completed
CRS-4133: Oracle High Availability Services has been stopped.
[root@x3dbzx36 ~]# crsctl start has
CRS-4123: Oracle High Availability Services has been started.

Database instance is able to come up.

[oracle@x3dbzx36 dbs]$ sqlplus / as sysdba

SQL*Plus: Release 11.2.0.4.0 Production on Sun May 1 21:46:24 2022

Copyright (c) 1982, 2013, Oracle.  All rights reserved.


Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Partitioning, Automatic Storage Management, OLAP, Data Mining
and Real Application Testing options

kIsH@x3z6zx9<^>select status from v$instance;

STATUS
------------
OPEN

Elapsed: 00:00:00.01

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s