Sometimes, when I installed the Oracle GI and run the asmca, I could create volume and acfs easily, while I never know the background of such things.
This time, I need to create a shared cluster filesystem for usage. At the beginning, I thought I should install the oracleasm rpm package. I searched lots of documents while still could not know what I should install to enable ADVM/ACFS.
According to Oracle best practice, to use ASM, usually I would install oracleasm and related packages. But one project changed my mind. During that project, sometimes the asm disks could not be recognized during the boot and the cluster would fail to start. After that, I usually create asm disk on the physical disk directly. While to use ACFS, I were not sure if I should install the recommended oracleasm rpm packages or not. In fact, I did installed one of them but removed it finally as it was not used by ADVM/ACFS.
The issue was that when I installed the oracleasm package, the kernel was upgraded from 3.10.0-693 to 3.10.0-957, while from the patched GI home I learnt maybe I should install 3.10.0-862. I found this version is the same as RHEL7.5 and downloaded it last night.
So installed the 3.10.0-862 kernel and I began to run command:
/u01/app/11.2.0/grid/bin/acfsroot install
I knew the version was supported as I could find it under the GI home, but I got below error:
ACFS-9459: ADVM/ACFS is not supported on this OS version: '3.10.0-862.el7.x86_64'
What?! Although below webpages could not fix this issue while they did help me:
ACFS-9129: ADVM/ACFS not installed in Oracle Linux 6
I also tried the original version 3.10.0-693.el7.x86_64 while also no lucky.
I did some attempts but all failed until I found below one:
解决在RHEL/CentOS7.4以上版本无法使用AFD(Oracle ASMFD)特性
Then I checked the installed kmod version, yes, it was 20-15 and should be upgraded.
Also I read the notes from Oracle support website:
It said usually the kmod library rpms should be upgraded at the same time.
So to fix this issue, I installed kmod-20-21.el7.x86_64 (should be enough) and kmod-libs-20-21.el7.x86_64.
Then I run below commands to enable the ADVM/ACFS support:
[root@node1 tmp]# /u01/app/11.2.0/grid/bin/acfsroot install -->better run it on all nodes then run next command ACFS-9300: ADVM/ACFS distribution files found. ACFS-9307: Installing requested ADVM/ACFS software. ACFS-9308: Loading installed ADVM/ACFS drivers. ACFS-9321: Creating udev for ADVM/ACFS. ACFS-9323: Creating module dependencies - this may take some time. ACFS-9154: Loading 'oracleoks.ko' driver. ACFS-9154: Loading 'oracleadvm.ko' driver. ACFS-9154: Loading 'oracleacfs.ko' driver. ACFS-9327: Verifying ADVM/ACFS devices. ACFS-9156: Detecting control device '/dev/asm/.asm_ctl_spec'. ACFS-9156: Detecting control device '/dev/ofsctl'. ACFS-9309: ADVM/ACFS installation correctness verified. [root@node1 tmp]# /u01/app/11.2.0/grid/bin/acfsroot installenable ACFS-9376: Adding ADVM/ACFS drivers resource succeeded. CRS-2672: Attempting to start 'ora.drivers.acfs' on 'node1' CRS-2676: Start of 'ora.drivers.acfs' on 'node1' succeeded ACFS-9380: Starting ADVM/ACFS drivers resource succeeded. ACFS-9368: Adding ACFS registry resource succeeded. CRS-2672: Attempting to start 'ora.registry.acfs' on 'node1' CRS-2672: Attempting to start 'ora.registry.acfs' on 'node2' CRS-5016: Process "/u01/app/11.2.0/grid/bin/acfsregistrymount" spawned by agent "/u01/app/11.2.0/grid/bin/orarootagent.bin" for action "start" failed: details at "(:CLSN00010:)" in "/u01/app/11.2.0/grid/log/node2/agent/crsd/orarootagent_root//orarootagent_root.log" CRS-2674: Start of 'ora.registry.acfs' on 'node2' failed CRS-2676: Start of 'ora.registry.acfs' on 'node1' succeeded CRS-4000: Command Start failed, or completed with errors. ACFS-9371: Starting ACFS registry resource failed.
