报错图片及日志如下:
[root@IDC-UFODB-01 UFO]# tail -50f trace.log
[Thread-214] [ 2016-06-02 15:22:03.646 CST ] [NativeSystem.rununixcmd:1152] NativeSystem.rununixcmd: RetString 1| :successful
[Thread-214] [ 2016-06-02 15:22:03.646 CST ] [CopyCommand.execute:79] CopyCommand.execute: native copyFile returns `1| :successful'
[Thread-214] [ 2016-06-02 15:22:03.646 CST ] [NativeResult.<init>:91] NativeResult: The String obtained is1| :successful
[Thread-214] [ 2016-06-02 15:22:03.646 CST ] [NativeResult.<init>:99] The status string is: 1
[Thread-214] [ 2016-06-02 15:22:03.647 CST ] [NativeResult.<init>:112] The result string is: :successful 1
[Thread-214] [ 2016-06-02 15:22:03.647 CST ] [PostDBCreationStep.executeImpl:838] isWindowsPolicyDB false
[Thread-214] [ 2016-06-02 15:22:03.647 CST ] [SQLEngine.done:2189] Done called
[Thread-214] [ 2016-06-02 15:22:03.647 CST ] [SQLEngine.spoolOff:2035] Setting spool off = /u01/app/oracle/cfgtoollogs/dbca/UFO/postDBCreation.log
[Thread-214] [ 2016-06-02 15:22:03.650 CST ] [PostDBCreationStep.executeImpl:874] Enable Database HA Resource
[Thread-214] [ 2016-06-02 15:22:03.650 CST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against11
[Thread-214] [ 2016-06-02 15:22:03.650 CST ] [Version.isPre:594] isPre.java: Returning FALSE
[Thread-214] [ 2016-06-02 15:22:03.651 CST ] [Version.isPre11202:461] version to be checked 11.2.0.4.0 minor version to check against2, patchset to check against 2
[Thread-214] [ 2016-06-02 15:22:03.651 CST ] [Version.isPre11202:480] isPre11202 : Returning FALSE for patchset version check
[Thread-214] [ 2016-06-02 15:22:03.675 CST ] [DatabaseFactoryImpl.getDatabase:771] Checking for version mismatch
[Thread-214] [ 2016-06-02 15:22:03.675 CST ] [DatabaseFactoryImpl.getDatabase:777] dbVersion4 = 11.2.0.4
[Thread-214] [ 2016-06-02 15:22:03.675 CST ] [DatabaseFactoryImpl.getDatabase:792] db type RAC
[Thread-214] [ 2016-06-02 15:22:03.675 CST ] [Version.isPre:583] version to be checked 11.2.0.4.0 major version to check against11
[Thread-214] [ 2016-06-02 15:22:03.675 CST ] [Version.isPre:594] isPre.java: Returning FALSE
[Thread-214] [ 2016-06-02 15:22:03.676 CST ] [Version.isPre112:427] version to be checked 11.2.0.4.0 minor version to check against2
[Thread-214] [ 2016-06-02 15:22:03.676 CST ] [Version.isPre112:438] isPre112 : Returning FALSE for minor version check
[Thread-214] [ 2016-06-02 15:22:03.676 CST ] [DatabaseFactoryImpl.getCardinalDatabase:1393] Getting cardinal database for UFO
[Thread-214] [ 2016-06-02 15:22:03.746 CST ] [DatabaseImpl.crsResource:3608] calling parent's crsResource
[Thread-214] [ 2016-06-02 15:22:04.033 CST ] [PostDBCreationStep.executeImpl:885] Starting Database HA Resource
[Thread-214] [ 2016-06-02 15:22:24.906 CST ] [CRSNative.internalStartResource:389] Failed to start resource: Name: ora.ufo.db, node: null, filter: null, msg CRS-5017: The resource action "ora.ufo.db start" encountered the following error:
ORA-01078: failure in processing system parameters
ORA-17510: Attempt to do i/o beyond file size
. For details refer to "(:CLSN00107:)" in "/u01/app/11.2.0/grid/log/idc-ufodb-02/agent/crsd/oraagent_oracle/oraagent_oracle.log".
CRS-5017: The resource action "ora.ufo.db start" encountered the following error:
ORA-01078: failure in processing system parameters
ORA-17510: Attempt to do i/o beyond file size
. For details refer to "(:CLSN00107:)" in "/u01/app/11.2.0/grid/log/idc-ufodb-01/agent/crsd/oraagent_oracle/oraagent_oracle.log".
CRS-2674: Start of 'ora.ufo.db' on 'idc-ufodb-02' failed
CRS-2674: Start of 'ora.ufo.db' on 'idc-ufodb-01' failed
CRS-2632: There are no more servers to try to place resource 'ora.ufo.db' on that would satisfy its placement policy
[Thread-214] [ 2016-06-02 15:22:24.907 CST ] [PostDBCreationStep.executeImpl:893] Exception while Starting with HA Database Resource PRCR-1079 : Failed to start resource ora.ufo.db
CRS-5017: The resource action "ora.ufo.db start" encountered the following error:
ORA-01078: failure in processing system parameters
ORA-17510: Attempt to do i/o beyond file size
. For details refer to "(:CLSN00107:)" in "/u01/app/11.2.0/grid/log/idc-ufodb-02/agent/crsd/oraagent_oracle/oraagent_oracle.log".
CRS-5017: The resource action "ora.ufo.db start" encountered the following error:
ORA-01078: failure in processing system parameters
ORA-17510: Attempt to do i/o beyond file size
. For details refer to "(:CLSN00107:)" in "/u01/app/11.2.0/grid/log/idc-ufodb-01/agent/crsd/oraagent_oracle/oraagent_oracle.log".
CRS-2674: Start of 'ora.ufo.db' on 'idc-ufodb-02' failed
CRS-2674: Start of 'ora.ufo.db' on 'idc-ufodb-01' failed
CRS-2632: There are no more servers to try to place resource 'ora.ufo.db' on that would satisfy its placement policy
[root@IDC-UFODB-01 UFO]# tail -30f postDBCreation.log
Generating apply and rollback scripts...
Check the following file for errors:
/u01/app/oracle/cfgtoollogs/catbundle/catbundle_PSU_UFO_GENERATE_2016Jun02_15_20_59.log
Apply script: /u01/app/oracle/product/11.2.0/dbhome_1/rdbms/admin/catbundle_PSU_UFO_APPLY.sql
Rollback script: /u01/app/oracle/product/11.2.0/dbhome_1/rdbms/admin/catbundle_PSU_UFO_ROLLBACK.sql
Executing script file...
Updating registry...
Check the following log file for errors:
/u01/app/oracle/cfgtoollogs/catbundle/catbundle_PSU_UFO_APPLY_2016Jun02_15_20_59.log
utl_recomp_begin: 03:20:59
utl_recomp_end: 03:21:06
Database closed.
Database dismounted.
ORACLE instance shut down.
ORACLE instance started.
Total System Global Area 1.0456E+10 bytes
Fixed Size 2262368 bytes
Variable Size 5603592864 bytes
Database Buffers 4831838208 bytes
Redo Buffers 17948672 bytes
Database mounted.
Database closed.
Database dismounted.
ORACLE instance shut down.

[oracle@IDC-UFODB-01 ~]$ tail -100 /u01/app/11.2.0/grid/log/idc-ufodb-01/agent/crsd/oraagent_oracle/oraagent_oracle.log
2016-06-02 15:50:03.270: [ora.ufo.db][2533668608]{1:60861:3469} [clean] CssGroup::regis registration of groupName:DBUFO mbrid:-1 m_grpNum:-1 regType:0 succeeded
......
2016-06-02 15:50:03.271: [ora.ufo.db][2533668608]{1:60861:3469} [clean] ConnectionPool::stopConnection
2016-06-02 15:50:03.272: [ora.ufo.db][2533668608]{1:60861:3469} [clean] ConnectionPool::removeConnection connection count 0
2016-06-02 15:50:03.272: [ora.ufo.db][2533668608]{1:60861:3469} [clean] ConnectionPool::removeConnection freed 0
2016-06-02 15:50:03.272: [ora.ufo.db][2533668608]{1:60861:3469} [clean] ConnectionPool::stopConnection sid UFO1 status 1
2016-06-02 15:50:03.272: [ora.ufo.db][2533668608]{1:60861:3469} [clean] InstAgent::check 1 prev clsagfw_res_status 0 current clsagfw_res_status 2
2016-06-02 15:50:08.274: [ora.ufo.db][2533668608]{1:60861:3469} [clean] InstAgent::check prev clsagfw_res_status 2 current clsagfw_res_status 2
2016-06-02 15:50:08.274: [ora.ufo.db][2533668608]{1:60861:3469} [clean] InstAgent::stop shutdown mode: 4
2016-06-02 15:50:08.274: [ora.ufo.db][2533668608]{1:60861:3469} [clean] DbAgent::preStopCbk {
2016-06-02 15:50:08.274: [ora.ufo.db][2533668608]{1:60861:3469} [clean] DbAgentEventModule::stop Forcing stop because of clean
2016-06-02 15:50:08.274: [ USRTHRD][2533668608]{1:60861:3469} Thread:DedicatedThreadstop {
2016-06-02 15:50:08.274: [ USRTHRD][2533668608]{1:60861:3469} Thread:DedicatedThreadstop }
2016-06-02 15:50:08.274: [ora.ufo.db][2533668608]{1:60861:3469} [clean] DbAgent::preStopCbk }
2016-06-02 15:50:08.274: [ora.ufo.db][2533668608]{1:60861:3469} [clean] ConnectionPool::getConnection 160 ERROR sid UFO1 pool status 1
2016-06-02 15:50:08.274: [ora.ufo.db][2533668608]{1:60861:3469} [clean] InstAgent::stop pool pConnxn 00000000
2016-06-02 15:50:08.274: [ USRTHRD][2533668608]{1:60861:3469} InstConnection::initMutex AttachLock 00ae3210 DetachLock 00ae3228
2016-06-02 15:50:08.275: [ora.ufo.db][2533668608]{1:60861:3469} [clean] clsnInstConnection::makeConnectStr UsrOraEnv m_oracleHome /u01/app/oracle/product/11.2.0/dbhome_1 Crshome /u01/app/11.2.0/grid
2016-06-02 15:50:08.275: [ora.ufo.db][2533668608]{1:60861:3469} [clean] makeConnectStr = (DESCRIPTION=(ADDRESS=(PROTOCOL=beq)(PROGRAM=/u01/app/oracle/product/11.2.0/dbhome_1/bin/oracle)(ARGV0=oracleUFO1)(ENVS='ORACLE_HOME=/u01/app/oracle/product/11.2.0/dbhome_1,ORACLE_SID=UFO1,LD_LIBRARY_PATH=')(ARGS='(DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))'))(CONNECT_DATA=(SID=UFO1)))
2016-06-02 15:50:08.279: [ora.ufo.db][2533668608]{1:60861:3469} [clean] InstAgent::stop non pool pConnxn 1 7800dcf0
2016-06-02 15:50:08.279: [ora.ufo.db][2533668608]{1:60861:3469} [clean] InstConnection::connectInt: server not attached
2016-06-02 15:50:08.308: [ora.ufo.db][2533668608]{1:60861:3469} [clean] ORA-01034: ORACLE not available
ORA-27101: shared memory realm does not exist
Linux-x86_64 Error: 2: No such file or directory
Process ID: 0
Session ID: 0 Serial number: 0
2016-06-02 15:50:08.308: [ora.ufo.db][2533668608]{1:60861:3469} [clean] InstConnection::connectInt (2) Exception OCIException
2016-06-02 15:50:08.308: [ora.ufo.db][2533668608]{1:60861:3469} [clean] InstConnection:connect:excp OCIException OCI error 1034
2016-06-02 15:50:08.308: [ora.ufo.db][2533668608]{1:60861:3469} [clean] InstAgent::stop: connect1 errcode 1034
2016-06-02 15:50:08.309: [ora.ufo.db][2533668608]{1:60861:3469} [clean] InstAgent::stop: connect2 oracleHome /u01/app/oracle/product/11.2.0/dbhome_1 oracleSid UFO1
2016-06-02 15:50:08.309: [ora.ufo.db][2533668608]{1:60861:3469} [clean] InstConnection::connectInt: server not attached
2016-06-02 15:50:08.331: [ora.ufo.db][2533668608]{1:60861:3469} [clean] InstConnection:connectInt connected
2016-06-02 15:50:08.331: [ora.ufo.db][2533668608]{1:60861:3469} [clean] InstConnection::shutdown mode 4
2016-06-02 15:50:08.332: [ora.ufo.db][2533668608]{1:60861:3469} [clean] ConnectionPool::removeConnection connection count 1
2016-06-02 15:50:08.332: [ora.ufo.db][2533668608]{1:60861:3469} [clean] ConnectionPool::removeConnection sid UFO1, InstConnection 7800dcf0
2016-06-02 15:50:08.332: [ USRTHRD][2533668608]{1:60861:3469} InstConnection::breakCall pConnxn:7800dcf0 DetachLock:00ae3228 m_pSvcH:78088ff0
2016-06-02 15:50:08.332: [ USRTHRD][2533668608]{1:60861:3469} InstConnection:~InstConnection: this 7800dcf0
2016-06-02 15:50:08.333: [ora.ufo.db][2533668608]{1:60861:3469} [clean] ConnectionPool::removeConnection delete InstConnection 7800dcf0
2016-06-02 15:50:08.333: [ora.ufo.db][2533668608]{1:60861:3469} [clean] ConnectionPool::removeConnection freed 1
2016-06-02 15:50:08.333: [ora.ufo.db][2533668608]{1:60861:3469} [clean] ConnectionPool::stopConnection
2016-06-02 15:50:08.333: [ora.ufo.db][2533668608]{1:60861:3469} [clean] ConnectionPool::removeConnection connection count 0
2016-06-02 15:50:08.333: [ora.ufo.db][2533668608]{1:60861:3469} [clean] ConnectionPool::removeConnection freed 0
2016-06-02 15:50:08.333: [ora.ufo.db][2533668608]{1:60861:3469} [clean] ConnectionPool::stopConnection sid UFO1 status 1
2016-06-02 15:50:08.333: [ora.ufo.db][2533668608]{1:60861:3469} [clean] InstAgent::stop db/asm
2016-06-02 15:50:08.333: [ora.ufo.db][2533668608]{1:60861:3469} [clean] ConnectionPool::stopConnection
2016-06-02 15:50:08.333: [ora.ufo.db][2533668608]{1:60861:3469} [clean] ConnectionPool::removeConnection connection count 0
2016-06-02 15:50:08.333: [ora.ufo.db][2533668608]{1:60861:3469} [clean] ConnectionPool::removeConnection freed 0
2016-06-02 15:50:08.333: [ora.ufo.db][2533668608]{1:60861:3469} [clean] ConnectionPool::stopConnection sid UFO1 status 1
2016-06-02 15:50:08.333: [ora.ufo.db][2533668608]{1:60861:3469} [clean] getResAttrib: attrib name USR_ORA_OPI value false len 5
2016-06-02 15:50:08.333: [ora.ufo.db][2533668608]{1:60861:3469} [clean] InstAgent::stop Container->stop, isShutdown = 0
2016-06-02 15:50:08.333: [ora.ufo.db][2533668608]{1:60861:3469} [clean] InstAgent::stop: }
2016-06-02 15:50:08.333: [ora.ufo.db][2533668608]{1:60861:3469} [clean] clean }
2016-06-02 15:50:08.333: [ora.ufo.db][2533668608]{1:60861:3469} [clean] (:CLSN00106:) clsn_agent::clean }
2016-06-02 15:50:08.333: [ AGFW][2533668608]{1:60861:3469} Command: clean for resource: ora.ufo.db 1 1 completed with status: SUCCESS
2016-06-02 15:50:08.334: [ora.ufo.db][2533668608]{1:60861:3469} [check] ConnectionPool::resetConnection s_statusOfConnectionMap 00ae9760
2016-06-02 15:50:08.335: [ AGFW][2531567360]{1:60861:3469} Agent sending reply for: RESOURCE_CLEAN[ora.ufo.db 1 1] ID 4100:33417
2016-06-02 15:50:08.335: [ora.ufo.db][2533668608]{1:60861:3469} [check] ConnectionPool::resetConnection sid UFO1 status 2
2016-06-02 15:50:08.335: [ora.ufo.db][2533668608]{1:60861:3469} [check] Gimh::check OH /u01/app/oracle/product/11.2.0/dbhome_1 SID UFO1
2016-06-02 15:50:08.335: [CLSFRAME][2552780576] TM [MultiThread] is changing desired thread
# to 3. Current #
is 2
2016-06-02 15:50:08.335: [CLSFRAME][2552780576] TM [MultiThread] is changing desired thread
# to 4. Current #
is 3
2016-06-02 15:50:08.335: [ora.ufo.db][2533668608]{1:60861:3469} [check] Gimh::check condition changes to (GIMH_NEXT_NUM) 1 exists
2016-06-02 15:50:08.335: [ora.ufo.db][2533668608]{1:60861:3469} [check] clsnDbAgent:checkCbk 9 state shutdown shutdownBeginn:1 GIMH 1
2016-06-02 15:50:08.336: [ora.ufo.db][2533668608]{1:60861:3469} [check] clsnDbAgent:checkCbk clsagfw_res_status ret 2
2016-06-02 15:50:08.337: [ USRTHRD][2533668608]{1:60861:3469} Thread:DedicatedThreadstop {
2016-06-02 15:50:08.337: [ USRTHRD][2533668608]{1:60861:3469} Thread:DedicatedThreadstop }
2016-06-02 15:50:08.337: [ USRTHRD][2533668608]{1:60861:3469} Gimh::destructor gimh_dest_query_ctx rc=0
2016-06-02 15:50:08.337: [ USRTHRD][2533668608]{1:60861:3469} Gimh::destructor gimh_dest_inst_ctx rc=0
2016-06-02 15:50:08.337: [ora.ufo.db][2533668608]{1:60861:3469} [check] ConnectionPool::stopConnection
2016-06-02 15:50:08.337: [ora.ufo.db][2533668608]{1:60861:3469} [check] ConnectionPool::removeConnection connection count 0
2016-06-02 15:50:08.337: [ora.ufo.db][2533668608]{1:60861:3469} [check] ConnectionPool::removeConnection freed 0
2016-06-02 15:50:08.337: [ora.ufo.db][2533668608]{1:60861:3469} [check] ConnectionPool::stopConnection sid UFO1 status 1
2016-06-02 15:50:08.337: [ora.ufo.db][2533668608]{1:60861:3469} [check] InstAgent::check 1 prev clsagfw_res_status 2 current clsagfw_res_status 2
2016-06-02 15:50:13.340: [ora.ufo.db][2533668608]{1:60861:3469} [check] InstAgent::check prev clsagfw_res_status 2 current clsagfw_res_status 2
2016-06-02 15:50:13.340: [ AGFW][2531567360]{1:60861:3469} ora.ufo.db 1 1 state changed from: CLEANING to: PLANNED_OFFLINE
2016-06-02 15:50:13.340: [ AGFW][2531567360]{1:60861:3469} ora.ufo.db 1 1 state details has changed from: to: Instance Shutdown
2016-06-02 15:50:13.341: [ AGFW][2531567360]{1:60861:3469} Agent sending last reply for: RESOURCE_CLEAN[ora.ufo.db 1 1] ID 4100:33417
2016-06-02 15:50:13.341: [ AGFW][2533668608]{1:60861:3469} Agent has no resources to be monitored, Shutting down ..
2016-06-02 15:50:13.341: [ AGFW][2533668608]{1:60861:3469} Agent sending message to PE: AGENT_SHUTDOWN_REQUEST[Proxy] ID 20486:28
2016-06-02 15:50:13.343: [ AGFW][2531567360]{1:60861:3469} Agent is shutting down.
2016-06-02 15:50:13.343: [ AGFW][2531567360]{1:60861:3469} Agent is exiting with exit code: 1