现象:
Oracle数据库在启动的时候alert日志中报错:
SUCCESS: diskgroup DATADG was mounted
Errors in file /oracle/app/11gR1/diag/rdbms/rac/rac2/trace/rac2_mmon_1066.trc (incident=240612):
ORA-00600: internal error code, arguments: [kmgs_parameter_update_timeout_1], [17510], [], [], [], [], [], [], [], [], [], []
ORA-17510: Attempt to do i/o beyond file size
Incident details in: /oracle/app/11gR1/diag/rdbms/rac/rac2/incident/incdir_240612/rac2_mmon_1066_i240612.trc
Tue Dec 31 14:23:25 2013
Trace dumping is performing id=[cdmp_20131231142325]
Completed: ALTER DATABASE MOUNT
推荐阅读:
ORA-01172、ORA-01151错误处理
ORA-00600 [2662]错误解决
ORA-01078 和 LRM-00109 报错解决方法
ORA-00471 处理方法笔记
ORA-00314,redolog 损坏,或丢失处理方法
ORA-00257 归档日志过大导致无法存储的解决办法
修改参数的时候报错ORA-17510:
SQL> alter system set control_files='current.303.835627291' scope=spfile;
alter system set control_files='current.303.835627291' scope=spfile
*
ERROR at line 1:
ORA-17510: Attempt to do i/o beyond file size
SQL>
SQL>
SQL> alter system set log_archive_dest_1='location=+DATADG/';
alter system set log_archive_dest_1='location=+DATADG/'
*
ERROR at line 1:
ORA-17510: Attempt to do i/o beyond file size
rac2_mmon_1066_i240612.trc文件信息:
*** 2013-12-31 14:23:24.392
Incident 240612 created, dump file: /oracle/app/11gR1/diag/rdbms/rac/rac2/incident/incdir_240612/rac2_mmon_1066_i240612.trc
ORA-00600: internal error code, arguments: [kmgs_parameter_update_timeout_1], [17510], [], [], [], [], [], [], [], [], [], []
ORA-17510: Attempt to do i/o beyond file size
KEBM: MMON action policy violation. 'SGA memory tuning parameter update' viol=0; err=600
error 0 detected in background process
OPIRIP: Uncaught error 447. Error stack:
ORA-00447: fatal error in background process
ORA-00600: internal error code, arguments: [kmgs_parameter_update_timeout_1], [17510], [], [], [], [], [], [], [], [], [], []
ORA-17510: Attempt to do i/o beyond file size
SQL>
rac2_mmon_1066_i240612.trc:
2013-12-31 14:23:23.993826 :80008ADE:db_trace:ksl2.c@9123:ksliwat(): [10005:23:876] KSL POST RCVD poster=15 loc='ksa2.h LINE:282 ID:ksasnd' id1=0 id2=0 name= type=0 fac#=0 facpost=1
2013-12-31 14:23:23.993838 :80008ADF:db_trace:ksb.c@1808:ksbabs(): [10254:23:876] KSBABS: (MMON) : (requested action) : acnum=[50] comment=[SGA memory tuning parameter update]
2013-12-31 14:23:23.995501 :80008AF6:KFNU:kfn.c@1719:kfnUStart(): kfnUStart (IN):
2013-12-31 14:23:23.995503 :80008AF7:KFNU:kfn.c@1728:kfnUStart(): Require ASM background process. (pid=196; state=3; bootstrap=1, running=2)
----- Session Open Cursors -----
----------------------------------------
Cursor#1(0x2b2949861980) state=BOUND curiob=0x2b294987cc48
curflg=d fl2=200000 par=(nil) ses=0x2a5a2fe30
----- Dump Cursor sql_id=8p447s6p0rv6b xsc=0x2b294987cc48 cur=0x2b2949861980 -----
Dump Parent Cursor sql_id=8p447s6p0rv6b phd=0x2a3538bb8 plk=0x2a38f6c10
sqltxt(0x2a3538bb8)=select java_pool_size_for_estimate s, java_pool_size_factor * 100 f, estd_lc_load_time l, 0 from v$java_pool_advice
hash=8b1cd0e04050e97a8a9087c1aa0beccb
parent=0x287fe4758 maxchild=01 plk=0x2a38f6c10 ppn=n
cursor instantiation=0x2b294987cc48 used=1388471003 exec_id=0 exec=0
child#0(0x2a35389d8) pcs=0x287fe3db0
clk=0x2a38f6b18 ci=0x287fe3a50 pn=0x2a38f6818 ctx=0x283faf250
kgsccflg=0 llk[0x2b294987cc50,0x2b294987cc50] idx=0
xscflg=100076 fl2=40000000 fl3=22004 fl4=100
Frames pfr (nil) siz=2120 efr (nil) siz=2104
Cursor frame dump
enxt: 2.0x000000b8 enxt: 1.0x00000780
pnxt: 1.0x00000010
----------------------------------------
Cursor#3(0x2b2949861aa0) state=BOUND curiob=0x2b294987c908
curflg=d fl2=200000 par=(nil) ses=0x2a5a2fe30
----- Dump Cursor sql_id=aykvshm7zsabd xsc=0x2b294987c908 cur=0x2b2949861aa0 -----
Dump Parent Cursor sql_id=aykvshm7zsabd phd=0x2a3536398 plk=0x2a38f6a20
sqltxt(0x2a3536398)=select size_for_estimate, size_factor * 100 f, estd_physical_read_time, estd_physical_reads from v$db_cache_advice where id = '3'
hash=e6a0c9e759694930af4b7884cffc296d
parent=0x287fdec20 maxchild=01 plk=0x2a38f6a20 ppn=n
cursor instantiation=0x2b294987c908 used=1388471003 exec_id=0 exec=0
child#0(0x2a35361b8) pcs=0x287fde278
clk=0x2a38f6898 ci=0x287fddf18 pn=0x2a3537e78 ctx=0x283fa0f90
kgsccflg=0 llk[0x2b294987c910,0x2b294987c910] idx=0
xscflg=100076 fl2=40000000 fl3=22004 fl4=100
Frames pfr (nil) siz=7176 efr (nil) siz=7160
Cursor frame dump
enxt: 3.0x00000b78 enxt: 2.0x00000250 enxt: 1.0x00000e30
pnxt: 1.0x00000010
----------------------------------------
Cursor#4(0x2b2949861b30) state=BOUND curiob=0x2b294987c5c8
curflg=d fl2=200000 par=(nil) ses=0x2a5a2fe30
----- Dump Cursor sql_id=772s25v1y0x8k xsc=0x2b294987c5c8 cur=0x2b2949861b30 -----
Dump Parent Cursor sql_id=772s25v1y0x8k phd=0x2a3533e18 plk=0x2a35385a8
sqltxt(0x2a3533e18)=select shared_pool_size_for_estimate s, shared_pool_size_factor * 100 f, estd_lc_load_time l, 0 from v$shared_pool_advice
hash=ae5675c671b365c6738b022ec3e07512
parent=0x287fd7f88 maxchild=01 plk=0x2a35385a8 ppn=n
cursor instantiation=0x2b294987c5c8 used=1388471003 exec_id=0 exec=0
child#0(0x2a3533c38) pcs=0x287fd75e0
clk=0x2a35384b0 ci=0x287fd7280 pn=0x2a3537eb0 ctx=0x283f872c0
kgsccflg=0 llk[0x2b294987c5d0,0x2b294987c5d0] idx=0
xscflg=100076 fl2=40000000 fl3=22004 fl4=100
Frames pfr (nil) siz=2120 efr (nil) siz=2104
Cursor frame dump
Frames pfr (nil) siz=2120 efr (nil) siz=2104
Cursor frame dump
enxt: 2.0x000000b8 enxt: 1.0x00000780
pnxt: 1.0x00000010
----------------------------------------
Cursor#5(0x2b2949861bc0) state=BOUND curiob=0x2b294987c288
curflg=d fl2=200000 par=(nil) ses=0x2a5a2fe30
----- Dump Cursor sql_id=g6gu1n3x0h1h4 xsc=0x2b294987c288 cur=0x2b2949861bc0 -----
Dump Parent Cursor sql_id=g6gu1n3x0h1h4 phd=0x2a35326d8 plk=0x2a35383b8
sqltxt(0x2a35326d8)=select streams_pool_size_for_estimate s, streams_pool_size_factor * 100 f, estd_spill_time + estd_unspill_time, 0 from v$streams_pool_advice
hash=78ee9a4289ed2031f33f41a0fa080604
parent=0x287fd2450 maxchild=01 plk=0x2a35383b8 ppn=n
cursor instantiation=0x2b294987c288 used=1388471003 exec_id=0 exec=0
child#0(0x2a35324f8) pcs=0x287fd1aa8
clk=0x2a35382c0 ci=0x287fd1748 pn=0x2a3537ee8 ctx=0x283f79000
kgsccflg=0 llk[0x2b294987c290,0x2b294987c290] idx=0
xscflg=100076 fl2=40000000 fl3=22004 fl4=100
Frames pfr (nil) siz=2208 efr (nil) siz=2192
Cursor frame dump
enxt: 2.0x000000e8 enxt: 1.0x000007a8
pnxt: 1.0x00000010
----------------------------------------
Cursor#6(0x2b2949861c50) state=BOUND curiob=0x2b294987bf48
curflg=d fl2=200000 par=(nil) ses=0x2a5a2fe30
----- Dump Cursor sql_id=5yv7yvjgjxugg xsc=0x2b294987bf48 cur=0x2b2949861c50 -----
Dump Parent Cursor sql_id=5yv7yvjgjxugg phd=0x2a352b990 plk=0x2a3538138
sqltxt(0x2a352b990)=select TIME_WAITED_MICRO from V$SYSTEM_EVENT where event = 'Shared IO Pool Memory'
hash=b670d0be0c8dd4595f6cfedc5f1ee9ef
parent=0x287fcc918 maxchild=01 plk=0x2a3538138 ppn=n
cursor instantiation=0x2b294987bf48 used=1388471003 exec_id=0 exec=0
child#0(0x2a352b7b0) pcs=0x287fcbf70
clk=0x2a3538040 ci=0x287fcbc10 pn=0x2a35341d8 ctx=0x283f6d198
kgsccflg=0 llk[0x2b294987bf50,0x2b294987bf50] idx=0
xscflg=100076 fl2=40000000 fl3=22004 fl4=100
Frames pfr (nil) siz=5008 efr (nil) siz=4992
Cursor frame dump
enxt: 3.0x00000390 enxt: 2.0x00000298 enxt: 1.0x00000d58
pnxt: 1.0x00000010
----- Session Cached Cursor Dump -----
----- Generic Session Cached Cursor Dump -----
-----------------------------------------------------------
-------------- Generic Session Cached Cursors Dump --------
-------------------------------------
----- End of Archival Runtime State -----
----- Recovery Context Info -----
--------- Recovery context -------
No recovery context found
-----------End of Recovery context-----------
dbkedDefDump: no current context area
-------------------------------------------------------------------------------
Trace Bucket Dump Begin: default bucket for process 23 (osid: 1066, MMON)
TIME(*=approx):SEQ:COMPONENT:FILE@LINE:FUNCTION:SECT/DUMP: [EVENT#:PID:SID] DATA
-------------------------------------------------------------------------------
2013-12-31 14:23:23.566604 :8000798B:db_trace:kjcv.c@1541:kjcvg0(): [10425:23:876] kjss2m skip([0x7da8296d][0x7bf71d2a],[LB])[owner 1507330][held-mode 5]
2013-12-31 14:23:23.566608 :8000798C:db_trace:kjcv.c@1541:kjcvg0(): [10425:23:876] kjss2m skip([0x6029d4ac][0x7cdfa2ab],[NB])[owner 1507330][held-mode 3]
2013-12-31 14:23:23.566611 :8000798D:db_trace:kjcv.c@1541:kjcvg0(): [10425:23:876] kjss2m skip([0x6029d4ac][0x7cdfa2ab],[LB])[owner 1507330][held-mode 3]
2013-12-31 14:23:23.567056 :8000798F:db_trace:ksxp.c@3220:ksxpvsnd(): [10401:23:876] KSXPVSND: client 2 tid(1,257,0x19befaa1) buf 0x2a7800cc8 sz 128
2013-12-31 14:23:23.569694 :800079AC:db_trace:ksxp.c@4354:ksxpwait(): [10401:23:876] KSXP_SND_CALLBACK: request 0x2b294941e908, status 30
2013-12-31 14:23:23.569697 :800079AD:db_trace:ksxp.c@4382:ksxpwait(): [10401:23:876] KSXPWAIT: Send compl suppressed and No requests. proc 0x2a4e3c9c8 haswrk 0
2013-12-31 14:23:23.570021 :800079B0:db_trace:ksl2.c@9123:ksliwat(): [10005:23:876] KSL POST RCVD poster=11 loc='kji.h LINE:2330 ID:kjata: wake up enqueue owner' id1=0 id2=0 name= type=0 fac#=3 facpost=1
2013-12-31 14:23:23.570047 :800079B1:db_trace:ksxp.c@3220:ksxpvsnd(): [10401:23:876] KSXPVSND: client 2 tid(1,257,0x19befaa1) buf 0x2a7800cc8 sz 128
2013-12-31 14:23:23.571416 :800079CA:db_trace:ksxp.c@4354:ksxpwait(): [10401:23:876] KSXP_SND_CALLBACK: request 0x2b294941e350, status 30
2013-12-31 14:23:23.571418 :800079CB:db_trace:ksxp.c@4382:ksxpwait(): [10401:23:876] KSXPWAIT: Send compl suppressed and No requests. proc 0x2a4e3c9c8 haswrk 0
2013-12-31 14:23:23.571794 :800079CE:db_trace:ksl2.c@9123:ksliwat(): [10005:23:876] KSL POST RCVD poster=11 loc='kji.h LINE:2330 ID:kjata: wake up enqueue owner' id1=0 id2=0 name= type=0 fac#=3 facpost=1
2013-12-31 14:23:23.573076 :800079DA:db_trace:kjcv.c@1541:kjcvg0(): [10425:23:876] kjss2m skip([0x574dcc5e][0x6a750b5f],[NB])[owner 1507330][held-mode 3]
2013-12-31 14:23:23.573079 :800079DB:db_trace:kjcv.c@1541:kjcvg0(): [10425:23:876] kjss2m skip([0x574dcc5e][0x6a750b5f],[LB])[owner 1507330][held-mode 3]
2013-12-31 14:23:23.573726 :800079DD:db_trace:kjcv.c@1541:kjcvg0(): [10425:23:876] kjss2m skip([0x574dcc5e][0x6a750b5f],[NB])[owner 1507330][held-mode 3]
2013-12-31 14:23:23.573729 :800079DE:db_trace:kjcv.c@1541:kjcvg0(): [10425:23:876] kjss2m skip([0x574dcc5e][0x6a750b5f],[LB])[owner 1507330][held-mode 3]
2013-12-31 14:23:23.574191 :800079F6:db_trace:ksxp.c@3220:ksxpvsnd(): [10401:23:876] KSXPVSND: client 2 tid(1,257,0x19befaa1) buf 0x2a7800cc8 sz 128
2013-12-31 14:23:23.575912 :80007A0A:db_trace:ksxp.c@4354:ksxpwait(): [10401:23:876] KSXP_SND_CALLBACK: request 0x2b294941dd98, status 30
2013-12-31 14:23:23.575915 :80007A0B:db_trace:ksxp.c@4382:ksxpwait(): [10401:23:876] KSXPWAIT: Send compl suppressed and No requests. proc 0x2a4e3c9c8 haswrk 0
分析:
这是Oracle的一个BUG,就如Oracle错误提示所说的,此时spfile无法扩展空间,造成不能修改参数值或者增加新的参数。
解决方法:
重建spfile,重建步骤:
1.先根据spile将pfile创建出来;
create pfile='' from spfile='';
再根据pfile创建spfile:
create spfile from pfile='';
其实从mmon进程的dump信息,我们可以看到在DB启动的过程中(准确的说是在NOMOUNT阶段),MMON会查询v$*_advice系列内存建议视图,获得各个内存池的建议大小信息,之后再做2个事情:
1.将查询到的建议值修改到spfile中(因此时spfile不能扩展大小,所以报错ORA-00600)。
2.根据查询到的建议值去初始化各个内存池大小。