2013 年6月9号 周末
dbms: Oracle11.1.0.7 4nodes RAC
报系统运行变的极度缓慢
查看系统等待事件,积压了很多的类如下语句
查看第一个节点的
insert into counterloadmessage(emsid,emsentityid,equipmentid,moentityid,startday,starttime,period,indicatorsetid,indicatortable,filename,succnum,failnum,loadstate,inserttime,taskid,inserttime_human,insertseq)select :1 as emsid,:2 as emsentityid,t1.equipmentid as equipmentid, t2.moentityid as moentityid,:3 as startday,:4 as starttime,:5 as period,:6 as indicatorsetid,:7 as indicatortable,:8 as filename,:9 as succnum,:10 as failnum,:11 as loadstate,to_char((sysdate - to_date('1970-01-01 00:00:00', 'yyyy-mm-dd hh24:mi:ss')) * 60 * 60 * 24 * 1000 + to_number(to_char(systimestamp, 'ff3'))) as inserttime,:12 as taskid,to_char(sysdate, 'yyyy-mm-dd hh24:mi:ss'),SEQ_COUNTERLOADMESSAGE.NEXTVAL from pm4h_ad.cm_equipment t1,pm4h_ad.mo_moentity t2,pm4h_ad.mdl_motype t3 where t1.motypeid=t2.motypeid and t2.motypeid=t3.motypeid and t3.iscommon=0 and t2.moentitycode= :13
主要等待事件为 enq: TX - index contention 这是一个很平常的sql 平均执一次要化1.5s
其它的节点基本没有什么负载
查看一下alter 日志
Errors in file /opt/oracle/diag/rdbms/mos5200/mos52001/trace/mos52001_ora_19284.trc (incident=250211):
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], [], [], [], [], []
ORA-00600: internal error code, arguments: [kclcls_8], [1091616], [], [], [], [], [], [], [], [], [], []
Incident details in: /opt/oracle/diag/rdbms/mos5200/mos52001/incident/incdir_250211/mos52001_ora_19284_i250211.trc
Trace dumping is performing id=[cdmp_20130609064529]
Sun Jun 09 06:45:30 2013
发现大理的的ora-600 错误 ,metalink 上无法查到相关的 bug .
处理方案： 把rac 所有节点重启一下，系统正常。
如果有那同位朋友查到相关的解决方案，请稿知，也为遇到此问题的朋友提供一个临时解决方案吧，重启。