哭诉: 数据库为什么会当掉?error 221

Tue May 27 03:55:43 2008
Errors in file /opt/oracle/admin/webapp/bdump/webapp_ckpt_1192110.trc:
ORA-00206: Message 206 not found; No message file for product=RDBMS, facility=ORA; arguments: [3] [1]
ORA-00202: Message 202 not found; No message file for product=RDBMS, facility=ORA; arguments: [/data/webapp/control02.ctl]
ORA-27072: Message 27072 not found; No message file for product=RDBMS, facility=ORA
IBM AIX RISC System/6000 Error: 22: Invalid argument
Additional information: 8
Tue May 27 03:55:43 2008
Errors in file /opt/oracle/admin/webapp/bdump/webapp_ckpt_1192110.trc:
ORA-00221: Message 221 not found; No message file for product=RDBMS, facility=ORA
ORA-00206: Message 206 not found; No message file for product=RDBMS, facility=ORA; arguments: [3] [1]
ORA-00202: Message 202 not found; No message file for product=RDBMS, facility=ORA; arguments: [/data/webapp/control02.ctl]
ORA-27072: Message 27072 not found; No message file for product=RDBMS, facility=ORA
IBM AIX RISC System/6000 Error: 22: Invalid argument
Additional information: 8
Tue May 27 03:55:43 2008
CKPT: terminating instance due to error 221
Termination issued to instance processes. Waiting for the processes to exit
Instance terminated by CKPT, pid = 1192110
Tue May 27 08:56:27 2008
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Picked latch-free SCN scheme 3
Using LOG_ARCHIVE_DEST_10 parameter default value as USE_DB_RECOVERY_FILE_DEST
Autotune of undo retention is turned on.
IMODE=BR
ILAT =165
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization
Starting up ORACLE RDBMS Version: 10.2.0.1.0.
System parameters with non-default values:
  processes                = 1000
  sessions                 = 1500
  sga_max_size             = 3758096384
  lock_sga                 = TRUE
  __shared_pool_size       = 956301312
  shared_pool_size         = 956301312
  __large_pool_size        = 167772160
  large_pool_size          = 167772160
  __java_pool_size         = 50331648
  java_pool_size           = 50331648
  shared_pool_reserved_size= 104857600
  nls_language             = SIMPLIFIED CHINESE
  nls_territory            = CHINA
  control_files            = /data/webapp/control01.ctl, /data/webapp/control02.ctl
  db_block_size            = 8192
  db_cache_size            = 1241513984
  db_writer_processes      = 2
  compatible               = 10.2.0.1.0
  log_buffer               = 14302208
  db_file_multiblock_read_count= 16
  db_recovery_file_dest    = /data/dbarch
  db_recovery_file_dest_size= 64424509440
  fast_start_mttr_target   = 1800
  undo_management          = AUTO
  undo_tablespace          = UNDOTBS1
  remote_login_passwordfile= EXCLUSIVE
  db_domain                =
  dispatchers              = (PROTOCOL=TCP) (SERVICE=webappXDB)
  job_queue_processes      = 100
  cursor_sharing           = EXACT
  background_dump_dest     = /opt/oracle/admin/webapp/bdump
  user_dump_dest           = /opt/oracle/admin/webapp/udump
  core_dump_dest           = /opt/oracle/admin/webapp/cdump
  audit_file_dest          = /opt/oracle/admin/webapp/adump
  sort_area_size           = 65536000
  db_name                  = webapp
  open_cursors             = 2500
  optimizer_mode           = CHOOSE
  pga_aggregate_target     = 805306368
PMON started with pid=2, OS id=14242248
PSP0 started with pid=3, OS id=14246344
MMAN started with pid=4, OS id=13889668
DBW0 started with pid=5, OS id=1073238
DBW1 started with pid=6, OS id=13873268
LGWR started with pid=7, OS id=14250442
CKPT started with pid=8, OS id=14254540
SMON started with pid=9, OS id=14258638
RECO started with pid=10, OS id=14262736
CJQ0 started with pid=11, OS id=14266834
MMON started with pid=12, OS id=13848674
Tue May 27 08:56:29 2008
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
MMNL started with pid=13, OS id=14270932
Tue May 27 08:56:29 2008
starting up 1 shared server(s) ...
Tue May 27 08:56:30 2008
ALTER DATABASE   MOUNT
Tue May 27 08:56:34 2008
Setting recovery target incarnation to 2
Tue May 27 08:56:34 2008
Successful mount of redo thread 1, with mount id 2116597886
Tue May 27 08:56:34 2008
Database mounted in Exclusive Mode
Completed: ALTER DATABASE   MOUNT
Tue May 27 08:56:34 2008
ALTER DATABASE OPEN
Tue May 27 08:56:34 2008
Beginning crash recovery of 1 threads
parallel recovery started with 15 processes
Tue May 27 08:56:35 2008
Started redo scan
Tue May 27 08:56:35 2008
Completed redo scan
11517 redo blocks read, 22 data blocks need recovery
Tue May 27 08:56:35 2008
Started redo application at
Thread 1: logseq 1909, block 56340
Tue May 27 08:56:35 2008
Recovery of Online Redo Log: Thread 1 Group 1 Seq 1909 Reading mem 0
  Mem# 0 errs 0: /data/webapp/redo01.log
Tue May 27 08:56:35 2008
Completed redo application
Tue May 27 08:56:35 2008
Completed crash recovery at
Thread 1: logseq 1909, block 67857, scn 62588965
22 data blocks read, 21 data blocks written, 11517 redo blocks read
Tue May 27 08:56:35 2008
LGWR: STARTING ARCH PROCESSES
ARC0 started with pid=32, OS id=14324206
ARC1 started with pid=33, OS id=14328304
Tue May 27 08:56:35 2008
ARC0: Archival started
ARC1: Archival started
LGWR: STARTING ARCH PROCESSES COMPLETE
Thread 1 advanced to log sequence 1910
Thread 1 opened at log sequence 1910
  Current log# 3 seq# 1910 mem# 0: /data/webapp/redo03.log
Successful open of redo thread 1
Tue May 27 08:56:36 2008
ARC1: STARTING ARCH PROCESSES
Tue May 27 08:56:36 2008
ARC0: Becoming the 'no FAL' ARCH
ARC0: Becoming the 'no SRL' ARCH
Tue May 27 08:56:36 2008
SMON: enabling cache recovery
Tue May 27 08:56:36 2008
db_recovery_file_dest_size of 61440 MB is 47.70% used. This is a
user-specified limit on the amount of space that will be used by this
database for recovery-related files, and does not reflect the amount of
space available in the underlying filesystem or ASM diskgroup.
Tue May 27 08:56:36 2008
ARC2: Archival started
ARC1: STARTING ARCH PROCESSES COMPLETE
ARC1: Becoming the heartbeat ARCH
ARC2 started with pid=34, OS id=14332402
Tue May 27 08:56:37 2008
Successfully onlined Undo Tablespace 1.
Tue May 27 08:56:37 2008
SMON: enabling tx recovery
Tue May 27 08:56:37 2008
Database Characterset is ZHS16GBK
replication_dependency_tracking turned off (no async multimaster replication found)
Starting background process QMNC
QMNC started with pid=35, OS id=14291208
Tue May 27 08:56:40 2008
Completed: ALTER DATABASE OPEN
Tue May 27 09:02:36 2008
Shutting down archive processes
Tue May 27 09:02:41 2008
ARCH shutting down
ARC2: Archival stopped
Tue May 27 10:24:20 2008
Memory Notification: Library Cache Object loaded into SGA
Heap size 3595K exceeds notification threshold (2048K)
KGL object name :XDB.XDbD/PLZ01TcHgNAgAIIegtw==
Tue May 27 10:24:21 2008
Memory Notification: Library Cache Object loaded into SGA
Heap size 3774K exceeds notification threshold (2048K)
Details in trace file /opt/oracle/admin/webapp/udump/webapp_ora_13967468.trc
KGL object name :XDB.XDJ7JY/ksrgOzgQ8CoEgGA7A==