一个奇怪的问题，TSM TDPO + Oracle RMAN

killkill_shadow

rman 的备份你脚本如下：
RMAN> ### backup database  everyday
2> set echo on;
3> run {
4>   configure exclude for tablespace PSTATS;
5>   configure exclude for tablespace WGXOA_SYS13;
6>   configure exclude for tablespace DZOA_SYS13;
7>   show exclude ;
8>   allocate channel ch1
9>     device type 'sbt_tape'
10>     format '%d_%I_%M%D_%s.dbf' ;
11>   backup incremental level 0 database tag 'tsm';
12>   backup current controlfile tag 'tsm';
13>   configure exclude for tablespace PSTATS clear;
14>   configure exclude for tablespace WGXOA_SYS13 clear;
15>   configure exclude for tablespace DZOA_SYS13 clear;
16>   release channel ch1;
17> }
18> exit;

从脚本来看 只有两句 backup... ，应该是备份出两个backup set，但是上述的报错，出现在第三个backup set ...

rman日志如下：
RMAN> ### backup database  everyday
2> set echo on;
3> run {
4>   configure exclude for tablespace PSTATS;
5>   configure exclude for tablespace WGXOA_SYS13;
6>   configure exclude for tablespace DZOA_SYS13;
7>   show exclude ;
8>   allocate channel ch1
9>     device type 'sbt_tape'
10>     format '%d_%I_%M%D_%s.dbf' ;
11>   backup incremental level 0 database tag 'tsm';
12>   backup current controlfile tag 'tsm';
13>   configure exclude for tablespace PSTATS clear;
14>   configure exclude for tablespace WGXOA_SYS13 clear;
15>   configure exclude for tablespace DZOA_SYS13 clear;
16>   release channel ch1;
17> }
18> exit;
echo set on

tablespace PSTATS will be excluded from future whole database backups
new RMAN configuration parameters are successfully stored
starting full resync of recovery catalog
full resync complete

tablespace WGXOA_SYS13 will be excluded from future whole database backups
new RMAN configuration parameters are successfully stored
starting full resync of recovery catalog
full resync complete

tablespace DZOA_SYS13 will be excluded from future whole database backups
new RMAN configuration parameters are successfully stored
starting full resync of recovery catalog
full resync complete

RMAN configuration parameters are:
CONFIGURE EXCLUDE FOR TABLESPACE 'PSTATS';
CONFIGURE EXCLUDE FOR TABLESPACE 'WGXOA_SYS13';
CONFIGURE EXCLUDE FOR TABLESPACE 'DZOA_SYS13';

allocated channel: ch1
channel ch1: sid=491 devtype=SBT_TAPE
channel ch1: Data Protection for Oracle: version 5.4.1.0

Starting backup at 2011-02-22 23:30:41
file 7 is excluded from whole database backup
file 10 is excluded from whole database backup
file 11 is excluded from whole database backup
file 12 is excluded from whole database backup
file 13 is excluded from whole database backup
file 14 is excluded from whole database backup
file 15 is excluded from whole database backup
file 16 is excluded from whole database backup
file 17 is excluded from whole database backup
file 18 is excluded from whole database backup
file 19 is excluded from whole database backup
file 20 is excluded from whole database backup
file 21 is excluded from whole database backup
file 22 is excluded from whole database backup
file 23 is excluded from whole database backup
file 24 is excluded from whole database backup
file 25 is excluded from whole database backup
file 26 is excluded from whole database backup
file 27 is excluded from whole database backup
file 28 is excluded from whole database backup
file 29 is excluded from whole database backup
file 30 is excluded from whole database backup
file 32 is excluded from whole database backup
file 33 is excluded from whole database backup
file 34 is excluded from whole database backup
file 35 is excluded from whole database backup
channel ch1: starting incremental level 0 datafile backupset
channel ch1: specifying datafile(s) in backupset
input datafile fno=00005 name=/u01/app/oradata/oracle/LSOA_SYS13_01.dbf
input datafile fno=00009 name=/u01/app/oradata/oracle/HCBOA_SYS13.dbf
input datafile fno=00002 name=/u01/app/oradata/oracle/undotbs101.dbf
input datafile fno=00031 name=/u01/app/oradata/oracle/ZC_USERS02.dbf
input datafile fno=00006 name=/u01/app/oradata/oracle/ZC_USERS01.dbf
input datafile fno=00001 name=/u01/app/oradata/oracle/system01.dbf
input datafile fno=00003 name=/u01/app/oradata/oracle/sysaux01.dbf
input datafile fno=00008 name=/u01/app/oradata/oracle/ZC_INDX01.dbf
input datafile fno=00004 name=/u01/app/oradata/oracle/users01.dbf
channel ch1: starting piece 1 at 2011-02-22 23:30:42
channel ch1: finished piece 1 at 2011-02-22 23:39:57
piece handle=ORACLE_1541093227_0222_348.dbf tag=TSM comment=API Version 2.0,MMS Version 5.4.1.0
channel ch1: backup set complete, elapsed time: 00:09:15
channel ch1: starting incremental level 0 datafile backupset
channel ch1: specifying datafile(s) in backupset
including current control file in backupset
including current SPFILE in backupset
channel ch1: starting piece 1 at 2011-02-22 23:39:59
channel ch1: finished piece 1 at 2011-02-22 23:40:14
piece handle=ORACLE_1541093227_0222_349.dbf tag=TSM comment=API Version 2.0,MMS Version 5.4.1.0
channel ch1: backup set complete, elapsed time: 00:00:17
Finished backup at 2011-02-22 23:40:14

Starting backup at 2011-02-22 23:40:15
channel ch1: starting full datafile backupset
channel ch1: specifying datafile(s) in backupset
including current control file in backupset
channel ch1: starting piece 1 at 2011-02-22 23:40:15
released channel: ch1
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03009: failure of backup command on ch1 channel at 02/22/2011 23:40:30
ORA-27192: skgfcls: sbtclose2 returned error - failed to close file
ORA-19511: Error received from media manager layer, error text:
   ANS1301E (RC1)    Server detected system error

Recovery Manager complete.


TSM 服务器的日志如下：

02/22/2011 23:30:36      ANR0406I Session 21012 started for node ORACLE_110_7
                          (Linux86) (Tcp/Ip 192.168.110.7(38146)). (SESSION:

21012)
02/22/2011 23:30:49      ANR0406I Session 21013 started for node ORA_110_7 (TDPO
                          LinuxAMD64) (Tcp/Ip 192.168.110.7(38151)). (SESSION:
                          21013)
02/22/2011 23:30:49      ANR8340I FILE volume E:\TSMPOOL\000034D4.BFS mounted.
                          (SESSION: 21013)
02/22/2011 23:30:50      ANR0511I Session 21013 opened output volume
                          E:\TSMPOOL\000034D4.BFS. (SESSION: 21013)
02/22/2011 23:30:52      ANR8340I SERVER volume ZAIBEI3_SERVER1.BFS.298388649
                          mounted. (SESSION: 21013)
02/22/2011 23:30:52      ANR1340I Scratch volume ZAIBEI3_SERVER1.BFS.298388649 is
                          now defined in storage pool COPY_POOL. (SESSION: 21013)
02/22/2011 23:30:52      ANR0511I Session 21013 opened output volume
                          ZAIBEI3_SERVER1.BFS.298388649. (SESSION: 21013)
more...   (<ENTER> to continue, 'C' to cancel)

02/22/2011 23:39:51      ANE4991I (Session: 21013, Node: ORA_110_7)  TDPO
                          LinuxAMD64 ANU0599 TDP for Oracle: (973: =>(ora_110_7)
                          ANU2535I File /adsmorc//ORACLE_1541093227_0222_348.dbf =
                          15311044608 bytes sent (SESSION: 21013)
02/22/2011 23:39:51      ANR0514I Session 21013 closed volume
                          E:\TSMPOOL\000034D4.BFS. (SESSION: 21013)
02/22/2011 23:39:51      ANR0514I Session 21013 closed volume
                          ZAIBEI3_SERVER1.BFS.298388649. (SESSION: 21013)
02/22/2011 23:39:51      ANR0403I Session 21013 ended for node ORA_110_7 (TDPO
                          LinuxAMD64). (SESSION: 21013)
02/22/2011 23:39:55      ANR0406I Session 21015 started for node ORA_110_7 (TDPO
                          LinuxAMD64) (Tcp/Ip 192.168.110.7(38207)). (SESSION:
                          21015)
02/22/2011 23:39:55      ANR0403I Session 21015 ended for node ORA_110_7 (TDPO
                          LinuxAMD64). (SESSION: 21015)
02/22/2011 23:40:05      ANR0406I Session 21016 started for node ORA_110_7 (TDPO
                          LinuxAMD64) (Tcp/Ip 192.168.110.7(38209)). (SESSION:
                          21016)
02/22/2011 23:40:05      ANR8340I FILE volume E:\TSMPOOL\000034D4.BFS mounted.
                          (SESSION: 21016)
02/22/2011 23:40:05      ANR0511I Session 21016 opened output volume
                          E:\TSMPOOL\000034D4.BFS. (SESSION: 21016)
02/22/2011 23:40:08      ANR8340I SERVER volume ZAIBEI3_SERVER1.BFS.298389205
                          mounted. (SESSION: 21016)
more...   (<ENTER> to continue, 'C' to cancel)

02/22/2011 23:40:08      ANR1340I Scratch volume ZAIBEI3_SERVER1.BFS.298389205 is
                          now defined in storage pool COPY_POOL. (SESSION: 21016)
02/22/2011 23:40:08      ANR0511I Session 21016 opened output volume
                          ZAIBEI3_SERVER1.BFS.298389205. (SESSION: 21016)
02/22/2011 23:40:08      ANE4991I (Session: 21016, Node: ORA_110_7)  TDPO
                          LinuxAMD64 ANU0599 TDP for Oracle: (973: =>(ora_110_7)
                          ANU2535I File /adsmorc//ORACLE_1541093227_0222_349.dbf =
                          10223616 bytes sent (SESSION: 21016)
02/22/2011 23:40:08      ANR0514I Session 21016 closed volume
                          E:\TSMPOOL\000034D4.BFS. (SESSION: 21016)
02/22/2011 23:40:08      ANR0514I Session 21016 closed volume
                          ZAIBEI3_SERVER1.BFS.298389205. (SESSION: 21016)
02/22/2011 23:40:08      ANR0403I Session 21016 ended for node ORA_110_7 (TDPO
                          LinuxAMD64). (SESSION: 21016)
02/22/2011 23:40:12      ANR0406I Session 21018 started for node ORA_110_7 (TDPO
                          LinuxAMD64) (Tcp/Ip 192.168.110.7(38210)). (SESSION:
                          2101
02/22/2011 23:40:12      ANR0403I Session 21018 ended for node ORA_110_7 (TDPO
                          LinuxAMD64). (SESSION: 2101
02/22/2011 23:40:21      ANR0406I Session 21019 started for node ORA_110_7 (TDPO
                          LinuxAMD64) (Tcp/Ip 192.168.110.7(38212)). (SESSION:
                          21019)
02/22/2011 23:40:21      ANR8340I FILE volume E:\TSMPOOL\000034D4.BFS mounted.
                          (SESSION: 21019)
more...   (<ENTER> to continue, 'C' to cancel)

02/22/2011 23:40:22      ANR0511I Session 21019 opened output volume
                          E:\TSMPOOL\000034D4.BFS. (SESSION: 21019)
02/22/2011 23:40:24      ANR8340I SERVER volume ZAIBEI3_SERVER1.BFS.298389221
                          mounted. (SESSION: 21019)
02/22/2011 23:40:24      ANR1340I Scratch volume ZAIBEI3_SERVER1.BFS.298389221 is
                          now defined in storage pool COPY_POOL. (SESSION: 21019)
02/22/2011 23:40:24      ANR0511I Session 21019 opened output volume
                          ZAIBEI3_SERVER1.BFS.298389221. (SESSION: 21019)
02/22/2011 23:40:24      ANR4383E Session failure, target server ZAIBEI3_SERVER1
                          has aborted current transaction; reason: Exceeded
                          MAXNUMMP on target. (SESSION: 21019)
02/22/2011 23:40:24      ANR1411W Access mode for volume
                          ZAIBEI3_SERVER1.BFS.298389221 now set to "read-only" due
                          to write error. (SESSION: 21019)
02/22/2011 23:40:24      ANR0514I Session 21019 closed volume
                          ZAIBEI3_SERVER1.BFS.298389221. (SESSION: 21019)
02/22/2011 23:40:24      ANR1181E astxn.c(684): Data storage transaction 0:6735375
                          was aborted. (SESSION: 21019)
02/22/2011 23:40:24      ANR0532W smnode.c(3191): Transaction 0:6735375 was

aborted
                          for session 21019 for node ORA_110_7 (TDPO LinuxAMD64).
                          (SESSION: 21019)
02/22/2011 23:40:24      ANE4994S (Session: 21019, Node: ORA_110_7)  TDPO
                          LinuxAMD64 ANU0599 TDP for Oracle: (973: =>

(ora_110_7)
                          ANS1301E (RC1)    Server detected system error (SESSION:
more...   (<ENTER> to continue, 'C' to cancel)

                          21019)
02/22/2011 23:40:24      ANR0514I Session 21019 closed volume
                          E:\TSMPOOL\000034D4.BFS. (SESSION: 21019)
02/22/2011 23:40:24      ANR0403I Session 21019 ended for node ORA_110_7 (TDPO
                          LinuxAMD64). (SESSION: 21019)
02/22/2011 23:40:29      ANR0406I Session 21021 started for node ORA_110_7 (TDPO
                          LinuxAMD64) (Tcp/Ip 192.168.110.7(38214)). (SESSION:
                          21021)
02/22/2011 23:40:29      ANE4994S (Session: 21021, Node: ORA_110_7)  TDPO
                          LinuxAMD64 ANU0599 TDP for Oracle: (973: =>(ora_110_7)
                          ANU2602E The object

/adsmorc//ORACLE_1541093227_0222_350-
                          .dbf was not found on the TSM Server (SESSION: 21021)
02/22/2011 23:40:29      ANR0403I Session 21021 ended for node ORA_110_7 (TDPO
                          LinuxAMD64). (SESSION: 21021)
02/22/2011 23:40:29      ANR0403I Session 21020 ended for node ZAIBEI_SERVER1
                          (Windows). (SESSION: 21019)
02/22/2011 23:40:31      ANR0403I Session 21022 ended for node ZAIBEI_SERVER1
                          (Windows). (SESSION: 21019)
02/22/2011 23:40:31      ANR1341I Scratch volume ZAIBEI3_SERVER1.BFS.298389221 has
                          been deleted from storage pool COPY_POOL. (SESSION:
                          21019)
02/22/2011 23:40:33      ANR2507I Schedule ORA110.7_BK_DB for domain ORA_DOMAIN
                          started at 02/22/2011 23:30:00 for node ORACLE_110_7
                          completed successfully at 02/22/2011 23:40:33. (SESSION:
more...   (<ENTER> to continue, 'C' to cancel)

                          21012)
02/22/2011 23:40:33      ANR0403I Session 21012 ended for node ORACLE_110_7
                          (Linux86). (SESSION: 21012)
02/22/2011 23:40:38      ANR0406I Session 21023 started for node ORACLE_110_7
                          (Linux86) (Tcp/Ip 192.168.110.7(3821). (SESSION:

21023)
02/22/2011 23:40:38      ANR0403I Session 21023 ended for node ORACLE_110_7
                          (Linux86). (SESSION: 21023)
02/22/2011 23:41:51      ANR8325I Dismounting volume ZAIBEI3_SERVER1.BFS.298388649
                          - 2 minute mount retention expired.
02/22/2011 23:41:51      ANR0403I Session 21014 ended for node ZAIBEI_SERVER1
                          (Windows). (SESSION: 21013)
02/22/2011 23:42:08      ANR8325I Dismounting volume ZAIBEI3_SERVER1.BFS.298389205
                          - 2 minute mount retention expired.
02/22/2011 23:42:08      ANR0403I Session 21017 ended for node ZAIBEI_SERVER1
                          (Windows). (SESSION: 21016)
02/22/2011 23:47:06      ANR0407I Session 21024 started for administrator
                          ADMIN_CENTER (DSMAPI) (Tcp/Ip zaibei(4793)). (SESSION:
                          21024)

renxiao2003

又见RMAN.

duolanshizhe

非 oracle本身的问题

killkill_shadow

回复 3# kerlion


    做了几个实现，与MaxNumMP这个参数无关，稍后我会写上原因。
    谢谢你的回复。

killkill_shadow

测试几次后就找到规律了，但还没搞清是Oracle还是TSM的问题？
http://www.cnblogs.com/killkill/archive/2011/02/23/1962553.html

killkill_shadow

q stg copy_pool:
Storage      Device       Estimated    Pct    Pct  High  Low  Next Stora-
Pool Name    Class Name    Capacity   Util   Migr   Mig  Mig  ge Pool
                                                    Pct  Pct
-----------  ----------  ----------  -----  -----  ----  ---  -----------
COPY_POOL    TSM_CP_DEV   476,691 G    0.6


q dr
ANR2034E QUERY DRIVE: No match found using this criteria.
ANS8001I Return code 11.

q vol
这个太多了...
不过可以肯定的一点是空间是够用的。

MaxNumMP 这个参数原来是 8 ，后来我改成16，问题依旧。