这个问题本来还以为是偶然遇到的一次,但没想到这已经是第二次发生了。因此我想这估计不是偶发案例,应该写出来和大家共享一下了。
今天接到一个ticket,说前一天晚上做chang,删除了部分分区,清除了表空间,在清除表空间的时候是用drop tablespace including contents and datafiles。在操作系统层面看,那些datafile已经被删除了,但是空间使用率却一直没有下去。似乎删除了数据文件之后,那些文件的句柄还是被某些进程hold住,导致操作系统层面文件系统无法释放。下面我们来看一下诊断过程:
该数据库是11.2.0.2的版本的3节点RAC,共享文件系统和心跳是有veritas cluster控制,RAC的cluster是CRS,每个server上还跑了10.2.0.5的emagent。
先来看看处理前的文件系统使用情况:
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 | ssdb0220:BRM1AP1:/opt/app/oracle/admin>df -k Filesystem            kbytes    used   avail capacity  Mounted on rpool/ROOT/zfsroot   8388608 6789636 1598971    81%    / /devices                   0       0       0     0%    /devices ctfs                       0       0       0     0%    /system/contract proc                       0       0       0     0%    /proc mnttab                     0       0       0     0%    /etc/mnttab swap                 33448496    1640 33446856     1%    /etc/svc/volatile objfs                      0       0       0     0%    /system/object sharefs                    0       0       0     0%    /etc/dfs/sharetab fd                         0       0       0     0%    /dev/fd rpool/ROOT/zfsroot/var                      8388608 5204250 3184357    63%    /var swap                 6291456    3656 6287800     1%    /tmp swap                 33446904      48 33446856     1%    /var/run swap                 33446856       0 33446856     0%    /dev/vx/dmp swap                 33446856       0 33446856     0%    /dev/vx/rdmp rpool/home           2097152 1459115  638037    70%    /home /dev/vx/dsk/ssdb0220dg/homeappvl                      10485760  656088 9755128     7%    /home/app /dev/vx/dsk/ssdb0220dg/optappvl                      104857600 49362928 55083616    48%    /opt/app /dev/vx/dsk/ssdb0220dg/appdatavl                      52428800 39903880 12430584    77%    /var/opt/app rpool/appstat        2097152 1486022  611130    71%    /apps/stats rpool/optemc         286949376 5434493 184688483     3%    /opt/emc rpool                286949376      97 184688483     1%    /rpool rpool/backuplog      10485760     117 10485642     1%    /usr/openv/netbackup/logs rpool/varcrash       8388608 3985384 4403224    48%    /var/crash /dev/odm                   0       0       0     0%    /dev/odm /dev/vx/dsk/crsdg/oracm002vl                      1039360   74680  957152     8%    /ora/oracm002 /dev/vx/dsk/crsdg/oracm004vl                      1039360   50464  981184     5%    /ora/oracm004 /dev/vx/dsk/crsdg/oracm003vl                      1039360   74680  957152     8%    /ora/oracm003 /dev/vx/dsk/crsdg/oracm005vl                      1039360   50464  981184     5%    /ora/oracm005 /dev/vx/dsk/crsdg/oracm001vl                      1039360   74680  957152     8%    /ora/oracm001 /dev/vx/dsk/oradb001redodg/redo001vl                      104857600 90905120 13843608    87%    /ora/db001/redo001 /dev/vx/dsk/oradb001dbfradg/dbfra001vl                      2097152000 44360760 2036754976     3%    /ora/db001/dbfra001 /dev/vx/dsk/oradb001redodg/redo002vl                      104857600 90905152 13843576    87%    /ora/db001/redo002 /dev/vx/dsk/oradb001tempdg/temp001vl                      734003200 616321123 110327426    85%    /ora/db001/temp001 /dev/vx/dsk/oradb001datadg/data022vl                      1572864000 1086356592 482706688    70%    /ora/db001/data022 /dev/vx/dsk/oradb001datadg/data024vl                      1572864000 1049210464 519562736    67%    /ora/db001/data024 /dev/vx/dsk/oradb001datadg/data019vl                      2097152000 1420040864 671821304    68%    /ora/db001/data019 /dev/vx/dsk/oradb001datadg/data018vl                      1572864000 1063923704 504964304    68%    /ora/db001/data018 /dev/vx/dsk/oradb001datadg/data028vl                      2097152000 1523616200 569055280    73%    /ora/db001/data023 /dev/vx/dsk/oradb001datadg/data025vl                      2097152000 1301086712 789846152    63%    /ora/db001/data025 /dev/vx/dsk/oradb001datadg/data999vl                      734003200 682547265 48240064    94%    /ora/db001/data999 /dev/vx/dsk/oradb001datadg/data021vl                      2097152000 1463006752 629191096    70%    /ora/db001/data021 /dev/vx/dsk/oradb001datadg/data020vl                      1572864000 1235488992 334739376    79%    /ora/db001/data020 /dev/vx/dsk/oradb001datadg/data026vl                      1572864000 1057756826 482913088    69%    /ora/db001/data026 /dev/vx/dsk/oradb001datadg/data016vl                      1572864000 1176481200 393286168    75%    /ora/db001/data016 /dev/vx/dsk/oradb001datadg/data014vl                      1572864000 1266939608 303534472    81%    /ora/db001/data014 /dev/vx/dsk/oradb001datadg/data017vl                      2097152000 1475675024 616621800    71%    /ora/db001/data017 /dev/vx/dsk/oradb001datadg/data012vl                      1258291200 846490992 408583272    68%    /ora/db001/data012 /dev/vx/dsk/oradb001datadg/data009vl                      1887436800 1348956488 534273560    72%    /ora/db001/data009 /dev/vx/dsk/oradb001datadg/data013vl                      2097152000 1528090512 564615936    74%    /ora/db001/data013 /dev/vx/dsk/oradb001datadg/data007vl                      1887436800 1313041416 569908048    70%    /ora/db001/data007 /dev/vx/dsk/oradb001datadg/data015vl                      2097152000 1684645232 409284424    81%    /ora/db001/data015 /dev/vx/dsk/oradb001datadg/data008vl                      1284505600 823680467 432023689    66%    /ora/db001/data008 /dev/vx/dsk/oradb001datadg/data006vl                      1258291200 870003474 364019870    71%    /ora/db001/data006 /dev/vx/dsk/oradb001datadg/data005vl                      1887436800 1446001576 437986640    77%    /ora/db001/data005 /dev/vx/dsk/oradb001datadg/data002vl                      1258291200 805501288 449252616    65%    /ora/db001/data002 /dev/vx/dsk/oradb001datadg/data004vl                      1258291200 780397232 474160552    63%    /ora/db001/data004 /dev/vx/dsk/oradb001datadg/data003vl                      1887436800 1379480680 503987968    74%    /ora/db001/data003 /dev/vx/dsk/oradb001datadg/data001vl                      1887436800 1627198432 258205384    87%    /ora/db001/data001 /dev/vx/dsk/ssdb0220dg/varoptappfastreadervl                      471859200  182297 442197103     1%    /var/opt/app/fastreader ssdb0220:BRM1AP1:/opt/app/oracle/admin>   | 
然后我们用fuser这个命令来检查文件句柄的情况,在solaris下,在veritas的文件系统中,我们可以用fuser -c [mount_point] 来检查每个挂载点的文件句柄情况。
由于是RAC,我们必须在每个节点的server上都进行检查,这点很重要。往往就是查了一个server没有发现hold住句柄的process,就认为是OS的问题,可能需要重启该主机了。
在第一个server上:
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 | ssdb0220:BRM1AP1:/opt/app/oracle/admin> ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data022 /ora/db001/data022:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data024 /ora/db001/data024:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data019 /ora/db001/data019:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data018 /ora/db001/data018:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuer -c /ora/db001/data023 ksh: fuer:  not found ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data023 /ora/db001/data023:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data025 /ora/db001/data025:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data999 /ora/db001/data999:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data021 /ora/db001/data021:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data020 /ora/db001/data020:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data026 /ora/db001/data026:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data016 /ora/db001/data016:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data014 /ora/db001/data014:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data017 /ora/db001/data017:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data012 /ora/db001/data012:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data012 /ora/db001/data012:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data009 /ora/db001/data009:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data013 /ora/db001/data013:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data007 /ora/db001/data007:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data015 /ora/db001/data015:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data008 /ora/db001/data008:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data006 /ora/db001/data006:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data005 /ora/db001/data005:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data002 /ora/db001/data002:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data004 /ora/db001/data004:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data003 /ora/db001/data003:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data001 /ora/db001/data001:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /var/opt/app/fastreader /var/opt/app/fastreader:  ssdb0220:BRM1AP1:/opt/app/oracle/admin>  | 
在第二个server上:
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 | ssdb0221:BRM1AP2:/opt/app/oracle/admin> ssdb0221:BRM1AP2:/opt/app/oracle/admin> ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data024 /ora/db001/data024:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data025 /ora/db001/data025:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data999 /ora/db001/data999:  ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data019 /ora/db001/data019:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data023 /ora/db001/data023:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data022 /ora/db001/data022:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data018 /ora/db001/data018:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data020 /ora/db001/data020:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data021 /ora/db001/data021:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data026 /ora/db001/data026:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data017 /ora/db001/data017:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data014 /ora/db001/data014:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data016 /ora/db001/data016:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data012 /ora/db001/data012:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data009 /ora/db001/data009:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data007 /ora/db001/data007:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data015 /ora/db001/data015:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data013 /ora/db001/data013:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data006 /ora/db001/data006:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data008 /ora/db001/data008:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data004 /ora/db001/data004:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data005 /ora/db001/data005:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data003 /ora/db001/data003:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data002 /ora/db001/data002:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data001 /ora/db001/data001:    12433o   22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin> | 
我们看到有2个进程hold住文件系统了。我们先来看看第三个server上有没有之后,再来细究这几个进程。
在第三个server上:
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 | ssdb0222:BRM1AP3:/opt/app/oracle/admin> ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data999 /ora/db001/data999:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser c  /ora/db001/data023 c: fuser: No such file or directory /ora/db001/data023:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c  /ora/db001/data023 /ora/db001/data023:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data022 /ora/db001/data022:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data021 /ora/db001/data021:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data025 /ora/db001/data025:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data018 /ora/db001/data018:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data024 /ora/db001/data024:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data020 /ora/db001/data020:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data019 /ora/db001/data019:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data026 /ora/db001/data026:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data015 /ora/db001/data015:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data012 /ora/db001/data012:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data017 /ora/db001/data017:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data014 /ora/db001/data014:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data013 /ora/db001/data013:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data009 /ora/db001/data009:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data016 /ora/db001/data016:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data007 /ora/db001/data007:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data006 /ora/db001/data006:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data008 /ora/db001/data008:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data002 /ora/db001/data002:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data004 /ora/db001/data004:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data005 /ora/db001/data005:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data001 /ora/db001/data001:  ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data003 /ora/db001/data003:  ssdb0222:BRM1AP3:/opt/app/oracle/admin> | 
ok,我们只在第二个节点的server上发现了问题,我们进一步来查看这些进程的详细情况:
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 | SQL> !ps -ef |grep 12433   oracle 23143 22717   0 18:45:12 pts/4       0:00 grep 12433   oracle 12433     1   0   Jul 05 ?           8:54 oracleBRM1AP2 (LOCAL=NO) SQL> !ps -ef |grep 22467   oracle 23310 22717   0 18:45:20 pts/4       0:00 grep 22467   oracle 22467     1   0   Jul 05 ?           5:53 oracleBRM1AP2 (LOCAL=NO) SQL> SELECT s.sid, s.username, s.osuser, p.spid, s.program, s.module, s.event, s.status   FROM v$session s, v$process p  WHERE s.paddr   = p.addr    AND p.spid IN (  2    3    4  '12433','22467'); SQL> /        SID USERNAME                       OSUSER                         SPID                     PROGRAM                                          MODULE                                                           EVENT                                                            STATUS ---------- ------------------------------ ------------------------------ ------------------------ ------------------------------------------------ ---------------------------------------------------------------- ---------------------------------------------------------------- --------        594 DBSNMP                         oracle                         22467                    emagent@ssdb0221 (TNS V1-V3)                     emagent_SQL_rac_database                                         SQL*Net message from client                                      INACTIVE       1617 DBSNMP                         oracle                         12433                    emagent@ssdb0221 (TNS V1-V3)                     emagent_SQL_rac_database                                         SQL*Net message from client                                      INACTIVE SQL>  | 
我们看到是emagent hold住了文件系统的句柄,导致文件系统空间无法释放。我们重启emagent进程后,文件系统释放。
| 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 | ssdb0221:BRM1AP2:/opt/app/oracle/emagent/agent10g/bin>df -k Filesystem            kbytes    used   avail capacity  Mounted on rpool/ROOT/zfsroot   8388608 7062840 1325768    85%    / /devices                   0       0       0     0%    /devices ctfs                       0       0       0     0%    /system/contract proc                       0       0       0     0%    /proc mnttab                     0       0       0     0%    /etc/mnttab swap                 32423120    1616 32421504     1%    /etc/svc/volatile objfs                      0       0       0     0%    /system/object sharefs                    0       0       0     0%    /etc/dfs/sharetab fd                         0       0       0     0%    /dev/fd rpool/ROOT/zfsroot/var                      8388608 3704952 4683656    45%    /var swap                 6291456    3648 6287808     1%    /tmp swap                 32421544      40 32421504     1%    /var/run swap                 32421504       0 32421504     0%    /dev/vx/dmp swap                 32421504       0 32421504     0%    /dev/vx/rdmp rpool/home           2097152 1520737  576415    73%    /home rpool/appstat        2097152 1664978  432173    80%    /apps/stats rpool/optemc         286949376 6344881 182808981     4%    /opt/emc rpool                286949376      97 182808981     1%    /rpool rpool/backuplog      10485760   14852 10470907     1%    /usr/openv/netbackup/logs rpool/varcrash       8388608 5943012 2445596    71%    /var/crash /dev/vx/dsk/ssdb0221dg/optappvl                      104857600 54946976 49534584    53%    /opt/app /dev/vx/dsk/ssdb0221dg/appdatavl                      52428800 13983104 38145472    27%    /var/opt/app /dev/vx/dsk/ssdb0221dg/homeappvl                      10485760  566088 9844392     6%    /home/app /dev/odm                   0       0       0     0%    /dev/odm /dev/vx/dsk/crsdg/oracm004vl                      1039360   50464  981184     5%    /ora/oracm004 /dev/vx/dsk/crsdg/oracm003vl                      1039360   74680  957152     8%    /ora/oracm003 /dev/vx/dsk/crsdg/oracm005vl                      1039360   50464  981184     5%    /ora/oracm005 /dev/vx/dsk/crsdg/oracm002vl                      1039360   74680  957152     8%    /ora/oracm002 /dev/vx/dsk/crsdg/oracm001vl                      1039360   74680  957152     8%    /ora/oracm001 /dev/vx/dsk/oradb001redodg/redo001vl                      104857600 90905120 13843608    87%    /ora/db001/redo001 /dev/vx/dsk/oradb001redodg/redo002vl                      104857600 90905152 13843576    87%    /ora/db001/redo002 /dev/vx/dsk/oradb001dbfradg/dbfra001vl                      2097152000 41133480 2039957040     2%    /ora/db001/dbfra001 /dev/vx/dsk/oradb001tempdg/temp001vl                      734003200 616321123 110327426    85%    /ora/db001/temp001 /dev/vx/dsk/oradb001datadg/data024vl                      1572864000 1049210464 519562736    67%    /ora/db001/data024 /dev/vx/dsk/oradb001datadg/data025vl                      2097152000 1301086712 789846152    63%    /ora/db001/data025 /dev/vx/dsk/oradb001datadg/data999vl                      734003200 682547265 48240064    94%    /ora/db001/data999 /dev/vx/dsk/oradb001datadg/data019vl                      2097152000 1420040864 671821304    68%    /ora/db001/data019 /dev/vx/dsk/oradb001datadg/data028vl                      2097152000 1523616200 569055280    73%    /ora/db001/data023 /dev/vx/dsk/oradb001datadg/data022vl                      1572864000 1086356592 482706688    70%    /ora/db001/data022 /dev/vx/dsk/oradb001datadg/data018vl                      1572864000 1063923704 504964304    68%    /ora/db001/data018 /dev/vx/dsk/oradb001datadg/data020vl                      1572864000 1235488992 334739376    79%    /ora/db001/data020 /dev/vx/dsk/oradb001datadg/data021vl                      2097152000 1463006752 629191096    70%    /ora/db001/data021 /dev/vx/dsk/oradb001datadg/data026vl                      1572864000 1057756826 482913088    69%    /ora/db001/data026 /dev/vx/dsk/oradb001datadg/data017vl                      2097152000 1475675024 616621800    71%    /ora/db001/data017 /dev/vx/dsk/oradb001datadg/data014vl                      1572864000 1266939608 303534472    81%    /ora/db001/data014 /dev/vx/dsk/oradb001datadg/data016vl                      1572864000 1176481200 393286168    75%    /ora/db001/data016 /dev/vx/dsk/oradb001datadg/data012vl                      1258291200 711441712 542577480    57%    /ora/db001/data012 /dev/vx/dsk/oradb001datadg/data009vl                      1887436800 1224785168 657474792    66%    /ora/db001/data009 /dev/vx/dsk/oradb001datadg/data007vl                      1887436800 1159732184 722019552    62%    /ora/db001/data007 /dev/vx/dsk/oradb001datadg/data015vl                      2097152000 1684645232 409284424    81%    /ora/db001/data015 /dev/vx/dsk/oradb001datadg/data013vl                      2097152000 1528090512 564615936    74%    /ora/db001/data013 /dev/vx/dsk/oradb001datadg/data006vl                      1258291200 870003474 364019870    71%    /ora/db001/data006 /dev/vx/dsk/oradb001datadg/data008vl                      1284505600 823680467 432023689    66%    /ora/db001/data008 /dev/vx/dsk/oradb001datadg/data004vl                      1258291200 772876960 481622072    62%    /ora/db001/data004 /dev/vx/dsk/oradb001datadg/data005vl                      1887436800 1278229368 604448128    68%    /ora/db001/data005 /dev/vx/dsk/oradb001datadg/data003vl                      1887436800 1379480680 503987968    74%    /ora/db001/data003 /dev/vx/dsk/oradb001datadg/data002vl                      1258291200 770492752 483987648    62%    /ora/db001/data002 /dev/vx/dsk/oradb001datadg/data001vl                      1887436800 1627198432 258205384    87%    /ora/db001/data001 /dev/vx/dsk/ssdb0221dg/varoptappfastreadervl                      838860800  468858 785992453     1%    /var/opt/app/fastreader ssdb0221:BRM1AP2:/opt/app/oracle/emagent/agent10g/bin>  | 
一条评论
可以用lsof -p 查看一下文件句柄~~