这个问题本来还以为是偶然遇到的一次,但没想到这已经是第二次发生了。因此我想这估计不是偶发案例,应该写出来和大家共享一下了。
今天接到一个ticket,说前一天晚上做chang,删除了部分分区,清除了表空间,在清除表空间的时候是用drop tablespace including contents and datafiles。在操作系统层面看,那些datafile已经被删除了,但是空间使用率却一直没有下去。似乎删除了数据文件之后,那些文件的句柄还是被某些进程hold住,导致操作系统层面文件系统无法释放。下面我们来看一下诊断过程:
该数据库是11.2.0.2的版本的3节点RAC,共享文件系统和心跳是有veritas cluster控制,RAC的cluster是CRS,每个server上还跑了10.2.0.5的emagent。
先来看看处理前的文件系统使用情况:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 |
ssdb0220:BRM1AP1:/opt/app/oracle/admin>df -k Filesystem kbytes used avail capacity Mounted on rpool/ROOT/zfsroot 8388608 6789636 1598971 81% / /devices 0 0 0 0% /devices ctfs 0 0 0 0% /system/contract proc 0 0 0 0% /proc mnttab 0 0 0 0% /etc/mnttab swap 33448496 1640 33446856 1% /etc/svc/volatile objfs 0 0 0 0% /system/object sharefs 0 0 0 0% /etc/dfs/sharetab fd 0 0 0 0% /dev/fd rpool/ROOT/zfsroot/var 8388608 5204250 3184357 63% /var swap 6291456 3656 6287800 1% /tmp swap 33446904 48 33446856 1% /var/run swap 33446856 0 33446856 0% /dev/vx/dmp swap 33446856 0 33446856 0% /dev/vx/rdmp rpool/home 2097152 1459115 638037 70% /home /dev/vx/dsk/ssdb0220dg/homeappvl 10485760 656088 9755128 7% /home/app /dev/vx/dsk/ssdb0220dg/optappvl 104857600 49362928 55083616 48% /opt/app /dev/vx/dsk/ssdb0220dg/appdatavl 52428800 39903880 12430584 77% /var/opt/app rpool/appstat 2097152 1486022 611130 71% /apps/stats rpool/optemc 286949376 5434493 184688483 3% /opt/emc rpool 286949376 97 184688483 1% /rpool rpool/backuplog 10485760 117 10485642 1% /usr/openv/netbackup/logs rpool/varcrash 8388608 3985384 4403224 48% /var/crash /dev/odm 0 0 0 0% /dev/odm /dev/vx/dsk/crsdg/oracm002vl 1039360 74680 957152 8% /ora/oracm002 /dev/vx/dsk/crsdg/oracm004vl 1039360 50464 981184 5% /ora/oracm004 /dev/vx/dsk/crsdg/oracm003vl 1039360 74680 957152 8% /ora/oracm003 /dev/vx/dsk/crsdg/oracm005vl 1039360 50464 981184 5% /ora/oracm005 /dev/vx/dsk/crsdg/oracm001vl 1039360 74680 957152 8% /ora/oracm001 /dev/vx/dsk/oradb001redodg/redo001vl 104857600 90905120 13843608 87% /ora/db001/redo001 /dev/vx/dsk/oradb001dbfradg/dbfra001vl 2097152000 44360760 2036754976 3% /ora/db001/dbfra001 /dev/vx/dsk/oradb001redodg/redo002vl 104857600 90905152 13843576 87% /ora/db001/redo002 /dev/vx/dsk/oradb001tempdg/temp001vl 734003200 616321123 110327426 85% /ora/db001/temp001 /dev/vx/dsk/oradb001datadg/data022vl 1572864000 1086356592 482706688 70% /ora/db001/data022 /dev/vx/dsk/oradb001datadg/data024vl 1572864000 1049210464 519562736 67% /ora/db001/data024 /dev/vx/dsk/oradb001datadg/data019vl 2097152000 1420040864 671821304 68% /ora/db001/data019 /dev/vx/dsk/oradb001datadg/data018vl 1572864000 1063923704 504964304 68% /ora/db001/data018 /dev/vx/dsk/oradb001datadg/data028vl 2097152000 1523616200 569055280 73% /ora/db001/data023 /dev/vx/dsk/oradb001datadg/data025vl 2097152000 1301086712 789846152 63% /ora/db001/data025 /dev/vx/dsk/oradb001datadg/data999vl 734003200 682547265 48240064 94% /ora/db001/data999 /dev/vx/dsk/oradb001datadg/data021vl 2097152000 1463006752 629191096 70% /ora/db001/data021 /dev/vx/dsk/oradb001datadg/data020vl 1572864000 1235488992 334739376 79% /ora/db001/data020 /dev/vx/dsk/oradb001datadg/data026vl 1572864000 1057756826 482913088 69% /ora/db001/data026 /dev/vx/dsk/oradb001datadg/data016vl 1572864000 1176481200 393286168 75% /ora/db001/data016 /dev/vx/dsk/oradb001datadg/data014vl 1572864000 1266939608 303534472 81% /ora/db001/data014 /dev/vx/dsk/oradb001datadg/data017vl 2097152000 1475675024 616621800 71% /ora/db001/data017 /dev/vx/dsk/oradb001datadg/data012vl 1258291200 846490992 408583272 68% /ora/db001/data012 /dev/vx/dsk/oradb001datadg/data009vl 1887436800 1348956488 534273560 72% /ora/db001/data009 /dev/vx/dsk/oradb001datadg/data013vl 2097152000 1528090512 564615936 74% /ora/db001/data013 /dev/vx/dsk/oradb001datadg/data007vl 1887436800 1313041416 569908048 70% /ora/db001/data007 /dev/vx/dsk/oradb001datadg/data015vl 2097152000 1684645232 409284424 81% /ora/db001/data015 /dev/vx/dsk/oradb001datadg/data008vl 1284505600 823680467 432023689 66% /ora/db001/data008 /dev/vx/dsk/oradb001datadg/data006vl 1258291200 870003474 364019870 71% /ora/db001/data006 /dev/vx/dsk/oradb001datadg/data005vl 1887436800 1446001576 437986640 77% /ora/db001/data005 /dev/vx/dsk/oradb001datadg/data002vl 1258291200 805501288 449252616 65% /ora/db001/data002 /dev/vx/dsk/oradb001datadg/data004vl 1258291200 780397232 474160552 63% /ora/db001/data004 /dev/vx/dsk/oradb001datadg/data003vl 1887436800 1379480680 503987968 74% /ora/db001/data003 /dev/vx/dsk/oradb001datadg/data001vl 1887436800 1627198432 258205384 87% /ora/db001/data001 /dev/vx/dsk/ssdb0220dg/varoptappfastreadervl 471859200 182297 442197103 1% /var/opt/app/fastreader ssdb0220:BRM1AP1:/opt/app/oracle/admin> |
然后我们用fuser这个命令来检查文件句柄的情况,在solaris下,在veritas的文件系统中,我们可以用fuser -c [mount_point] 来检查每个挂载点的文件句柄情况。
由于是RAC,我们必须在每个节点的server上都进行检查,这点很重要。往往就是查了一个server没有发现hold住句柄的process,就认为是OS的问题,可能需要重启该主机了。
在第一个server上:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 |
ssdb0220:BRM1AP1:/opt/app/oracle/admin> ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data022 /ora/db001/data022: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data024 /ora/db001/data024: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data019 /ora/db001/data019: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data018 /ora/db001/data018: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuer -c /ora/db001/data023 ksh: fuer: not found ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data023 /ora/db001/data023: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data025 /ora/db001/data025: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data999 /ora/db001/data999: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data021 /ora/db001/data021: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data020 /ora/db001/data020: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data026 /ora/db001/data026: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data016 /ora/db001/data016: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data014 /ora/db001/data014: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data017 /ora/db001/data017: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data012 /ora/db001/data012: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data012 /ora/db001/data012: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data009 /ora/db001/data009: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data013 /ora/db001/data013: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data007 /ora/db001/data007: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data015 /ora/db001/data015: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data008 /ora/db001/data008: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data006 /ora/db001/data006: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data005 /ora/db001/data005: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data002 /ora/db001/data002: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data004 /ora/db001/data004: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data003 /ora/db001/data003: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /ora/db001/data001 /ora/db001/data001: ssdb0220:BRM1AP1:/opt/app/oracle/admin>fuser -c /var/opt/app/fastreader /var/opt/app/fastreader: ssdb0220:BRM1AP1:/opt/app/oracle/admin> |
在第二个server上:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 |
ssdb0221:BRM1AP2:/opt/app/oracle/admin> ssdb0221:BRM1AP2:/opt/app/oracle/admin> ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data024 /ora/db001/data024: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data025 /ora/db001/data025: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data999 /ora/db001/data999: ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data019 /ora/db001/data019: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data023 /ora/db001/data023: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data022 /ora/db001/data022: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data018 /ora/db001/data018: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data020 /ora/db001/data020: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data021 /ora/db001/data021: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data026 /ora/db001/data026: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data017 /ora/db001/data017: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data014 /ora/db001/data014: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data016 /ora/db001/data016: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data012 /ora/db001/data012: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data009 /ora/db001/data009: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data007 /ora/db001/data007: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data015 /ora/db001/data015: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data013 /ora/db001/data013: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data006 /ora/db001/data006: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data008 /ora/db001/data008: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data004 /ora/db001/data004: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data005 /ora/db001/data005: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data003 /ora/db001/data003: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data002 /ora/db001/data002: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin>fuser -c /ora/db001/data001 /ora/db001/data001: 12433o 22467o ssdb0221:BRM1AP2:/opt/app/oracle/admin> |
我们看到有2个进程hold住文件系统了。我们先来看看第三个server上有没有之后,再来细究这几个进程。
在第三个server上:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 |
ssdb0222:BRM1AP3:/opt/app/oracle/admin> ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data999 /ora/db001/data999: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser c /ora/db001/data023 c: fuser: No such file or directory /ora/db001/data023: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data023 /ora/db001/data023: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data022 /ora/db001/data022: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data021 /ora/db001/data021: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data025 /ora/db001/data025: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data018 /ora/db001/data018: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data024 /ora/db001/data024: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data020 /ora/db001/data020: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data019 /ora/db001/data019: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data026 /ora/db001/data026: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data015 /ora/db001/data015: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data012 /ora/db001/data012: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data017 /ora/db001/data017: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data014 /ora/db001/data014: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data013 /ora/db001/data013: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data009 /ora/db001/data009: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data016 /ora/db001/data016: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data007 /ora/db001/data007: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data006 /ora/db001/data006: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data008 /ora/db001/data008: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data002 /ora/db001/data002: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data004 /ora/db001/data004: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data005 /ora/db001/data005: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data001 /ora/db001/data001: ssdb0222:BRM1AP3:/opt/app/oracle/admin>fuser -c /ora/db001/data003 /ora/db001/data003: ssdb0222:BRM1AP3:/opt/app/oracle/admin> |
ok,我们只在第二个节点的server上发现了问题,我们进一步来查看这些进程的详细情况:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 |
SQL> !ps -ef |grep 12433 oracle 23143 22717 0 18:45:12 pts/4 0:00 grep 12433 oracle 12433 1 0 Jul 05 ? 8:54 oracleBRM1AP2 (LOCAL=NO) SQL> !ps -ef |grep 22467 oracle 23310 22717 0 18:45:20 pts/4 0:00 grep 22467 oracle 22467 1 0 Jul 05 ? 5:53 oracleBRM1AP2 (LOCAL=NO) SQL> SELECT s.sid, s.username, s.osuser, p.spid, s.program, s.module, s.event, s.status FROM v$session s, v$process p WHERE s.paddr = p.addr AND p.spid IN ( 2 3 4 '12433','22467'); SQL> / SID USERNAME OSUSER SPID PROGRAM MODULE EVENT STATUS ---------- ------------------------------ ------------------------------ ------------------------ ------------------------------------------------ ---------------------------------------------------------------- ---------------------------------------------------------------- -------- 594 DBSNMP oracle 22467 emagent@ssdb0221 (TNS V1-V3) emagent_SQL_rac_database SQL*Net message from client INACTIVE 1617 DBSNMP oracle 12433 emagent@ssdb0221 (TNS V1-V3) emagent_SQL_rac_database SQL*Net message from client INACTIVE SQL> |
我们看到是emagent hold住了文件系统的句柄,导致文件系统空间无法释放。我们重启emagent进程后,文件系统释放。
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 |
ssdb0221:BRM1AP2:/opt/app/oracle/emagent/agent10g/bin>df -k Filesystem kbytes used avail capacity Mounted on rpool/ROOT/zfsroot 8388608 7062840 1325768 85% / /devices 0 0 0 0% /devices ctfs 0 0 0 0% /system/contract proc 0 0 0 0% /proc mnttab 0 0 0 0% /etc/mnttab swap 32423120 1616 32421504 1% /etc/svc/volatile objfs 0 0 0 0% /system/object sharefs 0 0 0 0% /etc/dfs/sharetab fd 0 0 0 0% /dev/fd rpool/ROOT/zfsroot/var 8388608 3704952 4683656 45% /var swap 6291456 3648 6287808 1% /tmp swap 32421544 40 32421504 1% /var/run swap 32421504 0 32421504 0% /dev/vx/dmp swap 32421504 0 32421504 0% /dev/vx/rdmp rpool/home 2097152 1520737 576415 73% /home rpool/appstat 2097152 1664978 432173 80% /apps/stats rpool/optemc 286949376 6344881 182808981 4% /opt/emc rpool 286949376 97 182808981 1% /rpool rpool/backuplog 10485760 14852 10470907 1% /usr/openv/netbackup/logs rpool/varcrash 8388608 5943012 2445596 71% /var/crash /dev/vx/dsk/ssdb0221dg/optappvl 104857600 54946976 49534584 53% /opt/app /dev/vx/dsk/ssdb0221dg/appdatavl 52428800 13983104 38145472 27% /var/opt/app /dev/vx/dsk/ssdb0221dg/homeappvl 10485760 566088 9844392 6% /home/app /dev/odm 0 0 0 0% /dev/odm /dev/vx/dsk/crsdg/oracm004vl 1039360 50464 981184 5% /ora/oracm004 /dev/vx/dsk/crsdg/oracm003vl 1039360 74680 957152 8% /ora/oracm003 /dev/vx/dsk/crsdg/oracm005vl 1039360 50464 981184 5% /ora/oracm005 /dev/vx/dsk/crsdg/oracm002vl 1039360 74680 957152 8% /ora/oracm002 /dev/vx/dsk/crsdg/oracm001vl 1039360 74680 957152 8% /ora/oracm001 /dev/vx/dsk/oradb001redodg/redo001vl 104857600 90905120 13843608 87% /ora/db001/redo001 /dev/vx/dsk/oradb001redodg/redo002vl 104857600 90905152 13843576 87% /ora/db001/redo002 /dev/vx/dsk/oradb001dbfradg/dbfra001vl 2097152000 41133480 2039957040 2% /ora/db001/dbfra001 /dev/vx/dsk/oradb001tempdg/temp001vl 734003200 616321123 110327426 85% /ora/db001/temp001 /dev/vx/dsk/oradb001datadg/data024vl 1572864000 1049210464 519562736 67% /ora/db001/data024 /dev/vx/dsk/oradb001datadg/data025vl 2097152000 1301086712 789846152 63% /ora/db001/data025 /dev/vx/dsk/oradb001datadg/data999vl 734003200 682547265 48240064 94% /ora/db001/data999 /dev/vx/dsk/oradb001datadg/data019vl 2097152000 1420040864 671821304 68% /ora/db001/data019 /dev/vx/dsk/oradb001datadg/data028vl 2097152000 1523616200 569055280 73% /ora/db001/data023 /dev/vx/dsk/oradb001datadg/data022vl 1572864000 1086356592 482706688 70% /ora/db001/data022 /dev/vx/dsk/oradb001datadg/data018vl 1572864000 1063923704 504964304 68% /ora/db001/data018 /dev/vx/dsk/oradb001datadg/data020vl 1572864000 1235488992 334739376 79% /ora/db001/data020 /dev/vx/dsk/oradb001datadg/data021vl 2097152000 1463006752 629191096 70% /ora/db001/data021 /dev/vx/dsk/oradb001datadg/data026vl 1572864000 1057756826 482913088 69% /ora/db001/data026 /dev/vx/dsk/oradb001datadg/data017vl 2097152000 1475675024 616621800 71% /ora/db001/data017 /dev/vx/dsk/oradb001datadg/data014vl 1572864000 1266939608 303534472 81% /ora/db001/data014 /dev/vx/dsk/oradb001datadg/data016vl 1572864000 1176481200 393286168 75% /ora/db001/data016 /dev/vx/dsk/oradb001datadg/data012vl 1258291200 711441712 542577480 57% /ora/db001/data012 /dev/vx/dsk/oradb001datadg/data009vl 1887436800 1224785168 657474792 66% /ora/db001/data009 /dev/vx/dsk/oradb001datadg/data007vl 1887436800 1159732184 722019552 62% /ora/db001/data007 /dev/vx/dsk/oradb001datadg/data015vl 2097152000 1684645232 409284424 81% /ora/db001/data015 /dev/vx/dsk/oradb001datadg/data013vl 2097152000 1528090512 564615936 74% /ora/db001/data013 /dev/vx/dsk/oradb001datadg/data006vl 1258291200 870003474 364019870 71% /ora/db001/data006 /dev/vx/dsk/oradb001datadg/data008vl 1284505600 823680467 432023689 66% /ora/db001/data008 /dev/vx/dsk/oradb001datadg/data004vl 1258291200 772876960 481622072 62% /ora/db001/data004 /dev/vx/dsk/oradb001datadg/data005vl 1887436800 1278229368 604448128 68% /ora/db001/data005 /dev/vx/dsk/oradb001datadg/data003vl 1887436800 1379480680 503987968 74% /ora/db001/data003 /dev/vx/dsk/oradb001datadg/data002vl 1258291200 770492752 483987648 62% /ora/db001/data002 /dev/vx/dsk/oradb001datadg/data001vl 1887436800 1627198432 258205384 87% /ora/db001/data001 /dev/vx/dsk/ssdb0221dg/varoptappfastreadervl 838860800 468858 785992453 1% /var/opt/app/fastreader ssdb0221:BRM1AP2:/opt/app/oracle/emagent/agent10g/bin> |
一条评论
可以用lsof -p 查看一下文件句柄~~