今天凌晨被叫醒起来，某省的数据库db01坏了一个cpu，由于有HA架构的保护，切换到了db02，但是在db02上却无法启动侦听，以下是报错信息：
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 |
oracle@gz_dc02:/oracle/app/oracle/admin/gzmisc/bdump > lsnrctl start LSNRCTL for HPUX: Version 9.2.0.6.0 - Production on 29-JUL-2009 03:53:16 Copyright (c) 1991, 2002, Oracle Corporation. All rights reserved. Starting /oracle/app/oracle/product/9.2.0/bin/tnslsnr: please wait... TNSLSNR for HPUX: Version 9.2.0.6.0 - Production System parameter file is /oracle/app/oracle/product/9.2.0/network/admin/listener.ora Log messages written to /oracle/app/oracle/product/9.2.0/network/log/listener.log Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=10.203.104.11)(PORT=1521))) Error listening on: (ADDRESS=(PROTOCOL=ipc)(PARTIAL=yes)(QUEUESIZE=1)) No longer listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=10.203.104.11)(PORT=1521))) TNS-12541: TNS:no listener TNS-12560: TNS:protocol adapter error TNS-00511: No listener HPUX Error: 2: No such file or directory Listener failed to start. See the error message(s) above... oracle@gz_dc02:/oracle/app/oracle/admin/gzmisc/bdump > |
看报错很奇怪：Error listening on: (ADDRESS=(PROTOCOL=ipc)(PARTIAL=yes)(QUEUESIZE=1))，难道是网络的问题？问了一下主机工程师，确认网络没问题。
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 |
root@gz_dc02:/oracle/app/oracle/product/9.2.0/network/admin # root@gz_dc02:/oracle/app/oracle/product/9.2.0/network/admin # ioscan -fnClan Class I H/W Path Driver S/W State H/W Type Description ===================================================================== lan 0 0/0/0/1/0 igelan CLAIMED INTERFACE HP PCI-X 1000Base-T Built-in lan 1 0/0/10/1/0 iether CLAIMED INTERFACE HP AD331-60001 PCI/PCI-X 1000Base-T Adapter lan 2 0/0/12/1/0 iether CLAIMED INTERFACE HP AD331-60001 PCI/PCI-X 1000Base-T Adapter root@gz_dc02:/oracle/app/oracle/product/9.2.0/network/admin # netstat -in Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Coll lan2* 1500 none none 0 0 0 0 0 lan1:1 1500 10.203.104.0 10.203.104.11 2291678 0 46 0 0 lan1 1500 10.203.104.0 10.203.104.62 32093945 0 51519548 0 0 lan0 1500 10.203.105.220 10.203.105.222 201 0 55 0 0 lo0 4136 127.0.0.0 127.0.0.1 36434057 0 36434729 0 0 |
那难道是ipc协议的问题？继续去看listener.ora文件的配置:
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 |
oracle@gz_dc02:/oracle/app/oracle/product/9.2.0/network/admin > cat listener.ora # LISTENER.ORA Network Configuration File: /oracle/app/oracle/product/9.2.0/network/admin/listener.ora # Generated by Oracle configuration tools. LISTENER = (DESCRIPTION_LIST = (DESCRIPTION = (ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = 10.203.104.11)(PORT = 1521)) ) (ADDRESS_LIST = (ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC)) ) ) ) SID_LIST_LISTENER = (SID_LIST = (SID_DESC = (SID_NAME = PLSExtProc) (ORACLE_HOME = /oracle/app/oracle/product/9.2.0) (PROGRAM = extproc) ) (SID_DESC = (SID_NAME = gzmisc) (ORACLE_HOME = /oracle/app/oracle/product/9.2.0) ) ) oracle@gz_dc02:/oracle/app/oracle/product/9.2.0/network/admin > |
难道是(ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC)) 的问题？但是这个一模一样的配置当初在db01也是没事的呀，奇怪！尝试去掉这个配置，再次启动侦听的时候，还是报同样的错。
重启network服务还是一样报错；一样的配置，尝试再次切换到db01，侦听能顺利启动；再切换到db02，还是无法启动。
没办法，trace一下侦听吧，由于侦听没启动，不能LSNRCTL> set trc_level admin，只能在listener.ora文件里面加入如下的内容：
|
1 2 3 4 5 |
TRACE_FILE_LISTENER = LISTENER.TRC TRACE_DIRECTORY_LISTENER = /oracle/app/oracle/product/9.2.0/network/trace TRACE_LEVEL_LISTENER = SUPPORT TRACE_FILELEN_LISTENER=10240 TRACE_FILENO_LISTENER=10 |
启动侦听后，观察trace文件：
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 |
TNSLSNR for HPUX: Version 9.2.0.6.0 - Production on 29-JUL-2009 04:48:02 Copyright (c) 1991, 2002, Oracle Corporation. All rights reserved. [000001 29-JUL-2009 04:48:02:875] --- TRACE CONFIGURATION INFORMATION FOLLOWS --- [000001 29-JUL-2009 04:48:02:875] New trace stream is /oracle/app/oracle/product/9.2.0/network/trace/listener.trc [000001 29-JUL-2009 04:48:02:875] New trace level is 16 [000001 29-JUL-2009 04:48:02:875] --- TRACE CONFIGURATION INFORMATION ENDS --- [000001 29-JUL-2009 04:48:02:875] --- PARAMETER SOURCE INFORMATION FOLLOWS --- [000001 29-JUL-2009 04:48:02:875] Attempted load of system pfile source /oracle/app/oracle/product/9.2.0/network/admin/listener.ora [000001 29-JUL-2009 04:48:02:875] Parameter source loaded successfully [000001 29-JUL-2009 04:48:02:875] [000001 29-JUL-2009 04:48:02:875] Attempted load of command line source [000001 29-JUL-2009 04:48:02:875] Parameter source was not loaded [000001 29-JUL-2009 04:48:02:876] [000001 29-JUL-2009 04:48:02:876] -> PARAMETER TABLE LOAD RESULTS FOLLOW <- [000001 29-JUL-2009 04:48:02:876] Successful parameter table load [000001 29-JUL-2009 04:48:02:876] -> PARAMETER TABLE HAS THE FOLLOWING CONTENTS <- [000001 29-JUL-2009 04:48:02:876] TRACE_FILELEN_LISTENER = 10240 [000001 29-JUL-2009 04:48:02:876] LISTENER = (DESCRIPTION_LIST = (DESCRIPTION = (ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = 10.203.104.11)(PORT = 1521))) (ADDRESS_LIST = (ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC))))) [000001 29-JUL-2009 04:48:02:876] TRACE_LEVEL_LISTENER = SUPPORT [000001 29-JUL-2009 04:48:02:876] TRACE_FILENO_LISTENER = 10 [000001 29-JUL-2009 04:48:02:876] SID_LIST_LISTENER = (SID_LIST = (SID_DESC = (SID_NAME = PLSExtProc) (ORACLE_HOME = /oracle/app/oracle/product/9.2.0) (PROGRAM = extproc)) (SID_DESC = (SID_NAME = gzmisc) (ORACLE_HOME = /oracle/app/oracle/product/9.2.0))) [000001 29-JUL-2009 04:48:02:876] TRACE_DIRECTORY_LISTENER = /oracle/app/oracle/product/9.2.0/network/trace [000001 29-JUL-2009 04:48:02:876] TRACE_FILE_LISTENER = LISTENER.TRC [000001 29-JUL-2009 04:48:02:876] --- PARAMETER SOURCE INFORMATION ENDS --- [000001 29-JUL-2009 04:48:02:876] --- LOG CONFIGURATION INFORMATION FOLLOWS --- [000001 29-JUL-2009 04:48:02:876] Log stream will be "/oracle/app/oracle/product/9.2.0/network/log/listener.log" [000001 29-JUL-2009 04:48:02:876] Log stream validation requested [000001 29-JUL-2009 04:48:02:877] Log stream is valid [000001 29-JUL-2009 04:48:02:877] --- LOG CONFIGURATION INFORMATION ENDS --- [000001 29-JUL-2009 04:48:02:877] ntvllt: entry [000001 29-JUL-2009 04:48:02:877] ntvllt: exit [000001 29-JUL-2009 04:48:02:877] nsglldprm: Resolved "INBOUND_CONNECT_TIMEOUT_LISTENER" to: 0 [000001 29-JUL-2009 04:48:02:877] nsglldprm: Resolved "STARTUP_WAIT_TIME_LISTENER" to: 0 [000001 29-JUL-2009 04:48:02:880] nsinherit: entry [000001 29-JUL-2009 04:48:02:880] nsinherit: doing connect handshake... [000001 29-JUL-2009 04:48:02:880] nsc2addr: entry [000001 29-JUL-2009 04:48:02:880] nlpcaini: entry [000001 29-JUL-2009 04:48:02:880] nlpcaini: No process parameters set [000001 29-JUL-2009 04:48:02:880] nlpcaini: exit [000001 29-JUL-2009 04:48:02:881] nsc2addr: normal exit [000001 29-JUL-2009 04:48:02:885] nsinherit: inheriting the connection... [000001 29-JUL-2009 04:48:02:885] nsopen: entry [000001 29-JUL-2009 04:48:02:885] nsmal: entry [000001 29-JUL-2009 04:48:02:885] nsmal: 800 bytes at 0x8000000100166448 [000001 29-JUL-2009 04:48:02:885] nsmal: normal exit [000001 29-JUL-2009 04:48:02:886] nsopenmplx: entry [000001 29-JUL-2009 04:48:02:886] nsmal: entry [000001 29-JUL-2009 04:48:02:886] nsmal: 2592 bytes at 0x8000000100166780 [000001 29-JUL-2009 04:48:02:886] nsmal: normal exit [000001 29-JUL-2009 04:48:02:886] nsopenmplx: normal exit [000001 29-JUL-2009 04:48:02:886] nsopen: opening transport... [000001 29-JUL-2009 04:48:02:886] ntpcon: entry [000001 29-JUL-2009 04:48:02:886] ntpcon: toc = 4 [000001 29-JUL-2009 04:48:02:886] ntpcon: NT layer IPC connection has been established [000001 29-JUL-2009 04:48:02:886] ntpcon: exit [000001 29-JUL-2009 04:48:02:886] nsopen: transport is open [000001 29-JUL-2009 04:48:02:886] nsoptions: entry [000001 29-JUL-2009 04:48:02:887] nsoptions: lcl[0]=0x0, lcl[1]=0x0, gbl[0]=0x0, gbl[1]=0x0, cha=0x0 [000001 29-JUL-2009 04:48:02:887] nsoptions: lcl[0]=0xffe9ff, lcl[1]=0x0, gbl[0]=0x7e3f, gbl[1]=0x0 [000001 29-JUL-2009 04:48:02:887] nsoptions: normal exit [000001 29-JUL-2009 04:48:02:887] nsnainit: entry [000001 29-JUL-2009 04:48:02:887] nsnainit: inherit [000001 29-JUL-2009 04:48:02:887] nsnadct: entry [000001 29-JUL-2009 04:48:02:887] nsnadct: normal exit [000001 29-JUL-2009 04:48:02:887] nsnasvnainfo: entry [000001 29-JUL-2009 04:48:02:887] nsnasvnainfo: NA disabled for this connection [000001 29-JUL-2009 04:48:02:887] ntpctl: entry [000001 29-JUL-2009 04:48:02:887] ntpctl: exit [000001 29-JUL-2009 04:48:02:887] nsnasvnainfo: normal exit [000001 29-JUL-2009 04:48:02:887] nainit: entry [000001 29-JUL-2009 04:48:02:887] nagblini: entry [000001 29-JUL-2009 04:48:02:888] nau_gin: entry [000001 29-JUL-2009 04:48:02:888] nau_gparams: entry [000001 29-JUL-2009 04:48:02:888] nam_gbp: Reading parameter "sqlnet.authentication_required" from parameter file [000001 29-JUL-2009 04:48:02:888] nam_gbp: Parameter not found [000001 29-JUL-2009 04:48:02:888] nau_gparams: Using default value "FALSE" [000001 29-JUL-2009 04:48:02:888] nau_gslf: entry [000001 29-JUL-2009 04:48:02:888] nam_gic: entry [000001 29-JUL-2009 04:48:02:888] nam_gic: Counting # of items in "sqlnet.authentication_services" parameter [000001 29-JUL-2009 04:48:02:888] nam_gic: Parameter not found [000001 29-JUL-2009 04:48:02:888] nam_gic: Found 0 items [000001 29-JUL-2009 04:48:02:888] nam_gic: exit [000001 29-JUL-2009 04:48:02:888] nau_gslf: Using default value "all available adapters" [000001 29-JUL-2009 04:48:02:888] nauss_set_state: entry [000001 29-JUL-2009 04:48:02:888] nauss_set_state: exit [000001 29-JUL-2009 04:48:02:889] nau_gslf: exit [000001 29-JUL-2009 04:48:02:889] nau_gparams: exit [000001 29-JUL-2009 04:48:02:889] nau_gin: exit [000001 29-JUL-2009 04:48:02:889] nagblini: exit [000001 29-JUL-2009 04:48:02:889] na_saveprot: entry [000001 29-JUL-2009 04:48:02:889] na_saveprot: exit [000001 29-JUL-2009 04:48:02:889] nacomin: entry [000001 29-JUL-2009 04:48:02:889] nas_init: entry [000001 29-JUL-2009 04:48:02:889] nas_init: exit [000001 29-JUL-2009 04:48:02:889] nau_ini: entry [000001 29-JUL-2009 04:48:02:889] naugcp_get_connect_parameters: entry [000001 29-JUL-2009 04:48:02:889] nauss_set_state: entry [000001 29-JUL-2009 04:48:02:889] nauss_set_state: exit [000001 29-JUL-2009 04:48:02:889] naugcp_get_connect_parameters: exit [000001 29-JUL-2009 04:48:02:889] nau_gettab: entry [000001 29-JUL-2009 04:48:02:889] nau_tadv: entry [000001 29-JUL-2009 04:48:02:890] nau_fad: entry [000001 29-JUL-2009 04:48:02:890] nau_fad: The following authentication adapter dll does not exist: /oracle/app/oracle/product/9.2.0/lib/libnk59.sl [000001 29-JUL-2009 04:48:02:891] nau_fad: exit [000001 29-JUL-2009 04:48:02:891] nau_fad: entry [000001 29-JUL-2009 04:48:02:891] nau_fad: The following authentication adapter dll does not exist: /oracle/app/oracle/product/9.2.0/lib/libngss9.sl [000001 29-JUL-2009 04:48:02:891] nau_fad: exit [000001 29-JUL-2009 04:48:02:891] nau_fad: entry [000001 29-JUL-2009 04:48:02:891] nau_fad: The following authentication adapter dll does not exist: /oracle/app/oracle/product/9.2.0/lib/libnnts9.sl [000001 29-JUL-2009 04:48:02:891] nau_fad: exit [000001 29-JUL-2009 04:48:02:891] nau_fad: entry [000001 29-JUL-2009 04:48:02:891] nau_fad: The following authentication adapter dll does not exist: /oracle/app/oracle/product/9.2.0/lib/libnrad9.sl [000001 29-JUL-2009 04:48:02:891] nau_fad: exit [000001 29-JUL-2009 04:48:02:891] nau_tadv: Found at least one invalid entry [000001 29-JUL-2009 04:48:02:891] nau_tadv: exit [000001 29-JUL-2009 04:48:02:891] nau_gettab: using authentication adapter table "dynamic table" [000001 29-JUL-2009 04:48:02:892] nau_gettab: adapter table is empty [000001 29-JUL-2009 04:48:02:892] nau_gettab: exit [000001 29-JUL-2009 04:48:02:892] nau_sini: entry [000001 29-JUL-2009 04:48:02:892] nau_sini: exit [000001 29-JUL-2009 04:48:02:892] nau_ini: connection type: "standard" [000001 29-JUL-2009 04:48:02:892] nau_ini: exit [000001 29-JUL-2009 04:48:02:892] naeeinit: entry [000001 29-JUL-2009 04:48:02:892] nam_gbp: Reading parameter "SQLNET.FIPS_140" from parameter file [000001 29-JUL-2009 04:48:02:892] nam_gbp: Parameter not found [000001 29-JUL-2009 04:48:02:892] nam_gnsp: Reading parameter "SQLNET.ENCRYPTION_SERVER" from parameter file [000001 29-JUL-2009 04:48:02:892] nam_gnsp: Parameter not found [000001 29-JUL-2009 04:48:02:892] naequad: Using default value "ACCEPTED" [000001 29-JUL-2009 04:48:02:892] nam_gic: entry [000001 29-JUL-2009 04:48:02:892] nam_gic: Counting # of items in "SQLNET.ENCRYPTION_TYPES_SERVER" parameter [000001 29-JUL-2009 04:48:02:892] nam_gic: Parameter not found [000001 29-JUL-2009 04:48:02:893] nam_gic: exit [000001 29-JUL-2009 04:48:02:893] naesno: Using default value "all available algorithms" [000001 29-JUL-2009 04:48:02:893] naeshow: entry [000001 29-JUL-2009 04:48:02:893] naeshow: These are the encryption algorithms that the server will accept, in decreasing order of preference: [000001 29-JUL-2009 04:48:02:893] naeshow: Choice 0: no algorithm; encryption inactive [000001 29-JUL-2009 04:48:02:893] naeshow: Choice 1: 'AES256' (ID 17) [000001 29-JUL-2009 04:48:02:893] naeshow: Choice 2: 'RC4_256' (ID 6) [000001 29-JUL-2009 04:48:02:893] naeshow: Choice 3: 'AES192' (ID 16) [000001 29-JUL-2009 04:48:02:893] naeshow: Choice 4: '3DES168' (ID 12) [000001 29-JUL-2009 04:48:02:893] naeshow: Choice 5: 'AES128' (ID 15) [000001 29-JUL-2009 04:48:02:893] naeshow: Choice 6: 'RC4_128' (ID 10) [000001 29-JUL-2009 04:48:02:893] naeshow: Choice 7: '3DES112' (ID 11) [000001 29-JUL-2009 04:48:02:893] naeshow: Choice 8: 'RC4_56' (ID 8) [000001 29-JUL-2009 04:48:02:893] naeshow: Choice 9: 'DES' (ID 2) [000001 29-JUL-2009 04:48:02:893] naeshow: Choice 10: 'RC4_40' (ID 1) [000001 29-JUL-2009 04:48:02:893] naeshow: Choice 11: 'DES40' (ID 3) [000001 29-JUL-2009 04:48:02:894] naeshow: exit [000001 29-JUL-2009 04:48:02:894] naeeinit: exit [000001 29-JUL-2009 04:48:02:894] naecinit: entry [000001 29-JUL-2009 04:48:02:894] nam_gnsp: Reading parameter "SQLNET.CRYPTO_CHECKSUM_SERVER" from parameter file [000001 29-JUL-2009 04:48:02:894] nam_gnsp: Parameter not found [000001 29-JUL-2009 04:48:02:894] naequad: Using default value "ACCEPTED" [000001 29-JUL-2009 04:48:02:894] nam_gic: entry [000001 29-JUL-2009 04:48:02:894] nam_gic: Counting # of items in "SQLNET.CRYPTO_CHECKSUM_TYPES_SERVER" parameter [000001 29-JUL-2009 04:48:02:894] nam_gic: Parameter not found [000001 29-JUL-2009 04:48:02:894] nam_gic: exit [000001 29-JUL-2009 04:48:02:894] naesno: Using default value "all available algorithms" [000001 29-JUL-2009 04:48:02:894] naeshow: entry [000001 29-JUL-2009 04:48:02:894] naeshow: These are the checksumming algorithms that the server will accept, in decreasingorder of preference: [000001 29-JUL-2009 04:48:02:894] naeshow: Choice 0: no algorithm; checksumming inactive [000001 29-JUL-2009 04:48:02:894] naeshow: Choice 1: 'SHA1' (ID 3) [000001 29-JUL-2009 04:48:02:895] naeshow: Choice 2: 'MD5' (ID 1) [000001 29-JUL-2009 04:48:02:895] naeshow: exit [000001 29-JUL-2009 04:48:02:895] naecinit: exit [000001 29-JUL-2009 04:48:02:895] nainit: native services disabled - disconnecting [000001 29-JUL-2009 04:48:02:895] nadisc: entry [000001 29-JUL-2009 04:48:02:895] nacomtm: entry [000001 29-JUL-2009 04:48:02:895] nacompd: entry [000001 29-JUL-2009 04:48:02:895] nacompd: exit [000001 29-JUL-2009 04:48:02:895] nacompd: entry [000001 29-JUL-2009 04:48:02:895] nacompd: exit [000001 29-JUL-2009 04:48:02:895] nacomtm: exit [000001 29-JUL-2009 04:48:02:895] nas_dis: entry [000001 29-JUL-2009 04:48:02:895] nas_dis: exit [000001 29-JUL-2009 04:48:02:895] nau_dis: entry [000001 29-JUL-2009 04:48:02:895] nau_dis: exit [000001 29-JUL-2009 04:48:02:895] naeetrm: entry [000001 29-JUL-2009 04:48:02:896] naeetrm: exit [000001 29-JUL-2009 04:48:02:896] naectrm: entry [000001 29-JUL-2009 04:48:02:896] naectrm: exit [000001 29-JUL-2009 04:48:02:896] nagbltrm: entry [000001 29-JUL-2009 04:48:02:896] nau_gtm: entry [000001 29-JUL-2009 04:48:02:896] nau_gtm: exit [000001 29-JUL-2009 04:48:02:896] nagbltrm: exit [000001 29-JUL-2009 04:48:02:896] nadisc: exit [000001 29-JUL-2009 04:48:02:896] nainit: exit [000001 29-JUL-2009 04:48:02:896] nsnainit: NS Connection version: 312 [000001 29-JUL-2009 04:48:02:896] nsnainit: inf->nsinfflg[0]: 0xd inf->nsinfflg[1]: 0xd [000001 29-JUL-2009 04:48:02:896] nsnainit: "or" info flags: 0xd Translations follow: native service(s) is (are) wanted NA disabled remotely for this connection NA services unavailable on both processes - negotiation not needed [000001 29-JUL-2009 04:48:02:896] nsnainit: "or" info flags: 0xd Translations follow: native service(s) is (are) wanted NA disabled remotely for this connection NA services unavailable on both processes - negotiation not needed "and" info flags: 0xd Translations follow: native service(s) is (are) wanted NA disabled remotely for this connection NA services unavailable on both processes - negotiation not needed [000001 29-JUL-2009 04:48:02:896] nsnainit: normal exit [000001 29-JUL-2009 04:48:02:896] nsopen: global context check-in (to slot 0) complete [000001 29-JUL-2009 04:48:02:897] nsopen: lcl[0]=0xffe9ff, lcl[1]=0x0, gbl[0]=0x7e3f, gbl[1]=0x0, tdu=8192, sdu=2048 [000001 29-JUL-2009 04:48:02:897] nsdo: entry [000001 29-JUL-2009 04:48:02:897] nsdo: cid=0, opcode=65, *bl=0, *what=0, uflgs=0x0, cflgs=0x2 [000001 29-JUL-2009 04:48:02:897] nsdo: rank=64, nsctxrnk=0 [000001 29-JUL-2009 04:48:02:897] nsdo: nsctx: state=7, flg=0x4200, mvd=0 [000001 29-JUL-2009 04:48:02:897] nsbal: entry [000001 29-JUL-2009 04:48:02:897] nsbgetfl: entry [000001 29-JUL-2009 04:48:02:897] nsbgetfl: normal exit [000001 29-JUL-2009 04:48:02:897] nsmal: entry [000001 29-JUL-2009 04:48:02:897] nsmal: 96 bytes at 0x8000000100041c28 [000001 29-JUL-2009 04:48:02:897] nsmal: normal exit [000001 29-JUL-2009 04:48:02:897] nsbal: normal exit [000001 29-JUL-2009 04:48:02:897] nsbal: entry [000001 29-JUL-2009 04:48:02:897] nsbgetfl: entry [000001 29-JUL-2009 04:48:02:897] nsbgetfl: normal exit [000001 29-JUL-2009 04:48:02:898] nsmal: entry [000001 29-JUL-2009 04:48:02:898] nsmal: 96 bytes at 0x8000000100041ca0 [000001 29-JUL-2009 04:48:02:898] nsmal: normal exit [000001 29-JUL-2009 04:48:02:898] nsbal: normal exit [000001 29-JUL-2009 04:48:02:898] nsdo: nsctxrnk=0 [000001 29-JUL-2009 04:48:02:898] nsdo: normal exit [000001 29-JUL-2009 04:48:02:898] nsopen: normal exit [000001 29-JUL-2009 04:48:02:898] nsdo: entry [000001 29-JUL-2009 04:48:02:898] nsdo: cid=0, opcode=68, *bl=0, *what=8, uflgs=0x0, cflgs=0x3 [000001 29-JUL-2009 04:48:02:898] nsdo: rank=64, nsctxrnk=0 [000001 29-JUL-2009 04:48:02:898] nsdo: nsctx: state=14, flg=0x4204, mvd=0 [000001 29-JUL-2009 04:48:02:898] nsdo: gtn=0, gtc=0, ptn=10, ptc=2011 [000001 29-JUL-2009 04:48:02:898] nscon: entry [000001 29-JUL-2009 04:48:02:898] nscon: doing connect handshake... [000001 29-JUL-2009 04:48:02:898] nscon: recving a packet [000001 29-JUL-2009 04:48:02:899] nsprecv: entry [000001 29-JUL-2009 04:48:02:899] nsbal: entry [000001 29-JUL-2009 04:48:02:899] nsbgetfl: entry [000001 29-JUL-2009 04:48:02:899] nsbgetfl: normal exit [000001 29-JUL-2009 04:48:02:899] nsmal: entry [000001 29-JUL-2009 04:48:02:899] nsmal: 96 bytes at 0x8000000100167870 [000001 29-JUL-2009 04:48:02:899] nsmal: normal exit [000001 29-JUL-2009 04:48:02:899] nsbal: normal exit [000001 29-JUL-2009 04:48:02:899] nsprecv: reading from transport... [000001 29-JUL-2009 04:48:02:899] ntprd: entry [000001 29-JUL-2009 04:48:02:899] ntprd: exit [000001 29-JUL-2009 04:48:02:899] nsprecv: 189 bytes from transport [000001 29-JUL-2009 04:48:02:899] nsprecv: tlen=189, plen=189, type=1 [000001 29-JUL-2009 04:48:02:899] nsprecv: packet dump [000001 29-JUL-2009 04:48:02:899] nsprecv: 00 BD 00 00 01 00 00 00 |........| [000001 29-JUL-2009 04:48:02:900] nsprecv: 01 38 01 2C 00 00 08 00 |.8.,....| [000001 29-JUL-2009 04:48:02:900] nsprecv: 20 00 4F 98 00 00 00 01 |..O.....| [000001 29-JUL-2009 04:48:02:900] nsprecv: 00 83 00 3A 00 00 08 00 |...:....| [000001 29-JUL-2009 04:48:02:900] nsprecv: 0C 0C 00 00 00 00 00 00 |........| [000001 29-JUL-2009 04:48:02:900] nsprecv: 00 00 00 00 6E 9F 00 00 |....n...| [000001 29-JUL-2009 04:48:02:900] nsprecv: 00 06 00 00 00 00 00 00 |........| [000001 29-JUL-2009 04:48:02:900] nsprecv: 00 00 28 41 44 44 52 45 |..(ADDRE| [000001 29-JUL-2009 04:48:02:900] nsprecv: 53 53 3D 28 50 52 4F 54 |SS=(PROT| [000001 29-JUL-2009 04:48:02:900] nsprecv: 4F 43 4F 4C 3D 62 65 71 |OCOL=beq| [000001 29-JUL-2009 04:48:02:900] nsprecv: 29 28 50 52 4F 47 52 41 |)(PROGRA| [000001 29-JUL-2009 04:48:02:900] nsprecv: 4D 3D 2F 6F 72 61 63 6C |M=/oracl| [000001 29-JUL-2009 04:48:02:900] nsprecv: 65 2F 61 70 70 2F 6F 72 |e/app/or| [000001 29-JUL-2009 04:48:02:900] nsprecv: 61 63 6C 65 2F 70 72 6F |acle/pro| [000001 29-JUL-2009 04:48:02:900] nsprecv: 64 75 63 74 2F 39 2E 32 |duct/9.2| [000001 29-JUL-2009 04:48:02:900] nsprecv: 2E 30 2F 62 69 6E 2F 74 |.0/bin/t| [000001 29-JUL-2009 04:48:02:900] nsprecv: 6E 73 6C 73 6E 72 29 28 |nslsnr)(| [000001 29-JUL-2009 04:48:02:900] nsprecv: 45 4E 56 53 3D 29 28 41 |ENVS=)(A| [000001 29-JUL-2009 04:48:02:900] nsprecv: 52 47 56 30 3D 29 28 41 |RGV0=)(A| [000001 29-JUL-2009 04:48:02:900] nsprecv: 52 47 53 3D 27 4C 49 53 |RGS='LIS| [000001 29-JUL-2009 04:48:02:900] nsprecv: 54 45 4E 45 52 2C 2D 69 |TENER,-i| [000001 29-JUL-2009 04:48:02:900] nsprecv: 6E 68 65 72 69 74 27 29 |nherit')| [000001 29-JUL-2009 04:48:02:900] nsprecv: 28 44 45 54 41 43 48 3D |(DETACH=| [000001 29-JUL-2009 04:48:02:900] nsprecv: 79 65 73 29 29 |yes)) | [000001 29-JUL-2009 04:48:02:901] nsprecv: normal exit [000001 29-JUL-2009 04:48:02:901] nscon: got NSPTCN packet [000001 29-JUL-2009 04:48:02:901] nsconneg: entry [000001 29-JUL-2009 04:48:02:901] nsconneg: vsn=312, lov=300, opt=0x0, sdu=2048, tdu=8192, ntc=0x4f98 [000001 29-JUL-2009 04:48:02:901] nsconneg: vsn=312, gbl=0x0, sdu=2048, tdu=8192 [000001 29-JUL-2009 04:48:02:901] nsconneg: normal exit [000001 29-JUL-2009 04:48:02:901] nsmal: entry [000001 29-JUL-2009 04:48:02:901] nsmal: 131 bytes at 0x8000000100167c30 [000001 29-JUL-2009 04:48:02:901] nsmal: normal exit [000001 29-JUL-2009 04:48:02:901] nscon: got 131 bytes connect data [000001 29-JUL-2009 04:48:02:901] nsmfr: entry [000001 29-JUL-2009 04:48:02:901] nsmfr: 131 bytes at 0x8000000100167c30 [000001 29-JUL-2009 04:48:02:901] nsmfr: normal exit [000001 29-JUL-2009 04:48:02:901] nscon: discarding connect data (131 bytes) [000001 29-JUL-2009 04:48:02:901] nscon: exit (0) [000001 29-JUL-2009 04:48:02:902] nsdo: nsctxrnk=0 [000001 29-JUL-2009 04:48:02:902] nsdo: normal exit [000001 29-JUL-2009 04:48:02:902] nsinherit: connection inherited [000001 29-JUL-2009 04:48:02:902] nsinherit: connected [000001 29-JUL-2009 04:48:02:902] nsinherit: normal exit [000001 29-JUL-2009 04:48:02:902] nsglma: entry [000001 29-JUL-2009 04:48:02:902] nsglma: Listener's pid=28321 [000001 29-JUL-2009 04:48:02:902] nladini: entry [000001 29-JUL-2009 04:48:02:902] nladini: exit [000001 29-JUL-2009 04:48:02:902] nladget: entry [000001 29-JUL-2009 04:48:02:902] nladget: exit [000001 29-JUL-2009 04:48:02:903] nsgllsn: LSNDSC==>(DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=10.203.104.11)(PORT=1521))) [000001 29-JUL-2009 04:48:02:903] nsglhcrt: entry [000001 29-JUL-2009 04:48:02:903] nsglhcrt: exit [000001 29-JUL-2009 04:48:02:903] nladini: entry [000001 29-JUL-2009 04:48:02:903] nladini: exit [000001 29-JUL-2009 04:48:02:903] nladget: entry [000001 29-JUL-2009 04:48:02:903] nladget: exit [000001 29-JUL-2009 04:48:02:903] nladtrm: entry [000001 29-JUL-2009 04:48:02:903] nladtrm: exit [000001 29-JUL-2009 04:48:02:903] nslisten: entry [000001 29-JUL-2009 04:48:02:903] nsc2addr: entry [000001 29-JUL-2009 04:48:02:904] nttbnd2addr: entry [000001 29-JUL-2009 04:48:02:904] nttgetport: entry [000001 29-JUL-2009 04:48:02:904] nttgetport: port resolved to 1521 [000001 29-JUL-2009 04:48:02:904] nttgetport: exit [000001 29-JUL-2009 04:48:02:904] nttbnd2addr: using host IP address: 10.203.104.11 [000001 29-JUL-2009 04:48:02:904] nttbnd2addr: exit [000001 29-JUL-2009 04:48:02:904] nsc2addr: normal exit [000001 29-JUL-2009 04:48:02:904] nsopen: entry [000001 29-JUL-2009 04:48:02:904] nsmal: entry [000001 29-JUL-2009 04:48:02:904] nsmal: 800 bytes at 0x8000000100195b78 [000001 29-JUL-2009 04:48:02:904] nsmal: normal exit [000001 29-JUL-2009 04:48:02:904] nsopenmplx: entry [000001 29-JUL-2009 04:48:02:904] nsmal: entry [000001 29-JUL-2009 04:48:02:904] nsmal: 2592 bytes at 0x8000000100195eb0 [000001 29-JUL-2009 04:48:02:905] nsmal: normal exit [000001 29-JUL-2009 04:48:02:905] nsopenmplx: normal exit [000001 29-JUL-2009 04:48:02:905] nttcon: entry [000001 29-JUL-2009 04:48:02:905] nttcon: toc = 6 [000001 29-JUL-2009 04:48:02:905] nttcnp: entry [000001 29-JUL-2009 04:48:02:905] nttcnp: exit [000001 29-JUL-2009 04:48:02:905] nttcon: exit [000001 29-JUL-2009 04:48:02:905] nsopen: opening transport... [000001 29-JUL-2009 04:48:02:905] nttcon: entry [000001 29-JUL-2009 04:48:02:905] nttcon: toc = 2 [000001 29-JUL-2009 04:48:02:905] nttcnp: entry [000001 29-JUL-2009 04:48:02:905] ntvlin: entry [000001 29-JUL-2009 04:48:02:905] ntvllt: entry [000001 29-JUL-2009 04:48:02:905] ntvllt: tcp.validnode_checking not turned on [000001 29-JUL-2009 04:48:02:905] ntvllt: exit [000001 29-JUL-2009 04:48:02:906] ntvlin: exit [000001 29-JUL-2009 04:48:02:906] nttcnp: Validnode Table IN use; err 0x0 [000001 29-JUL-2009 04:48:02:906] nttcnp: creating a socket. [000001 29-JUL-2009 04:48:02:906] nttcnp: binding an address to a socket. [000001 29-JUL-2009 04:48:02:906] nttcnp: listening on a bound socket (queue size = 20). [000001 29-JUL-2009 04:48:02:906] nttcnp: getting sockname [000001 29-JUL-2009 04:48:02:906] nttcnp: exit [000001 29-JUL-2009 04:48:02:906] nttcon: exit [000001 29-JUL-2009 04:48:02:906] nsopen: transport is open [000001 29-JUL-2009 04:48:02:906] nsoptions: entry [000001 29-JUL-2009 04:48:02:906] nsoptions: lcl[0]=0x0, lcl[1]=0x12003, gbl[0]=0x0, gbl[1]=0x2001, cha=0x0 [000001 29-JUL-2009 04:48:02:906] nsoptions: lcl[0]=0xffe9ff, lcl[1]=0x12003, gbl[0]=0x7e3f, gbl[1]=0x2001 [000001 29-JUL-2009 04:48:02:907] nsoptions: normal exit [000001 29-JUL-2009 04:48:02:907] nsopen: global context check-in (to slot 1) complete [000001 29-JUL-2009 04:48:02:907] nsopen: lcl[0]=0xffe9ff, lcl[1]=0x12003, gbl[0]=0x7e3f, gbl[1]=0x2001, tdu=32767, sdu=8192 [000001 29-JUL-2009 04:48:02:907] nsdo: entry [000001 29-JUL-2009 04:48:02:907] nsdo: cid=1, opcode=65, *bl=0, *what=0, uflgs=0x0, cflgs=0x2 [000001 29-JUL-2009 04:48:02:907] nsdo: rank=64, nsctxrnk=0 [000001 29-JUL-2009 04:48:02:907] nsdo: nsctx: state=7, flg=0x4202, mvd=0 [000001 29-JUL-2009 04:48:02:907] nsdo: nsctxrnk=0 [000001 29-JUL-2009 04:48:02:907] nsdo: normal exit [000001 29-JUL-2009 04:48:02:907] nsopen: normal exit [000001 29-JUL-2009 04:48:02:907] nslisten: normal exit [000001 29-JUL-2009 04:48:02:907] nsgllsn: completing partial addr: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=10.203.104.11)(PORT=1521))) [000001 29-JUL-2009 04:48:02:907] nttaddr2bnd: entry [000001 29-JUL-2009 04:48:02:907] nttaddr2bnd: exit [000001 29-JUL-2009 04:48:02:908] nsgllsn: Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=10.203.104.11)(PORT=1521))) [000001 29-JUL-2009 04:48:02:908] nsevreg: entry [000001 29-JUL-2009 04:48:02:908] nsevreg: begin registration process for 1 [000001 29-JUL-2009 04:48:02:908] nsevregPrePost: entry [000001 29-JUL-2009 04:48:02:908] nsevregPrePost: normal exit [000001 29-JUL-2009 04:48:02:908] nsevreg: sgt=0, evn=1, evt[2]=0x0 [000001 29-JUL-2009 04:48:02:908] nsevreg: begin notification process for 1 [000001 29-JUL-2009 04:48:02:908] nsevregAffectNotif: entry [000001 29-JUL-2009 04:48:02:908] nsevregAffectNotif: exit (0) [000001 29-JUL-2009 04:48:02:908] nsevreg: rdm=0, sgt=0, evt[0]=0x1, [1]=0x1, [2]=0x0, nrg=0 [000001 29-JUL-2009 04:48:02:908] nsevreg: registering for 0x1 [000001 29-JUL-2009 04:48:02:908] nsevreg: normal exit [000001 29-JUL-2009 04:48:02:908] nsgllsn: Direct handoff is supported for the endpoint. [000001 29-JUL-2009 04:48:02:909] nsgllsn: Direct handoff is enabled for the endpoint. [000001 29-JUL-2009 04:48:02:909] nsglhins: entry [000001 29-JUL-2009 04:48:02:909] nsglhins: exit [000001 29-JUL-2009 04:48:02:909] nslisten: entry [000001 29-JUL-2009 04:48:02:909] nsc2addr: entry [000001 29-JUL-2009 04:48:02:909] sntuscrt: entry [000001 29-JUL-2009 04:48:02:909] sntuscrt: failed to create dir /tmp/.oracle [000001 29-JUL-2009 04:48:02:909] sntuscrt: exit [000001 29-JUL-2009 04:48:02:909] ntusb2adr: entry [000001 29-JUL-2009 04:48:02:909] nsc2addr: normal exit [000001 29-JUL-2009 04:48:02:909] nsopen: entry [000001 29-JUL-2009 04:48:02:909] nsmal: entry [000001 29-JUL-2009 04:48:02:909] nsmal: 800 bytes at 0x80000001001974f8 [000001 29-JUL-2009 04:48:02:909] nsmal: normal exit [000001 29-JUL-2009 04:48:02:910] nsopenmplx: entry [000001 29-JUL-2009 04:48:02:910] nsmal: entry [000001 29-JUL-2009 04:48:02:910] nsmal: 2592 bytes at 0x8000000100197830 [000001 29-JUL-2009 04:48:02:910] nsmal: normal exit [000001 29-JUL-2009 04:48:02:910] nsopenmplx: normal exit [000001 29-JUL-2009 04:48:02:910] ntusconn: entry [000001 29-JUL-2009 04:48:02:910] ntusconn: connect: operation 6 [000001 29-JUL-2009 04:48:02:910] ntuscnp: entry [000001 29-JUL-2009 04:48:02:910] ntuscnp: exit [000001 29-JUL-2009 04:48:02:910] ntusconn: exit [000001 29-JUL-2009 04:48:02:910] nsopen: opening transport... [000001 29-JUL-2009 04:48:02:910] ntusconn: entry [000001 29-JUL-2009 04:48:02:910] ntusconn: connect: operation 2 [000001 29-JUL-2009 04:48:02:910] ntuscnp: entry [000001 29-JUL-2009 04:48:02:910] sntusgph: entry [000001 29-JUL-2009 04:48:02:911] sntusgph: exit [000001 29-JUL-2009 04:48:02:911] ntus2err: entry [000001 29-JUL-2009 04:48:02:911] ntus2err: sd=21, op=1, resnt[0]=511, resnt[1]=2, resnt[2]=0 [000001 29-JUL-2009 04:48:02:911] ntus2err: exit [000001 29-JUL-2009 04:48:02:911] ntuscnp: Address in use [000001 29-JUL-2009 04:48:02:911] ntus2err: entry [000001 29-JUL-2009 04:48:02:911] ntus2err: sd=21, op=1, resnt[0]=511, resnt[1]=2, resnt[2]=0 [000001 29-JUL-2009 04:48:02:911] ntus2err: exit [000001 29-JUL-2009 04:48:02:911] ntuscnp: exit [000001 29-JUL-2009 04:48:02:911] ntusconn: exit [000001 29-JUL-2009 04:48:02:911] nserror: entry [000001 29-JUL-2009 04:48:02:911] nserror: nsres: id=0, op=65, ns=12541, ns2=12560; nt[0]=511, nt[1]=2, nt[2]=0; ora[0]=0, ora[1]=0, ora[2]=0 [000001 29-JUL-2009 04:48:02:911] nsopen: unable to open transport [000001 29-JUL-2009 04:48:02:911] nsbfr: entry [000001 29-JUL-2009 04:48:02:911] nsbfr: normal exit [000001 29-JUL-2009 04:48:02:912] nsbfr: entry [000001 29-JUL-2009 04:48:02:912] nsbfr: normal exit [000001 29-JUL-2009 04:48:02:912] nsmfr: entry [000001 29-JUL-2009 04:48:02:912] nsmfr: 2592 bytes at 0x8000000100197830 [000001 29-JUL-2009 04:48:02:912] nsmfr: normal exit [000001 29-JUL-2009 04:48:02:912] nsmfr: entry [000001 29-JUL-2009 04:48:02:912] nsmfr: 800 bytes at 0x80000001001974f8 [000001 29-JUL-2009 04:48:02:912] nsmfr: normal exit [000001 29-JUL-2009 04:48:02:912] nsopen: error exit [000001 29-JUL-2009 04:48:02:912] nslisten: error exit [000001 29-JUL-2009 04:48:02:912] nsglhfre: entry [000001 29-JUL-2009 04:48:02:912] nsglhrem: entry [000001 29-JUL-2009 04:48:02:912] nsglhrem: entry [000001 29-JUL-2009 04:48:02:912] nsglhrem: exit [000001 29-JUL-2009 04:48:02:912] nsglhfre: Terminating listening endpoint: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=10.203.104.11)(PORT=1521))) [000001 29-JUL-2009 04:48:02:913] nsdisc: entry [000001 29-JUL-2009 04:48:02:913] nsclose: entry [000001 29-JUL-2009 04:48:02:913] nstimarmed: entry [000001 29-JUL-2009 04:48:02:913] nstimarmed: no timer allocated [000001 29-JUL-2009 04:48:02:913] nstimarmed: normal exit [000001 29-JUL-2009 04:48:02:913] nsdo: entry [000001 29-JUL-2009 04:48:02:913] nsdo: cid=1, opcode=98, *bl=0, *what=0, uflgs=0x40, cflgs=0x2 [000001 29-JUL-2009 04:48:02:913] nsdo: rank=64, nsctxrnk=0 [000001 29-JUL-2009 04:48:02:913] nsdo: nsctx: state=7, flg=0x4202, mvd=0 [000001 29-JUL-2009 04:48:02:913] nsevunreg: entry [000001 29-JUL-2009 04:48:02:913] nsevunreg: cid=1, sgt=0, rdm=0 [000001 29-JUL-2009 04:48:02:913] nsevunreg: 0 registered connection(s) [000001 29-JUL-2009 04:48:02:913] nsevunreg: exit (0) [000001 29-JUL-2009 04:48:02:913] nsdo: nsctxrnk=0 [000001 29-JUL-2009 04:48:02:913] nsdo: normal exit [000001 29-JUL-2009 04:48:02:913] nsclose: closing transport [000001 29-JUL-2009 04:48:02:914] nttdisc: entry [000001 29-JUL-2009 04:48:02:914] nttdisc: Closed socket 20 [000001 29-JUL-2009 04:48:02:914] nttdisc: exit [000001 29-JUL-2009 04:48:02:914] nsclose: global context check-out (from slot 1) complete [000001 29-JUL-2009 04:48:02:914] nsnadisc: entry [000001 29-JUL-2009 04:48:02:914] nsbfr: entry [000001 29-JUL-2009 04:48:02:914] nsbfr: normal exit [000001 29-JUL-2009 04:48:02:914] nsbfr: entry [000001 29-JUL-2009 04:48:02:914] nsbfr: normal exit [000001 29-JUL-2009 04:48:02:914] nsmfr: entry [000001 29-JUL-2009 04:48:02:914] nsmfr: 2592 bytes at 0x8000000100195eb0 [000001 29-JUL-2009 04:48:02:914] nsmfr: normal exit [000001 29-JUL-2009 04:48:02:914] nsmfr: entry [000001 29-JUL-2009 04:48:02:914] nsmfr: 800 bytes at 0x8000000100195b78 [000001 29-JUL-2009 04:48:02:914] nsmfr: normal exit [000001 29-JUL-2009 04:48:02:915] nsclose: normal exit [000001 29-JUL-2009 04:48:02:915] nsdisc: exit (0) [000001 29-JUL-2009 04:48:02:915] nsglhfre: Deallocating cxd 0x80000001001956d0. [000001 29-JUL-2009 04:48:02:915] nsglhfre: exit [000001 29-JUL-2009 04:48:02:915] nsglma: Reporting the following error stack: TNS-12541: TNS:no listener TNS-12560: TNS:protocol adapter error TNS-00511: No listener HPUX Error: 2: No such file or directory [000001 29-JUL-2009 04:48:02:915] nsrefuse: entry [000001 29-JUL-2009 04:48:02:915] nsdo: entry [000001 29-JUL-2009 04:48:02:915] nsdo: cid=0, opcode=67, *bl=694, *what=10, uflgs=0x0, cflgs=0x3 [000001 29-JUL-2009 04:48:02:915] nsdo: rank=64, nsctxrnk=0 [000001 29-JUL-2009 04:48:02:915] nsdo: nsctx: state=2, flg=0x4204, mvd=0 [000001 29-JUL-2009 04:48:02:915] nsdo: gtn=189, gtc=189, ptn=10, ptc=2011 [000001 29-JUL-2009 04:48:02:915] nscon: entry [000001 29-JUL-2009 04:48:02:916] nscon: sending NSPTRF packet [000001 29-JUL-2009 04:48:02:916] nspsend: entry [000001 29-JUL-2009 04:48:02:916] nspsend: plen=12, type=4 [000001 29-JUL-2009 04:48:02:916] ntpwr: entry [000001 29-JUL-2009 04:48:02:916] ntpwr: exit [000001 29-JUL-2009 04:48:02:916] nspsend: 12 bytes to transport [000001 29-JUL-2009 04:48:02:916] nspsend: packet dump [000001 29-JUL-2009 04:48:02:916] nspsend: 00 0C 00 00 04 00 00 00 |........| [000001 29-JUL-2009 04:48:02:916] nspsend: 22 00 02 B6 |"... | [000001 29-JUL-2009 04:48:02:916] nspsend: normal exit [000001 29-JUL-2009 04:48:02:916] nscon: sending 694 bytes connect data [000001 29-JUL-2009 04:48:02:916] nsdo: entry [000001 29-JUL-2009 04:48:02:916] nsdo: cid=0, opcode=67, *bl=694, *what=1, uflgs=0x4000, cflgs=0x0 [000001 29-JUL-2009 04:48:02:916] nsdo: nsctx: state=2, flg=0x4204, mvd=0 [000001 29-JUL-2009 04:48:02:916] nsdo: gtn=189, gtc=189, ptn=10, ptc=2011 [000001 29-JUL-2009 04:48:02:916] nsdo: 694 bytes to NS buffer [000001 29-JUL-2009 04:48:02:917] nsdo: normal exit [000001 29-JUL-2009 04:48:02:917] nscon: exit (0) [000001 29-JUL-2009 04:48:02:917] nsdo: nsctxrnk=0 [000001 29-JUL-2009 04:48:02:917] nsdo: normal exit [000001 29-JUL-2009 04:48:02:917] nsclose: entry [000001 29-JUL-2009 04:48:02:917] nstimarmed: entry [000001 29-JUL-2009 04:48:02:917] nstimarmed: no timer allocated [000001 29-JUL-2009 04:48:02:917] nstimarmed: normal exit [000001 29-JUL-2009 04:48:02:917] nsdo: entry [000001 29-JUL-2009 04:48:02:917] nsdo: cid=0, opcode=66, *bl=0, *what=0, uflgs=0x0, cflgs=0x2 [000001 29-JUL-2009 04:48:02:917] nsdo: rank=64, nsctxrnk=0 [000001 29-JUL-2009 04:48:02:917] nsdo: nsctx: state=2, flg=0x4200, mvd=0 [000001 29-JUL-2009 04:48:02:917] nsdofls: entry [000001 29-JUL-2009 04:48:02:917] nsdofls: DATA flags: 0x40 [000001 29-JUL-2009 04:48:02:917] nsdofls: sending NSPTDA packet [000001 29-JUL-2009 04:48:02:917] nspsend: entry [000001 29-JUL-2009 04:48:02:918] nspsend: plen=704, type=6 [000001 29-JUL-2009 04:48:02:918] ntpwr: entry [000001 29-JUL-2009 04:48:02:918] ntpwr: exit [000001 29-JUL-2009 04:48:02:918] nspsend: 704 bytes to transport [000001 29-JUL-2009 04:48:02:918] nspsend: packet dump [000001 29-JUL-2009 04:48:02:918] nspsend: 02 C0 00 00 06 00 00 00 |........| [000001 29-JUL-2009 04:48:02:918] nspsend: 00 40 54 4E 53 4C 53 4E |.@TNSLSN| [000001 29-JUL-2009 04:48:02:918] nspsend: 52 20 66 6F 72 20 48 50 |R.for.HP| [000001 29-JUL-2009 04:48:02:918] nspsend: 55 58 3A 20 56 65 72 73 |UX:.Vers| [000001 29-JUL-2009 04:48:02:918] nspsend: 69 6F 6E 20 39 2E 32 2E |ion.9.2.| [000001 29-JUL-2009 04:48:02:918] nspsend: 30 2E 36 2E 30 20 2D 20 |0.6.0.-.| [000001 29-JUL-2009 04:48:02:918] nspsend: 50 72 6F 64 75 63 74 69 |Producti| [000001 29-JUL-2009 04:48:02:918] nspsend: 6F 6E 0A 53 79 73 74 65 |on.Syste| [000001 29-JUL-2009 04:48:02:918] nspsend: 6D 20 70 61 72 61 6D 65 |m.parame| [000001 29-JUL-2009 04:48:02:918] nspsend: 74 65 72 20 66 69 6C 65 |ter.file| [000001 29-JUL-2009 04:48:02:918] nspsend: 20 69 73 20 2F 6F 72 61 |.is./ora| [000001 29-JUL-2009 04:48:02:918] nspsend: 63 6C 65 2F 61 70 70 2F |cle/app/| [000001 29-JUL-2009 04:48:02:918] nspsend: 6F 72 61 63 6C 65 2F 70 |oracle/p| [000001 29-JUL-2009 04:48:02:918] nspsend: 72 6F 64 75 63 74 2F 39 |roduct/9| [000001 29-JUL-2009 04:48:02:918] nspsend: 2E 32 2E 30 2F 6E 65 74 |.2.0/net| [000001 29-JUL-2009 04:48:02:919] nspsend: 77 6F 72 6B 2F 61 64 6D |work/adm| [000001 29-JUL-2009 04:48:02:919] nspsend: 69 6E 2F 6C 69 73 74 65 |in/liste| [000001 29-JUL-2009 04:48:02:919] nspsend: 6E 65 72 2E 6F 72 61 0A |ner.ora.| [000001 29-JUL-2009 04:48:02:919] nspsend: 4C 6F 67 20 6D 65 73 73 |Log.mess| [000001 29-JUL-2009 04:48:02:919] nspsend: 61 67 65 73 20 77 72 69 |ages.wri| [000001 29-JUL-2009 04:48:02:919] nspsend: 74 74 65 6E 20 74 6F 20 |tten.to.| [000001 29-JUL-2009 04:48:02:919] nspsend: 2F 6F 72 61 63 6C 65 2F |/oracle/| [000001 29-JUL-2009 04:48:02:919] nspsend: 61 70 70 2F 6F 72 61 63 |app/orac| [000001 29-JUL-2009 04:48:02:919] nspsend: 6C 65 2F 70 72 6F 64 75 |le/produ| [000001 29-JUL-2009 04:48:02:919] nspsend: 63 74 2F 39 2E 32 2E 30 |ct/9.2.0| [000001 29-JUL-2009 04:48:02:919] nspsend: 2F 6E 65 74 77 6F 72 6B |/network| [000001 29-JUL-2009 04:48:02:919] nspsend: 2F 6C 6F 67 2F 6C 69 73 |/log/lis| [000001 29-JUL-2009 04:48:02:919] nspsend: 74 65 6E 65 72 2E 6C 6F |tener.lo| [000001 29-JUL-2009 04:48:02:919] nspsend: 67 0A 54 72 61 63 65 20 |g.Trace.| [000001 29-JUL-2009 04:48:02:919] nspsend: 69 6E 66 6F 72 6D 61 74 |informat| [000001 29-JUL-2009 04:48:02:919] nspsend: 69 6F 6E 20 77 72 69 74 |ion.writ| [000001 29-JUL-2009 04:48:02:919] nspsend: 74 65 6E 20 74 6F 20 2F |ten.to./| [000001 29-JUL-2009 04:48:02:919] nspsend: 6F 72 61 63 6C 65 2F 61 |oracle/a| [000001 29-JUL-2009 04:48:02:919] nspsend: 70 70 2F 6F 72 61 63 6C |pp/oracl| [000001 29-JUL-2009 04:48:02:919] nspsend: 65 2F 70 72 6F 64 75 63 |e/produc| [000001 29-JUL-2009 04:48:02:919] nspsend: 74 2F 39 2E 32 2E 30 2F |t/9.2.0/| [000001 29-JUL-2009 04:48:02:919] nspsend: 6E 65 74 77 6F 72 6B 2F |network/| [000001 29-JUL-2009 04:48:02:920] nspsend: 74 72 61 63 65 2F 6C 69 |trace/li| [000001 29-JUL-2009 04:48:02:920] nspsend: 73 74 65 6E 65 72 2E 74 |stener.t| [000001 29-JUL-2009 04:48:02:920] nspsend: 72 63 31 2E 74 72 63 0A |rc1.trc.| [000001 29-JUL-2009 04:48:02:920] nspsend: 4C 69 73 74 65 6E 69 6E |Listenin| [000001 29-JUL-2009 04:48:02:920] nspsend: 67 20 6F 6E 3A 20 28 44 |g.on:.(D| [000001 29-JUL-2009 04:48:02:920] nspsend: 45 53 43 52 49 50 54 49 |ESCRIPTI| [000001 29-JUL-2009 04:48:02:920] nspsend: 4F 4E 3D 28 41 44 44 52 |ON=(ADDR| [000001 29-JUL-2009 04:48:02:920] nspsend: 45 53 53 3D 28 50 52 4F |ESS=(PRO| [000001 29-JUL-2009 04:48:02:920] nspsend: 54 4F 43 4F 4C 3D 74 63 |TOCOL=tc| [000001 29-JUL-2009 04:48:02:920] nspsend: 70 29 28 48 4F 53 54 3D |p)(HOST=| [000001 29-JUL-2009 04:48:02:920] nspsend: 31 30 2E 32 30 33 2E 31 |10.203.1| [000001 29-JUL-2009 04:48:02:920] nspsend: 30 34 2E 31 31 29 28 50 |04.11)(P| [000001 29-JUL-2009 04:48:02:920] nspsend: 4F 52 54 3D 31 35 32 31 |ORT=1521| [000001 29-JUL-2009 04:48:02:920] nspsend: 29 29 29 0A 45 72 72 6F |))).Erro| [000001 29-JUL-2009 04:48:02:920] nspsend: 72 20 6C 69 73 74 65 6E |r.listen| [000001 29-JUL-2009 04:48:02:920] nspsend: 69 6E 67 20 6F 6E 3A 20 |ing.on:.| [000001 29-JUL-2009 04:48:02:920] nspsend: 28 41 44 44 52 45 53 53 |(ADDRESS| [000001 29-JUL-2009 04:48:02:920] nspsend: 3D 28 50 52 4F 54 4F 43 |=(PROTOC| [000001 29-JUL-2009 04:48:02:920] nspsend: 4F 4C 3D 69 70 63 29 28 |OL=ipc)(| [000001 29-JUL-2009 04:48:02:920] nspsend: 50 41 52 54 49 41 4C 3D |PARTIAL=| [000001 29-JUL-2009 04:48:02:920] nspsend: 79 65 73 29 28 51 55 45 |yes)(QUE| [000001 29-JUL-2009 04:48:02:920] nspsend: 55 45 53 49 5A 45 3D 31 |UESIZE=1| [000001 29-JUL-2009 04:48:02:921] nspsend: 29 29 0A 4E 6F 20 6C 6F |)).No.lo| [000001 29-JUL-2009 04:48:02:921] nspsend: 6E 67 65 72 20 6C 69 73 |nger.lis| [000001 29-JUL-2009 04:48:02:921] nspsend: 74 65 6E 69 6E 67 20 6F |tening.o| [000001 29-JUL-2009 04:48:02:921] nspsend: 6E 3A 20 28 44 45 53 43 |n:.(DESC| [000001 29-JUL-2009 04:48:02:921] nspsend: 52 49 50 54 49 4F 4E 3D |RIPTION=| [000001 29-JUL-2009 04:48:02:921] nspsend: 28 41 44 44 52 45 53 53 |(ADDRESS| [000001 29-JUL-2009 04:48:02:921] nspsend: 3D 28 50 52 4F 54 4F 43 |=(PROTOC| [000001 29-JUL-2009 04:48:02:921] nspsend: 4F 4C 3D 74 63 70 29 28 |OL=tcp)(| [000001 29-JUL-2009 04:48:02:921] nspsend: 48 4F 53 54 3D 31 30 2E |HOST=10.| [000001 29-JUL-2009 04:48:02:921] nspsend: 32 30 33 2E 31 30 34 2E |203.104.| [000001 29-JUL-2009 04:48:02:921] nspsend: 31 31 29 28 50 4F 52 54 |11)(PORT| [000001 29-JUL-2009 04:48:02:921] nspsend: 3D 31 35 32 31 29 29 29 |=1521)))| [000001 29-JUL-2009 04:48:02:921] nspsend: 0A 54 4E 53 2D 31 32 35 |.TNS-125| [000001 29-JUL-2009 04:48:02:921] nspsend: 34 31 3A 20 54 4E 53 3A |41:.TNS:| [000001 29-JUL-2009 04:48:02:921] nspsend: 6E 6F 20 6C 69 73 74 65 |no.liste| [000001 29-JUL-2009 04:48:02:921] nspsend: 6E 65 72 0A 20 54 4E 53 |ner..TNS| [000001 29-JUL-2009 04:48:02:921] nspsend: 2D 31 32 35 36 30 3A 20 |-12560:.| [000001 29-JUL-2009 04:48:02:921] nspsend: 54 4E 53 3A 70 72 6F 74 |TNS:prot| [000001 29-JUL-2009 04:48:02:921] nspsend: 6F 63 6F 6C 20 61 64 61 |ocol.ada| [000001 29-JUL-2009 04:48:02:921] nspsend: 70 74 65 72 20 65 72 72 |pter.err| [000001 29-JUL-2009 04:48:02:921] nspsend: 6F 72 0A 20 20 54 4E 53 |or...TNS| [000001 29-JUL-2009 04:48:02:921] nspsend: 2D 30 30 35 31 31 3A 20 |-00511:.| [000001 29-JUL-2009 04:48:02:922] nspsend: 4E 6F 20 6C 69 73 74 65 |No.liste| [000001 29-JUL-2009 04:48:02:922] nspsend: 6E 65 72 0A 20 20 20 48 |ner....H| [000001 29-JUL-2009 04:48:02:922] nspsend: 50 55 58 20 45 72 72 6F |PUX.Erro| [000001 29-JUL-2009 04:48:02:922] nspsend: 72 3A 20 32 3A 20 4E 6F |r:.2:.No| [000001 29-JUL-2009 04:48:02:922] nspsend: 20 73 75 63 68 20 66 69 |.such.fi| [000001 29-JUL-2009 04:48:02:922] nspsend: 6C 65 20 6F 72 20 64 69 |le.or.di| [000001 29-JUL-2009 04:48:02:922] nspsend: 72 65 63 74 6F 72 79 0A |rectory.| [000001 29-JUL-2009 04:48:02:922] nspsend: normal exit [000001 29-JUL-2009 04:48:02:922] nsdofls: exit (0) [000001 29-JUL-2009 04:48:02:922] nsbfr: entry [000001 29-JUL-2009 04:48:02:922] nsbaddfl: entry [000001 29-JUL-2009 04:48:02:922] nsbaddfl: normal exit [000001 29-JUL-2009 04:48:02:922] nsbfr: normal exit [000001 29-JUL-2009 04:48:02:922] nsbfr: entry [000001 29-JUL-2009 04:48:02:922] nsbaddfl: entry [000001 29-JUL-2009 04:48:02:922] nsbaddfl: normal exit [000001 29-JUL-2009 04:48:02:922] nsbfr: normal exit [000001 29-JUL-2009 04:48:02:923] nsdo: nsctxrnk=0 [000001 29-JUL-2009 04:48:02:923] nsdo: normal exit [000001 29-JUL-2009 04:48:02:923] nsclose: closing transport [000001 29-JUL-2009 04:48:02:923] ntpdisc: entry [000001 29-JUL-2009 04:48:02:923] ntpdisc: exit [000001 29-JUL-2009 04:48:02:923] nsclose: global context check-out (from slot 0) complete [000001 29-JUL-2009 04:48:02:923] nsnadisc: entry [000001 29-JUL-2009 04:48:02:923] nsbfr: entry [000001 29-JUL-2009 04:48:02:923] nsbaddfl: entry [000001 29-JUL-2009 04:48:02:923] nsbaddfl: normal exit [000001 29-JUL-2009 04:48:02:923] nsbfr: normal exit [000001 29-JUL-2009 04:48:02:923] nsbfr: entry [000001 29-JUL-2009 04:48:02:923] nsbfr: normal exit [000001 29-JUL-2009 04:48:02:923] nsmfr: entry [000001 29-JUL-2009 04:48:02:923] nsmfr: 2592 bytes at 0x8000000100166780 [000001 29-JUL-2009 04:48:02:923] nsmfr: normal exit [000001 29-JUL-2009 04:48:02:924] nsmfr: entry [000001 29-JUL-2009 04:48:02:924] nsmfr: 800 bytes at 0x8000000100166448 [000001 29-JUL-2009 04:48:02:924] nsmfr: normal exit [000001 29-JUL-2009 04:48:02:924] nsclose: normal exit [000001 29-JUL-2009 04:48:02:924] nsrefuse: exit (0) |
我们注意到在391行有一个报错 [000001 29-JUL-2009 04:48:02:909] sntuscrt: failed to create dir /tmp/.oracle，在这个报错之后，在443行就[000001 29-JUL-2009 04:48:02:912] nsglhfre: Terminating listening endpoint: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=10.203.104.11)(PORT=1521)))，侦听被终止了。
因此，我们将该问题定位于oracle无法写入/tmp/.oracle，并且通过进一步的检查，发现db01有/tmp/.oracle目录，而db02没这个目录，当我们手工创建/tmp/.oracle，并且chown oracle:dba /tmp/.oracle再次启动侦听，恢复正常了！
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 |
oracle@gz_dc02:/oracle > lsnrctl start LSNRCTL for HPUX: Version 9.2.0.6.0 - Production on 29-JUL-2009 04:59:52 Copyright (c) 1991, 2002, Oracle Corporation. All rights reserved. Starting /oracle/app/oracle/product/9.2.0/bin/tnslsnr: please wait... TNSLSNR for HPUX: Version 9.2.0.6.0 - Production System parameter file is /oracle/app/oracle/product/9.2.0/network/admin/listener.ora Log messages written to /oracle/app/oracle/product/9.2.0/network/log/listener.log Trace information written to /oracle/app/oracle/product/9.2.0/network/trace/listener.trc1.trc Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=10.203.104.11)(PORT=1521))) Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC))) Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=10.203.104.11)(PORT=1521))) STATUS of the LISTENER ------------------------ Alias LISTENER Version TNSLSNR for HPUX: Version 9.2.0.6.0 - Production Start Date 29-JUL-2009 04:59:52 Uptime 0 days 0 hr. 0 min. 0 sec Trace Level support Security OFF SNMP OFF Listener Parameter File /oracle/app/oracle/product/9.2.0/network/admin/listener.ora Listener Log File /oracle/app/oracle/product/9.2.0/network/log/listener.log Listener Trace File /oracle/app/oracle/product/9.2.0/network/trace/listener.trc1.trc Listening Endpoints Summary... (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=10.203.104.11)(PORT=1521))) (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC))) Services Summary... Service "PLSExtProc" has 1 instance(s). Instance "PLSExtProc", status UNKNOWN, has 1 handler(s) for this service... Service "gzmisc" has 1 instance(s). Instance "gzmisc", status UNKNOWN, has 1 handler(s) for this service... The command completed successfully oracle@gz_dc02:/oracle > |
我们此时再看了一下/tmp目前的权限，发现：
|
1 2 |
db01上 drwxrwxrwx 13 bin bin 8192 Jul 29 03:32 tmp |
|
1 2 |
db02上： drwxr-xr-x 10 root root 3072 Jul 29 04:58 tmp |
看来还确实是权限问题，修改db02上的/tmp目前权限为777，和db01一样，这样，下次哪怕/tmp/.oracle目录被删除，也不怕了。
最后打扫战场，停止lsnr的trace。故障处理完成。
6条评论
启动监听要在/tmp/.oracle目录下创建socket_file
应该不是所有平台都有这问题,我在linux上测试没有这问题
re mht：谢谢！在linux上也有这样的问题，linux的路径是/var/tmp/.oracle
上周刚刚遇到,unix和linux上都有。
辛苦呀，凌晨被叫醒。。。
遇到这种怪怪的问题，重建一个监听连接，可以吧。