Ok, last series of tests. A quick trace of the oraagent process showed that the write privilege for group was missing on the $ORACLE_HOME/network/admin directory and the $ORACLE_HOME/network/admin/listener.ora file. Once I fixed that, I was able to start a listener in the database home. But it still looks like that the listener must be added via the srvctl from the grid home, regardless of which home is used for the listener. 25395 stat("/opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/listener.ora", <unfinished ...> 4442 write(4, "2011-01-15 00:55:17.110: [ora.LS"..., 152) = 152 4442 futex(0x16a9e764, FUTEX_WAIT_PRIVATE, 657869, NULL <unfinished ...> 25395 <... stat resumed> {st_mode=S_IFREG|0664, st_size=301, ...}) = 0 25395 uname({sys="Linux", node="olvorap03.olvz.intra", ...}) = 0 25395 stat("/opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/listener.ora.new.olvorap03", 0x415ee300) = -1 ENOENT (No such file or directory) 25395 stat("/opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/listener.ora.bak.olvorap03", 0x415ee300) = -1 ENOENT (No such file or directory) 25395 open("/opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/listener.ora", O_RDONLY) = 20 25395 read(20, "# listener.ora Network Configura"..., 8191) = 301 [orarx@olvorap03 ~]$ ls -lhd /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/ drwxr-xr-x 3 orarx oinstall 4.0K Jan 13 10:34 /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/ [orarx@olvorap03 ~]$ ls -lh /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/listener.ora -rw-r--r-- 1 orarx oinstall 301 Dec 27 14:30 /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/listener.ora [orarx@olvorap03 ~]$ chmod 775 /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/ [orarx@olvorap03 ~]$ chmod 664 /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/listener.ora [orarx@olvorap03 ~]$ ls -lhd /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/ drwxrwxr-x 3 orarx oinstall 4.0K Jan 13 10:34 /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/ [orarx@olvorap03 ~]$ ls -lh /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/listener.ora -rw-rw-r-- 1 orarx oinstall 301 Dec 27 14:30 /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/listener.ora [orarx@olvorap03 ~]$ ls -lhd /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/ drwxr-xr-x 3 orarx oinstall 4.0K Jan 13 10:34 /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/ [orarx@olvorap03 ~]$ ls -lh /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/listener.ora -rw-r--r-- 1 orarx oinstall 301 Dec 27 14:30 /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/listener.ora [orarx@olvorap03 ~]$ chmod 775 /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/ [orarx@olvorap03 ~]$ chmod 664 /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/listener.ora [orarx@olvorap03 ~]$ ls -lhd /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/ drwxrwxr-x 3 orarx oinstall 4.0K Jan 13 10:34 /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/ [orarx@olvorap03 ~]$ ls -lh /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/listener.ora -rw-rw-r-- 1 orarx oinstall 301 Dec 27 14:30 /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/listener.ora [orarx@olvorap03 ~]$ su - grid Password: [grid@olvorap03 ~]$ srvctl config listener -l LSNR_TEST Name: LSNR_TEST Home: /opt/oracle/orarx/product/11.2.0.2/db_1 End points: TCP:1521 [grid@olvorap03 ~]$ srvctl start listener -l LSNR_TEST [grid@olvorap03 ~]$ srvctl status listener -l LSNR_TEST Listener LSNR_TEST is enabled Listener LSNR_TEST is running on node(s): olvorap03 [grid@olvorap03 ~]$ ls -alhtr /opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/ total 28K -rw-r--r-- 1 orarx oinstall 187 May 7 2007 shrept.lst drwxr-xr-x 2 orarx oinstall 4.0K Dec 14 10:35 samples drwxr-xr-x 11 orarx oinstall 4.0K Dec 14 10:40 .. -rw-rw-r-- 1 orarx oinstall 301 Dec 27 14:30 listener.ora.bak.olvorap03 -rw-r----- 1 orarx oinstall 735 Jan 13 10:34 tnsnames.ora -rw-r--r-- 1 grid oinstall 470 Jan 15 00:59 listener.ora drwxrwxr-x 3 orarx oinstall 4.0K Jan 15 00:59 . [grid@olvorap03 ~]$ srvctl stop listener -l LSNR_TEST [grid@olvorap03 ~]$ exit logout [orarx@olvorap03 ~]$ srvctl start listener -l LSNR_TEST [orarx@olvorap03 ~]$ srvctl stop listener -l LSNR_TEST [orarx@olvorap03 ~]$ srvctl remove listener -l LSNR_TEST [orarx@olvorap03 ~]$ srvctl add listener -l LSNR_TEST -p "TCP:1521" [orarx@olvorap03 ~]$ srvctl start listener -l LSNR_TEST PRCR-1079 : Failed to start resource ora.LSNR_TEST.lsnr CRS-2674: Start of 'ora.LSNR_TEST.lsnr' on 'olvorap03' failed CRS-2678: 'ora.LSNR_TEST.lsnr' on 'olvorap03' has experienced an unrecoverable failure CRS-0267: Human intervention required to resume its availability. CRS-5802: Unable to start the agent process [orarx@olvorap03 ~]$ srvctl remove listener -l LSNR_TEST [orarx@olvorap03 ~]$ srvctl add listener -l LSNR_TEST -p "TCP:1521" -o /opt/oracle/orarx/product/11.2.0.2/db_1 [orarx@olvorap03 ~]$ srvctl start listener -l LSNR_TEST PRCR-1079 : Failed to start resource ora.LSNR_TEST.lsnr CRS-2674: Start of 'ora.LSNR_TEST.lsnr' on 'olvorap03' failed CRS-2678: 'ora.LSNR_TEST.lsnr' on 'olvorap03' has experienced an unrecoverable failure CRS-0267: Human intervention required to resume its availability. CRS-5802: Unable to start the agent process Regards, Freek D'Hooge Uptime Oracle Database Administrator email: freek.dhooge@xxxxxxxxx tel +32(0)3 451 23 82 http://www.uptime.be disclaimer: www.uptime.be/disclaimer -----Original Message----- From: D'Hooge Freek Sent: zaterdag 15 januari 2011 0:54 To: D'Hooge Freek; Martin Berger Cc: cicciuxdba@xxxxxxxxx; oracle-l-freelists Subject: RE: listener... which home? Sorry, posted to quickly It seems that you need to use the srvctl from the grid home to add the listener. Using the srvctl from the db home will fail, even if the listener home is set to the grid home. Below you find some additional tests I have run. It could be that you can indeed use the grid home srvctl to add a listener in the db home. However in 11.2.0.2 on linux this seems to be failing because of some privilege problem (I have a bug open for the same problem on some other directories). [orarx@olvorap03 ~]$ su - grid Password: [grid@olvorap03 ~]$ which srvctl /opt/oracle/grid/11.2.0.2/bin/srvctl [grid@olvorap03 ~]$ srvctl start listener -l LSNR_TEST PRCR-1079 : Failed to start resource ora.LSNR_TEST.lsnr CRS-2680: Clean of 'ora.LSNR_TEST.lsnr' on 'olvorap03' failed CRS-5802: Unable to start the agent process [grid@olvorap03 ~]$ srvctl remove listener -l LSNR_TEST [grid@olvorap03 ~]$ srvctl add listener -l LSNR_TEST -p "TCP:1521" -o /opt/oracle/orarx/product/11.2.0.2/db_1 [grid@olvorap03 ~]$ srvctl config listener -l LSNR_TEST Name: LSNR_TEST Home: /opt/oracle/orarx/product/11.2.0.2/db_1 End points: TCP:1521 [grid@olvorap03 ~]$ srvctl start listener -l LSNR_TEST PRCR-1079 : Failed to start resource ora.LSNR_TEST.lsnr CRS-5010: Update of configuration file "/opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/listener.ora" failed: details at "(:CLSN00014:)" in "/opt/oracle/grid/11.2.0.2/log/olvorap03/agent/ohasd/oraagent_grid/oraagent_grid.log" CRS-2674: Start of 'ora.LSNR_TEST.lsnr' on 'olvorap03' failed [orarx@olvorap03 ~]$ which srvctl /opt/oracle/orarx/product/11.2.0.2/db_1/bin/srvctl [orarx@olvorap03 ~]$ srvctl start listener -l LSNR_TEST PRCR-1079 : Failed to start resource ora.LSNR_TEST.lsnr CRS-5010: Update of configuration file "/opt/oracle/orarx/product/11.2.0.2/db_1/network/admin/listener.ora" failed: details at "(:CLSN00014:)" in "/opt/oracle/grid/11.2.0.2/log/olvorap03/agent/ohasd/oraagent_grid/oraagent_grid.log" CRS-2674: Start of 'ora.LSNR_TEST.lsnr' on 'olvorap03' failed [orarx@olvorap03 ~]$ su - grid Password: [grid@olvorap03 ~]$ srvctl remove listener -l LSNR_TEST [grid@olvorap03 ~]$ srvctl add listener -l LSNR_TEST -p "TCP:1521" [grid@olvorap03 ~]$ srvctl config listener -l LSNR_TEST Name: LSNR_TEST Home: /opt/oracle/grid/11.2.0.2 End points: TCP:1521 [grid@olvorap03 ~]$ srvctl start listener -l LSNR_TEST [grid@olvorap03 ~]$ srvctl status listener -l LSNR_TEST Listener LSNR_TEST is enabled Listener LSNR_TEST is running on node(s): olvorap03 Kind regards, Freek D'Hooge Uptime Oracle Database Administrator email: freek.dhooge@xxxxxxxxx tel +32(0)3 451 23 82 http://www.uptime.be disclaimer: www.uptime.be/disclaimer -----Original Message----- From: oracle-l-bounce@xxxxxxxxxxxxx [mailto:oracle-l-bounce@xxxxxxxxxxxxx] On Behalf Of D'Hooge Freek Sent: zaterdag 15 januari 2011 0:35 To: Martin Berger Cc: cicciuxdba@xxxxxxxxx; oracle-l-freelists Subject: RE: listener... which home? Martin, You can create one in the db home, but you can't start it. No idea why they kept the option in the db home srvctl, but I found it out the hard way. Metalink note: Unable to Manage the Manually Configured Listener with Oracle Restart [ID 987825.1] [orarx@olvorap03 ~]$ which srvctl /opt/oracle/orarx/product/11.2.0.2/db_1/bin/srvctl [orarx@olvorap03 ~]$ srvctl add listener -l LSNR_TEST -p "TCP:1521" [orarx@olvorap03 ~]$ srvctl config listener -l LSNR_TEST Name: LSNR_TEST Home: /opt/oracle/grid/11.2.0.2 End points: TCP:1521 [orarx@olvorap03 ~]$ srvctl start listener -l LSNR_TEST PRCR-1079 : Failed to start resource ora.LSNR_TEST.lsnr CRS-2674: Start of 'ora.LSNR_TEST.lsnr' on 'olvorap03' failed CRS-2678: 'ora.LSNR_TEST.lsnr' on 'olvorap03' has experienced an unrecoverable failure CRS-0267: Human intervention required to resume its availability. CRS-5802: Unable to start the agent process Regards, Freek D'Hooge Uptime Oracle Database Administrator email: freek.dhooge@xxxxxxxxx tel +32(0)3 451 23 82 http://www.uptime.be disclaimer: www.uptime.be/disclaimer -----Original Message----- From: Martin Berger [mailto:martin.a.berger@xxxxxxxxx] Sent: vrijdag 14 januari 2011 20:56 To: D'Hooge Freek Cc: cicciuxdba@xxxxxxxxx; oracle-l-freelists Subject: Re: listener... which home? I assume this is not 100% correct. see the possibilities of srvctl: srvctl add listener -h Adds a listener configuration to the Oracle Clusterware. Usage: srvctl add listener [-l <lsnr_name>] [-s] [-p "[TCP:]<port>[, ...][/IPC:<key>][/NMP:<pipe_name>][/TCPS:<s_port>] [/SDP:<port>]"] [-o <oracle_home>] [-k <net_num>] -l <lsnr_name> Listener name (default name is LISTENER) -o <oracle_home> ORACLE_HOME path (default value is CRS_HOME) -k <net_num> network number (default number is 1) -s Skip the checking of ports -p "[TCP:]<port>[, ...][/IPC:<key>][/NMP:<pipe_name>][/TCPS:<s_port>] [/SDP:<port>]" Comma separated tcp ports or listener endpoints -h Print usage there you can define a oracle_home. This would not make sense if you MUST use the grid home - CRS would know about the grid_home quite well. So you can use any oracle_home which is supported in combination with the version of grid_home. Still I'd suggest to use the listener of your CRS as long as possible. br Martin Am 14.01.2011 um 18:32 schrieb D'Hooge Freek: > In 11.2 when you have grid infrastructure installed (which is, if I'm not > mistaken, required when using ASM), then the listener must be running from > the grid home (in your case called asm) when you want to control it via > srvctl. > It is still possible to start a listener from the db home by using lsnrctl > (and the listener.ora file), but this listener can't be controlled via srvctl > (and thus can't benefit from oracle restart). > > > Regards, > > Freek D'Hooge > Uptime > Oracle Database Administrator > email: freek.dhooge@xxxxxxxxx > tel +32(0)3 451 23 82 > http://www.uptime.be > disclaimer: www.uptime.be/disclaimer > --- > From: oracle-l-bounce@xxxxxxxxxxxxx [mailto:oracle-l-bounce@xxxxxxxxxxxxx] On > Behalf Of Guillermo Alan Bort > Sent: vrijdag 14 januari 2011 16:26 > To: oracle-l-freelists > Subject: listener... which home? > > hi guys, > > so, we have two homes in a server. One is /u01/app/asm, obviously this is > the ASM home. it's an 11g home as well. Then we have the > /u01/app/oracle/product/11.2.0 home which is the DB home. There is a single > DB in this server. The listener is running from /u01/app/asm/bin/tnslsnr.... > which to me is odd. Is there any reason you can think of for this? (I already > asked the previous owner of this server and they replied it was "by design"). > I can see some benefits (like in theory you don't need to bring down the > listener for $OH patching... and you usually have the ASM home in the latest > patch/version... > > what cons do you find in this? > > cheers > Alan.- > -- > //www.freelists.org/webpage/oracle-l > > -- //www.freelists.org/webpage/oracle-l -- //www.freelists.org/webpage/oracle-l