Re: 11.5.10.2 Wierd Issue

The issue is resolved now.
The NAS device where the Applications code tree are mounted is a 3-node RAID
5 configuration.
One of the node went down but did not show any error messages at all.
This was detected after 4 days :-)

We figured out the issue when we ran adadmin, and the workers were showing
in 'Running' status forever.
Relink did not work.

We copied an older version of the code tree to a new mount point and ran
adcfgclone.pl to fix the issue.

Thanks everyone for their support.

Regards,
Ashwin

On Sat, Jan 31, 2009 at 8:59 PM, Shyam Kumar <shyam4558@xxxxxxxxxxx> wrote:

> I suspect its issue with filesystem, are you using NFS for $APPLPTMP &
> $APPLCSF?
>
> Good Luck!
>
> ------------------------------
> Date: Fri, 30 Jan 2009 07:21:28 -0800
> Subject: Re: 11.5.10.2 Wierd Issue
> From: ashdbablog@xxxxxxxxx
>
> To: ora-apps-dba@xxxxxxxxxxxxx
>
> logins from both the tiers are working fine with no issues.
> autoconfig was also run successfully but the issue still persists.
>
> Regards,
> Ashwin
>
> On Fri, Jan 30, 2009 at 1:34 AM, Fadi Hasweh <fhasweh@xxxxxxxxxxx> wrote:
>
> check from the applicaiton tire.
> are you able to run sqlplus apps/apps.
> can you plz try to shutdonw every thing keep db and lsnr up run
> acutoncfongi on both db and apps tire.
> start every ting and try agin
> fadi
>
>
>
> ------------------------------
>
> Date: Fri, 30 Jan 2009 11:01:44 +0530
> From: balla+apps@xxxxxxxxxxx
> To: ora-apps-dba@xxxxxxxxxxxxx
> Subject: Re: 11.5.10.2 Wierd Issue
>
>
> check the db alert log,for any kind of messages related to redo log
> switching or archiving
>
> vasu
>
> Ashwin wrote:
>
> strace showed nothing.
> This is Red Hat 4.3 32-bit for database and apps
> No major activity was performed for the last 2 months, not even any patches
> applied :-)
>
> On Thu, Jan 29, 2009 at 8:30 PM, Vikram <vikramsingh120@xxxxxxxxx> wrote:
>
> Ashwin,
>
> Interesting! Can you run "strace -p <pid>" on the f60gen commands that are
> spawned as part of adadmin generating forms? Upload the trace file please.
> If strace is not available, try truss.
> Has there been any activity on the server before the issue was reported?
> What was the major activity performed successfully on this instance? and
> what was the first event that noticed this error?
> What OS is this server?
>
> -Vikram
>
> On Thu, Jan 29, 2009 at 10:49 PM, Ashwin <ashdbablog@xxxxxxxxx> wrote:
>
> List,
>
> I have a wierd issue.
> Our 11i instance reported concurrent manager problems and we restarted the
> apps services and the database.
>
> Current scenario: -
>
> - Oracle Database (9.2.0.6) and listener are up and running
> - Starting Apps services starts up everything but when we login to the
> forms, we are able to open the form but when we try closing the form, it
> hangs
> - The concurrent services start but nothing runs
> - We see processes for all the services but they do not run
> - Load average is 0.01, CPU usage around 0.6% which is never the case
> - adadmin run for generate of forms keeps the workers in 'Assigned' status
> and they never run.  They have to be killed.
>
> Its like they are frozen.  There is no activity.
>
> I checked the following: -
>
> - No errors in any log files i.e. alert logs, apache logs, concurrent
> manager logs (moved them and created new sets to avoid file size issues)
> - Archive log is enabled and working fine
> - All the Diagnostic tests from IZU_TOP as well as aoljtest are working
> fine.
> - APPLSYS, APPS, GUEST accounts are fine and validating
> - No end-dated or locked users in FND_USER or DBA_USERS
> - strace of f60webmx does not show any significant errors (except a phrase
> like "The Guest user cannot b" which is why i checked the GUEST user)
> - Relinked all executables
> - Ran autoconfig (it ran successfully)
>
> I have a Sev1 SR running but no significant throughputs.
>
> Nothing seems to resolve the issue.  Any ideas?
>
>
>
>
> --
> Vasu Balla
> DBA - The Pythian Group - www.pythian.com
>
>
> ------------------------------
> Get news, entertainment and everything you care about at Live.com. Check
> it out!
>
>
>
> ------------------------------
> Need more space to upload pictures? Get 25 GB online storage with Windows
> Live SkyDrive! Try it! <http://windowslive.com/Online/SkyDrive>
>

Other related posts: