11.5.10.2 Wierd Issue

List,

I have a wierd issue.
Our 11i instance reported concurrent manager problems and we restarted the
apps services and the database.

Current scenario: -

- Oracle Database (9.2.0.6) and listener are up and running
- Starting Apps services starts up everything but when we login to the
forms, we are able to open the form but when we try closing the form, it
hangs
- The concurrent services start but nothing runs
- We see processes for all the services but they do not run
- Load average is 0.01, CPU usage around 0.6% which is never the case
- adadmin run for generate of forms keeps the workers in 'Assigned' status
and they never run.  They have to be killed.

Its like they are frozen.  There is no activity.

I checked the following: -

- No errors in any log files i.e. alert logs, apache logs, concurrent
manager logs (moved them and created new sets to avoid file size issues)
- Archive log is enabled and working fine
- All the Diagnostic tests from IZU_TOP as well as aoljtest are working
fine.
- APPLSYS, APPS, GUEST accounts are fine and validating
- No end-dated or locked users in FND_USER or DBA_USERS
- strace of f60webmx does not show any significant errors (except a phrase
like "The Guest user cannot b" which is why i checked the GUEST user)
- Relinked all executables
- Ran autoconfig (it ran successfully)

I have a Sev1 SR running but no significant throughputs.

Nothing seems to resolve the issue.  Any ideas?

Other related posts: