Tom, v$streams_apply_server.message_sequence -- does this move or not (for apply server which is executing transaction)? Also, take a look at your v$streams_transaction to get an idea what kind of transaction you currently have. v$streams_apply_reader.total_messages_[dequeued/spilled] -- does that moves anywhere? On Fri, Dec 5, 2008 at 10:35 AM, Mercadante, Thomas F (LABOR) < Thomas.Mercadante@xxxxxxxxxxxxxxxxx> wrote: > Sql_id from v$session is null; > > > > Yes I enabled trace and all I can see are a couple of alter session sql > statements (like "skip disabled indexes") and then the "rdbms ipc" messages > below. It does not seem to be doing anything. > > > ------------------------------ > > *From:* Alex Fatkulin [mailto:afatkulin@xxxxxxxxx] > *Sent:* Friday, December 05, 2008 10:29 AM > *To:* Mercadante, Thomas F (LABOR) > *Subject:* Re: Data Guard Hanging > > > > Ok, EXECUTING TRANSACTION is a status of APPLY process, that is -- > v$streams_apply_process.status > > Can you please get SID from v$streams_apply_process where status is EXECUTE > TRANSACTION and then check v$session.sql_id for that SID? > > Also, am I understanding correctly that you have enabled trace for the > APPLY server with a status of EXECUTE TRANSACTION? > > On Fri, Dec 5, 2008 at 9:52 AM, Mercadante, Thomas F (LABOR) < > Thomas.Mercadante@xxxxxxxxxxxxxxxxx> wrote: > > Alex, > > > > The sql statement that gets returned when I run that query says "EXECUTING > TRANSACTION'. Not very helpful. > > I have traced the APPLY process per Oracle instructions. The only thing I > am seeing is: > > > > *** 2008-12-05 09:48:10.795 > > WAIT #0: nam='rdbms ipc message' ela= 81 timeout=500 p2=0 p3=0 obj#=-1 > tim=40075115529914 > > *** 2008-12-05 09:49:09.807 > > WAIT #0: nam='rdbms ipc message' ela= 74 timeout=500 p2=0 p3=0 obj#=-1 > tim=40075173159416 > > *** 2008-12-05 09:50:06.069 > > WAIT #0: nam='rdbms ipc message' ela= 86 timeout=500 p2=0 p3=0 obj#=-1 > tim=40075228102633 > > > > It just looks like it is waiting on something. The Log File Details page > in Grid shows that log files that need to be applied. Whenever we stop and > start the Apply process, is restarts back to the same place (Log # 167). > > > > So something is wacked (a technical term). > > > Thanks for any hints you can give. > > > > Tom > > > > > ------------------------------ > > *From:* Alex Fatkulin [mailto:afatkulin@xxxxxxxxx] > *Sent:* Friday, December 05, 2008 9:33 AM > *To:* Mercadante, Thomas F (LABOR) > *Cc:* oracle-l@xxxxxxxxxxxxx > *Subject:* Re: Data Guard Hanging > > > > Tom, > > if I understood correctly, in case you take sid from v$streams_apply_server > and join it to v$session the sql_id is empty? > > if it is, try enable sql trace with wait events and see what session is > doing. starce/truss might provide some low-level related information as > well (though sql trace should be enough). > > On Fri, Dec 5, 2008 at 8:36 AM, Mercadante, Thomas F (LABOR) < > Thomas.Mercadante@xxxxxxxxxxxxxxxxx> wrote: > > All, > > I am running a Data Guard with a Logical Standby on Aix V 10.2.0.4. > > This is our first run at this so we are still learning. > > > During my first large data load in the primary database, I ran out of room > in my tablespaces. The load died and I restarted it after fixing the > tablespaces. I then noticed that the DDL did not change the tablespaces in > the Logical Standby. I realized that this does not happen automatically > because > the Apply died. I changed the tablespaces in the Standby and restarted > Apply. Everything seemed to work fine. The data all got propagated over. > But now the Apply process seems to be hung – or very slow. We are about > 150 archivelogs behind. All of the monitoring sql's that Oracle Metalink > gives us shows that the apply process is just running "EXECUTE > TRANSACTION" – I can't see any sql statements being run. > > Anybody seen anything like this? We have an SR submitted with Oracle and > the have been actively asking questions but nothing so far. > > > Thanks > > > > Tom > > > > > -- > Alex Fatkulin, > http://www.linkedin.com/in/alexfatkulin > > > > > -- > Alex Fatkulin, > http://www.linkedin.com/in/alexfatkulin > -- Alex Fatkulin, http://www.linkedin.com/in/alexfatkulin