[foxboro] Loss of access to CP's

  • From: "DUNHAM, KENNETH J" <kdunham@xxxxxxxx>
  • To: "'foxboro@xxxxxxxxxxxxx'" <foxboro@xxxxxxxxxxxxx>
  • Date: Sat, 3 Dec 2011 17:24:53 +0000

List,

Just wondering if anyone has seen any behavior like the below.

Following troubleshooting one of the redundant the Short Term AIM  
historian/OPC Servers  was rebooted to resolve a teamed network card issue.  
Upon rebooting, the historian failed to reconnect with the gateway to the plant 
computer.  Subsequently a number of other things occurred:

-The redundant historian connection to the plant computer failed.   It remained 
failed for a few seconds and then restored without intervention.  It continued 
to do this periodically.
-Other DCS displays on two other workstations  failed.  The data being viewed 
would "smurf" and then sometimes restore.  Two different CPs were involved.
-Individual using IACC to download changes to 050ACP (turbine controls control 
processor) was unable to download data to that CP.  Download messages were 
received indicating that the ICC Driver task could not communicate.
The rebooted historian showed the primary Network Interface Card (NIC) 
"disabled".

After Rebooting the historian again with the NIC enabled, the problem with 
communication seems to have resolved itself.  IACC download was successful.

I/A 8.3, AIM/OPC 3.3, IACC 2.3.1, P91 Boxes on Windows XP.

This is of great concern because it looked like the entire system may have 
become unresponsive.  I am speculating the rebooted historian generated a 
broadcast storm that overwhelmed the network.  Didn't have a sniffer hooked up 
at the time so we don't really know.

Has anyone experienced anything like this or have any thoughts or suggestions?

Kenneth Dunham
ERF/DCS System Engineer,
Fort Calhoun Station
9610 Power Lane, Blair, NE 68008
Mail Stop FC 1-9
Phone: (402) 533-6934
email: kdunham@xxxxxxxx<mailto:kdunham@xxxxxxxx>
Good judgement comes from experience.
Experience comes from bad judgement.
(Author Unknown)


----------------------------------------------------------------------
This e-mail contains Omaha Public Power District's confidential and proprietary 
information and is for use only by the intended recipient.  Unless explicitly 
stated otherwise, this e-mail is not a contract offer, amendment, or 
acceptance.  If you are not the intended recipient you are notified that 
disclosing, copying, distributing or taking any action in reliance on the 
contents of this information is strictly prohibited.
 
 
_______________________________________________________________________
This mailing list is neither sponsored nor endorsed by Invensys Process
Systems (formerly The Foxboro Company). Use the info you obtain here at
your own risks. Read http://www.thecassandraproject.org/disclaimer.html
 
foxboro mailing list:             //www.freelists.org/list/foxboro
to subscribe:         mailto:foxboro-request@xxxxxxxxxxxxx?subject=join
to unsubscribe:      mailto:foxboro-request@xxxxxxxxxxxxx?subject=leave
 

Other related posts:

  • » [foxboro] Loss of access to CP's - DUNHAM, KENNETH J