Re: [foxboro] /var full, but none of the usual offenders

Cool, glad you got it fixed.

It's really tricky when programs are keeping files open by inode....
Perhaps a cp /dev/null <filename> might work.


Cheers,
Frits.

-----Original Message-----
From: foxboro-bounce@xxxxxxxxxxxxx [mailto:foxboro-bounce@xxxxxxxxxxxxx] On 
Behalf Of Kevin Fitzgerrell
Sent: Thursday, 5 November 2009 2:44 PM
To: foxboro@xxxxxxxxxxxxx
Subject: Re: [foxboro] /var full, but none of the usual offenders

Reboot fixed the problem.  Thanks Frits, it was likely a process holding a
file open by inode that we had cleaned at some point.
Regards,

Kevin

On Thu, Nov 5, 2009 at 10:27 AM, Fitzgerrell, Kevin <
Kevin_Fitzgerrell@xxxxxxx> wrote:

> Thanks Frits.
>
> It does not appear to be the online.log file this time, however we will try
> a reboot and see if Informix (or another process) is keeping something open.
>
> AW301F# du -sk *
> 82      adm
> 1       audit
> 2       crash
> 11      cron
> 16      log
> 1       lost+found
> 4       lp
> 2       mail
> 1       news
> 1       nis
> 1       opt
> 1       preserve
> 1869    sadm
> 2       saf
> 50      spool
> 4       statmon
> 49      tmp
> 10      uucp
> 4       yp
>
> Regards,
>
> Kevin
>
> -----Original Message-----
> From: foxboro-bounce@xxxxxxxxxxxxx [mailto:foxboro-bounce@xxxxxxxxxxxxx]
> On Behalf Of Schouten, Frits JF
> Sent: Thursday, November 05, 2009 10:17 AM
> To: 'foxboro@xxxxxxxxxxxxx'
> Subject: Re: [foxboro] /var full, but none of the usual offenders
>
> Hi Kevin,
> have you tried du -sk * in /var?
>
> btw. the most likely contender for filling up /var is /var/tmp/online.log.
> Deleting it will not clear it. Informix is keeping track of it by inode.
> A reboot or stop/start Informix is required to clear the space used up by
> online.log.
>
> Cheers,
> Frits.
>
> -----Original Message-----
> From: foxboro-bounce@xxxxxxxxxxxxx [mailto:foxboro-bounce@xxxxxxxxxxxxx]
> On Behalf Of Kevin Fitzgerrell
> Sent: Thursday, 5 November 2009 1:58 PM
> To: foxboro@xxxxxxxxxxxxx
> Subject: [foxboro] /var full, but none of the usual offenders
>
> Hi all,
> I've got an odd problem on one of my E box AWs.
>
> My /var partition is full (nothing unusual there), but we've gone through
> and can't find any of the usual offenders.  /var/adm/utmp,utmpx,wtmp,wtmpx
> are all small.  The cron and mail logs are also small, and there aren't any
> print jobs in the spool or lp directories.  Nothing unusual in /var/tmp.
>
> Checking for large files gets me very little:
>
> AW301F# df -kFufs
>
> Filesystem            kbytes    used   avail capacity  Mounted on
> /dev/md/dsk/d0         68571   27293   34428    45%    /
> /dev/md/dsk/d4        953015  398414  459301    47%    /usr
> /dev/md/dsk/d2         42655   42128       0   100%    /var
> /dev/md/dsk/d5       15281341 2297913 11455298    17%    /opt
> AW301F#cd /var
> AW301F# find . -fstype urfs -prune -o -type f -a -size +20 -ls
>
>  555 1416 -rw-r--r--  1 root     other     1436513 Nov 13  2001
> ./sadm/install/contents
> 18060   18 -rw-r--r--  1 root     other       18376 Jul 31  2001
> ./sadm/pkg/SUNWcsu/save/105256-01/undo.Z
>  243   21 -rw-r--r--  1 root     root        20571 Nov 13  2001
> ./sadm/pkg/SUNWcsu/pkginfo
>  470   11 -rw-r--r--  1 root     root        10421 Nov 13  2001
> ./sadm/pkg/SUNWcsr/pkginfo
>  362   29 -rw-r--r--  1 root     other       29403 Sep 30  1997
> ./sadm/pkg/SUNWidecr/install/postinstall
>  363   29 -rw-r--r--  1 root     other       29403 Sep 30  1997
> ./sadm/pkg/SUNWidecr/install/preremove
>  437   19 -rw-r--r--  1 root     root        19024 Jul 31  2001
> ./sadm/system/admin/.clustertoc
> 18058   11 -rw-r--r--  1 root     root        11013 Jul 31  2001
> ./sadm/system/logs/install_log
> 18080   13 -rw-r--r--  1 root     root        13252 Jul 31  2001
> ./sadm/system/logs/finish.log
>  353   24 -rw-r--r--  1 root     other       23623 Nov 13  2001
> ./sadm/patch/.patchDB
> 18271   11 -rw-r--r--  1 root     other       10897 Oct 23 14:51
> ./adm/messages.1
> 17665   40 -rw-r--r--  1 root     other       40543 Oct  8 18:54
> ./adm/messages.3
>  382   55 -rw-r--r--  1 root     sys         55353 Oct 23 14:54
> ./saf/zsmon/log
> 18006   19 -rw-rw-rw-  1 root     root        18972 Oct 23 14:54 ./saf/_log
>  617   11 -rw-rw----  1 root     informix    10623 Nov  4 23:18
> ./tmp/sysinfx.lOg
>
> I moved the biggest file (./sadm/install/contents) off to /opt and no
> change
> in the /var/ partition size.
>
> Any thoughts?
>
> I'm assuming I've likely got a file system problem.
>
> Regards,
>
> Kevin
>
>
>
>
> _______________________________________________________________________
> This mailing list is neither sponsored nor endorsed by Invensys Process
> Systems (formerly The Foxboro Company). Use the info you obtain here at
> your own risks. Read http://www.thecassandraproject.org/disclaimer.html
>
> foxboro mailing list:             http://www.freelists.org/list/foxboro
> to subscribe:         mailto:foxboro-request@xxxxxxxxxxxxx?subject=join
> to unsubscribe:      mailto:foxboro-request@xxxxxxxxxxxxx?subject=leave
>
>
>
>
> NOTICE - This message and any attached files may contain information that
> is confidential, legally privileged or proprietary. It is intended only for
> use by the intended recipient. If you are not the intended recipient or the
> person responsible for delivering the message to the intended recipient, be
> advised that you have received this message in error. Any dissemination,
> copying, use or re-transmission of this message or attachment, or the
> disclosure of any information therein, is strictly forbidden. BlueScope
> Steel Limited does not represent or guarantee that this message or
> attachment is free of errors, virus or interference.
>
> If you have received this message in error please notify the sender
> immediately and delete the message. Any views expressed in this email are
> not necessarily the views of BlueScope Steel Limited.
>
>
> _______________________________________________________________________
> This mailing list is neither sponsored nor endorsed by Invensys Process
> Systems (formerly The Foxboro Company). Use the info you obtain here at
> your own risks. Read http://www.thecassandraproject.org/disclaimer.html
>
> foxboro mailing list:             http://www.freelists.org/list/foxboro
> to subscribe:         mailto:foxboro-request@xxxxxxxxxxxxx?subject=join
> to unsubscribe:      mailto:foxboro-request@xxxxxxxxxxxxx?subject=leave
>
>
>
> _______________________________________________________________________
> This mailing list is neither sponsored nor endorsed by Invensys Process
> Systems (formerly The Foxboro Company). Use the info you obtain here at
> your own risks. Read http://www.thecassandraproject.org/disclaimer.html
>
> foxboro mailing list:             http://www.freelists.org/list/foxboro
> to subscribe:         mailto:foxboro-request@xxxxxxxxxxxxx?subject=join
> to unsubscribe:      mailto:foxboro-request@xxxxxxxxxxxxx?subject=leave
>
>




_______________________________________________________________________
This mailing list is neither sponsored nor endorsed by Invensys Process
Systems (formerly The Foxboro Company). Use the info you obtain here at
your own risks. Read http://www.thecassandraproject.org/disclaimer.html

foxboro mailing list:             http://www.freelists.org/list/foxboro
to subscribe:         mailto:foxboro-request@xxxxxxxxxxxxx?subject=join
to unsubscribe:      mailto:foxboro-request@xxxxxxxxxxxxx?subject=leave




NOTICE - This message and any attached files may contain information that is 
confidential, legally privileged or proprietary. It is intended only for use by 
the intended recipient. If you are not the intended recipient or the person 
responsible for delivering the message to the intended recipient, be advised 
that you have received this message in error. Any dissemination, copying, use 
or re-transmission of this message or attachment, or the disclosure of any 
information therein, is strictly forbidden. BlueScope Steel Limited does not 
represent or guarantee that this message or attachment is free of errors, virus 
or interference.

If you have received this message in error please notify the sender immediately 
and delete the message. Any views expressed in this email are not necessarily 
the views of BlueScope Steel Limited.
 
 
_______________________________________________________________________
This mailing list is neither sponsored nor endorsed by Invensys Process
Systems (formerly The Foxboro Company). Use the info you obtain here at
your own risks. Read http://www.thecassandraproject.org/disclaimer.html
 
foxboro mailing list:             http://www.freelists.org/list/foxboro
to subscribe:         mailto:foxboro-request@xxxxxxxxxxxxx?subject=join
to unsubscribe:      mailto:foxboro-request@xxxxxxxxxxxxx?subject=leave

Other related posts: