Space on device problems...

Ok, don't shoot me! I have looked all over the forum for the issue I'm having and I don't think its a duh delete some files or I deleted them but its still showing 100% type thing.

This morning one of my servers starts crying that it can't write log files and I can't use vi etc.... when I check the usages I see this:

$ df -k
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/dsk/c1t0d0s0 16140362 3816860 12162099 24% /
/dev/dsk/c1t0d0s5 28242791 22188232 5772132 80% /var
swap 7502984 40 7502944 1% /var/run
swap 7743392 240448 7502944 4% /tmp
/dev/dsk/c1t0d0s3 17954570 1825958 15949067 11% /opt
/dev/dsk/c1t0d0s7 1988887 1261080 668141 66% /export/home

Nothing is 100%.... is this a bug that it is really 100% but showing 80%? I haven't deleted any files yet or anything so I'm kind of lost as to what to check now. :confused:

I also tried to run sync a few times to see if that helped with inode issues....nothing

This is my inode info which also looks ok...(i think)

$ sudo df -F ufs -i
Filesystem Inodes IUsed IFree IUse% Mounted on
/dev/dsk/c1t0d0s0 1943168 91756 1851412 5% /
/dev/dsk/c1t0d0s5 3393024 1571342 1821682 47% /var
/dev/dsk/c1t0d0s3 2159744 30481 2129263 2% /opt
/dev/dsk/c1t0d0s7 486720 7979 478741 2% /export/home

I removed a file from /var/tmp and now its down to 78% full and it works... could this be a disk quota thing which i've never used before?

To reconcile the df output with the file sizes, try having a play with du -skd on some of those filesystems:

for fs in `df -k | awk '{ print $6 }'` ; do du -skd $fs ; df -k $fs ; done

It won't fix anything but it has found discrepancies for me when I've got a munted file somewhere. Might narrow down the search?

pfiles can be your friend here too but only once you've narrowed down possible culprits.