Shell script for log archiving

Shell Programming and Scripting
1

I have an nfs mount /logfile/project mounted on several of my application server machines. I have 5 jvms running on each machine and I have several machines. the jvms logs are created and rotated every day so it will look like

/jvm1/logs/server.log.2010-10-27
/jvm2/logs/server.log.2010-10-27
/jvm3/logs/server.log.2010-10-27
/jvm4/logs/server.log.2010-10-27
/jvm5/logs/server.log.2010-10-27
/jvm5/logs/server.log.2010-10-28

I would like to create 2 cronjobs
a) go to local directory on each machine and gzip the files everyday
b) move those files to the mountpoint /logfile/project/month-year and rename them to something like "hostname-jvm1-server.log.2010-10-27"
if we could add a check which will make sure the directory exists for each month that would be good too .

2

Here is a script for a)

ls /jvm[1-5]/logs/*server.log* | grep -v .gz | while read file
do
   gzip $file
done

How about this bash / ksh script for b)

host=$(hostname)
host=${host%.*}
MTH=$(date +%m-%Y)
# ensure at lease 1 file exists
[ "$(echo /jvm[1-5]/logs/*.gz)" = '/jvm[1-5]/logs/*.gz' ] && exit
for file in /jvm[1-5]/logs/*.gz
do
    topdir=${file#/}
    topdir=${topdir%%/*}
    base=$(basename $file)
    mkdir -p /logfile/project/$MTH
    mv $file /logfile/project/$MTH/${host}-${topdir}-${base}
done
3 
#!/bin/bash
logdir=/jvm[0-9]*/logs
logfiles=`find ${logdir} -type f`
todat=`date +"%Y-%m-%d"`

for i in `ls ${logfiles} | grep -v ${today}`
do
	gzip ${i}
	echo "File ${i} has been gziped"
done


#!/bin/bash
logdir=/jvm[0-9]*/logs
mountpoint=/logfile/project
hostname=`hostname`
for i in `ls ${logdir}/*gz 2>/dev/null`
do
	year=`echo ${i} | grep -o [0-9]*-[0-9]*-[0-9]* | awk -F'-' '{print $1}'`
	month=`echo ${i} | grep -o [0-9]*-[0-9]*-[0-9]* | awk -F'-' '{print $2}'`
	jvm=`echo ${i} | grep -o jvm[0-9]*`
	file=`echo ${i} | sed s+/.*/++g`
	newpath=${mountpoint}/${month}-${year}
	mkdir -p ${newpath} >/dev/null 2>&1
	mv ${i} ${newpath}/${hostname}-${jvm}-${file}
	echo "${i} has been moved to ${newpath}/${hostname}-${jvm}-${file}"
done
4

Thanks both work ..