I'm looking to write a script that will do a find of directories and delete them if they are older than x days but keep the last x # of folders even if they are older than x days.
The usage is for a deployment location, so we want to keep the location clean but retain maybe the last 2 builds that have been deployed from a given folder. If there have been multiple builds in the last couple of days then we might want to keep more than 2 builds.
So the first criteria is keep a minimum of x builds.
The 2nd criteria is if they are less than 2 days old, keep more builds.
So I'm thinking I have to write something that does an ls -al, dumps to a temp file, removes the last 2 lines in that file or more lines if they are less than 2 days old and then uses that file to delete the folders.
I know the logic to do the find by date and delete, but I need to add the logic of keeping the last x builds to it. I'm just wondering about the best way to do this. Has anyone done something similar or have some suggestions?
So the ideal would be to keep the last 2 build#'s so you have the last successful deploy and the current one which may have multiple iterations but as the folder names are constantly changing that would be too difficult, this is an attempt to do the same thing with different logic.
Example 1 - would want to keep the last 2 folders from Dec 22/23
/Deployments1
drwxr-xr-x 18 wasadm wasgroup 4096 Dec 11 10:50 2.0.0.020.20091130-1446
drwxr-xr-x 18 wasadm wasgroup 4096 Jan 05 12:31 2.0.0.020.final.20091207-1048
drwxr-xr-x 18 wasadm wasgroup 4096 Dec 11 13:07 2.0.0.021.20091210-1236
drwxr-xr-x 19 wasadm wasgroup 4096 Dec 22 11:41 2.0.0.022.20091217-1126
drwxr-xr-x 18 wasadm wasgroup 4096 Dec 23 14:49 2.0.0.023.20091223-1155
Example 2 - in this case would keep the last 3 builds because they are within the 2 day criteria (would probably change this to something like a 7 day criteria so would actually be saving the last 4 builds)
/Deployments2
drwxr-xr-x 17 wasadm wasgroup 4096 Nov 17 21:52 2.0.0.019.20091117-1929
drwxr-xr-x 18 wasadm wasgroup 4096 Nov 19 00:50 2.0.0.019.20091118-1742
drwxr-xr-x 20 wasadm wasgroup 4096 Nov 25 12:59 2.0.0.020.20091124-1656
drwxr-xr-x 18 wasadm wasgroup 4096 Nov 26 10:49 2.0.0.020.20091125-1748
drwxr-xr-x 18 wasadm wasgroup 4096 Nov 26 22:24 2.0.0.020.20091126-1150
Even better would be to come up with logic that compared the first part of the folder name and if it is the same keep all those plus 1 more. ie. 2.0.0.020 - keep all that matched this, plus the last 2.0.0.019.
So you would want to save the most recent folder, any folders that match the same first 10 characters of that folder, and then the most recent folder before all of those folders. All other folders would be deleted.
---------- Post updated at 10:48 AM ---------- Previous update was at 09:20 AM ----------
I'm getting closer. This will give me that last build and any associated revisions of it. Now I just have to figure out how to add the last previous folder to this list, and then use this as an exclude list while I delete the other folders.
That's great and clearly cleaner than the round about way that I was trying to do it. I guess it's time to stop putting off learning awk and sed.
ls -r | awk -F. '{a=$1$2$3$4} b!=a {b=a;i++} i>2
I get that awk is splitting the name using the period with -F and grabbing the first 4 sections separated by a period ($1$2$3$4). Then you want b to be everything but a. Just need to understand this piece {b=a;i++} .
Guess I better find a good book on awk and sed.
I apologize for having edited my code after you saw it (at the time, i still had not seen this response).
The code extracts the current filename's build number into the variable a and compares it against the build number of the previous filename which is stored in b. If they are the same, nothing happens. If they are different, the current build number becomes the previous build number and i is incremented. i is the total number of build numbers encountered. when i exceeds 2, it starts printing the lines encountered (these are the directory names to be removed using xargs).