Find all files before a certain date

UNIX for Beginners Q & A UNIX for Dummies Questions & Answers
1

Hi all,

I am a beginner and I was hoping you can help me out.

I am doing some PDF cleanup and I am looking for a command to search for all PDFs in a certain folder that are older than 2008 for example.

This is what I have so far:

find ./ -mtime +500 -name '*.pdf' >/test/results.txt

Would the above do it? obviously I would need to change the 500 to the correct number. Is there a way to specify the 2008 in the command?

Thanks,
Zig

2

Try this:

touch -m -d "2008-01-01 00:00:01" /tmp/file
find ./ \( ! -newer /tmp/file \) -name "*.pdf" >/test/results.txt
3

Thanks Xor

I am trying to clean up old/orphaned pdf files. I was wondering, is there a way I can run a grep while the find is running to search if each returned file name is linked from an HTML page?

I think I know how to do them individually but not sure how to do both at the same time.

find ./ -mtime +1460 -name '*.pdf'

find ./ -name '*.html' -exec grep -l 'filename' | grep :0$ {} \; 2>/dev/null 1>/test/results.txt

Thanks,
Zig

4

Please post what Operating System and version you are running and what Shell you use. There is some variation in the unix "touch" command and there is a lot of variation in the "find" command.

5

You might want to read this thread with a short explanation about how to combine various clauses of find . The thread deals with exactly your problem, btw..

I hope this helps.

bakunin

6

methyl, This is the box I am using:

SunOS 5.10 Generic_144488-11 sun4u sparc SUNW,Sun-Fire-V440

Shell: -ksh

Thanks for the link bakunin

7

On second thoughts you can write the output of the first "find" to an intermediate file and then use "grep -f" to read the patterns you search for from this file. Have a look at the man page of "grep" and look for the "-f" option, which is required by POSIX, so it should be there.

I hope this helps.

bakunin

8

Thanks Bakunin.

I ran the find pdf on its own and saved the output to a file. I have all the PDFs paths/filenames that meet my criteria.

When I was looking at grep -f, I could only find examples of reading pattern from file and searching in another file. How can I make it search the patterns in an entire folder?

So far all I find is similar to: grep -f file1 file2
Apologies in advance. I am very new to this.

Zig

9

Suppose you have a file file with the patterns you search for (the names of the .pdf files). How about something along the lines of:

 find /some/path -type f -name "*html" -exec grep -f file {} \;

I hope this helps.

bakunin

10

I tried the above and the grep command doesn't seem to work properly. I added a pdf to the pattern file that is linked from other pages but it wasn't found by the grep.
I am starting to think that the format of the patterns in the file matter. Is it possible it fails because of the format of the filenames in the pattern file? ie: abc-abc.pdf

11

So based on the above, I made a script that does the work:

#!/bin/ksh

for p in $(cat "path-to-patterns-file); do
    echo $p;
    find ./ -type f -name "*.html" -exec grep -l $p {} \; 2>/dev/null 1>>/path-ro-results;
done

I tested the above and it seems to work accurately. The PDF names are grabbed from the patterns file and the loop is working as expected as well. However, I calculated the amount of time it takes to complete a search for 1 file and it was 45 seconds. If I were to use 2000 pdfs file in the pattern, it would take 24 hours to complete all the searches.

I was wondering, is there a way to further optimize the script and speed it up. I was thinking for example if there is a way to stop the search once a single match is found and jump to the next pattern. I am only interested in PDFs with no results.

Thanks,
Zig

12

It's slow because you're running grep dozens to thousands of times for things it only needs to run a few times for. That's also a useless use of cat.

Your use of -l was a good idea, since it should stop at the first match in the file instead of hunting for all matches in a file.

The matching may not work because they're regular expressions, not filenames. Use -F to force grep to interpret the patterns as fixed strings instead.

Beware that blank lines in the file will mess it up. Everything matches against a blank expression.

Also, use xargs to run grep once for many files, which should help a lot.

find /some/path -type f -name "*.html"| xargs grep -l -F -f patternfile
13

For some reason the 1 line command doesn't work. This is what I have:

#!/bin/ksh

find /somepath -type f -name "*.html"| xargs grep -l -F -f /path-to-patterns-file {} \; 2>/dev/null 1>>/path-to-results;

The above doesn't return any results which is wrong. I am not sure what's wrong or if I have some syntax error somewhere.

14

I figured out why the command was failing. The box has two grep utilities and the default one didn't support -f option. Once I used the other one the script worked as expected. Now I just need to fix the output so I know which string is being searched for and which file they were found in.

I want to thank everyone who helped me with this script. I appreciate it.
Zig