Hi,
So I'm trying to find duplicate lines on a repertory that contains multiple files
the test of the command below is working on a folder with a little number of files :
grep -T -r . mainfolder | sort -k 2 | uniq -D -f 1
But my problem is that the reel test is a folder with 500000 files and the massage :
Argument list too long
Is there a way to do it please ?
Best Regards
Welcome!
Your given command cannot yield a "Argument list too long" error, because the arguments are fixed:
-T -r . mainfolder (4)
-k 2 (2)
-D -f 1 (3)
Please give the full command!
Hi,
Thank You!
I'm using : grep -T -r . * | sort -k 2 | uniq -D -f 1
as you can see, on screen shot below, I used it on a repertory with 46 files and I had the result
And used it on a repertory with more than 500000 files and I have the massage: argument too long
Aha, the * expands to too many arguments (filenames).
Try with . instead:
grep -T -r . . | sort -k 2 | uniq -D -f 1
The op originally asked to list the duplicated lines.
A clarification question for them...
Are the dupes -