Hi All,
I have multiple files and i need to segregate unique and duplicates into files.
Eg: /source/ -- path
abc_12092016.csv
abc_11092016.csv
abc_12092016.csv
ID,NAME,NUMBER
1,XYZ,1234
2,SDF,3456
1,XYZ,1234
abc_11092016.csv
4,RTY,7890
6,WER,5678
8,YUI,0987
6,WER,5678
in the source folder it may be 2 files today and tomorrow 3 files etc..
from each file the unique and duplictes hvae to be segregated and loaded
result--
abc_12092016.csv
ID,NAME,NUMBER
1,XYZ,1234
2,SDF,3456
abc_11092016.csv
ID,NAME,NUMBER
4,RTY,7890
6,WER,5678
8,YUI,0987
abc_12092016_dup.csv
ID,NAME,NUMBER
1,XYZ,1234
abc_11092016_dup.csv
ID,NAME,NUMBER
6,WER,5678
a script will do fine....