Hi All,
I have requirement where multiple csv files are present in a directory and each file contains a header.I need to append the contents of all the files into one file by removing header.
Once the data is merged in one file ,I need to remove duplicates on nth column to find out distinct record on the merged file.Can anyone please help me with this through unix scripting.Thanks in advance.
Could you give a short example of input files and expected output file?
Did you make any attempt yet?
When removing duplicates, which of the records should be kept?