Select distinct values from a flat file

Shell Programming and Scripting
1

Hi ,
I have a similar problem.
Please can anyone help me with a shell script or a perl.
I have a flat file like this

fruit     country
apple     germany
apple     india
banana    pakistan
banana    saudi
mango     india

I want to get a output like

 
fruit       country
apple     germany
banana    pakistan
mango     india

Is there anyways this can be done?:mad::confused:

2 
awk '{a[$1]++}a[$1]<2' file
3

Thanks sir. Please also tell me how this can be sent to a file

4 
awk '{a[$1]++}a[$1]<2' file > new.file
5

Thanks Mate for this.
Unforfunately other module have decided to send a comma seperated file instead of space seperated. Please help again .
I have values like this now

INDIA,mango,2
PAK,mango,1
USA,apple,1
UK,apple,1
6

A little modificatiion to danmero solution...

awk -F, '{a[$1]++}a[$1]<2' file > new.file

i guess you might need to change $1 to $2...

7 
awk -F "," '{a[$2]++}a[$2]<2' file2

cheers,
Devaraj Takhellambam

8

Shorter:

awk -F "," '!a[$2]++' file