Deleting the similar lines

Shell Programming and Scripting
1

Dear Friends
myself Avinash working in bash shell
The problem goes like this
I have a file called work.txt [ the content of the file as follows]
assume that
first colum=mac address
second colum= IP
third colum = port number
----------------------------------------
00:12:23:34 192.168.50.1 2
00:12:23:35 192.168.50.1 5
00:12:23:36 192.168.50.1 8
00:12:23:34 192.168.50.1 2
00:12:23:37 192.168.50.1 12
00:12:23:38 192.168.50.1 14
00:12:23:39 192.168.50.1 11
00:12:23:34 192.168.50.1 2
-----------------------------------------
as u can observe the line "00:12:23:34 192.168.50.1 2" has repeated 3 times

my problem is i want to suppress all repeated lines to single line ie i want the output as
---------------------------------
00:12:23:34 192.168.50.1 2
00:12:23:35 192.168.50.1 5
00:12:23:36 192.168.50.1 8
00:12:23:37 192.168.50.1 12
00:12:23:38 192.168.50.1 14
00:12:23:39 192.168.50.1 11
------------------------------
Thanks for every one
Avinash. :confused:

2

cat work.txt | sort -u > new_work.txt

3

Found here: http://student.northpark.edu/pemente/sed/sed1line.txt (Thank you very much to the author - Mr. Eric Pement...got me through a lot :b::b:)

sort foo | sed '$!N; /^\(.*\)\n\1$/!P; D'

or

sed -n 'G; s/\n/&&/; /^\([ -~]*\n\).*\n\1/d; s/\n//; h; P' foo

You may also want to look at the uniq command

sort foo | uniq -u
sort foo | uniq -d
sort foo | uniq -c | awk '{print $NF}'