delete from line and remove duplicates

Shell Programming and Scripting
1

My Input.....file1

ABCDE4435 Connected to 107.71.136.122 (SubNetwork=ONRM_RootMo_R SubNetwork=XYVLTN29CRBR99 MeContext=ABCDE4435 ManagedElement=1)	
ABCDE4478 Connected to 166.208.30.57 (SubNetwork=ONRM_RootMo_R SubNetwork=KLFMTN29CR0R04 MeContext=ABCDE4478 ManagedElement=1)	
ABCDE4478 Connected to 166.208.30.57 (SubNetwork=ONRM_RootMo_R SubNetwork=KLFMTN29CR0R04 MeContext=ABCDE4478 ManagedElement=1)	
ABCDE4503 Connected to 166.208.22.41 (SubNetwork=ONRM_RootMo_R SubNetwork=NSVLTR0R888 MeContext=ABCDE4503 ManagedElement=1)	
ABCDE4503 Connected to 166.208.22.41 (SubNetwork=ONRM_RootMo_R SubNetwork=NSVLTR0R888 MeContext=ABCDE4503 ManagedElement=1)

I need output like this....file2

ABCDE4435	XYVLTN29CRBR99
ABCDE4478	KLFMTN29CR0R04
ABCDE4503	NSVLTR0R888
2 
 awk '{sub(/SubNetwork=/,"",$6); print $1"\t"$6}' file1 > file2
1 Like
3 
awk -F'[= ]' '{a[$1" "$8]=$1" "$8} END{for(i in a) print a}' file1
1 Like
4

One method:

awk '{print $1,$6}' file1 | sed -e "s/SubNetwork=//g"|sort | uniq > file2

ABCDE4435 XYVLTN29CRBR99
ABCDE4478 KLFMTN29CR0R04
ABCDE4503 NSVLTR0R888
1 Like
5 
$
$ cat file1
ABCDE4435 Connected to 107.71.136.122 (SubNetwork=ONRM_RootMo_R SubNetwork=XYVLTN29CRBR99 MeContext=ABCDE4435 ManagedElement=1)
ABCDE4478 Connected to 166.208.30.57 (SubNetwork=ONRM_RootMo_R SubNetwork=KLFMTN29CR0R04 MeContext=ABCDE4478 ManagedElement=1)
ABCDE4478 Connected to 166.208.30.57 (SubNetwork=ONRM_RootMo_R SubNetwork=KLFMTN29CR0R04 MeContext=ABCDE4478 ManagedElement=1)
ABCDE4503 Connected to 166.208.22.41 (SubNetwork=ONRM_RootMo_R SubNetwork=NSVLTR0R888 MeContext=ABCDE4503 ManagedElement=1)
ABCDE4503 Connected to 166.208.22.41 (SubNetwork=ONRM_RootMo_R SubNetwork=NSVLTR0R888 MeContext=ABCDE4503 ManagedElement=1)
$
$
$ perl -lne 's/^(.*?)\s+.*SubNetwork=(.*?)\s+.*$/$1\t$2/; defined $x{$_}?"":print; $x{$_}++' file1
ABCDE4435       XYVLTN29CRBR99
ABCDE4478       KLFMTN29CR0R04
ABCDE4503       NSVLTR0R888
$
$

tyler_durden

6

Thanks a lot guys .......its working fine//////

Great help /////:):):):):):):):slight_smile: