Remove line breaks in csv file using shell script

Shell Programming and Scripting
1

Hi All,

  I've a csv file in which the record is getting break into 1 line or more than one line. I want to combine those splits into one line and remove the unwanted character existing in the record i.e. double quote symbol \("\). The line gets break only when the record contains double quote\("\) symbol. Please find the following current and expected csv file format.

Current CSV file:

TESTID1|ACTIVE|Todd|Geller|Marketing Dir-Sales Model (IC)|TIER1
TESTID2|ACTIVE|Todd|Geller|Marketing Dir-Sales Model (MCA)|TIER2
TESTID3|ACTIVE|Todd|Geller|"Marketing Dir-Sales
 Model (MCA)"|TIER4
TESTID3|ACTIVE|Todd|Geller|"Marketing Dir
 
         -Sales
 
 Model (MCA)"|TIER4

Expected CSV file:

TESTID1|ACTIVE|Todd|Geller|Marketing Dir-Sales Model (IC)|TIER1
TESTID2|ACTIVE|Todd|Geller|Marketing Dir-Sales Model (MCA)|TIER2
TESTID3|ACTIVE|Todd|Geller|Marketing Dir-Sales Model (MCA)|TIER4
TESTID3|ACTIVE|Todd|Geller|Marketing Dir-Sales Model (MCA)|TIER4

      I know its bit difficult to find the solution but it would be great if anyone can help me out in getting the script prepared to fix this issue.

Thanks in Advance.

2 
$ awk 'ORS=!/\|TIER[0-9]*$/?FS:RS' infile | sed 's/\"//g;s/  //g'
TESTID1|ACTIVE|Todd|Geller|Marketing Dir-Sales Model (IC)|TIER1
TESTID2|ACTIVE|Todd|Geller|Marketing Dir-Sales Model (MCA)|TIER2
TESTID3|ACTIVE|Todd|Geller|Marketing Dir-SalesModel (MCA)|TIER4
TESTID3|ACTIVE|Todd|Geller|Marketing Dir-SalesModel (MCA)|TIER4
3

Try this (not tested):

awk -F"|" '{while(NF < 6){s=$0;getline;gsub(/^[ \t]+/,x); $0=s $0; gsub(q,x)}}1' q=\' file
4

Thank you cabrao and Franklin for your responses.

  I tried the following code but didn't work. Please suggest.

#!/bin/bash
awk -F"|" '{while(NF < 6){s=$0;getline;gsub(/^[ \t]+/,x); $0=s $0; gsub(q,x)}}1' q=\' ISM_FEED_20120607.csv >> test.csv

Please suggest.

5

I can't with the info above...