Unable to read special character from the file

Shell Programming and Scripting
1

Hello All,
We are getting files from sftp server through file transmission protocol & after transmission we are removing all the control M
(^M) characters from them.we are expecting various kind of special characters in the files.
we are tried removing '^M' characters through 'dos2unix' command then we are not able to read greek character 'mu' character,'dos2unix' is replacing 'mu' with some unknown boxes (actually it's changing ASCII value of mu to other ASCII value).

When we removed ^M from 'sed' command then : we are not able to read pound character (Britain currency).
The same problem exists 'tr' command.

Can anybody help us on handling the any special character in the files.

2

Hi.

Can you show the sed you are using?

sed "s/^M$//" input_file > output_file
or
tr -d '^M' < input_file > output_file

(using ^V ^M to get the ^M character - the ^ does not mean at the start of the line!)

3

Currently we are getting '^M' characters at the end but it's not compulsory these will come at tend of the line only. So we are using following commands to handle these.