Encoding of a text issue

Shell Programming and Scripting
1

I created one file on windows system and is visible as :

TestTable,INSERT,�veilnin1,2010-02-02 10:10:10.612447,137277,�veilnin!@#$%^&*()_+=-{}][:;"<>?/.'|\`~@email.com,10021/1.0.0.112,    maa6�uval �veilnin � 6 a �t�Sein  ,2010-02-02 10:10:10.612447

But when send this file to unix system, the file is visible as :

TestTable,INSERT,žve�ilnin1ई�-ल �-害�...是第,2010-02-02  10:10:10.612447,137277,ई�-ल�-害�...是第žve�ilnin!@#$%^&*()_+=-{}][:;"<& gt;?/.'|\`~@email.com,10021/1.0.0.112,واندلعت بعد  ذلك انه �ξ�*σπασ�-嚼�香�-强maĉa� 牲�...6���-�Žuvalหัวใจข�*งเขาโขล� žve�ilnin ° 6 a  étéSeinרייסט �ַר�ָפּ �יןई�-ल�-害�...是第,2010-02-02 10:10:10.612447

How can i see the file in it's original form in unix systems as well ?

2

What are the encoding schemes on both machines? You'll have to either switch one of the encoding schemes or to convert the file (recode, iconv, dos2unix, ...)

3

in windows, the file was opened with UTF-8 and in unix system , it was
en_US.UTF-8, found by

echo $LANG
4

Using en_US.UTF-8 on a Unix system, I get:

$ cat infile
TestTable,INSERT,�veilnin1,2010-02-02 10:10:10.612447,137277,�veilnin!@#$%^&*()_+=-{}][:;"<>?/.'|\`~@email.com,10021/1.0.0.112,    maa6�uval �veilnin � 6 a �t�Sein  ,2010-02-02 10:10:10.612447

What is the output of

locale

on your Unix system?

It could be that the file is in different format when stored on your windows system, then when it is pasted into a web page.. Could you post the original Windows file?

5 
!@#$%^&*()_+=-{}][:;"<>?/.'|\`~

vs

!@#$%^&*()_+=-{}][:;"<& gt;?/.'|\`~

See the & gt; part? Figure out why that is there and you will be on your way to a solution. Think!