Wget download file content in unicode

Shell Programming and Scripting
1

Hi All,

I am trying to download a XML from a URL through wget and successful in that but the problem is that I have to check for some special characters inside that XML. But when I download through wget it transfers the content of the XML in plain text and I'm not able to search for those characters while if I open the file in any plain text editor I can see those characters.

See attachment, the character

EM

there becomes

^

Can you please tell me how to download the file through wget preserving the character set, it's UTF-8 btw?

 
wget --no-check-certificate --http-user="${username}" --http-password="${password}"  ${website}/test.XML

In one website I was option -r --remote-encoding=UTF-8 to be set but it's not working.
Error:

 
wget: unrecognized option `--remote-encoding=UTF-8'
Usage: wget [OPTION]... ...
Try `wget --help' for more options.

wget version -

 
GNU Wget 1.11.4 Red Hat modified
Copyright (C) 2008 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later
<http://www.gnu.org/licenses/gpl.html>.

-dips

2

My wget on red hat supports --local-encoding=<encoding> and --remote-encoding=<encoding> switches. See the man page for your wget. Not sure this will help, but something to try.

3

If it is utf-8, what is a "special" character? A character may be many bytes. It's not going to look good if it goes past ASCII range in any app not UTF-8 handling.