Ggod evening.
I need your help please, in a Production system there is a process that download a xls file from an URL which is IMF(International Monetary Fund) and afterwards to be loaded into a databse table.
When testing conectivity from a unix server to IMF seems to work but when editing it yields an error:
Output repsonding OK:
Connecting to IMF -- International Monetary Fund Home Page[23.14.80.171]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 188 [text/html]
but it is the problem when editing:
more rms_five_pt.cfm.18
<html><head><title>Request Rejected</title></head><body>The requested URL was rejected. Please consult with your administrator.<br><
br>Your support ID is: 3489631159782436117</body></html>
i dint know how to adress this problem if it has something to do with a network issue like firewall or any other restriction or has something to do a IMF problem or website problem etc.
as far as i know code has not been changed and i dont where to scalate this problem.
I used wget and got the same message. However, with curl , I got:
<head><title>Document Moved</title></head>
<body><h1>Object Moved</h1>This document may be found <a HREF="http://www.imf.org/redirect/?URL=$V&404;http://prdwww-legacy-ext.imf.org:80/external/np/fin/rates/rms_five_pt.cfm">here</a></body>
Then playing with links2 http://www.imf.org/external/np/fin/rates/rms_five_pt.cfm , I was able to obtain a file, rms_five.xls :
SDRs per Currency unit and Currency units per SDR (1)
last five days
SDRs per Currency unit (2)
Currency July 17, 2017 July 14, 2017 July 13, 2017 July 12, 2017 July 11, 2017
Chinese Yuan 0.1060520000 0.1061510000 0.1059300000 0.1059710000
Euro 0.8209440000 0.8217710000 0.8233320000 0.8218750000
Japanese Yen 0.0063363900 0.0063595900 0.0063376200 0.0063113200
...
On a sysem like:
OS, ker|rel, machine: Linux, 3.16.0-4-amd64, x86_64
Distribution : Debian 8.8 (jessie)
wget GNU Wget 1.16 built on linux-gnu.
curl 7.38.0 (x86_64-pc-linux-gnu) libcurl/7.38.0 OpenSSL/1.0.1t zlib/1.2.8 libidn/1.29 libssh2/1.4.3 librtmp/2.3
links2 - ( /usr/bin/links2, 2014-11-08 )
The steps in my reply were 1) to make sure I got the same response as you, 2) to try a different download mechanism to see if it was different, and 3) to try a text-mode browser to see if it was able to figure out the URL.
So looking at the results, 1) I was able to verify your error, 2) I saw as RudiC pointed out that the file had apparently been moved at IMF and it showed a re-direct URL, 3)I noted the links2 browser was able to follow the re-direct, but it required some manual interaction.
I don't know anything about finances or the IMF, but I thought that the fiscal year rolled over at July 01, the date at which you seemed to start having trouble.
It's possible that wget and/or curl might have the ability to follow a re-direct, but if so, then they are not set to do that by default on my machine.
You may need to seek advice from IMF folks, and/or look around the IMF web-pages to see if the data in which you are interested can be found in some place other than the URL to which you usually use, in the manner you usually use.
Yes, as Corona688 wrote, links , although different from links2 worked for me as well. I think I decided usually to use links2 because it seemed to render HTML tables in text very well.
Below are details on some browsers that might be useful ... cheers, drl
links2 lynx-like alternative character mode WWW browser (man)
Path : /usr/bin/links2
Version : - ( /usr/bin/links2, 2014-11-08 )
Type : ELF 64-bit LSB executable, x86-64, version 1 (SYSV ...)
Help : probably available with -h
Repo : Debian 8.8 (jessie)
Home : http://links.twibright.com/ (pm)
links lynx-like alternative character mode WWW browser (man)
Path : /usr/bin/links
Version : - ( /usr/bin/links, 2014-11-08 )
Type : ELF 64-bit LSB executable, x86-64, version 1 (SYSV ...)
Repo : Debian 8.8 (jessie)
Home : http://links.twibright.com/ (pm)
lynx a general purpose distributed information browser for ... (man)
Path : /usr/bin/lynx
Package : lynx-cur
Home : http://lynx.isc.org/
Version : Lynx Version 2.8.9dev.1 (12 Mar 2014)
Type : ELF 64-bit LSB executable, x86-64, version 1 (SYSV ...)
Repo : Debian 8.8 (jessie)
Home : http://lynx.isc.org/ (pm)