The requested URL was rejected. Please consult with your administrator

Ggod evening.
I need your help please, in a Production system there is a process that download a xls file from an URL which is IMF(International Monetary Fund) and afterwards to be loaded into a databse table.
When testing conectivity from a unix server to IMF seems to work but when editing it yields an error:

wget http://www.imf.org/external/np/fin/rates/rms_five_pt.cfm

Output repsonding OK:
Connecting to IMF -- International Monetary Fund Home Page[23.14.80.171]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 188 [text/html]

but it is the problem when editing:

more rms_five_pt.cfm.18
<html><head><title>Request Rejected</title></head><body>The requested URL was rejected. Please consult with your administrator.<br><
br>Your support ID is: 3489631159782436117</body></html>

i dint know how to adress this problem if it has something to do with a network issue like firewall or any other restriction or has something to do a IMF problem or website problem etc.

as far as i know code has not been changed and i dont where to scalate this problem.

I would appreciate your help in advanced.

Hi.

I used wget and got the same message. However, with curl , I got:

<head><title>Document Moved</title></head>
<body><h1>Object Moved</h1>This document may be found <a HREF="http://www.imf.org/redirect/?URL=$V&404;http://prdwww-legacy-ext.imf.org:80/external/np/fin/rates/rms_five_pt.cfm">here</a></body>

Then playing with links2 http://www.imf.org/external/np/fin/rates/rms_five_pt.cfm , I was able to obtain a file, rms_five.xls :

SDRs per Currency unit and Currency units per SDR (1)
last five days
SDRs per Currency unit (2)

Currency        July 17, 2017   July 14, 2017   July 13, 2017   July 12, 2017   July 11, 2017
Chinese Yuan            0.1060520000    0.1061510000    0.1059300000    0.1059710000
Euro            0.8209440000    0.8217710000    0.8233320000    0.8218750000
Japanese Yen            0.0063363900    0.0063595900    0.0063376200    0.0063113200
...

On a sysem like:

OS, ker|rel, machine: Linux, 3.16.0-4-amd64, x86_64
Distribution        : Debian 8.8 (jessie) 
wget GNU Wget 1.16 built on linux-gnu.
curl 7.38.0 (x86_64-pc-linux-gnu) libcurl/7.38.0 OpenSSL/1.0.1t zlib/1.2.8 libidn/1.29 libssh2/1.4.3 librtmp/2.3
links2 - ( /usr/bin/links2, 2014-11-08 )

Best wishes ... cheers, drl

1 Like

Thanks for your help but i have a couple of questions.

  1. you test the url using 3 commands wget,curl2 and links2 and the only one that worked out was links2 command right ?

2- the wget comand used to work perfectly before july 1sth 2017 in an Unix system no linux (im not sure iF is HPUX)

  1. so to draw a conclusion where the problem arises since the wget command is failing from july 1sth.

Thanks for your help in advanced

Looks like that file / object has been moved / redirected?

so you mean the problem comes from IMF itself ?

thanks for your hrlp in advanced

---------- Post updated at 07:50 AM ---------- Previous update was at 05:59 AM ----------

The OS is SunOS 5.10 Generic_144488-01 sun4u sparc SUNW,SP

Hi.

The steps in my reply were 1) to make sure I got the same response as you, 2) to try a different download mechanism to see if it was different, and 3) to try a text-mode browser to see if it was able to figure out the URL.

So looking at the results, 1) I was able to verify your error, 2) I saw as RudiC pointed out that the file had apparently been moved at IMF and it showed a re-direct URL, 3)I noted the links2 browser was able to follow the re-direct, but it required some manual interaction.

I don't know anything about finances or the IMF, but I thought that the fiscal year rolled over at July 01, the date at which you seemed to start having trouble.

It's possible that wget and/or curl might have the ability to follow a re-direct, but if so, then they are not set to do that by default on my machine.

In poking around at the IMF, I was able to see lots of links at IMF Data , and some of them pointed to to places like: http://www.imf.org/external/np/sta/cdis/pdf/2015/042915.pdf

You may need to seek advice from IMF folks, and/or look around the IMF web-pages to see if the data in which you are interested can be found in some place other than the URL to which you usually use, in the manner you usually use.

Best wishes ... cheers, drl

Ok thanks you very much for your help, yuo wre realley helpful to me.

In some linux and unix machines instalations the links2 command was not found. it means it needed to be installed?

It might be just links, or might need to be installed. links is a web browser, more or less.

Hi.

Yes, as Corona688 wrote, links , although different from links2 worked for me as well. I think I decided usually to use links2 because it seemed to render HTML tables in text very well.

Below are details on some browsers that might be useful ... cheers, drl

links2  lynx-like alternative character mode WWW browser (man)
Path    : /usr/bin/links2
Version : - ( /usr/bin/links2, 2014-11-08 )
Type    : ELF 64-bit LSB executable, x86-64, version 1 (SYSV ...)
Help    : probably available with -h
Repo    : Debian 8.8 (jessie) 
Home    : http://links.twibright.com/ (pm)

links   lynx-like alternative character mode WWW browser (man)
Path    : /usr/bin/links
Version : - ( /usr/bin/links, 2014-11-08 )
Type    : ELF 64-bit LSB executable, x86-64, version 1 (SYSV ...)
Repo    : Debian 8.8 (jessie) 
Home    : http://links.twibright.com/ (pm)

lynx    a general purpose distributed information browser for ... (man)
Path    : /usr/bin/lynx
Package : lynx-cur
Home    : http://lynx.isc.org/
Version : Lynx Version 2.8.9dev.1 (12 Mar 2014)
Type    : ELF 64-bit LSB executable, x86-64, version 1 (SYSV ...)
Repo    : Debian 8.8 (jessie) 
Home    : http://lynx.isc.org/ (pm)

Whether its links or links2 depends on your distribution. That actually changed for me with an upgrade.