HTTP Headers Reference: HTTP Status-Codes

Hypertext Transfer Protocol -- HTTP/1.1 for Reference - HTTP Headers

10 Status Code Definitions

Each Status-Code is described below, including a description of which method(s) it can follow and any metainformation required in the response.

FWIW, we are starting to configuration our web server to return the 403 Forbidden status code for robots and spiders who do not follow our robots.txt directives.