Why do apache access log shows "GET robots.txt HTTP 1.1" 404 ?
Issue
Apacheaccess log shows follwoing messages,
63.249.66.212 - - [07/Dec/2013:12:11:02 +0800] "GET /robots.txt HTTP/1.1" 404 208
65.55.52.95 - - [07/Dec/2013:12:40:24 +0800] "GET /robots.txt HTTP/1.1" 404 208 "-" "Mozilla/5.
Environment
Red Hat Enterprise Linux x.x
Apache
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.
Close
Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.