Why do apache access log shows "GET robots.txt HTTP 1.1" 404 ?
Issue
Apache
access log shows follwoing messages,
63.249.66.212 - - [07/Dec/2013:12:11:02 +0800] "GET /robots.txt HTTP/1.1" 404 208
65.55.52.95 - - [07/Dec/2013:12:40:24 +0800] "GET /robots.txt HTTP/1.1" 404 208 "-" "Mozilla/5.
Environment
Red Hat Enterprise Linux x.x
Apache
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.