Amazonbot is finally respecting robots.txt
Amazonbot, Amazon's web crawler, has started respecting the robots.txt file, which allows website owners to control automated access. The author thanks Amazon for this change, noting it helps support a viable business model for smaller sites.