Apple Insider reports on the discovery of a web-crawling bot originating from Apple’s servers. It was first “outed” by developer Jan Moesen. This is what Moesen saw: Moesen reports that the bot is only crawling HTML, “not the CSS, JavaScript or image files.” Then he…
Please visit Search Engine Land for the full article.
