Website URLs are virtual real-estate. “Spiders” are the algorithms that search engines use.