Google Sitemaps Robot identifies as Google-Sitemaps/1.0 and Firefox 1.5
A few days ago, I cought the Google Sitemaps robot (or maybe human?) crawling my website with two User Agents. The connection was coming from the same Google registered IP.
Here is a screenshot from cPanel’s recent visitor log analyser: ![]()
As you can see, five requests were made from 74.125.16.5 :
the first two agents identified themselves as “Google-Sitemaps/1.0” immediately after submitting my new website to Google Webmaster Tools for credentials, and a few hours later, three other page were grabbed identifying as “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7“. Curiously, the last three URL’s have the parameter “?8″ at the end…
IP Location: United States Mountain View Google Inc IP Address: 74.125.16.5 Blacklist Status: Clear Whois Record OrgName: Google Inc. OrgID: GOGL Address: 1600 Amphitheatre Parkway City: Mountain View StateProv: CA PostalCode: 94043 Country: US NetRange: 74.125.0.0 - 74.125.255.255 CIDR: 74.125.0.0/16 NetName: GOOGLE NetHandle: NET-74-125-0-0-1 Parent: NET-74-0-0-0-0 NetType: Direct Allocation NameServer: NS1.GOOGLE.COM NameServer: NS2.GOOGLE.COM NameServer: NS3.GOOGLE.COM NameServer: NS4.GOOGLE.COM Comment: RegDate: 2007-03-13 Updated: 2007-05-22 OrgTechHandle: ZG39-ARIN OrgTechName: Google Inc. OrgTechPhone: +1-650-318-0200
I think this is manual (human) verification by the Google staff… what do you think?