SEO Test

August 20, 2008

Google Sitemaps Robot identifies as Google-Sitemaps/1.0 and Firefox 1.5

Filed under: hacks — Crevete @ 10:30 am

A few days ago, I cought the Google Sitemaps robot (or maybe human?) crawling my website with two User Agents. The connection was coming from the same Google registered IP.

Here is a screenshot from cPanel’s recent visitor log analyser: Google Sitemaps User Agents

As you can see, five requests were made from 74.125.16.5 :

the first two agents identified themselves as “Google-Sitemaps/1.0” immediately after submitting my new website to Google Webmaster Tools for credentials, and a few hours later, three other page were grabbed identifying as “Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.7) Gecko/20060909 Firefox/1.5.0.7“. Curiously, the last three URL’s have the parameter “?8″ at the end…

IP Location: United States Mountain View Google Inc
IP Address: 74.125.16.5
Blacklist Status: Clear

Whois Record

OrgName:    Google Inc.
OrgID:      GOGL
Address:    1600 Amphitheatre Parkway
City:       Mountain View
StateProv:  CA
PostalCode: 94043
Country:    US
NetRange:   74.125.0.0 - 74.125.255.255
CIDR:       74.125.0.0/16
NetName:    GOOGLE
NetHandle:  NET-74-125-0-0-1
Parent:     NET-74-0-0-0-0
NetType:    Direct Allocation
NameServer: NS1.GOOGLE.COM
NameServer: NS2.GOOGLE.COM
NameServer: NS3.GOOGLE.COM
NameServer: NS4.GOOGLE.COM
Comment:
RegDate:    2007-03-13
Updated:    2007-05-22
OrgTechHandle: ZG39-ARIN
OrgTechName:   Google Inc.
OrgTechPhone:  +1-650-318-0200

I think this is manual (human) verification by the Google staff… what do you think?

No Comments »

Leave a comment

20 queries and 0.195 seconds.