Google is everywere, even where and when you don't expect it to be

Oct. 7th, 2010 11:24 by Stéphane de LucaPermalink | TrackBack: https://stephanedeluca.com/trackback/878 — exists for 14 years & 2 months ago

Lately, as I was working with a friend on android on a new way to write native app more effectively, I stumbled upon something quite surprising.
We where doing an HTTP request to a server from within the android app, to a non existent URL, in order to catch the default user-agent of the sdk.
As we used a non existent URL for the first time ever there is no way googlebot could be aware of it. Nevertheless, I was surprised to see googlebot coming right after the expected request!

That means Android is used to sniff web servers

80.14.90.42 - - [07/Oct/2010:11:19:23 +0200] "GET /stephaXXXXXrze HTTP/1.1" 404 1399 "-" "Mozilla/5.0 (Linux; U; Android 2.1-update1; en-us; sdk Build/ECLAIR) AppleWebKit/530.17 (KHTML, like Gecko) Version/4.0 Mobile Safari/530.17" 66.249.66.187 - - [07/Oct/2010:11:19:33 +0200] "GET /stephaXXXXXrze HTTP/1.1" 404 1399 "-" "Mediapartners-Google" 80.14.90.42 - - [07/Oct/2010:11:19:39 +0200] "GET / HTTP/1.1" 200 23166 "http://mobilezoo.biz/stephaXXXXXrze" "Mozilla/5.0 (Linux; U; Android 2.1-update1; en-us; sdk Build/ECLAIR) AppleWebKit/530.17 (KHTML, like Gecko) Version/4.0 Mobile Safari/530.17"


Back