Testing Googlebot

Posted on November 17, 2013 by Fred Stiening

The new healthcare web pages are still invisible to Google – the only link to them is this blog, which I deliberately keep Google from seeing. So far Googlebot hasn’t visited the new pages. I’m going to add a visible link now and see how long it is before the eye that sees all, knows all finds my handiwork.

This entry was posted in About the Guide. Bookmark the permalink.

9 Responses to Testing Googlebot

  1. CC1s121LrBGT says:
    November 17, 2013 at 4:07 pm

    What if you bing the site? 😉

    Lycos, anyone?

  2. Art Stone says:
    November 17, 2013 at 8:31 pm

    I posted my message at 3:53 PM ET, then updated the web page.

    at 4:17, some random person followed the link, and then within half an hour Googlebot is on the job

    67.175.79.207 – – [17/Nov/2013:16:17:41 -0500] “GET / HTTP/1.1” 200 1652
    67.175.79.207 – – [17/Nov/2013:16:17:41 -0500] “GET /favicon.ico HTTP/1.1” 404 310
    66.249.66.123 – – [17/Nov/2013:16:43:54 -0500] “GET /robots.txt HTTP/1.1” 404 309
    66.249.66.123 – – [17/Nov/2013:16:43:54 -0500] “GET / HTTP/1.1” 200 1652
    66.249.66.123 – – [17/Nov/2013:16:51:13 -0500] “GET /health-insurance-list.php?state=SD HTTP/1.1” 200 542
    66.249.66.123 – – [17/Nov/2013:16:51:16 -0500] “GET /health-insurance-list.php?state=WV HTTP/1.1” 200 605
    66.249.66.123 – – [17/Nov/2013:16:51:19 -0500] “GET /health-insurance-list.php?state=OR HTTP/1.1” 200 497
    66.249.66.123 – – [17/Nov/2013:16:51:21 -0500] “GET /health-insurance-list.php?state=WY HTTP/1.1” 200 564
    66.249.66.123 – – [17/Nov/2013:16:51:24 -0500] “GET /health-insurance-list.php?state=ID HTTP/1.1” 200 501
    66.249.66.123 – – [17/Nov/2013:16:51:27 -0500] “GET /health-insurance-list.php?state=ND HTTP/1.1” 200 500
    66.249.66.123 – – [17/Nov/2013:16:51:33 -0500] “GET /health-insurance-list.php?state=NY HTTP/1.1” 200 2528
    66.249.66.123 – – [17/Nov/2013:16:51:38 -0500] “GET /health-insurance-list.php?state=TX HTTP/1.1” 200 1164

  3. CC1s121LrBGT says:
    November 18, 2013 at 5:28 pm

    hurry Hurry HURRY….

    Step right up!

    http://www.cnbc.com/id/101198671

    • Art Stone says:
      November 19, 2013 at 12:46 am

      I have read mixed things – one source had suggested insurers could apply for the subsidy on behalf of their customer without going through the exchange, and certainly this isn’t going to happen every year, is it?

      Who is the gatekeeper that the person applying is not in the country illegally?

      Keep in mind the subsidy is an advance against a tax credit applied at the end of the tax year. What happens if someone takes the subsidy and then never files a tax return to prove they were entitled to the credit. In NC (because they rejected Medicaid expansion, a single person below $15,000 is entitled to $0.00

      A person making $16,000 is entitled to around $6,000 in subsidy.

  5. Art Stone says:
    November 19, 2013 at 2:00 pm

    The chinese have found me:

    182.118.35.18 – – [19/Nov/2013:13:54:13 -0500] “GET /robots.txt HTTP/1.1” 404 309 “http://health-care.streamingradioguide.com/robots.txt” “Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; MDDR; .NET4.0C; .NET4.0E; .NET CLR 1.1.4322; Tablet PC 2.0)”

    About the only way that is possible is Google is feeding crawler data to the Chinese. The records only wind up in this log if you use health-care. as the server name – there are only 3 ways I can think of that this is knowable – loading the pages here that have the link, getting the information from Google, or looking at dns databases and seeing that I added a sub-domain

Leave a Reply