Google Indexing Report

29th Feb 2008

In the Labs -> Google Indexing Report, you are able to get a detailed report of which pages on a domain have been indexed versus the pages that have not been indexed. The script crawls your site, then looks up each page and sees if it was in googles index. Once its done it displays the report which shows the percentage of pages indexed as well the numerical counts. It also gives you the list of pages that are not in the index.

The pages not in the index are pages that should be submitted to squirt. This will help ad multiple starting points into squirt.

 Also this pulls from the Google SOAP api which doesn’t always give the exact same information as the google.com search. Its also worth mentioning that google has hundreads of datacenters and the results vary from datacenter to datacenter.

A note about other updates.

It has been brought to my attention that there is software out that does a good job of transfering files from one ftp site to another ftp site. The http://www.wsftp.com/products/ws_ftp_professional/ WS FTP Professional allows you to connect to two ftp sites and transfer between those.

The next scheduled update is the “limited” member based invitation system.

Also for the Feb 15th update - forgot to make a post on this.. The template is undergoing some major overhauls.. Some of these are still being ironed out..