I have been looking into a problem that has plagued two of my most popular blogs for the past three months. Ever since I did an extensive re-build I have noticed a steady decline in traffic. No matter what I have attempted, I continued to lose traffic.

Someone asked me the other day to supply them with “the world according to Google stats” for one of the sites that I have for sale on this blog, and I responded that I just did not have that info as I find it unnecessary on a blog that is brand new …….. I mean ……… what’s the point? Plus I’m busier than a three legged cat in a sandbox, the last thing I need to do at this time is climb into Google’s sandbox and play.

I found myself with some spare time the other day and I thought that I would at least take a look at Google’s “Webmaster Tools” and discovered much to my dismay that the “Google Bot” was being blocked on two of my sites as per my “Robots.txt” file settings. Do What ???????? I have never had any type of “Robots.txt” file in any of my blogs.

I did a did a double check and ran a server side check on any and all “Robots.txt” files and the search came back negative. I did a general search engine check and found that my site was indexed and indexed as recently as a week ago. Ok ……… I just don’t get it!

After another two hours of searching, I came to the nasty understanding that the “Robots.txt” file that was causing all the trouble was a virtual file found at the bottom of the options table in my database for the WordPress Software; what was being indexed were the directory files of the site not my posts’ created by the WordPress Software. You just can’t think this stuff up! Wow ……… that was expensive!!!!!!

To avoid becoming road kill on the “Information Super Highway“, I present you with this Plug-in solution.