Helping Google Search See More of Your Blogger Blog

You can help Google search find and keep current with the posts in your blog by using the Google Webmaster tools. Login to the Google Webmaster control panel and then you tell it where there are sitemaps that describe your site (or blog) content. Conveniently enough, RSS and ATOM feeds can be used as sitemaps because they describe where your posts are. Basic use of the Google Webmaster tools is fairly self-explanatory but if you have questions, the on-line help should do the trick.
However, ATOM and RSS feeds for a blog typically only have the latest 10-30 posts listed. If you have a large blog (100s of posts) this provides Google only the most recent updates to your blog. Probably not a problem if you have been using the Google Webmaster tools on your blog from the beginning as then Google will have been reading your site feeds as they are updated. However, if you start using the Google Webmaster tools after your blog already had many posts, you may find the older posts aren't shown in Google searchs.
One way around this is to provide Google with multiple feeds about your site. With many blog tools, feeds are available for posts by topic. Google's own Blogger service supports this and I use this on my own blog.
So, to get Google search to see more of the posts in your blog, all you have to do is load these additional feeds into the Google Webmaster tools.
Ah, but there is a wrinkle and that is that Google Webmaster tools is very picky about where these feeds are located. If the site I register with Google Webmaster tools is www.BrianLawler.org then it allows me to load sitemaps with URLs in www.BrianLawler.org (e.g. www.BrianLawler.org/atom.xml) or a sub-directory of www.BrianLawler.org (e.g. www.BrianLawler.org/blog/atom.xml). If you are using another domain (e.g. ww2.BrianLawler.org or www.BrianLawler.net) to provide those topic or label based feeds of you site/blog content, you won't be able to load those URLs.
How to get around this?
If your site or blog is hosted by a server that supports some kind of scripting (ASP, PHP, etc.) then you can write a little script on your server that facades the content from another server.
Here is an example in ASP.Net using C#

<script runat="server">
protected void Page_Load(Object sender, EventArgs e)
{
  XmlDocument doc = new XmlDocument();
  doc.Load("http://www2.blogger.com/feeds/19459839/posts/default/-/UML/");
  Response.ContentType = "text/xml";
  doc.Save(Response.Output);
}
</script>
In this case, my blog might be at www.BrianLawler.com/blog but the label feeds are coming from ww2.blogger.com. Google Webmaster tools wouldn't let me add the feeds from ww2.blogger.com as sitemaps for www.BrianLawler.com/blog but if I store the script above at the URL www.BrianLawler.com/blog/rss-UML.aspx then that URL can be loaded to the Google Webmaster tools and now all of the posts on a topic ("UML" in this example) will also be known to the Google search engine.
This is also easily done in PHP using the fopen function.

No comments: