Submitting feedmap to Google Webmaster?

Thanx a lot folks for getting my query resolved!!!

Robots.txt

Robots.txt files are made for search engine crawlers to control the site access.  Before start searching a site all search engine crawlers go through robots.txt file. With appropriate standard robot meta tags one can block from accessing a folder, page or even the complete site

Structure of robots.txt file•    User-agent: the robot the following rule applies to (Google bot, yahoo bot etc)•    Disallow: the URL you want to block

Eg:User-agent: *Disallow: /folder1/User-Agent: GooglebotDisallow: /folder2/This robot meta tag specifies (1)  will block all the search engines from accessing the content of folder 1(2) Only Google will be blocked to access the content of folder 2 By Default all the blogspot blogs are coming with the following robots.txt meta tagUser-agent: Mediapartners-GoogleDisallow: User-agent: *Disallow: /search

It means that (1) nothing will be disallowed for Google  (2) Search pages will be blocked for all search engines. This technique is used to prevent the duplicate indexing of contents because the search pages contain duplicate content of the original posts. So nothing to worry about thatIn blogger, you cannot edit the robots.txt file, but in Wordpress blogs you can do that

but Sujith , if the robot.txt file keeps restricting my URLs , how wil google bot crawl my blog ?

It is restricting only the search urls

"restricting only the search urls" as in? isnt it the search urls only which index the pages and helps in the site being available on google and othe search engines?

The search folder of the blog contains the duplicate information For excample this is the url of your search folder

http://aashishsood.blogspot.com/search which contains the same information of http://aashishsood.blogspot.com/

So  it has to be prevented from indexing.

ohk... so irrespective of whether the robot is restricted or not... the content is indexed equally well... It is just to avoid duplicity? Right?

wow ! thanx for te great info Sujith, u rock ! now i hope te bots can crawl my blog ! thanx again !

Yes, All the pages of your blog will be crawled and indexed by search engines. robots.txt blocks only the search directory which contains the duplicate information of main blog.

Hi every body

I have put up the most easiest way to put up site map to all search engines on right hand column of my blog, above revolver maps just siole to click on it and add ur donain name, simple 

http://likemymusings.blogspot.com/

wen i saw te crawl stats , it says my Urls were restricted by robots.txt ! now wat in god's name is tat ???

he he... @Doc: Our queries seem to be same :D

@Aashish .... :)

I think you might have integrated the feeds with feeduburner so try to use this

atom.xml?redirect=false instead of atom.xml

wow ! now i got a tick ! thanx a ton !!! so tat means my sitemap is added to google?

wow! I got a tick as well!!! Guess this means that the sitemap is added... Thanx Sujith!!!

Another query though... Does it matter having a "Restricted by robots.txt" error?

@ sujith ji, great, very well explained., mine too i got it just now,

I don no if the site that submit to all seo is doing the job, or just cheating.

sud i delete the simple link fr it that i put up. on my blog ,.thanks,.

wen i submitted my sitemap , i got my blog address as prefix , so i wrote atom.xml , bt te status came "X" !

Uploaded with ImageShack.us

@Sujith..do i need to have a file by tat name in te blog? 

Uploaded with ImageShack.us

done tat , bt te status comes "X" ! :(

@ Just a pen : Login to google webmasters, then move to site settings and then to sitemap. There can add ur sitemap through atom.xml or rss.xml

i have created a sitemap from a site , but the file says "sitemap.xml" ...but when i go to the webmasters page to add tat , the option is like "http://my blog address" ...and then asks for te feed url , but in blogger , my feed url starts wid "http://feeds.feedburner......"

dnt understand tis tech stuff , plz elaborate if u cn , wud b a great help ...... 

There s no need to create a sitemap.xml file. Sujith has posted a screen shot . Hope it will be useful for u

very nice nandan.,

Just now checked with one of my dummy blogs. It's working perfectly.

First of all you must add your blog to webmaster tool then add site map for that blog. Just click subit sitemap button and enter only rss.xml or atom.xml

yourblog.blogspot.com/ will be automatically prefixed

@Aashish , where have u been adding it ?

in the sitemap tad on the left hand side

happens to me too , dnt have a sitemap , dnt even knw wat tat means ! :(

@Sujith , some help plz ...

Try to add site map

http://aashishsood.blogspot.com/rss.xml or

http://aashishsood.blogspot.com/atom.xml

let me chk that and then get back to you!

nopes... neither of them working... instantaneosly it is displaying a cross for both of them