| <META NAME=”robots” CONTENT=”noindex”> | Yahoo Slurp will retrieve the document, but it will not index the document. |
| <META NAME=”robots” CONTENT=”nofollow”> | Yahoo Slurp will not follow any links that are present on the page to other documents. |
| <META NAME=”robots” CONTENT=”noarchive”> | Yahoo maintains a cache of all the documents that we fetch, to permit our users to access the content that we indexed (in the event that the original host of the content is inaccessible, or the content has changed). If you do not wish us to archive a document from your site, you can place this tag in the head of the document, and Yahoo will not provide an archive copy(Cache) for the document. |
Yahoo Slurp indexes not only the title and meta tags, but also the full text of webpages. So including quality content in the webpage is as important as including keywords in the title and meta tags.
Yahoo searches for pages and when it finds a page with the required keyword, it lists the page in its SERPs. The position of the page depends on the content. But there are chances for a page with the required keyword being left out due to poor content or because Yahoo could not find the page.
How to attract Yahoo slurp to crawl the site ?
There are 3 ways you attract the Yahoo Crawler in crawling the site:
1. Get links from sites that are regularly crawled by the Yahoo Robot, If that is done Yahoo regular visits the site and crawls it, Regular Yahoo visit is a good sign and helps a lot of getting good Ranking,
2. As yahoo says you can trigger the Yahoo Robot by browsing a site using the Yahoo companion toolbar, Yahoo says this will trigger the Yahoo slurp Bot,
3. Through the Infamous PFI/PPC program sitematch, This type of inclusion guarantee’s an inclusion into the Yahoo index, so no problem using it,