SEO frinedly website - robots.txt
What is robots.txt and how to create it ?
robots.txt is a file that can be created by any text editor like notepad++ etc. robots.txt is a file which tells web robots which pages on your website to crawl and pages not to crawl as well. Searchengine will check robots.txt for instructions before crawling your website pages. Create this file and place it in root folder of your website.Allow Searchengine to crawl your entire website pages
User-agent:*
Disallow: