- Subscribe to RSS Feed
- Mark Thread as New
- Mark Thread as Read
- Float this Thread for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
Site is not being indexed on Google
Hello there,
My web site https://www.elitecabs.co.uk is not being indexed by Google. I have waited for over 3 weeks now. I have had a look at the robots file on Google Webmaster and it adds below into it. Does this stop the Google to index the website? How can I get rid off these two lines?
User-agent: NerdyBot
Disallow: /
Thanks,
Imran
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report
- Subscribe to RSS Feed
- Mark Thread as New
- Mark Thread as Read
- Float this Thread for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
Hi @immy,
Weebly automatically creates a blank robots.txt file for your site. Google occasionally has difficulty crawling a site and will then send a message like that. They make errors on a regular basis and it's not something to worry about. If this is a false positive, it should be cleared up the next time Google crawls your site.
For more information on your Robots.txt file, check out our help guide here:
https://hc.weebly.com/hc/en-us/articles/216567308-Working-With-Your-Robots-txt-File
But in general, as far as SEO, it can take a number of weeks for a new site to index.
- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Permalink
- Report