Crawl allowed? problem solved 100%
Hello friends,
Those who are viewing my post must have blogger / blogspot site.
At this time blogger / blogspot is one of the means of online income
I have been experiencing a problem on the blogger / blogspot site for a long time. When the category / label of my site Submitted to Google search engine Then there was an error.
The error like looking :-
blogspot Crawl allowed? error No: blocked by robots.txt Page fetch error Failed: Blocked by robots.txt
I have found a solution to solve this, maybe everyone will find it useful
- FIRST GO TO ON YOUR BLOGGER SETTINGS
- THEN CLICK ON CUSTOM ROBOTS.TXT AND MAKE IT ON
- THEN CASTOM ROBOTS.TXT BOX
AND PAST THE CODE ON THE BOX
User-agent: *
Disallow:
Allow: /search
Sitemap: https://yoursite.blogspot.com/sitemap.xml?redirect=false&start-index=1&max-results=500
Dont forget to replace yoursite.blogspot.com to yoursite
4.NOW CLICK ON SAVE BUTTON