Find answers, ask questions, and connect with our
community around the world.

Forums Forums Search Engine Optimization Possibly pausing googlebot crawling your site

  • Possibly pausing googlebot crawling your site

  • Jacob

    Member
    July 30, 2019 at 8:09 pm

    If you have a SPA site and needed to upgrade the prerender box for it stopping googlebot from crawling the sitetemporarily would be great. Google is supposed to render js fine but many tests have shown it is not perfect yet. What do you think is the better way to pause googlebot from crawling site? Putting something in robots.txt or going into crawl settings and limiting the crawl rate? – by hq overview xeon1 – –

Viewing 1 of 1 replies
Reply to: Jacob
Your information:

Cancel
Original Post
0 of 0 posts June 2018
Now