Skip to content
    Moz logo Menu open Menu close
    • Products
      • Moz Pro
      • Moz Pro Home
      • Moz Local
      • Moz Local Home
      • STAT
      • Moz API
      • Moz API Home
      • Compare SEO Products
      • Moz Data
    • Free SEO Tools
      • Domain Analysis
      • Keyword Explorer
      • Link Explorer
      • Competitive Research
      • MozBar
      • More Free SEO Tools
    • Learn SEO
      • Beginner's Guide to SEO
      • SEO Learning Center
      • Moz Academy
      • SEO Q&A
      • Webinars, Whitepapers, & Guides
    • Blog
    • Why Moz
      • Agency Solutions
      • Enterprise Solutions
      • Small Business Solutions
      • Case Studies
      • The Moz Story
      • New Releases
    • Log in
    • Log out
    • Products
      • Moz Pro

        Your all-in-one suite of SEO essentials.

      • Moz Local

        Raise your local SEO visibility with complete local SEO management.

      • STAT

        SERP tracking and analytics for enterprise SEO experts.

      • Moz API

        Power your SEO with our index of over 44 trillion links.

      • Compare SEO Products

        See which Moz SEO solution best meets your business needs.

      • Moz Data

        Power your SEO strategy & AI models with custom data solutions.

      Save big on Moz Pro!
      Limited time offer

      Save big on Moz Pro!

      See pricing
    • Free SEO Tools
      • Domain Analysis

        Get top competitive SEO metrics like DA, top pages and more.

      • Keyword Explorer

        Find traffic-driving keywords with our 1.25 billion+ keyword index.

      • Link Explorer

        Explore over 40 trillion links for powerful backlink data.

      • Competitive Research

        Uncover valuable insights on your organic search competitors.

      • MozBar

        See top SEO metrics for free as you browse the web.

      • More Free SEO Tools

        Explore all the free SEO tools Moz has to offer.

      Access the Moz API for less
      Save on Moz Data

      Access the Moz API for less

      Hurry - ends Dec 6th!
    • Learn SEO
      • Beginner's Guide to SEO

        The #1 most popular introduction to SEO, trusted by millions.

      • SEO Learning Center

        Broaden your knowledge with SEO resources for all skill levels.

      • On-Demand Webinars

        Learn modern SEO best practices from industry experts.

      • How-To Guides

        Step-by-step guides to search success from the authority on SEO.

      • Moz Academy

        Upskill and get certified with on-demand courses & certifications.

      • SEO Q&A

        Insights & discussions from an SEO community of 500,000+.

      Save 20% on all Moz Academy courses
      Limited time offer

      Save 20% on all Moz Academy courses

      Level up your SEO
    • Blog
    • Why Moz
      • Small Business Solutions

        Uncover insights to make smarter marketing decisions in less time.

      • Agency Solutions

        Earn & keep valuable clients with unparalleled data & insights.

      • Enterprise Solutions

        Gain a competitive edge in the ever-changing world of search.

      • The Moz Story

        Moz was the first & remains the most trusted SEO company.

      • Case Studies

        Explore how Moz drives ROI with a proven track record of success.

      • New Releases

        Get the scoop on the latest and greatest from Moz.

      Explore Moz updates & save up to 40%
      Big Savings!

      Explore Moz updates & save up to 40%

      See the latest
    • Log in
      • Moz Pro
      • Moz Local
      • Moz Local Dashboard
      • Moz API
      • Moz API Dashboard
      • Moz Academy
    • Avatar
      • Moz Home
      • Notifications
      • Account & Billing
      • Manage Users
      • Community Profile
      • My Q&A
      • My Videos
      • Log Out

    The Moz Q&A Forum

    • Forum
    • Questions
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. Home
    2. Moz Tools
    3. Moz Pro
    4. Blog archive pages in Craw Error Report

    Unsolved Blog archive pages in Craw Error Report

    Moz Pro
    seo audit
    4
    4
    1050
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with question management privileges can see it.
    • mhenshall
      mhenshall Subscriber last edited by

      Hi there,

      I'm new to MOZ Pro and have a question. My scan shows Archive pages as having crawl issues, but this is because Yoast is set up to block robots on these pages.

      Should I be allowing search engines to crawl these pages, or am I fine to leave them as I have it set up already?

      Any advice is greatly appreciated.
      Marc

      fcevey 1 Reply Last reply Reply Quote 0
      • Johnweki
        Johnweki @fcevey last edited by

        @fcevey
        If blog archive pages are showing up in the crawl error report, it indicates that search engine bots are encountering issues while attempting to crawl and index those pages. To address this:

        Check URL Structure: Ensure that the URLs for your blog archive pages are correctly formatted and follow best practices. Avoid special characters, and use a logical and organized structure.

        Update Sitemap: Make sure that the blog archive pages are included in your website's XML sitemap. Submit the updated sitemap to search engines using their respective webmaster tools.

        Robots.txt File: Review your website's robots.txt file to ensure it's not blocking search engine bots from crawling your blog archive pages. Adjust the file if needed.

        HTTP Status Codes: Check if the archive pages return the correct HTTP status codes (e.g., 200 OK). Crawl errors might be triggered if pages return 4xx or 5xx status codes.

        Internal Linking: Ensure that there are internal links pointing to your blog archive pages. This helps search engines discover and index these pages more effectively.

        Redirects: If you've recently changed the URL structure or migrated your website, implement proper redirects from old URLs to new ones to maintain SEO authority.

        Server Issues: Investigate if there are any server-related issues causing intermittent errors when search engine bots try to access the blog archive pages.

        1 Reply Last reply Reply Quote 0
        • educationedge012
          educationedge012 last edited by

          Blog archive pages in the crawl error report indicate issues or problems encountered while indexing or accessing the archive pages of a blog or website. These errors need attention to ensure that all content remains accessible to users and search engines. ( what is project management) ( PMP Exam Prep) (study abroad)

          1 Reply Last reply Reply Quote 0
          • fcevey
            fcevey @mhenshall last edited by

            @mhenshall The decision to allow search engines to crawl archive pages in YOAST SEO or leave them as they are currently configured depends on your specific goals and needs.

            If the archive pages contain valuable and relevant content for both search engines and users, allowing them to be crawled could enhance the visibility of that content in search results. However, if the content on the archive pages is not important or is duplicated from other pages, blocking crawling could be a valid option to prevent indexing issues and improve the user experience.

            I would recommend evaluating the content on the archive pages and considering how their visibility in search engines will be affected by allowing or blocking crawling. You can use tools like Google Search Console to monitor how Google is indexing those pages and make informed decisions based on the data.

            Keep in mind that configuring YOAST SEO is a strategic decision that should align with your SEO goals and your webs```
            code_text

            Free Research Preview. ChatGPT may produce inaccurate information about people, places, or facts.  Follow us [https://posicionamiento-web-seo.com.ar/](link url)
            Johnweki 1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post

            Got a burning SEO question?

            Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


            Start my free trial


            Browse Questions

            Explore more categories

            • Moz Tools

              Chat with the community about the Moz tools.

            • SEO Tactics

              Discuss the SEO process with fellow marketers

            • Community

              Discuss industry events, jobs, and news!

            • Digital Marketing

              Chat about tactics outside of SEO

            • Research & Trends

              Dive into research and trends in the search industry.

            • Support

              Connect on product support and feature requests.

            • See all categories

            Related Questions

            • ralphbaer

              What steps should I take to address damage to my website, including malware insertion and content theft?

              seo audit url inspection indexed urls

              The question revolves around the steps required to mitigate damage inflicted upon a website, encompassing issues such as malware insertion and content theft. It prompts a comprehensive exploration of the necessary actions to take in response to these challenges. The inquirer seeks guidance on how to effectively address the damage, indicating a desire for practical solutions and strategies to restore and safeguard their website's integrity. By posing this question, the individual demonstrates an awareness of the severity of the situation and a readiness to undertake corrective measures.

              Technical SEO | | ralphbaer
              0
            • williamhuynh

              Shopify SEO - Double Filter Pages

              shopify seo audit seo expert

              Hi Experts, Single filter page: /collections/dining-chairs/black
              -- currently, canonical the same: /collections/dining-chairs/black
              -- currently, index, follow Double filter page: /collections/dining-chairs/black+fabric
              -- currently, canonical the same: /collections/dining-chairs/black+fabric
              -- currently, noindex, follow My question is about double filter page above:
              if noindexing is the better option OR should I change the canonical to /collections/dining-chairs/black Thank you

              Technical SEO | | williamhuynh
              0
            • Caroline_Ardmoor

              Searchability Strategy

              technical seo seo audit

              We recently had a technical SEO audit carried out and it highlighted how many clicks it took to get to many of our pages (more than 4)). Does anyone have advice on how to create a structure for our pages to avoid this or recommend any articles I can read?

              Technical SEO | | Caroline_Ardmoor
              0
            • valigholami1386

              Solved how to do seo audit

              seo audit seo tactics

              hello . i am a user that runs parsp website . i really need to know how to run a site audit to keep my job clean and my site works well ! i need help and i am a newbie in this job . thanks moz !

              Moz Tools | | valigholami1386
              3
            • AndyKubrin

              How do you report SEO audit findings?

              seo audit reporting

              Hello, Mozzers! I'm curious to know how you report SEO audit findings. Do you use a spreadsheet? A presentation? A formal report? Or maybe something else. If you have a favourite audit template, I'd love to see it. A second question: what things do you report in an audit? I currently report crawl findings, authority and trust, link profiles, and competitive analysis. I also investigate a site's security—that's not usually part of an audit, but site owners need to know about it. What do you report to your audit customers? Thanks for sharing your auditing wisdom!

              Intermediate & Advanced SEO | | AndyKubrin
              0
            • dhands17

              Listing of all Google Indexed Pages

              I started managing a site that has about 391,000 indexed pages.  I want to get to the bottom of why there are so many in preparation for a ecommerce Migration and improving SEO.  Anyone know of a tool?  Many tools I have came across can only take 100 at a time.  I would love to get them in excel or a database.  I look forward to the suggestions.

              Moz Pro | | dhands17
              0
            • CodeBaby

              Seomoz puts hyphen and company name after page title in the report, why?'

              Hi Community, Can you figure out why this is happening? The title in the url itself does not contain - CodeBaby. Thank you! W6yg1cJ.png

              Moz Pro | | CodeBaby
              0
            • johnsearles

              Duplicate Page Titles and Content

              The SeoMoz crawler has found many pages like this on my site with /?Letter=Letter, e.g.  http://www.johnsearles.com/metal-art-tiles/?D=A. I believe it is finding multiple caches of a page and identifying them as duplicates. Is there any way to screen out these multiple cache results?

              Moz Pro | | johnsearles
              0
            Moz logo
            • Contact
            • Community
            • Free Trial
            • Terms & Privacy
            • Accessibility
            • Jobs
            • Help
            • What's New
            • News & Press
            • MozCon
            © 2021 - 2024 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.

            Looks like your connection to Moz was lost, please wait while we try to reconnect.