Skip to content
    Moz logo Menu open Menu close
    • Products
      • Moz Pro
      • Moz Pro Home
      • Moz Local
      • Moz Local Home
      • STAT
      • Mozscape API
    • Free SEO Tools
      • Competitive Research
      • Link Explorer
      • Keyword Explorer
      • Domain Analysis
      • MozBar
      • More Free SEO Tools
    • Learn SEO
      • Beginner's Guide to SEO
      • SEO Learning Center
      • Moz Academy
      • SEO Q&A
      • Webinars, Whitepapers, & Guides
    • Blog
    • Why Moz
      • Agency Solutions
      • Enterprise Solutions
      • Small Business Solutions
      • Case Studies
      • The Moz Story
      • New Releases
    • Log in
    • Log out
    • Products
      • Moz Pro

        Your All-In-One Suite of SEO Tools

        The essential SEO toolset: keyword research, link building, site audits, page optimization, rank tracking, reporting, and more.

        Learn more
        Try Moz Pro free
        Illustration of Moz Pro
      • Moz Local

        Complete Local SEO Management

        Raise your local SEO visibility with easy directory distribution, review management, listing updates, and more.

        Learn more
        Check my presence
        Illustration of Moz Local
      • STAT

        Enterprise Rank Tracking

        SERP tracking and analytics for SEO experts, STAT helps you stay competitive and agile with fresh insights.

        Learn more
        Book a demo
        Illustration of STAT
      • Mozscape API

        The Power of Moz Data via API

        Power your SEO with the proven, most accurate link metrics in the industry, powered by our index of trillions of links.

        Learn more
        Get connected
        Illustration of Mozscape API
      • Compare SEO Products
    • Free SEO Tools
      • Competitive Research

        Competitive Intelligence to Fuel Your SEO Strategy

        Gain intel on your top SERP competitors, keyword gaps, and content opportunities.

        Find competitors
        Illustration of Competitive Research
      • Link Explorer

        Powerful Backlink Data for SEO

        Explore our index of over 40 trillion links to find backlinks, anchor text, Domain Authority, spam score, and more.

        Get link data
        Illustration of Link Explorer
      • Keyword Explorer

        The One Keyword Research Tool for SEO Success

        Discover the best traffic-driving keywords for your site from our index of over 500 million real keywords.

        Search keywords
        Illustration of Keyword Explorer
      • Domain Analysis

        Free Domain SEO Analysis Tool

        Get top competitive SEO metrics like Domain Authority, top pages, ranking keywords, and more.

        Analyze domain
        Illustration of Domain Analysis
      • MozBar

        Free, Instant SEO Metrics As You Surf

        Using Google Chrome, see top SEO metrics instantly for any website or search result as you browse the web.

        Try MozBar
        Illustration of MozBar
      • More Free SEO Tools
    • Learn SEO
      • Beginner's Guide to SEO

        The #1 most popular introduction to SEO, trusted by millions.

        Read the Beginner's Guide
      • How-To Guides

        Step-by-step guides to search success from the authority on SEO.

        See All SEO Guides
      • SEO Learning Center

        Broaden your knowledge with SEO resources for all skill levels.

        Visit the Learning Center
      • Moz Academy

        Upskill and get certified with on-demand courses & certifications.

        Explore the Catalog
      • On-Demand Webinars

        Learn modern SEO best practices from industry experts.

        View All Webinars
      • SEO Q&A

        Insights & discussions from an SEO community of 500,000+.

        Find SEO Answers
      The Impact of Local Business Reviews
      SEO Industry Report

      The Impact of Local Business Reviews

      Learn more
    • Blog
    • Why Moz
      • Small Business Solutions

        Uncover insights to make smarter marketing decisions in less time.

        Grow Your Business
      • The Moz Story

        Moz was the first & remains the most trusted SEO company.

        Read Our Story
      • Agency Solutions

        Earn & keep valuable clients with unparalleled data & insights.

        Drive Client Success
      • Case Studies

        Explore how Moz drives ROI with a proven track record of success.

        See What's Possible
      • Enterprise Solutions

        Gain a competitive edge in the ever-changing world of search.

        Scale Your SEO
      • New Releases

        Get the scoop on the latest and greatest from Moz.

        See What’s New
      Surface actionable competitive intel
      New Feature: Moz Pro

      Surface actionable competitive intel

      Learn More
    • Log in
      • Moz Pro
      • Moz Local
      • Moz Local Dashboard
      • Mozscape API
      • Mozscape API Dashboard
      • Moz Academy
    • Avatar
      • Moz Home
      • Notifications
      • Account & Billing
      • Manage Users
      • Community Profile
      • My Q&A
      • My Videos
      • Log Out

    The Moz Q&A Forum

    • Forum
    • Questions
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. Home
    2. Research & Trends
    3. Other SEO Tools
    4. site crawl

    site crawl

    Other SEO Tools
    seo seo audit
    2
    2
    2404
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with question management privileges can see it.
    • valigholami1386
      valigholami1386 Banned last edited by

      hello . my website is https://papionshopping.ir/ but i cant make a site crawl for this . everytime i run crawling it stops and shows nothing !!!!!!!!!!!!!!!!!! plz helppp.

      1 Reply Last reply Reply Quote 0
      • davidbennett. 0
        davidbennett. 0 Banned last edited by

        Same issue face our window cleaning website some pages google not crawl. Anyone help me

        1 Reply Last reply Reply Quote 0
        • 1 / 1
        • First post
          Last post

        Got a burning SEO question?

        Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


        Start my free trial


        Browse Questions

        Explore more categories

        • Moz Tools

          Chat with the community about the Moz tools.

        • SEO Tactics

          Discuss the SEO process with fellow marketers

        • Community

          Discuss industry events, jobs, and news!

        • Digital Marketing

          Chat about tactics outside of SEO

        • Research & Trends

          Dive into research and trends in the search industry.

        • Support

          Connect on product support and feature requests.

        • See all categories

        Related Questions

        • Billywig

          Rankings preferring English URL above local URL

          seo local seo rankings ranking factors

          We've recently had a redesign for our website and it has influenced our rankings a little bit. However, what I mainly noticed is that for some keywords in MOZ the English URL is looked at in terms of ranking, instead of the local URL. It used to be just the local URL ranking, even for keywords that are more English oriented, and I'm wondering if that might be hurting our rankings. And more importantly, why it's happening. An example of a page where it's happening is: https://www.bluebillywig.com/online-video-platform/

          Local SEO | | Billywig
          0
        • haapalatuomas

          Static content pages ranking dropping all the time

          rankings seo rankings seo on page optimization on-page

          Hello all. I have been working three months in my current job in the hotel industry. I have been publishing a lot of content to our website (mainly articles), which in general have been ranking well and really boosted our website traffic. The problem that I am facing, though, is the fact that our static pages' rankings are basically constantly dropping. Especially one of our main pages, which is this hotel page. I haven't been doing any real changes to the content, but the ranking (with keywords "hotelli helsinki" [Hotel in Helsinki in Finnish]) has plummeted from 13th position all the way down to 19th... What has been happening during these last three months is that we did change to a new domain and we have done all the redirections and also informed Google about this change through search console. I have also done some minor changes to the on-page content, such as changing the meta titles and descriptions as well as the page title and some of the text content to more natural ones instead of clumsy SEO texts and optimizing the images. This hasn't helped at all though and the rankings seem to steadily drop all the time. What would YOU do with this page? Maybe add more text content to the page to be more informative? All tips would be highly appreciated.

          On-Page Optimization | | haapalatuomas
          0
        • SolenneGINX

          What is the importance of DA for traffic when launching a website?

          seo domain authority domain

          I am working on a new content website. Before I decide of the name and buy the domain name, I wonder if it's still worth buying an expired domain name with high(ish) DA instead of starting from scratch.
          Any opinion?
          TA

          White Hat / Black Hat SEO | | SolenneGINX
          0
        • easyjobber

          Spam on Google SEO

          seo spam

          Do you know any good tips to reduce spam and if spams have an on google ranking?

          SEO Tactics | | easyjobber
          0
        • LukeRow

          Breadcrumbs and multiple parent categories on Shopify site - what's the answer?

          navigation breadcrumb trail breadcrumbs ux seo

          Hi Mozzers... I'm working on a Shopify site - it is polyhierarchical with multiple parent categories for each product. Not uncommon with Shopify because of issues with faceted nav on that platform. The problem is that defining ONE breadcrumb trail back to the homepage, it works against UX, as people will be wanting to go back to the previous search results, primarily, to revisit the parent category specific search (this is an ecommerce site with a huge number of products). So heaven knows what to do. I could do: (1) Home / Product to avoid the issue. Not very good for UX though as where is the previous category page (where more than likely a product search was carried out). (2) Home / Specific Previous Search Page - Parent Category / Product (if that is possible without upsetting SEO performance - I don't think it is - but any advice is welcome) (3) or I could define one specific path and also include: Return to Previous Page / Search as a separate clickback link outside of but adjacent to the breadcrumb trail (I think Macy's used to do that): https://baymard.com/blog/ecommerce-breadcrumbs The problem with defining a specific path is it flys in the face of UX in the context of this site! Although of course defining one path seems to be best practice for SEO. Any help would be gratefully received! Thanks a million, Luke

          Intermediate & Advanced SEO | | LukeRow
          0
        • netcomsia

          block primary . xxx domain with disavow tool

          search results spam spam score disavow seo audit

          Hi friends I discovered spam url attack on top sites with good google positions for specific keyword. Can I block primary domain like .xxx with disavow tool? There is hundreds of different domains but primary domain is always the same. for example like this domain:xxx? Thanks

          Intermediate & Advanced SEO | | netcomsia
          0
        • 0eup.ombitao

          How .ae and .com domain in SEO performance for UAE region?

          seo audit domain rankings

          I have a domain for my UAE based project called https://mydubaiseo.com/ and however, one of my colleagues suggested going with .ae option.
          Whether if we change the domain like as suggested get earlier results than .com domain or what?\Which domain .com or .ae ranks faster in UAE location if the SEO strategies followed in the same way?

          Technical SEO | | 0eup.ombitao
          0
        • Bhasker

          I am using Yoast Wordpress SEO plugin on my site. Is it good enough?

          What does other members and Moz think about using Yoast Wordpress SEO plugin? Are there better alternative?

          Other SEO Tools | | Bhasker
          0
        Moz logo
        • Contact
        • Community
        • Free Trial
        • Terms & Privacy
        • Jobs
        • Help
        • News & Press
        • Mozcon
        © 2021 - 2023 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.

        Looks like your connection to Moz was lost, please wait while we try to reconnect.