Solved Duplicate content error affecting 142 pages
-
Hello,
Recently I noticed a new duplicate error notification.
This page: https://www.earley.com/insights/internet-things-and-product-data
is flagged as 'duplicate content' with 142 affected pages.
Here's an example of one of the affected pages:
https://www.earley.com/insights/how-ontologies-drive-digital-transformation
This is not an ecommerce site. The affected pages are blog posts. We are pretty prolific writers and over the years we have produced nearly 300 articles. We are a consulting firm and the articles are about our area of expertise and cover a wide range of topics within that space.
I just don't understand why this would be flagged as duplicate or what I'm supposed to do with this information!
Help!
Thanks!
Sharon -
@meghanpahinui said in Duplicate content error affecting 142 pages:
@eismarketing Hi Sharon!
Thanks so much for the great question! And so sorry for any confusion here.
Pages that are flagged as duplicate content are being assessed on the source code of those pages and not just the content on the page itself. Since it's not based purely on the written content of the page, this means if you're using a template of some kind or all your pages have a similar structure, they may end up being flagged as duplicate content. Pages can be marked as duplicates of each other when there isn't enough unique content on each page to distinguish them from each other.
The Moz tools have a 90% threshold for duplicate content so any pages with at least 90% of the same code will be flagged as duplicates of one another.
I've grabbed a few resources that may help:
Here is a Whiteboard Friday about duplicate content and some ways you can resolve it.
Here is an article from the Moz Learning Center regarding duplicate content.
Here is some information from Google re: duplicate content as well.At time of answering your query, you won't get a penalty for duplicate content, however anything you can do to help search engines understand what you content is about and to create value for your visitors, will support a strong content marketing and SEO strategy.
-
@eismarketing Hi Sharon!
Thanks so much for the great question! And so sorry for any confusion here.
Pages that are flagged as duplicate content are being assessed on the source code of those pages and not just the content on the page itself. Since it's not based purely on the written content of the page, this means if you're using a template of some kind or all your pages have a similar structure, they may end up being flagged as duplicate content. Pages can be marked as duplicates of each other when there isn't enough unique content on each page to distinguish them from each other.
The Moz tools have a 90% threshold for duplicate content so any pages with at least 90% of the same code will be flagged as duplicates of one another.
I've grabbed a few resources that may help:
Here is a Whiteboard Friday about duplicate content and some ways you can resolve it.
Here is an article from the Moz Learning Center regarding duplicate content.
Here is some information from Google re: duplicate content as well.At time of answering your query, you won't get a penalty for duplicate content, however anything you can do to help search engines understand what you content is about and to create value for your visitors, will support a strong content marketing and SEO strategy.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Ok to have multiple domains w/ seperate websites rank for similar keywords?
Is it Ok to have multiple domains (separate website different content) rank for similar keywords? Is it 'OK' to have multiple domains in the following instance? Does Google actively discourage multiple (but completely different sites) domains from the same company appearing in the search results for the same and or similar keywords if the content is slightly different? This is where the 'main site' has the details, and you can purchase product, and the second site is a blog site only. We are creating a separate content blogsite; which would be on a second domain that will be related to one portion of content on main site. They would be linking back and forth, or maybe the blog site would just link over to the main site so they can purchase said product. This would be a similar scenario to give you an idea of how it would be structured: MAIN SITE: describes a few products, and you can purchase from this site SECOND SITE, different domain: a blog site that contains personal experiences
SEO Tactics | | fourwhitesocks
with one of the products. BOTH sites will be linked back and forth....or as mentioned maybe the blog site could just link over to the 'main site' Logo would be a modified version of the main logo and look and feel of the sight would be similar but not exactly the same. MORE INFO: the main site has existed for way over 10 years, starting to gain some traction in an extremely competitive market, but does not rank super high, is gaining traction due to improvements in speed, content, onpage SEO, etc... So in addition to my main question of is this 'ok' to have this second domain, also will it hurt the rankings or negatively affect the 'main' site, will we have duplicate content issues? ** If this is not the right place to ask this then where should I be asking?
Thank you!0 -
Can you use no-index to counter duplicate content across separate domains?
Hi Moz Community, I have a client who is splitting out a sub brand from a company website to its own domain. They have lots of content around the theme and they want to migrate most of the content out to the new domain, but they also wanted to keep that content on the main site as the main site gets lots of traffic. My question is, as they want search traffic to go to the new site, but want to keep the best content on the original site too, so it can be found in the nav, if they no-index identical content on main site and index content on the new site will they still be penalised for duplicate content? Our advice has been to keep the thematic content on both sites but make them different enough so they are not considered duplicate - we routinely write the same blog post in 50 different ways for them but their Head of Web asked if the no-index is a route, which means they don't need to pay for and wait for brand new content? They are comfortable in losing traffic until the new domain gets traction. In theory, if they are telling Google not to index or rank the main site content, the new site shouldn't be penalised but I'm not confident giving that advice as I've never been asked to do this before. Thoughts?
Technical SEO | | Algorhythm_jT0 -
Unsolved Almost every new page become Discovered - currently not indexed
Almost every new page that I create becomes Discovered - currently not indexed. It started a couple of months ago, before that all pages were indexed within a couple of weeks. Now there are pages that have not been indexed since the beginning of September. From a technical point of view, the pages are fine and acceptable for a Google bot. The pages are in the sitemap and have content. Basically, these are texts of 1000+ or 2000+ words. I've tried adding new content to pages and even transferring content to a new page with a different url. But in this way, I managed to index only a couple of pages. Has anyone encountered a similar problem?
Product Support | | roadlexx
Could it be that until September of this year, I hadn't added new content to the site for several months?
Please help, I am already losing my heart.0 -
My duplicate pages are mostly Tag pages...what are best practices?
As I'm looking through my Moz Pro reports on Pages with Duplicate Content, almost all the results are from the automatically created "tag" pages from my blog. I.e., takeflyte.com/flyte/tags/kickapps Should I worry about this? Does it have a negative impact in my search visibility? Should I be using canonical tags on these pages (and if so, pointing them where if there's multiple pages that use the same tags?) How would you recommend handling this issue?
Product Support | | flyte0 -
Why is Moz Crawl Diagnostics labelling pages as duplicate when they appear to be different?
Moz Crawl Diagnostics is flagging some pages on the Doorfit website as duplicate, yet the page content is completely different and not identical. Example. Page: http://www.doorfit.co.uk/locks-security/secondary-security Duplicate: http://www.doorfit.co.uk/seals-and-sealants?cat=279 Does anybody have any suggestions as to why this might be the case? Thanks
Product Support | | A_Q0 -
Receiving incapsula error codes when trying to respond to questions
I have been receiving multiple error codes from incapsula when trying to edit answers or add an additional answer. I want to save the code I have seen is 112 or 12 I will take a screenshot the next time I see it. However, it has happened to me quite a few times and I have to refresh my browser every time I choose to post, edit basically do anything on the site. Using both Safari, Chrome and Firefox have yielded the same results. Tom PS I have tried to replicate the results when posting this no luck.
Product Support | | BlueprintMarketing0 -
On page SEO Report Sucks
Hey. I'm trying to get a PDF of the on page report so I can see a list of each issue. This works well if you're logged in and just navigate through the different tabs, but not so well if you export. All I get is an overview of the number of the priority issues, but not the URLs and the specific problems. I know you can export a CVS, but that's not a very good branded way to export this. What I'd like to do is export a report that is fairly gainular so I can provide "before and after" reports for work we completed. As is stands now, I have an overview PDF which sucks and can't provide any more details or a CVS which has all the details in the world, but is so in depth it's hard to navigate, especially for clients who don't know what they're looking at, not to mention it's not branded!!! There should be way more options for reporting here. Please let me know if you can do something about this or if I'm just missing something. Thanks. Micha
Product Support | | Multiverse-Media-Group0 -
Duplicate content on ecommerce sites
I just want to confirm something about duplicate content. On an eCommerce site, if the meta-titles, meta-descriptions and product descriptions are all unique, yet a big chunk at the bottom (featuring "why buy with us" etc) is copied across all product pages, would each page be penalised, or not indexed, for duplicate content? Does the whole page need to be a duplicate to be worried about this, or would this large chunk of text, bigger than the product description, have an effect on the page. If this would be a problem, what are some ways around it? Because the content is quite powerful, and is relavent to all products... Cheers,
Intermediate & Advanced SEO | | Creode0