In beta, with limited placesOpen to everyone in Q1 2027

↑↓ to move · Enter to open · Esc to close

Crawling and indexing

What is duplicate content in SEO?

Duplicate content is identical or nearly identical content that can be opened from more than one URL, within one site or across different sites. Duplicate content does not by itself violate Google's policies, but it forces the search engine to pick which version to show and spreads across several addresses the signals that should add up on one.

Written by
Reviewed by
Published 7 min read
Takeaway:

Key takeaways

  • Duplicate content is the same content, or nearly, on more than one URL; in a store it comes from variants, filters and sorting.
  • Google says some duplicate content is normal and does not violate its spam policies: it groups the copies and picks one as canonical.
  • The problem starts when other people's content is copied without adding value or nearly identical pages are manufactured to rank.
  • Bing explained in December 2025 that language models group near-duplicate URLs and pick one to represent the group, which may not be the one you want.
  • It is sorted out with consistent signals: canonical, redirects, internal links and sitemap all pointing to the same URL.

Duplicate content is not the same as plagiarism. The SEO term is not about who copied whom, but about something more prosaic: the same page can be opened from several addresses, and the search engine has to decide which one counts. In an online store that is the norm, not the exception. A t-shirt in three colors, a category you can sort by price and a product you reach from two collections are already duplicate content, and nobody copied anything. It matters to you because, if you do not choose the right version, the search engine does, and what that page accumulates gets split across addresses.

How it works

Google calls canonicalization the process of choosing the representative URL for a piece of content. When it finds several pages that are identical or very similar, it groups them and picks one as canonical; that one is crawled more often and the duplicates less, so the server is not overloaded.⁠[1]Google Search Central. What is URL canonicalization The causes it lists are those of any store: regional variants, mobile and desktop versions, http versus https, site features such as sorting and filtering a category, and versions that are accessible by accident.⁠[1]Google Search Central. What is URL canonicalization Versions in different languages count as duplicates only if the main content is in the same language.⁠[1]Google Search Central. What is URL canonicalization

The first thing to know is what it is not: Google says having some duplicate content on a site is normal and does not violate its spam policies.⁠[1]Google Search Central. What is URL canonicalization What does violate them is something else. Scraping is taking content from other sites and publishing it to manipulate rankings: republishing it without adding anything, changing it only slightly (for example, with synonyms) or reproducing other people's feeds without adding value of your own. And doorway abuse includes creating substantially similar pages that are closer to a list of results than to a clear hierarchy.⁠[2]Google Search Central. Spam policies for Google web search The line is in intent and in value: a technical duplicate gets sorted out; manufacturing copies to rank is another conversation, the one about scaled content abuse.

If there is no punishment, why sort it out? Google gives four reasons to declare the right URL: to decide which one people see in results, to consolidate the signals the copies receive (such as links from other sites) onto one URL, to simplify the metrics for that content and to avoid spending crawl time on duplicates.⁠[3]Google Search Central. How to specify a canonical URL with rel="canonical" and other methods On large sites the last one weighs most: its guide to crawl budget asks you to consolidate duplicate content so crawling focuses on unique content and not on unique URLs.⁠[4]Google, crawling documentation. Crawl budget management for large sites

And in AI answers

Bing explained it on December 19, 2025, in an article by Fabrice Canel and Krishna Madhavan: duplicate content does not cause penalties by itself, but it reduces visibility, because it dilutes authority, muddies intent and delays changes reaching search engines and AI discovery systems. Its description of the mechanism is the new part: language models group near-duplicate URLs into a single cluster and pick one page to represent it, and they may choose an outdated version or one that is not the one you wanted.⁠[5]Microsoft, Bing Webmaster blog (Fabrice Canel and Krishna Madhavan). Does Duplicate Content Hurt SEO and AI Search Visibility?

The kinds of duplicate it lists are the usual ones: syndicated articles on other domains, campaign variants that target the same intent, nearly identical regional pages and technical causes such as URL parameters, http and https, upper and lower case, the trailing slash, print versions and accessible staging environments. So are its remedies: canonical tags, 301 redirects, hreflang for language or region versions and IndexNow to announce changes.⁠[5]Microsoft, Bing Webmaster blog (Fabrice Canel and Krishna Madhavan). Does Duplicate Content Hurt SEO and AI Search Visibility?

In a store

Fictional example. A lighting store sells a table lamp in three colors. This is how its duplicate content breaks down and what to do with each case:

Case (fictional example) URL What to do
Variant by parameter /cloud-lamp?color=green Canonical to /cloud-lamp, the URL without the parameter⁠[6]Google Search Central. Designing a URL structure for ecommerce sites
Sorted category /table-lamps?sort=price Canonical to the unsorted category, or keep it from being crawled (see faceted navigation)
Same product from a collection /sale/cloud-lamp Canonical to /cloud-lamp
http or with a trailing slash http://store.example/cloud-lamp/ Redirect to the right URL
Two nearly identical product pages /cloud-lamp and /cloud-lamp-2-pack It depends: see the criterion below

For product variants, Google accepts a path segment (/t-shirt/green) or a parameter (/t-shirt?color=green), and if you use optional parameters it asks that the canonical be the URL without the parameter. And one rule that holds for the whole table: use the same URL in internal links, in the sitemap and in the canonical.⁠[6]Google Search Central. Designing a URL structure for ecommerce sites

The last row is the one a tag does not resolve. Two product pages with the same manufacturer description and a small difference, like a two-pack, can be two products that deserve their own page or a copy that only splits signals.

Warning:

What people often get wrong

There is no "duplicate content penalty." Google says some duplication is normal and does not violate its spam policies,⁠[1]Google Search Central. What is URL canonicalization and Bing says it does not cause penalties by itself.⁠[5]Microsoft, Bing Webmaster blog (Fabrice Canel and Krishna Madhavan). Does Duplicate Content Hurt SEO and AI Search Visibility? What you lose is something else: control over which URL is shown and signals split between copies. Blocking the copies in robots.txt or marking them noindex is not the way to choose the right one either: Google expressly advises against it for canonicalization.⁠[3]Google Search Central. How to specify a canonical URL with rel="canonical" and other methods

How to check it

  1. Open the page indexing report in Search Console and look for two statuses: "Duplicate without user-selected canonical" and "Duplicate, Google chose different canonical than user." The first asks you to declare the canonical; the second, to review why your signals are not convincing.⁠[7]Search Console Help. Page indexing report
  2. Inspect a duplicate URL and compare the canonical you declare with the one Google chose. Remember the goal Google sets: to get the canonical version of every important page indexed, not every URL.⁠[7]Search Console Help. Page indexing report
  3. Review the consistency of your signals: the canonical, the menu and collection links and the sitemap all have to point to the same URL, with or without parameters, but always the same.⁠[6]Google Search Central. Designing a URL structure for ecommerce sites Google expressly asks you not to declare different canonicals with different methods.⁠[3]Google Search Central. How to specify a canonical URL with rel="canonical" and other methods
  4. Search for a sentence from your description in quotation marks. If it shows up on other stores, you share the manufacturer's description: it is not a violation, but your page adds nothing to tell it apart from the other copies.
  5. If your store is in Bing Webmaster Tools, look at the recommendations tab: according to Bing, it flags possible duplicates, such as too many pages with the same title.⁠[5]Microsoft, Bing Webmaster blog (Fabrice Canel and Krishna Madhavan). Does Duplicate Content Hurt SEO and AI Search Visibility?

Duplicate content is the situation; the canonical is one of the tools for resolving it. A rel="canonical" tag declares which URL you prefer within a group of duplicates, and Google treats it as a strong signal, like a redirect, while including a URL in the sitemap is a weak signal.⁠[3]Google Search Central. How to specify a canonical URL with rel="canonical" and other methods None of the three is a command: if they contradict each other, Google decides. And none of them fixes two pages that merely look alike: that is decided by the content of each.

To go further, the entry on indexing explains what happens to the URL that wins, and the crawling and indexing reading path orders the rest of the terms.

Synonyms

English
duplicate content
Español
páginas duplicadas, contenido repetido

Sources

  1. [1] Google Search Central. What is URL canonicalization. Accessed . ↑ ↑ ↑ ↑ ↑
  2. [2] Google Search Central. Spam policies for Google web search. Accessed . ↑
  3. [3] Google Search Central. How to specify a canonical URL with rel="canonical" and other methods. Accessed . ↑ ↑ ↑ ↑
  4. [4] Google, crawling documentation. Crawl budget management for large sites. Accessed . ↑
  5. [5] Microsoft, Bing Webmaster blog (Fabrice Canel and Krishna Madhavan). Does Duplicate Content Hurt SEO and AI Search Visibility?. Accessed . ↑ ↑ ↑ ↑
  6. [6] Google Search Central. Designing a URL structure for ecommerce sites. Accessed . ↑ ↑ ↑
  7. [7] Search Console Help. Page indexing report. Accessed . ↑ ↑

Change history

  • First English version.

This definition is published under CC BY 4.0. Reuse this definition freely, crediting Clione with a link to this page.

Make your catalog easy for bots to read

Clione fills every product page with what bots read best: the JSON-LD graph with its structured data, the meta description and the FAQs. You review and press Push; then we check your live store so it all stays published.