What is duplicate content in SEO?
Duplicate content is identical or nearly identical content that can be opened from more than one URL, within one site or across different sites. Duplicate content does not by itself violate Google's policies, but it forces the search engine to pick which version to show and spreads across several addresses the signals that should add up on one.
Key takeaways
- Duplicate content is the same content, or nearly, on more than one URL; in a store it comes from variants, filters and sorting.
- Google says some duplicate content is normal and does not violate its spam policies: it groups the copies and picks one as canonical.
- The problem starts when other people's content is copied without adding value or nearly identical pages are manufactured to rank.
- Bing explained in December 2025 that language models group near-duplicate URLs and pick one to represent the group, which may not be the one you want.
- It is sorted out with consistent signals: canonical, redirects, internal links and sitemap all pointing to the same URL.
Duplicate content is not the same as plagiarism. The SEO term is not about who copied whom, but about something more prosaic: the same page can be opened from several addresses, and the search engine has to decide which one counts. In an online store that is the norm, not the exception. A t-shirt in three colors, a category you can sort by price and a product you reach from two collections are already duplicate content, and nobody copied anything. It matters to you because, if you do not choose the right version, the search engine does, and what that page accumulates gets split across addresses.
How it works
Google calls canonicalization the process of choosing the representative URL for a piece of content. When it finds several pages that are identical or very similar, it groups them and picks one as canonical; that one is crawled more often and the duplicates less, so the server is not overloaded.[1]Google Search Central. What is URL canonicalization The causes it lists are those of any store: regional variants, mobile and desktop versions, http versus https, site features such as sorting and filtering a category, and versions that are accessible by accident.[1]Google Search Central. What is URL canonicalization Versions in different languages count as duplicates only if the main content is in the same language.[1]Google Search Central. What is URL canonicalization
The first thing to know is what it is not: Google says having some duplicate content on a site is normal and does not violate its spam policies.[1]Google Search Central. What is URL canonicalization What does violate them is something else. Scraping is taking content from other sites and publishing it to manipulate rankings: republishing it without adding anything, changing it only slightly (for example, with synonyms) or reproducing other people's feeds without adding value of your own. And doorway abuse includes creating substantially similar pages that are closer to a list of results than to a clear hierarchy.[2]Google Search Central. Spam policies for Google web search The line is in intent and in value: a technical duplicate gets sorted out; manufacturing copies to rank is another conversation, the one about scaled content abuse.
If there is no punishment, why sort it out? Google gives four reasons to declare the right URL: to decide which one people see in results, to consolidate the signals the copies receive (such as links from other sites) onto one URL, to simplify the metrics for that content and to avoid spending crawl time on duplicates.[3]Google Search Central. How to specify a canonical URL with rel="canonical" and other methods On large sites the last one weighs most: its guide to crawl budget asks you to consolidate duplicate content so crawling focuses on unique content and not on unique URLs.[4]Google, crawling documentation. Crawl budget management for large sites
And in AI answers
Bing explained it on December 19, 2025, in an article by Fabrice Canel and Krishna Madhavan: duplicate content does not cause penalties by itself, but it reduces visibility, because it dilutes authority, muddies intent and delays changes reaching search engines and AI discovery systems. Its description of the mechanism is the new part: language models group near-duplicate URLs into a single cluster and pick one page to represent it, and they may choose an outdated version or one that is not the one you wanted.[5]Microsoft, Bing Webmaster blog (Fabrice Canel and Krishna Madhavan). Does Duplicate Content Hurt SEO and AI Search Visibility?
The kinds of duplicate it lists are the usual ones: syndicated articles on other domains, campaign variants that target the same intent, nearly identical regional pages and technical causes such as URL parameters, http and https, upper and lower case, the trailing slash, print versions and accessible staging environments. So are its remedies: canonical tags, 301 redirects, hreflang for language or region versions and IndexNow to announce changes.[5]Microsoft, Bing Webmaster blog (Fabrice Canel and Krishna Madhavan). Does Duplicate Content Hurt SEO and AI Search Visibility?
In a store
Fictional example. A lighting store sells a table lamp in three colors. This is how its duplicate content breaks down and what to do with each case:
| Case (fictional example) | URL | What to do |
|---|---|---|
| Variant by parameter | /cloud-lamp?color=green |
Canonical to /cloud-lamp, the URL without the parameter[6]Google Search Central. Designing a URL structure for ecommerce sites |
| Sorted category | /table-lamps?sort=price |
Canonical to the unsorted category, or keep it from being crawled (see faceted navigation) |
| Same product from a collection | /sale/cloud-lamp |
Canonical to /cloud-lamp |
http or with a trailing slash |
http://store.example/cloud-lamp/ |
Redirect to the right URL |
| Two nearly identical product pages | /cloud-lamp and /cloud-lamp-2-pack |
It depends: see the criterion below |
For product variants, Google accepts a path segment (/t-shirt/green) or a parameter (/t-shirt?color=green), and if you use optional parameters it asks that the canonical be the URL without the parameter. And one rule that holds for the whole table: use the same URL in internal links, in the sitemap and in the canonical.[6]Google Search Central. Designing a URL structure for ecommerce sites
The last row is the one a tag does not resolve. Two product pages with the same manufacturer description and a small difference, like a two-pack, can be two products that deserve their own page or a copy that only splits signals.
What people often get wrong
There is no "duplicate content penalty." Google says some duplication is normal and does not violate its spam policies,[1]Google Search Central. What is URL canonicalization and Bing says it does not cause penalties by itself.[5]Microsoft, Bing Webmaster blog (Fabrice Canel and Krishna Madhavan). Does Duplicate Content Hurt SEO and AI Search Visibility? What you lose is something else: control over which URL is shown and signals split between copies. Blocking the copies in robots.txt or marking them noindex is not the way to choose the right one either: Google expressly advises against it for canonicalization.[3]Google Search Central. How to specify a canonical URL with rel="canonical" and other methods
How to check it
- Open the page indexing report in Search Console and look for two statuses: "Duplicate without user-selected canonical" and "Duplicate, Google chose different canonical than user." The first asks you to declare the canonical; the second, to review why your signals are not convincing.[7]Search Console Help. Page indexing report
- Inspect a duplicate URL and compare the canonical you declare with the one Google chose. Remember the goal Google sets: to get the canonical version of every important page indexed, not every URL.[7]Search Console Help. Page indexing report
- Review the consistency of your signals: the canonical, the menu and collection links and the sitemap all have to point to the same URL, with or without parameters, but always the same.[6]Google Search Central. Designing a URL structure for ecommerce sites Google expressly asks you not to declare different canonicals with different methods.[3]Google Search Central. How to specify a canonical URL with rel="canonical" and other methods
- Search for a sentence from your description in quotation marks. If it shows up on other stores, you share the manufacturer's description: it is not a violation, but your page adds nothing to tell it apart from the other copies.
- If your store is in Bing Webmaster Tools, look at the recommendations tab: according to Bing, it flags possible duplicates, such as too many pages with the same title.[5]Microsoft, Bing Webmaster blog (Fabrice Canel and Krishna Madhavan). Does Duplicate Content Hurt SEO and AI Search Visibility?
Related concept: canonical
Duplicate content is the situation; the canonical is one of the tools for resolving it. A rel="canonical" tag declares which URL you prefer within a group of duplicates, and Google treats it as a strong signal, like a redirect, while including a URL in the sitemap is a weak signal.[3]Google Search Central. How to specify a canonical URL with rel="canonical" and other methods None of the three is a command: if they contradict each other, Google decides. And none of them fixes two pages that merely look alike: that is decided by the content of each.
To go further, the entry on indexing explains what happens to the URL that wins, and the crawling and indexing reading path orders the rest of the terms.
Synonyms
- English
- duplicate content
- Español
- páginas duplicadas, contenido repetido
Sources
- [1] Google Search Central. What is URL canonicalization. Accessed . ↑ ↑ ↑ ↑ ↑
- [2] Google Search Central. Spam policies for Google web search. Accessed . ↑
- [3] Google Search Central. How to specify a canonical URL with rel="canonical" and other methods. Accessed . ↑ ↑ ↑ ↑
- [4] Google, crawling documentation. Crawl budget management for large sites. Accessed . ↑
- [5] Microsoft, Bing Webmaster blog (Fabrice Canel and Krishna Madhavan). Does Duplicate Content Hurt SEO and AI Search Visibility?. Accessed . ↑ ↑ ↑ ↑
- [6] Google Search Central. Designing a URL structure for ecommerce sites. Accessed . ↑ ↑ ↑
- [7] Search Console Help. Page indexing report. Accessed . ↑ ↑
Change history
- First English version.
This definition is published under CC BY 4.0. Reuse this definition freely, crediting Clione with a link to this page.
Related terms
Canonical URL
What a canonical URL is, how Google uses it to pick the address of a product page with several URLs and how to check which one it chose in your store.
Faceted navigation
What faceted navigation is, how many URLs a category's filters create, what Google recommends for crawling them and how to check it on Shopify.
Indexing
What indexing is, how it differs from crawling, why Google does not store all your product pages and how to read its status in Search Console.
301 redirect
What a 301 redirect is, how it differs from a 302 or a 308, what Google does with it and how to redirect a product page that changes URL on Shopify.
Product variants
What product variants are, how Shopify, Google and Merchant Center model them, and when a size or a color is a variant and not a separate product.
Crawl budget
What crawl budget is, when an online store should care, what wastes it (filters, duplicates, noindex) and how to measure it.
Make your catalog easy for bots to read
Clione fills every product page with what bots read best: the JSON-LD graph with its structured data, the meta description and the FAQs. You review and press Push; then we check your live store so it all stays published.