Universal Duplicate Tab Content Detector

WHAT IT DOES

Universal Duplicate Tab Content Detector helps you identify duplicate content on any webpage by analyzing text similarity, repeated elements, and duplicate images or media. The script scans the page for text blocks, comparing them using a configurable similarity threshold, and highlights duplicate sections with color-coded badges. Duplicate text appears with red highlights and numbered badges, duplicate images appear with orange dashed outlines, duplicate meta tags appear with yellow dotted outlines, and duplicate headings appear with blue outlines. A duplicate content ratio shows the percentage of page text that is duplicated. The script identifies duplicated meta tags (description, keywords) that could affect SEO, and repeated headings that may indicate content redundancy. A summary provides counts of all duplicate groups and suggests potential SEO implications.

WHERE IT RUNS

This script runs on every website (matching all URLs), detecting duplicate content across the entire web. It works on articles, product pages, blog posts, documentation, landing pages, and any page with textual or visual content. The script automatically adapts to each page and handles both static and dynamically loaded content.

HOW TO USE

After installing through the BotGentz extension, simply navigate to any webpage. The script automatically scans the page for duplicate content and displays highlights and statistics. Use the configuration panel to customize your experience: toggle highlights on or off, show or hide the duplicate ratio, enable or disable image duplicate detection, enable or disable meta duplicate detection, adjust the similarity threshold (0.3 to 1.0), and show or hide the summary. The panel displays real-time statistics including the number of duplicate groups by type (text, images, meta, headings) and the overall duplicate ratio. Use the "Scan Page" button to manually rescan, or "Clear Highlights" to remove all visual indicators.

SIMILARITY-BASED DUPLICATE DETECTION WITH ADAPTIVE GROUPING

This script implements a sophisticated duplicate detection engine using Jaccard similarity for text comparison. The engine extracts text blocks from paragraphs, divs, sections, articles, and other content containers, then computes similarity between each pair using word set intersection over union. Text blocks with similarity above the configurable threshold (default 0.7) are grouped into duplicate clusters. Image duplicate detection uses src attribute matching to identify repeated images. Meta tag duplicate detection compares name/content pairs for description, keywords, and other meta fields. Heading duplicate detection compares heading text across h1-h6 elements. The adaptive grouping algorithm ensures each text block belongs to at most one duplicate group, preventing overlapping detections. The duplicate ratio calculation weighs duplicated text by total page text length, providing a meaningful metric of content redundancy.

THE PANEL

The configuration panel is fully draggable and remembers its position per-site using GM_setValue. It snaps to screen edges when dragged near them, collapses to a compact bubble when minimized, and supports Escape key for quick collapse. All settings—including highlight visibility, duplicate ratio display, image and meta detection, similarity threshold, and summary visibility—are persisted across sessions.

PLEASE NOTE

This script requires the free BotGentz extension to run. The script runs on all websites and reads page content to detect duplicates. It does not capture, store, or transmit any personal information. All analysis occurs locally in your browser. The duplicate detection is based on text similarity and may not identify all types of content duplication. The SEO implications are suggestions only and should not be considered definitive advice. Always consult with an SEO professional for comprehensive content analysis.