List DeduplicatorPrivacy: All processing runs locally
Remove duplicate list items with advanced matching, sorting, statistics, and export options.
Smart Normalization
Email Normalization
URL Normalization
Domain Normalization
CSV Mode
Duplicate Groups (0)
How It Works
The List Deduplicator splits your input into items using your chosen separator, normalizes each item according to your selected options, then removes duplicates using a local in-browser Map for O(1) lookups.
It can preserve first or last occurrences, show only unique items, extract duplicates, sort output naturally, and optionally normalize emails, URLs, or domains before comparison.
CSV Mode: When enabled, the tool parses CSV rows and can deduplicate by entire row, by a specific column index, or by column header name.
Performance: Handles 100,000+ items smoothly using efficient Map-based deduplication with debounced live processing.
Privacy: No input is sent to any server. All processing happens entirely in your browser using JavaScript.