Remove duplicate lines

Paste a list to remove repeated lines, keeping the first copy of each.

Options

What it does

Clean up email lists, keywords, URLs, product codes or any other list with one item per line. Each line is kept once, in the order it first appeared, so nothing gets shuffled unless you ask for sorting. Lines that differ only by spaces at the start or end count as the same, and you can also ignore upper and lower case so “Apple” and “apple” merge. Lines copied from different sources sometimes look identical but are stored differently, for example an accented letter typed as one character or as a letter plus an accent; those are matched too. The summary tells you how many lines were removed and which ones were repeated most, which helps when you’re checking a list for mistakes rather than just cleaning it.

How to use it

How it works
  1. Paste your list into the box, one item per line.
  2. Duplicates are removed as you type, keeping the first copy of each line. The count of removed lines appears under the result.
  3. Adjust the options if needed: ignore upper and lower case, ignore spaces around lines, keep empty lines, keep the last copy instead, or sort the list A to Z.
  4. Copy the clean list or download it as a text file.

Common uses

  • Removing repeated addresses from an email list before sending a newsletter
  • Merging keyword lists from several SEO tools into one list without repeats
  • Finding which order numbers or product codes appear more than once in an export
  • Cleaning a list of URLs before submitting them for indexing or adding them to a redirect file

Tips

  • Turn on “Ignore case” for email addresses: the part after @ is never case-sensitive, and in practice the part before it isn’t either.
  • Sorting uses natural order, so “item 2” comes before “item 10”, unlike a plain A to Z sort in many spreadsheets.
  • To compare two lists, paste both into the box: the “Repeated most” summary shows which entries appear in both.

Questions

Does it change the order of my lines?

No. Lines stay in the order they first appeared, and only the later copies are removed. Choose “Keep last copy” to keep each line at its last position instead, or sort A to Z if you want a sorted list.

Can it remove duplicates from a CSV or Excel column?

Yes: copy the column and paste it here, since each cell becomes a line. For whole CSV rows, each row is compared as one line of text, so rows are removed only when every column matches.

How many lines can it handle?

Hundreds of thousands of lines are processed in a moment, because everything happens in your browser’s memory. Very large pastes may make the text box itself slower to scroll.

Is my list uploaded?

No. Email lists and customer data stay on your device; the tool runs entirely in your browser and stores nothing.

Related tools

  • Word and character counter

    Count words, characters, sentences and paragraphs as you type, with reading time and limits for X, SMS and meta tags. Counts Arabic correctly.

  • Case converter

    Convert text to sentence case, Title Case, UPPERCASE or lowercase, or to camelCase, snake_case and kebab-case for code. Free, in your browser.

  • Compress images

    Shrink image file size without visible quality loss. Private, fast, free.

  • Convert HEIC to JPG

    Convert iPhone HEIC photos to JPG instantly. Files never leave your device.

  • Resize images

    Resize JPG, PNG and WebP images to exact pixel dimensions or by percentage. Keep the aspect ratio, resize in bulk, no upload.

  • Passport & ID photo maker

    Make a passport or ID photo at the right size for the US, UK, Canada and more, plus a 4×6 inch print sheet. Free, private, no upload.