Remove Duplicate Lines
Paste a list with one item per line and delete the repeats. The first copy of each line is kept, in the original order.
Characters: 0Words: 0Lines: 0
What this tool does
It reads your text line by line and keeps only the first copy of every line. The original order is preserved, so your list does not get reshuffled. Use the ignore case button when "Apple" and "apple" should count as the same line.
Good uses for removing duplicate lines
- Cleaning an email or mailing list.
- Deduplicating a list of keywords or web addresses.
- Tidying log files and exported data.
- Combining two lists into one without repeats.
Tips for better results
Lines that differ only by an extra space at the end count as different. Run Trim extra spaces on the Remove Line Breaks page first if your list has messy spacing. Sorting the list afterwards makes it easier to scan.
How to use the Remove Duplicate Lines tool
- Paste your list into the box, one item per line.
- Click Remove duplicates. Use the ignore case option if "Apple" and "apple" should count as the same.
- Click the copy icon above the text to use the cleaned list.
Frequently asked questions
Does it keep the original order?
Yes. The first time a line appears it is kept, and later copies are removed.
Does it treat Apple and apple as duplicates?
Only if you click Remove duplicates (ignore case). The normal button treats them as different lines.
Can I clean an email or name list?
Yes. Put one email or name on each line and run the tool. Extra spaces at the ends of lines count as part of the line.