Remove duplicate lines
Paste a list and remove the repeated lines instantly. Choose whether case and accents matter, which copy to keep, and see how many times each line appeared.
Paste a list to see how many items repeat.
You can also drag a .txt, .csv, or .docx file onto the box. It is not uploaded to any server.
Options
Frequency table
| Line | Times | Removed |
|---|
Paste a list to see how many times each line appears.
Select a line to highlight its first occurrence in your list.
How to use it
- Paste your list in the box, one item per line. You can also open a .txt or .csv file.
- Pick what to show: remove duplicates, show only the lines that repeat, or keep only the lines that appear once.
- Adjust the options: case, accents, spaces, blank lines, which copy to keep, and the order of the result.
- Copy the result or download it. Open the frequency table to see how many times each line appeared.
Frequently asked questions
Does it match upper and lower case?
Not by default: “Apple” and “apple” count as the same line. If you turn on “Case-sensitive,” they become different lines. With “Ignore accents,” two lines that differ only by accent marks are also treated as the same.
Which of the repeated lines is kept?
The first one by default. If you choose “Last,” the last copy stays and the result follows the position of that last occurrence. When copies differ only in case, the text of the copy you keep is the one shown.
What is the difference between “Duplicates only” and “Appear once only”?
“Duplicates only” shows each line that appears more than once, one time each. “Appear once only” shows the lines that appear exactly once and drops every repeated line completely.
Can I remove duplicates from a comma-separated list?
Yes. Change the separator to comma, semicolon, space, or tab. The result is joined with the same separator. It works well for a list of email addresses or tags.
How many lines can it handle?
Hundreds of thousands. Large lists are processed in the background so the page does not freeze, and the result box shows only the beginning while Copy and Download include everything.
Is my list sent to a server?
No. Everything is processed in your browser and your list never leaves your device.
What removing duplicates is useful for
- Email and contact lists: avoid sending the same message twice.
- Keywords and tags: keep each term only once.
- Exported data: clean up a column copied from a spreadsheet.
- Logs: find which lines repeat and how many times with the frequency table.
How two lines are decided to be the same
Before comparing, each line can go through three adjustments: trimming the spaces at both ends, ignoring case, and ignoring accents. Two lines are duplicates if they end up identical after those adjustments. The result keeps the original text of the copy you choose.
Characters written in two different ways are also unified. Accented letters can be stored as a single character or as a plain letter followed by a separate accent mark. Text copied from a macOS file or a PDF sometimes uses the second form, and it looks exactly the same on screen. Here both count as the same line.
What counts as a repeated line
Each line break separates one item. Blank lines are skipped by default, so they never show up as “repeated.” If your list uses commas, semicolons, spaces, or tabs, change the separator and each item is compared on its own, without touching the rest of the text.
How to keep only the unique lines
Removing duplicates leaves one copy of each line. If you would rather discard everything that repeats, for example to see which email addresses appear only once in a list, use the “Appear once only” mode. And if you want to know what repeats, “Duplicates only” shows each of those lines once.
When to use the frequency table
The table shows how many times each line appears and how many copies are removed. Selecting a row highlights that line in your list. It helps you spot the items that repeat most in a log or a keyword list, and you can download it as a CSV to open in a spreadsheet.
Need to put the cleaned list in order? Try Sort lines. To see what changed between two versions, use Compare text.
Updated on September 29, 2026