How to remove duplicates from a list
- Paste your list into the box, one item per line.
- Set the options. Case sensitive and Trim whitespace before comparing are on by default. Remove empty lines is off.
- Select Remove Duplicates.
- Check the counts, then select Copy result.
If you change an option, the result updates straight away. If you edit the list itself, select Remove Duplicates again.
Which copy is kept
The tool reads your list from top to bottom. The first time it sees a line, it keeps it. Any later line that matches is removed. Nothing is sorted or moved.
For example, the list red, blue, Red, red, green, blue (one per line) becomes red, blue, Red, green with the default settings. The counts read 6 original lines, 4 unique lines, and 2 removed. "Red" stays because case-sensitive matching treats it as a different line.
How the options change the result
| Setting | What counts as a match | red, blue, Red, red, green, blue |
|---|---|---|
| Case sensitive on (default) | Same letters and same capitals | red, blue, Red, green |
| Case sensitive off | Same letters, any capitals | red, blue, green |
| Trim whitespace on (default) | Spaces and tabs at the start and end are ignored | "apple " matches "apple" |
| Trim whitespace off | Every character must match | "apple " and "apple" both stay |
| Remove empty lines on | Every blank line is dropped, not just repeats | a, blank, b, blank, c gives a, b, c |
With case sensitivity off, the first spelling wins. If "Apple" comes before "apple" and "APPLE", only "Apple" is kept.
Trimming only affects the comparison. The lines you keep stay exactly as you typed them, so indentation is not lost. Trimming also only touches the ends of a line. Two spaces between words still differ from one space; clean those first with the Whitespace Remover.
Blank lines and the line counts
By default, empty lines are compared like any other line. The first blank line is kept and every later blank line is removed and counted in Removed. A list of a, blank, b, blank, c gives 5 original lines, 4 unique lines, and 1 removed. Tick Remove empty lines to drop every blank line, including lines that hold only spaces.
A line break after the last item is not counted as an extra line, so the original count matches the items you see. The final line break is kept at the end of the result.
When to use the Text Sorter instead
Use this tool when the order of your list matters, such as steps, a ranked list, or rows you will paste back next to other data. If you also want the list in A to Z order, the Text Sorter can remove duplicates and sort in one step. It does not trim spaces before comparing, so a line with a trailing space survives there.
Common Mistakes to Avoid
Expecting "Apple" and "apple" to merge with the default settings.
Solution:
Pasting a comma-separated list.
Solution:
Expecting all blank lines to disappear.
Solution:
Cleaning email lists with case sensitivity on.
Solution:

