Duplicate Line Remover
Your workspaceProcessed on your device
A few things to know.
Runs on your device. Up to 1 million UTF-16 code units and local UTF-8 files smaller than 4 MB. CRLF, CR and LF are accepted. Downloads use UTF-8 and LF. Ignore case uses English lowercase matching. The tool compares full physical lines, including blank lines.
- Paste a list, open a UTF-8 text file or choose Load example. By default, matching compares the full line and keeps its first occurrence.
- Choose which occurrence to keep. Enable ignore-case, surrounding whitespace or NFC matching only if those distinctions are irrelevant to your identifiers.
- Check the count and removed source line numbers. Copy or download the retained lines.