Clean an inventory list without changing the retained entries
Admin ·
When two inventory lists contain the same item, decide whether capitalization and surrounding spaces are part of the item ID. Duplicate Line Remover can match exact lines or ignore those differences for comparison. The retained line keeps its original spelling and spacing.
Start with exact matching and inspect the removed line numbers
Choose Load example with the default First occurrence selected. Stage-03 occurs on lines 2 and 4. The tool keeps line 2 and reports that it removed source line 4. The list still includes both Reserve-12 and the lowercase version with two leading spaces on line 3.
Select Ignore case and Ignore surrounding whitespace if your inventory uses those spellings for the same item. The tool now reports 5 input, 3 kept, 2 removed. It removes source lines 3 and 4, and the output lists Reserve-12, Stage-03 and Gate-06 in that order.
Reserve-12
Stage-03
reserve-12
Stage-03
Gate-06Choose which occurrence should survive
Keep First occurrence when the earlier text is authoritative. With Last occurrence, the same settings remove lines 1 and 2. The retained text starts with the indented lowercase reserve-12 from line 3, then Stage-03 from line 4 and Gate-06 from line 5. The tool keeps the order of the surviving source lines.
Download cleaned text and open it in a text editor. Check the first line's capitalization and leading spaces to verify which record was retained. If your import expects a uniform identifier spelling, handle that as a separate transformation.
Compare canonically equivalent accents when a list has mixed sources
An accented character may be stored as one code point or as a base letter followed by a combining mark. Paste the two café lines below with the other comparison controls off. Exact matching keeps both. When you select Match canonically equivalent Unicode (NFC), the comparison key treats them as equal and one line remains.
NFC is used for matching only. Check the downloaded text in an editor that shows code points if the exact stored form also matters.
café
caféCommon questions
Does last occurrence mean the output is reversed?
The last source index for each matching key survives. The output still follows source order across the retained lines.
Can I deduplicate according to one CSV field?
This tool compares physical lines. For a file with quoted fields and embedded line breaks, use a CSV-aware workflow to compare records.