Archive guides

Trace the same file bytes across ZIP and TAR.GZ

·

A backup can contain the same file under a new name. Check the expanded bytes before treating filenames as evidence of duplicate content.

Duplicate File Finder in Archives

Find the route note under three paths

Select Load example and Scan for duplicates. The example contains routes.zip and handoff.tar.gz, with five regular files total. One group contains three copies of the 12-byte text North route followed by LF.

The expanded bytes match exactly at the three locations below. The two label.txt files contain different bytes, so they do not form a group.

Find the route note under three paths
ArchiveMatching pathExpanded bytes
routes.ziproutes/café.txt12
routes.zipcopies/check.txt12
handoff.tar.gzhandoff/route-backup.txt12

PKWARE APPNOTE 6.3.10, ZIP file formatRFC 1952, GZIP file formatNIST FIPS 180-4, Secure Hash Standard

Read the 24 repeated logical bytes

One 12-byte copy is counted as the first occurrence. The other two account for 24 repeated logical bytes. Compression and archive headers determine how removing copies would affect the size on disk.

The worker hashes expanded member bytes using SHA-256 and then compares all bytes within matching hash and size groups. Nested archives are treated as ordinary files.

PKWARE APPNOTE 6.3.10, ZIP file formatRFC 1952, GZIP file formatNIST FIPS 180-4, Secure Hash Standard

Save the JSON and verify the scan coverage

Download archive-duplicates.json. Each group lists its SHA-256, byte count and source locations. The source number points to its archive in sources, which is useful when selected archives share a filename.

Check complete and the source issues before relying on the report. A damaged member produces a partial scan. Every displayed group is backed by matching readable files.

PKWARE APPNOTE 6.3.10, ZIP file formatRFC 1952, GZIP file format

Common questions

Will the path inside the ZIP affect matching?

Paths identify the locations only. Matching uses the expanded file bytes.

Do nested ZIPs get scanned recursively?

The scan compares a nested archive as one regular file. Open that archive separately to inspect its members.

Sources

Put it into practice.

Related guides