Text editing guides

Audit a repeated word without losing its denominator

·

When a draft feels repetitive, start with counts and a passage you can check. A term’s share describes repetition in that passage. Read the repeated sentences before deciding which wording to change.

Word Frequency Counter

Check four café occurrences in twelve tokens

Choose Load café example and Count words. The report shows 12 word tokens and 6 distinct terms. The café row shows 4 occurrences and a 33.33% share. The example has one uppercase Café and one lowercase spelling that uses a separate combining accent.

English is the selected segmentation language in this example. The two Arabic occurrences of خريطة still appear as a single term with count 2. Browse the rows to see how the tool treats the whole passage.

Unicode Standard Annex #29 — Unicode Text SegmentationUnicode Standard Annex #15 — Unicode Normalization Forms

Change case and filter separately

Enable Match case and count again. Café appears once and café appears three times. Leave case matching off when the initial capital and lowercase form belong in the same row.

Turn case matching off again and recount. Select a minimum length of four characters and turn on Hide common words. The table has café, maps and خريطة. The café share stays 33.33%. Its denominator still includes the 12 tokens counted before filtering.

ECMA-402 — Intl.Segmenter

Check the TSV column by column

Keep the default high-to-low order and choose Download TSV. Open the file with UTF-8 encoding and a tab delimiter. The headings are Word, Count and Share (%). The café row has the values café, 4 and 33.33. The Share (%) column uses numbers in percentage units, so read 33.33 as 33.33%.

The TSV contains every matching term. Change the sort settings if you want the export to begin with an alphabetical list.

Common questions

Can the reported shares add to less than 100 percent?

Yes. Distinct terms can be hidden by the selected filters, and each visible share is rounded independently.

Why can word boundaries vary between browsers?

The browser’s Unicode segmentation data and the selected text language supply word boundaries. Dictionary-based segmentation can vary with browser versions.

Sources

Put it into practice.

Related guides