How to find repeated words and decide which to keep

Istio · Updated

A frequent word is a place to start reading, not necessarily a word to delete. Try this with a short product description. The aim is to remove the repetition while keeping every fact a buyer needs.

Find the repeated word

The lantern has a folding handle. The lantern runs for six hours. Hang the lantern inside the tent.

Paste the passage into Istio’s text analyzer, choose English and turn off word-form grouping for this comparison. Look for lantern in the word frequency table. Read the three sentences aloud: the identical openings are more noticeable than the last mention.

Edit the passage, then compare

The lantern has a folding handle and runs for six hours. Hang it inside the tent.
Occurrences in the two passages
WordOriginalRevision
lantern31
handle11

Analyze just the revised passage with the same settings. Joining two sentences removed a repeated subject; using “it” works because the instruction still points to one object. The handle, runtime and hanging instruction all survived the edit.

When keeping the noun is clearer

Compare “Place the lantern beside the battery. Remove it before packing.” Which item comes out? If the instruction means the battery, write “Remove the battery before packing.” That extra occurrence earns its place. For an explanation of why word counts and percentages can move differently, see how to read text analysis metrics.