TEXT · LINES · WORDS
Remove duplicate lines or words
Find and remove repeated lines or words. Choose whether case, whitespace, punctuation, and original order should be significant.
Review duplicate entries and copy or download the cleaned text.
Hides comparison and inference settings
01 / PROCESSING
Select what to consider as a repeat
Leaves the first or last match of a string, preserving the order of the remaining strings.
0 characters
02 / RESULT
Cleared text
EXAMINATION
Deleted matches
TEXT OVERVIEW
Text statistics
Characters are counted as Unicode graphemes. The “Without spaces” count excludes whitespace, including tabs and line breaks.
TOOL FEATURES
Remove duplicate lines and words
The tool finds duplicate lines or words and produces clean text while maintaining the order of the remaining elements. It is suitable for lists, uploads and plain text in Russian and English.
- For strings, you can adjust case, edge spaces, series of spaces, and first or last occurrence selection.
- Word matching can be case-sensitive, ignore punctuation, search within longer strings, or treat ё and е as equivalent.
- Can remove empty lines, select line endings, and view a list of deleted position matches.
- The overview shows characters, characters without spaces, words, and lines.
Select "line" or "word" mode, insert text and press the process button. In simplified mode, only the basic parameters remain; full mode opens comparison and result settings.