Remove Duplicate Words
Remove words typed twice in a row, such as “is is”, or keep only the first time each word appears. Punctuation, line breaks and paragraphs stay, and it works with accents and non-Latin scripts.
Runs in your browser. Your data is not uploaded.How our tools work
Removes a word that repeats the word right before it, like “is is”. Words separated by punctuation or a line break are kept. Punctuation, line breaks and paragraphs are kept.
Word statistics
- Words before
- 0
- Duplicates removed
- 0
- Words after
- 0
How do I remove duplicate words from text?
Paste your text and words typed twice in a row are removed straight away: “This is is a test test.” becomes “This is a test.” Punctuation, line breaks and paragraphs stay. To keep only the first occurrence of every word, choose “Every repeat in the text”. Capitals are ignored unless you match them exactly.
Key features
Typos like “the the”
By default only a word that repeats the word right before it is removed, which fixes doubled words without touching the rest.
Unique words
“Every repeat in the text” keeps only the first time each word appears, and tidies list separators: “apple, banana, apple” becomes “apple, banana”.
Structure kept
Punctuation, line breaks and paragraphs are never removed, and words separated by punctuation or a new line don’t count as a repeat.
Every language
Words are found with Unicode rules, so accents, apostrophes, Urdu, Arabic and other scripts work.
Common uses
- Fix doubled words before submitting an essay or article
- Clean up text from speech-to-text or OCR
- Turn a list of keywords or tags into unique entries
Example: the two modes on one list
Take “apple, Apple, banana, apple pie, apple”. In the default mode nothing changes: no word is directly followed by itself with only a space between, because the commas separate them. In “Every repeat in the text” mode the result is “apple, banana, pie”: Apple counts as a repeat of apple (capitals are ignored unless you match them exactly), and each removed word takes one neighbouring space or list separator with it, so the commas stay tidy.
The default mode is for typos. “I went to to the the shop. Well, well.” becomes “I went to the shop. Well, well.”: the doubled “to” and “the” are fixed, and “Well, well.” is left alone because a comma separates the repeat.
Frequently Asked Questions
Why wasn’t “is, is” changed?
In the default mode only words separated by spaces count as a repeat. A comma, full stop or line break between them usually means the repeat is intended, as in “Well, well.”
What does “Every repeat in the text” do?
It keeps the first time each word appears and removes it everywhere after that, so “hello world hello test” becomes “hello world test”. This changes sentences, so check the result.
Is it case-sensitive?
Not by default: “Hello hello” becomes “Hello”, keeping the first spelling. Turn on “Match capitals exactly” to treat them as different words.
How is this different from Remove Duplicate Lines?
This tool works on individual words. Remove Duplicate Lines deletes whole lines that appear more than once, which is better for lists with one item per line.
Last updated: