Remove Duplicate Lines
Paste text above to remove duplicate lines.
Paste a list or block of text and this tool removes repeated lines, keeping the first occurrence of each one in its original order. Turn on case insensitive matching to treat Apple and apple as the same, or trim whitespace so stray spaces and tabs do not hide duplicates. Everything runs in your browser, so your text never leaves your device.
How to use
- Paste or type your text into the input box, one entry per line.
- Optionally tick case insensitive to match lines regardless of letter case.
- Optionally tick trim whitespace to ignore leading and trailing spaces and tabs when comparing.
- Read the deduplicated text in the output box and check the count of removed lines.
- Click Copy to copy the result, or Reset to start over.
Examples
- Input: apple, banana, apple, cherry, banana (each on its own line). Output: apple, banana, cherry. Removed 2 duplicate lines.
- Input: Apple, apple, APPLE with case insensitive on. Output: Apple. Removed 2 duplicate lines.
- Input: hello, two spaces hello, hello with a trailing tab, with trim whitespace on. Output: hello. Removed 2 duplicate lines.
FAQs
- Which copy of a duplicate line is kept?
- The first occurrence is always kept, and the original order of the remaining lines is preserved. Later repeats are removed.
- Does this change the lines that are kept?
- No. The text of each kept line is left exactly as you entered it. The case insensitive and trim options only affect how lines are compared, not what is written out.
- What counts as a duplicate when trim whitespace is on?
- With trimming on, leading and trailing spaces and tabs are ignored during comparison, so a line and the same line with extra surrounding spaces are treated as the same.
- Are blank lines removed?
- Repeated blank lines are treated like any other duplicate, so the first blank line is kept and later blank lines that match are removed.
- Does it work with text copied from Windows?
- Yes. Windows (CRLF) and classic Mac (CR) line endings are normalized to standard line breaks before comparing, so pasting from any platform works.
- Is my text uploaded anywhere?
- No. All processing happens locally in your browser. Nothing is sent to a server.
Related tools
- Sort LinesSort lines of text online. Alphabetical (A to Z, Z to A), case insensitive, numeric, by length, or reverse. Fast, private, and free.
- Find and ReplaceFind and replace text online. Case insensitive, whole word, and regex modes with a live replacement count. Runs in your browser.
- Whitespace RemoverClean up whitespace in text. Trim lines, collapse extra spaces, remove blank lines, or strip all spaces. Free, fast, and private in your browser.
- Text ReverserReverse text by characters, by word order, or by line order. Emoji safe and fully client-side. Paste, pick a mode, and copy the result.
- Word CounterCount words, characters, sentences, paragraphs, and reading time for any text. Live, private, and free in your browser.
- Case ConverterConvert text between UPPERCASE, lowercase, Title Case, Sentence case, camelCase, snake_case, and kebab-case instantly in your browser.