freesabaiRemove duplicate lines
Paste a list (names, emails, links, phone numbers) one item to a line and remove the repeated lines so one of each is left, in the original order, or show only the lines that repeat. It runs in your browser and the text you paste is not sent anywhere.
This tool needs JavaScript. If you still see this after a few seconds, JavaScript is switched off in your browser or the page did not load completely: turn JavaScript on or reload the page.
How to use it
- Paste the list into the box on the left, one item to a line, or press "Open file" and choose a text file.
- Choose what to keep: one of each line, only the lines that appear once, or only the lines that repeat. The result shows at once.
- Press "Copy" or "Download" to take the result.
Frequently asked questions
Does removing duplicates change the order of the lines?
No. The lines that are left stay in their original order, keeping the first one found (or the last, if you choose). To sort them too, use the line sorter afterwards.
Are lines that differ only in case or trailing spaces duplicates?
Not by default, because the text is different. Tick "Ignore upper and lower case" and "Trim spaces before comparing" to treat Apple and "apple " as one. The line that is kept keeps its text exactly as it was.
How big a list can it handle?
You can paste or open up to 20 MB, hundreds of thousands of lines. Big texts are handled in a worker of the browser, so the tab does not freeze.
Good to know
- The kind of line ending of the text (Windows or Mac/Linux) is kept as it came.
- Thai text that differs only in the order of vowel and tone marks but looks the same counts as equal (Unicode NFC), but a composed sara am and its two-piece form are not treated as the same.
Your data stays on your device
Everything runs in your browser. What you type, paste or open is not sent to freesabai's servers or anyone else's, and is not kept in the browser: close the page and it is gone. The site only counts how many times this page was opened and how many times someone copied or saved a result (never what was pasted or the result, and you can switch the counting off in the footer; see the privacy policy).
Report a problem or suggest an idea
Found a bug, or want this tool to do more? Tell us on the feedback page. No sign-up.
Other text tools
Convert and edit text
- Case converterUPPERCASE, lowercase, Title Case, camelCase, snake_case, kebab-case and more
- Find and replace textReplace several pairs at once, plain text or regex
- Slug generatorTurn a title into a clean URL slug, Thai kept or removed
- Reverse textReverse characters, words or lines without breaking Thai marks and emoji
Lines
- Remove duplicate linesKeep one of each repeated line, in the original order
- Sort linesSort A-Z, in Thai alphabetical order, by number or length, or shuffle
- Remove empty lines and extra spacesRemove blank lines, trim every line, collapse repeated spaces
- Add line numbers, prefix and suffixNumber lines, or add text at the start and end of every line
Thai language
- Thai keyboard layout fixerTurn "l;ylfu" into "สวัสดี" and back (Kedmanee layout)
- Number to Thai words (baht text)1,234.50 becomes the amount in Thai words, with baht and satang
- Buddhist and Gregorian year and date converter10/10/2569 becomes 10/10/2026, many dates at once
- Thai digits converter1234 ⇄ ๑๒๓๔ in a whole text, phone numbers can stay as they are
More tools for text (in the developer tools)
- Character, word and line counterCount characters, words (Thai too), lines, sentences, paragraphs and reading time
- Lorem ipsum generatorPlaceholder text in Thai and English, by paragraphs, sentences or words
- Password generatorMake strong random passwords, choose length and characters, made on your device
- URL encode and decodePercent-encode or decode a link, Thai in URLs included, and take a URL apart
- HTML entities encode and decodeTurn special characters into & < > " and back
- Base64 encode and decodeBase64 for text (Thai and UTF-8), URL-safe, and files to and from Base64