pipr.tools
Pipes
Clean Email Strip formatting from pasted email for clean plain text Clean AI Output Clean plain text from ChatGPT or AI output Decode & Format JWT Decode a JWT and pretty-print header and payload Word Frequency Count word frequency in text

unique-lines Remove duplicate lines

Aa Text
Input0 chars
Output0 chars

Examples

Deduplicate log error lines

Usage
"error: timeout
error: 404
error: timeout
error: 500
error: 4..." | unique-lines

Remove duplicate emails from a newsletter subscriber list

Deduplicate a copy-pasted attendee list from a meeting invite

Usage
"Alice
Bob
Alice
Charlie
Bob
Dave
Charlie" | unique-lines
View source
(input)=>[
                    ...new Set(input.split("\n"))
                ].join("\n")