Extract Unique Links
Extract unique URLs from text
ExtractHow it works
$ grep --pattern=https?:// | unique-lines Examples
Deduplicate URLs from a research notes document
Usage
"Check https://example.com/page1 and https://docs.example.com..." | grep --pattern=https?:// | unique-lines Get unique links from a bookmarks export
Usage
"Resources:
https://react.dev/learn
https://vuejs.org/guide
h..." | grep --pattern=https?:// | unique-lines List unique API endpoints from request logs
Usage
"https://api.example.com/v1/users
https://api.example.com/v1/..." | grep --pattern=https?:// | unique-lines