⚡ Pipes

Clean Email Strip formatting from pasted email for clean plain text Clean AI Output Clean plain text from ChatGPT or AI output Decode & Format JWT Decode a JWT and pretty-print header and payload Word Frequency Count word frequency in text Extract Emails Extract email addresses from text Fit Context Window Clean HTML and truncate to fit an LLM token budget Find Unique Errors Find unique error lines in logs JSON → Table Readable ASCII table from a JSON array Extract AI Code Numbered code blocks from AI responses Count Markdown Words Count words in Markdown content Clean HTML to Text Readable plain text from raw HTML Flatten & Sort JSON Sorted dot-notation view of nested JSON Transliterate to Slug Convert Unicode text to ASCII and create a URL slug Query & Format JSON Formatted JSON value from a nested path HTML Word Frequency Count word frequency in HTML content Extract & Sort Numbers Sorted list of all numbers found in text Split, Sort & Deduplicate Clean sorted list from comma-separated values Lowercase, Sort & Deduplicate Case-normalized sorted unique list Strip Comment Lines Clean text with comment lines removed HTML to Plain Text Plain text from HTML-encoded content Decode Base64 to JSON Readable JSON from Base64-encoded data Minify & Encode JSON Base64-encoded minified JSON Extract Unique Links Extract unique URLs from text Extract URLs Extract URLs from text Extract Unique Email Addresses Extract unique email addresses from text Sort & Deduplicate Sorted unique list of lines Number Lines Sorted, numbered unique lines Trim & Clean Clean text with no extra whitespace Clean & Count Text Line and word counts for cleaned text Remove HTML Tags Plain text with HTML tags removed Reverse & Number Numbered lines in reverse order Reverse Sort & Number Numbered lines in reverse-sorted order Markdown Table GitHub Markdown table from CSV data Base64 Encode Encode text as Base64 URL Encode Encode text for safe use in URLs Character Stats Character, word, and line counts

⟐ Data

csv-to-json csv-to-md-table csv-to-table json-flatten json-format json-keys json-minify json-query json-to-csv json-to-toml json-to-yaml sql-format toml-to-json yaml-to-json

</> Web

extract-codeblocks html-to-text md-to-html mermaid-render mustache-render strip-markdown syntax-highlight

{ } Encode

base64-decode base64-encode escape html-decode html-encode jwt-decode qr-encode url-decode url-encode

⇔ Decode

chmod-calc cron-explain nato

# Stats

char-freq token-chunk token-count token-split token-truncate wc word-freq

.* Regex

regex-extract regex-replace

⚡ Gen

ascii-art hash lorem timestamp uuid

◷ Time

epoch-to-human human-to-epoch

Find Unique Errors

Find unique error lines in logs

Extract

How it works

1. grep Filter lines matching a pattern 2. sort-lines Sort lines alphabetically 3. unique-lines Remove duplicate lines

$ grep --pattern=error | sort-lines | unique-lines

Examples

Deduplicate error lines from a server log file

Usage

"2024-01-15 INFO: Server started
2024-01-15 ERROR: Connection..." | grep --pattern=error | sort-lines | unique-lines

Extract unique CI/CD pipeline errors from build output

Usage

"[ERROR] Build failed: missing module
[WARN] Deprecated API
[..." | grep --pattern=error | sort-lines | unique-lines

Find distinct Java exceptions from an application log

Usage

"ERROR: NullPointerException at line 42
DEBUG: Processing rec..." | grep --pattern=error | sort-lines | unique-lines

Combine with other tools