Skip to content
uencoder
PIPELINE Text Processing Beginner 2 steps

Deduplicate lines and count words

Useful for analyzing log entries or token lists. The first node produces a sorted unique list; the second node counts words, giving you a quick sense of vocabulary size or remaining work. The count reflects the deduplicated output, not the original input.

What it solves

Sort and remove duplicate lines, then count the remaining words to get a quick inventory.

Input → Output

Sort & Unique input → Word Count output across 2 steps.

Runs in

1–2 minutes · fully local in your browser.

Before you start

  • A text with one item per line

The pipeline

  1. 1 Sort & Unique sort-unique

    Sort lines alphabetically, numerically, by length, or naturally; deduplicate; reverse or shuffle. Free, private, and 100% client-side.

    Params: dedup=true

  2. 2 Word Count word-count

    Count characters, words, lines, sentences, paragraphs, byte size, and estimate reading time. Free, private, and 100% client-side.

Open in Toolchain

Runs locally in your browser. The recipe defines the pipeline only — your input never leaves this tab.

▶Run this workflow

Enter your input below and click Run. All processing happens locally in your browser — nothing is uploaded.

Pipeline progress

  1. Sort & Uniquesort-unique
  2. Word Countword-count

Sample input

error
warn
error
info
warn

Expected output

Characters: 15
Characters (no spaces): 13
Words: 3
Lines: 3
Sentences: 1
Paragraphs: 1
Bytes (UTF-8): 15
Reading time: ~1 min

This pair is executed against the real tools at build time (tests/unit/recipes.test.ts) — the expected output is verified, not illustrative.

Related workflows

You might also need

Workflows sharing tools or topics with this recipe.

Learn more

Tools used