Skip to content
uencoder

CSV Stream

CSV stream processing parses CSV line by line without buffering the whole file, supporting large files and pipelines.

Purpose

To parse CSV line by line in memory-constrained or large-file scenarios, supporting pipeline transformations and streaming output.

Mechanism

A streaming parser keeps a line buffer, detects the line terminator, parses one line, and emits a record object without waiting for the whole file. It can be piped into transform and write streams.

Use cases

  • Large CSV file processing
  • ETL pipelines
  • Database bulk import

Related tools

References