# glob-files

Read files matching globs, splitting content by separator and emitting records. Reading is throttled at maxMbps. Pipeline shuts down after all files are consumed.

This plugin is intended for reading text files. For reading files as binary chunks, see the file plugin.

# Config

Required:

globs: Array of glob patterns for files to read

Optional:

separator: Record delimiter (default: \n)
encoding: File encoding (utf8, ascii, base64)
trim: Strip whitespace from records
maxMbps: Throttle rate in MB/s (default: 100)

# Example

pipeline:
  read-globs:
    config:
      globs:
        - /var/log/app/*.log
        - /var/log/system.log
      separator: "\n"
      encoding: utf8
      trim: true
      maxMbps: 50