# tail-file

Watch files matching glob pattern for changes, splitting content by separator and emit records. File positions & inodes are tracked in the db state file to handle things like file rotations. Re-evaluates glob every globInterval seconds to discover new files. Will read from the beginning of a file when fromStart is true.

# Config

Required:

globs: Array of glob patterns for files to tail

Optional:

separator: Record delimiter (default: \n)
encoding: File encoding (utf8, ascii, base64)
trim: Strip whitespace from records
db: State file path (default: {STAGE}.taildb)
globInterval: Glob re-evaluation interval in seconds (default: 60)
tailInterval: File check interval in milliseconds
fromStart: Read new files from beginning instead of end

# Example

pipeline:
  tail-file:
    config:
      globs:
        - /var/log/app/*.log
      separator: "\n"
      encoding: utf8
      db: taildb.json
      fromStart: true