Skip to content
craph edited this page Dec 12, 2020 · 1 revision

Output

It exports events out of the pipeline. It can be file, database, etc.

output_archive

It stores in buffer event and it writes buffer in file.

Parameters :

  • match : pattern to match tag
  • time_key : used to extract time to interpolate path_template
  • path_template : Template of the file path
  • buffer_size=1000 : Number of event stored before flush
  • timeout_flush=60 : Flush buffer after timeout, in second
  • db_path=None : file path to store internal state. None means only RAM is used.

Example :

- name : output_archive
  time_key : timestamp
  path_template : "/archives/{source}/log-%Y%m%d.json"
  match : mylog

Notes :

  • if the example received the event contains record {"timestamp":1607618046, "source":foo, "data":"test"}, the path will be /archives/foo/log-20201210.json

output_rethinkdb

Store events in RethinkDB as time serie.

Parameters

  • match : pattern to match tag
  • time_key : used to extract time to interpolate table_template
  • table_template : Template of the table name
  • buffer_size=1000 : Number of event stored before flush
  • database="test" : database name
  • ip="localhost" : f set, change the database destination ip
  • port=None : if set, change the database destination port
  • wait_connection=30 : used to wait the database warmup
  • timeout_flush=60 : Flush buffer after timeout, in second
  • db_path=None : file path to store internal state. None means only RAM is used.

Example:

- name : output_rethinkdb
  time_key : timestamp
  table_template : "log-%Y%m%d"
  database : test
  ip : rethink.com
  port : 28015
  match : my_log

output_stdout

Display event in stdout.

Parameters

  • match : pattern to match tag

Example:

- name : output_stdout
  match : my_log
Clone this wiki locally