FluentD Collector Inputs

George Alpizar
George Alpizar
  • Updated

Overview

This input type allows you to specify a set of ports and protocols that the agent will listen for.


Review Parameters

Review the following parameters that you can configure in the Edge Delta App:

YAML Description
labels

Enter a descriptive name for this input. 

When you create a workflow, you will use this label to enter your input into the workflow. 

This parameter is required. 

Review the following example: 

labels: "fluentd-input"
port

Enter the FluentD port. This parameter is required to support tcp stream.

This parameter is required. 

Review the following example: 

port: 23131
shared_key

Enter the key shared between nodes. 

This parameter is optional. 

listen

Enter a network interface where the agent can listen for data. 

This parameter is optional. 

Review the following example: 

listen: localhost
read_timeout

Enter a maximum time to wait and listen for data. 

This parameter only applies if you select tcp as the protocol

This parameter is required. 

Review the following example: 

read_timeout: 30s
read_size

Enter the number of lines to read from the incoming data. 

If you do not enter a value, then 1 will be used. 

This parameter only applies if you select tcp as the protocol

This parameter is optional. 

Review the following example: 

read_size: 10000
enable_incoming_line_anomalies

Enter true or false to generate anomaly scores.  

This parameter is optional. 

Review the following example: 

enable_incoming_line_anomalies: true

add_ingestion_time

Mark (or enter) true or false to ingest a timestamp if the input format is in JSON.

This parameter is optional. 

Review the following example: 

- labels: "billing,errorcheck"
      path: "/billing/logfolder1/*.log"
      add_ingestion_time: true
      skip_ingestion_time_on_failure: true 

skip_ingestion_time_on_failure

Mark (or enter) true or false to skip the ingestion of the timestamp when the input is broken or in an invalid format. 

This parameter is optional. 

Review the following example: 

skip_ingestion_time_on_failure: true
filters

Select an existing filter to add to this input. 

To learn how to create a filter, see Filters.

This parameter is optional. 

Review the following example: 

filters:
  - info

tls:

  disable_verify

To disable a TLS verification of a certificate, in the YAML file, enter: 

  • disable_verify: true.

To enable a TLS verification of the certificate, in the YAML file, you can enter disable_verify: false or you can remove this line entirely. 

This parameter is optional. 

Review the following example: 

tls:
  disable_verify: true

tls:

  ca_file

Enter the absolute file path to the CA certificate file.

This parameter is optional. 

Review the following example: 

tls:
  ca_file: /var/etc/fluentd

tls:

  ca_path

Enter the absolute path to scan the CA certificate file.

This parameter is optional. 

Review the following example: 

tls:
  ca_path: /certs/ca.pem

tls:

  crt_file

Enter the absolute path to the certificate file. 

This parameter is optional. 

Review the following example: 

tls:
  crt_file: /certs/server-cert.pem

tls:

  key_file

Enter the absolute path to the private key file. 

This parameter is optional. 

Review the following example: 

tls:
  key_file: /certs/server-key.pem

tls:

  key_password

Enter the password for the key file.

This parameter is optional. 

Review the following example: 

tls:
  key_password: p@ssword123

tls:

 client_auth_type

Select a client authorization type. 

You can select (or enter):

  • noclientcert
  • requestclientcert
  • requireanyclientcert
  • verifyclientcertifgiven
  • requireandverifyclientcert

The default setting is noclientcert.

This parameter is optional. 

Review the following example: 

tls:
client_auth_type: noclientcert

tls:

  min_version

Enter the minimum version of TLS to accept. 

This parameter is optional. 

Review the following example: 

tls:
min_version: TLSv1_1

tls:

  max_version

Enter the maximum version of TLS to accept. 

This parameter is optional. 

Review the following example: 

tls:
max_version: TLSv1_3

 

Share this document