Infrastructure Integration

Configuration

  1. Configure your fluentd to use a monitor agent and plugin id, for example:

          <source>
      type monitor_agent
      bind 0.0.0.0
      port 24220
    </source>
    <match test>
      id   plg1
      type forward
      <server>
        host localhost
      </server>
    </match>
    
    <match **>
      id   plg2
      type forward
      <server>
        host localhost
      </server>
    </match>
    
  2. Configure the agent by editing /etc/netsil-dd-agent/conf.d/fluentd.yamlin the collectors.

Example:

    init_config:
    instances:
        # Every instance requires a `monitor_agent_url`
        # Optional, set `plugin_ids` to monitor a specific scope of plugins.
        -  monitor_agent_url: http://example.com:24220/api/plugins.json
           plugin_ids:
         - plg1
         - plg2
           tags:
         - 'test'
         - 'datacenter:northeast'
        # Optional, set 'tag_by' to specify how to tag metrics. By default, metrics are tagged with `plugin_id`
        -  monitor_agent_url: http://example.com:24220/api/plugins.json
           tag_by: type
  1. Check and make sure that all yaml files are valid with following command:

    /etc/init.d/netsil-collectors configcheck
    
  2. Restart the Agent using the following command:

    /etc/init.d/netsil-collectors restart
    
  3. Execute the info command to verify that the integration check has passed:

    /etc/init.d/netsil-collectors info
    

The output of the info command should contain a section similar to the following:

    Checks
    ======
      [...]
      fluentd
      ----------
          - instance #0 [OK]
          - Collected 8 metrics & 0 events

Infrastructure Datasources

Datasource Available Aggregations Unit Description
fluentd.retry_count avg max min sum time The number of retries for this plugin.
fluentd.buffer_queue_length avg max min sum buffer The length of the buffer queue for this plugin.
fluentd.buffer_total_queued_size avg max min sum byte The size of the buffer queue for this plugin.