winston3-logstash-transport

A winston@3 transport for LogStash.

This winston transport has been rewritten from both winston-logastah and winston-logstash-udp to use the new Transport behavior from winston@3.

Where possible, this has been updated to mimic the behaviors of the original modules. There are some changes that have been made to allow the transport to handle either TCP or UDP connections to LogStash, instead of being dedicated to a single transport-layer protocol.

Usage

const Winston = require('winston');
const WinstonLogStash = require('winston3-logstash-transport');

const logger = Winston.createLogger();

logger.add(new WinstonLogStash({
  mode: 'udp',
  host: '127.0.0.1',
  port: 28777
}));

logger.error('Some Error');

API

constructor(options)

Create a new Logstash Transport

options

Name	Type	Description	Valid Values	Default	TCP	UDP
mode	string	The protocol to use to connect to LogStash. tcp is an alias for tcp4 and udp is an alias for udp4.	udp udp4 udp6 tcp tcp4 tcp6	'udp4'	✔️	✔️
localhost	string	The hostname sent to LogStash	Any	os.hostname	✔️	✔️
host	string	The LogStash server ip or hostname	Any valid IP or host address	127.0.0.1 (ip4) ::0 (ip6)	✔️	✔️
port	integer	The LogStash server port number	Any integer	28777	✔️	✔️
applicationName	string	The application name sent to LogStash	Any	process.title	✔️	✔️
pid	string	The Operating System process ID for this process	Any valid PID	process.pid	✔️	✔️
silent	boolean	Offline/Silent mode enabled		false	✔️	✔️
maxConnectRetries	integer	The number of attempts to reconnect to make before erroring out	Any integer	4	✔️	✔️
timeoutConnectRetries	integer	The number of milliseconds to wait between connection attempts	Any integer	100	✔️	✔️
label	string	The LogStash label to send with the information	Any	process.title	✔️	✔️
sslEnable	boolean	Whether SSL/TLS connection should be attempted when connecting via TCP		false	✔️
sslKey	filepath	The filepath to the SSL Key	Any valid filepath	''	✔️
sslCert	filepath	The filepath to the SSL Cert	Any valid filepath	''	✔️
sslCA	filepath or Array(filepaths)	The filepath(s) to the Certificat Authority (CA) Intermediary Certs	Any valid filepath(s)	''	✔️
sslPassPhrase	string	The SSL Cert PassPhrase (if any)	Any	''	✔️
rejectUnauthorized	boolean	Enable connection rejection when cert is not valid		false	✔️
trailingLineFeed	boolean	Enable appending end of line character to UDP output		false		✔️
trailingLineFeedChar	string	The type of end of line character(s) to append to UDP output	Any	os.EOL		✔️
formatted	boolean	Enable/Disable delivery of standard pre-formatted JSON payloads. See Message Payloads for more info.		true	✔️	✔️
hasNewline	boolean	Enable / disable added newline for message		false	✔️	✔️

Message Payloads

By default or when options.formatted is explicitly set true, this module delivers a standard message payload to logstash as follows:

{
  "timestamp": new Date().toISOString(), // The time the payload was created
  "message": "",                         // JSON Stringified version of your message
  "level": "",                           // The logger level of the message
  "label": `${options.label}`,
  "application": `${options.applicationName}`,
  "serverName": `${options.localhost}`,
  "pid": `${options.pid}`
}

In this case when the log message is a string, boolean, or Number value, then the message is a stringified as:

{
  "data": `${message}`
}

If options.formatted is set to false, then the entire Winston log message object is JSON.stringified and then set to logstash.

Logstash Configuration

Having logstash ingest preformatted messages delivered by this module can be done with a configuration file similar to below:

input {
  # Sample input over TCP
  tcp {
    codec => json
    port => 28777
    add_field => { "category" => "winston_log" }
  }
}
filter {
  if [category] == "winston_log" {
    json {
      source => "message"
    }
    json {
      source => "data"
      remove_field => [ "[headers][secret]", "[headers][apikey]" ]
    }
  }
}
output {
  if [category] == "winston_log" {
    stdout {
      codec => json
    }
    elasticsearch {
      id => "winston_log_tcp"
      index => "winston_log-%{+YYYY.MM.dd}"
      hosts => ["192.168.1.1:9200"] # Use the address of your Elasticsearch server
    }
  }
}

License

Copyright (c) 2018, 2019 Jay Reardon

Copyright (c) 2019-2021 Out of Sync Studios LLC -- Licensed under the MIT license.