Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

version incompatibility between fluent-plugin-s3:1.8.1 and fluentd:v1.17.1-debian-1.1 docker image, but not with fluentd:v1.16-debian-1 #449

Open
ellisonch opened this issue Nov 20, 2024 · 0 comments
Open

version incompatibility between fluent-plugin-s3:1.8.1 and fluentd:v1.17.1-debian-1.1 docker image, but not with fluentd:v1.16-debian-1 #449

ellisonch opened this issue Nov 20, 2024 · 0 comments
Labels
waiting-for-triage

Comments

@ellisonch
Copy link

ellisonch commented Nov 20, 2024 •
edited
Loading

Describe the bug

There seems to be some sort of version incompatibility. I don't really know how to narrow it down, but the error is ultimately coming from fluent-plugin-s3's interaction with other gems. Things seem to work with the fluentd:v1.16-debian-1 docker image, but not fluentd:v1.17.1-debian-1.1.

Upon updating my docker container to use fluent/fluentd:v1.17.1-debian-1.1, I immediately get errors that look like this:

  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/json-2.7.4/lib/json/common.rb:222:in `initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/json-2.7.4/lib/json/common.rb:222:in `new'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/json-2.7.4/lib/json/common.rb:222:in `parse'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-partitions-1.1009.0/lib/aws-partitions.rb:226:in `defaults'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-partitions-1.1009.0/lib/aws-partitions/endpoint_provider.rb:263:in `default_provider'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-partitions-1.1009.0/lib/aws-partitions/endpoint_provider.rb:245:in `resolve'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/aws-sdk-core/plugins/regional_endpoint.rb:120:in `resolve_legacy_endpoint'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/aws-sdk-core/plugins/regional_endpoint.rb:110:in `rescue in initialize_default_endpoint'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/aws-sdk-core/plugins/regional_endpoint.rb:101:in `initialize_default_endpoint'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/aws-sdk-core/plugins/regional_endpoint.rb:87:in `after_initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/seahorse/client/base.rb:81:in `block in after_initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/seahorse/client/base.rb:80:in `each'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/seahorse/client/base.rb:80:in `after_initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/seahorse/client/base.rb:23:in `initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-sdk-s3-1.172.0/lib/aws-sdk-s3/client.rb:552:in `initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/seahorse/client/base.rb:102:in `new'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluent-plugin-s3-1.8.1/lib/fluent/plugin/out_s3.rb:263:in `start'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:203:in `block in start'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:182:in `block (2 levels) in lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/agent.rb:121:in `block (2 levels) in lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/agent.rb:120:in `each'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/agent.rb:120:in `block in lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/agent.rb:113:in `each'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/agent.rb:113:in `lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:181:in `block in lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:178:in `each'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:178:in `lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:202:in `start'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/engine.rb:248:in `start'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/engine.rb:147:in `run'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/supervisor.rb:617:in `block in run_worker'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/supervisor.rb:962:in `main_process'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/supervisor.rb:608:in `run_worker'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/command/fluentd.rb:372:in `<top (required)>'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: <internal:/usr/local/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:86:in `require'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: <internal:/usr/local/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:86:in `require'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/bin/fluentd:15:in `<top (required)>'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/bin/fluentd:25:in `load'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/bin/fluentd:25:in `<main>'
2024-11-19 22:33:28 +0000 [error]: #0 fluent/log.rb:404:error: unexpected error error_class=ArgumentError error="wrong number of arguments (given 2, expected 1)"
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/json-2.7.4/lib/json/common.rb:222:in `initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/json-2.7.4/lib/json/common.rb:222:in `new'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/json-2.7.4/lib/json/common.rb:222:in `parse'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-partitions-1.1009.0/lib/aws-partitions.rb:226:in `defaults'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-partitions-1.1009.0/lib/aws-partitions/endpoint_provider.rb:263:in `default_provider'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-partitions-1.1009.0/lib/aws-partitions/endpoint_provider.rb:245:in `resolve'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/aws-sdk-core/plugins/regional_endpoint.rb:120:in `resolve_legacy_endpoint'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/aws-sdk-core/plugins/regional_endpoint.rb:110:in `rescue in initialize_default_endpoint'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/aws-sdk-core/plugins/regional_endpoint.rb:101:in `initialize_default_endpoint'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/aws-sdk-core/plugins/regional_endpoint.rb:87:in `after_initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/seahorse/client/base.rb:81:in `block in after_initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/seahorse/client/base.rb:80:in `each'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/seahorse/client/base.rb:80:in `after_initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/seahorse/client/base.rb:23:in `initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-sdk-s3-1.172.0/lib/aws-sdk-s3/client.rb:552:in `initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/seahorse/client/base.rb:102:in `new'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluent-plugin-s3-1.8.1/lib/fluent/plugin/out_s3.rb:263:in `start'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:203:in `block in start'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:182:in `block (2 levels) in lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/agent.rb:121:in `block (2 levels) in lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/agent.rb:120:in `each'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/agent.rb:120:in `block in lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/agent.rb:113:in `each'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/agent.rb:113:in `lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:181:in `block in lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:178:in `each'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:178:in `lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:202:in `start'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/engine.rb:248:in `start'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/engine.rb:147:in `run'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/supervisor.rb:617:in `block in run_worker'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/supervisor.rb:962:in `main_process'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/supervisor.rb:608:in `run_worker'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/command/fluentd.rb:372:in `<top (required)>'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: <internal:/usr/local/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:86:in `require'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: <internal:/usr/local/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:86:in `require'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/bin/fluentd:15:in `<top (required)>'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/bin/fluentd:25:in `load'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/bin/fluentd:25:in `<main>'
2024-11-19 22:33:28 +0000 [error]: fluent/log.rb:404:error: Worker 0 exited unexpectedly with status 1

I guess the problem could be with gems that fluent-plugin-s3 relies on, but I really have no way of knowing.

To Reproduce

Add fluent-plugin-s3 to a fluent/fluentd:v1.17.1-debian-1.1 and run fluentd with a config that uses S3. See logs.

Expected behavior

It should load and not crash

Your Environment

- Fluentd version: v1.17.1-debian-1.1
- fluent-plugin-s3 version: 1.8.1
- aws-sdk-s3 version: 1.172.0

Your Configuration

  <match **>
    @type s3
    s3_bucket "#{ENV['OUTPUT_LOGS_BUCKET']}"
    s3_region "#{ENV['AWS_REGION']}"

    path logs/kubernetes/date=%Y-%m-%d/container_name=${$.kubernetes.container_name}
    s3_object_key_format %{path}/%{time_slice}_%{hms_slice}_%{hex_random}.%{file_extension}

    check_object false
    check_bucket false
    check_apikey_on_start false

    store_as parquet

    <buffer tag,time,$.kubernetes.container_name>
      @type file
      path /fluentd/buffer/kubernetes-logs-s3
      timekey 3600 # 1 hour partition
      timekey_wait 5s
      timekey_use_utc true # use utc
    </buffer>
    <format>
      @type json
    </format>
    <compress>
      schema_file /fluentd/etc/kubernetes-logs.bqsc
      record_type json
      schema_type bigquery
      parquet_compression_codec gzip
    </compress>
  </match>

Your Error Log

2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/json-2.7.4/lib/json/common.rb:222:in `initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/json-2.7.4/lib/json/common.rb:222:in `new'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/json-2.7.4/lib/json/common.rb:222:in `parse'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-partitions-1.1009.0/lib/aws-partitions.rb:226:in `defaults'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-partitions-1.1009.0/lib/aws-partitions/endpoint_provider.rb:263:in `default_provider'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-partitions-1.1009.0/lib/aws-partitions/endpoint_provider.rb:245:in `resolve'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/aws-sdk-core/plugins/regional_endpoint.rb:120:in `resolve_legacy_endpoint'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/aws-sdk-core/plugins/regional_endpoint.rb:110:in `rescue in initialize_default_endpoint'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/aws-sdk-core/plugins/regional_endpoint.rb:101:in `initialize_default_endpoint'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/aws-sdk-core/plugins/regional_endpoint.rb:87:in `after_initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/seahorse/client/base.rb:81:in `block in after_initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/seahorse/client/base.rb:80:in `each'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/seahorse/client/base.rb:80:in `after_initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/seahorse/client/base.rb:23:in `initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-sdk-s3-1.172.0/lib/aws-sdk-s3/client.rb:552:in `initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/seahorse/client/base.rb:102:in `new'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluent-plugin-s3-1.8.1/lib/fluent/plugin/out_s3.rb:263:in `start'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:203:in `block in start'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:182:in `block (2 levels) in lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/agent.rb:121:in `block (2 levels) in lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/agent.rb:120:in `each'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/agent.rb:120:in `block in lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/agent.rb:113:in `each'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/agent.rb:113:in `lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:181:in `block in lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:178:in `each'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:178:in `lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:202:in `start'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/engine.rb:248:in `start'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/engine.rb:147:in `run'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/supervisor.rb:617:in `block in run_worker'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/supervisor.rb:962:in `main_process'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/supervisor.rb:608:in `run_worker'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/command/fluentd.rb:372:in `<top (required)>'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: <internal:/usr/local/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:86:in `require'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: <internal:/usr/local/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:86:in `require'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/gems/fluentd-1.17.1/bin/fluentd:15:in `<top (required)>'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/bin/fluentd:25:in `load'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:962:main_process: /usr/local/bundle/bin/fluentd:25:in `<main>'
2024-11-19 22:33:28 +0000 [error]: #0 fluent/log.rb:404:error: unexpected error error_class=ArgumentError error="wrong number of arguments (given 2, expected 1)"
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/json-2.7.4/lib/json/common.rb:222:in `initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/json-2.7.4/lib/json/common.rb:222:in `new'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/json-2.7.4/lib/json/common.rb:222:in `parse'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-partitions-1.1009.0/lib/aws-partitions.rb:226:in `defaults'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-partitions-1.1009.0/lib/aws-partitions/endpoint_provider.rb:263:in `default_provider'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-partitions-1.1009.0/lib/aws-partitions/endpoint_provider.rb:245:in `resolve'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/aws-sdk-core/plugins/regional_endpoint.rb:120:in `resolve_legacy_endpoint'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/aws-sdk-core/plugins/regional_endpoint.rb:110:in `rescue in initialize_default_endpoint'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/aws-sdk-core/plugins/regional_endpoint.rb:101:in `initialize_default_endpoint'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/aws-sdk-core/plugins/regional_endpoint.rb:87:in `after_initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/seahorse/client/base.rb:81:in `block in after_initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/seahorse/client/base.rb:80:in `each'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/seahorse/client/base.rb:80:in `after_initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/seahorse/client/base.rb:23:in `initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-sdk-s3-1.172.0/lib/aws-sdk-s3/client.rb:552:in `initialize'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/aws-sdk-core-3.213.0/lib/seahorse/client/base.rb:102:in `new'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluent-plugin-s3-1.8.1/lib/fluent/plugin/out_s3.rb:263:in `start'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:203:in `block in start'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:182:in `block (2 levels) in lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/agent.rb:121:in `block (2 levels) in lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/agent.rb:120:in `each'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/agent.rb:120:in `block in lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/agent.rb:113:in `each'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/agent.rb:113:in `lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:181:in `block in lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:178:in `each'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:178:in `lifecycle'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/root_agent.rb:202:in `start'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/engine.rb:248:in `start'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/engine.rb:147:in `run'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/supervisor.rb:617:in `block in run_worker'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/supervisor.rb:962:in `main_process'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/supervisor.rb:608:in `run_worker'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/lib/fluent/command/fluentd.rb:372:in `<top (required)>'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: <internal:/usr/local/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:86:in `require'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: <internal:/usr/local/lib/ruby/3.2.0/rubygems/core_ext/kernel_require.rb>:86:in `require'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/gems/fluentd-1.17.1/bin/fluentd:15:in `<top (required)>'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/bin/fluentd:25:in `load'
  2024-11-19 22:33:28 +0000 [error]: #0 fluent/supervisor.rb:961:main_process: /usr/local/bundle/bin/fluentd:25:in `<main>'
2024-11-19 22:33:28 +0000 [error]: fluent/log.rb:404:error: Worker 0 exited unexpectedly with status 1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
waiting-for-triage
Projects
Fluentd Kanban
Status: No status
Milestone
No milestone
Development

No branches or pull requests
1 participant
@ellisonch