Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

enable multiline parsing #429

Open
valentinacala opened this issue Aug 8, 2023 · 0 comments
Open

enable multiline parsing #429

valentinacala opened this issue Aug 8, 2023 · 0 comments

Comments

@valentinacala
Copy link

valentinacala commented Aug 8, 2023

Is your feature request related to a problem? Please describe.

I noticed me and many users are wondering to be able to recognize logs that are on many lines.

Currently any plugin seemes to satisfy the thing, because:

  • the fluentd multiline parsers applys on in_tail input only
  • the fluent-plugin-concat plugin works only if the numeber of lines is well defined

Describe the solution you'd like

I propose to embed the multiline parser in the fluent-plugin-s3 as it works for in_tail input

Describe alternatives you've considered

I tried the flluent-plugin-concat plugin, but it ignore the multiline_start_regexp if it is not specified a fixed number of lines

I tried also applying the multiline parser with S3 source, but I got error

Additional context

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Triage
Development

No branches or pull requests

1 participant