core: filesystem access abstraction layer addition#7564
Open
leonardo-albertovich wants to merge 317 commits intomasterfrom
Open
core: filesystem access abstraction layer addition#7564leonardo-albertovich wants to merge 317 commits intomasterfrom
leonardo-albertovich wants to merge 317 commits intomasterfrom
Conversation
patrick-stephens
previously approved these changes
Jun 15, 2023
Signed-off-by: Leonardo Alminana <leonardo@calyptia.com>
Co-authored-by: igorpeshansky <igorpeshansky@users.noreply.github.com> Signed-off-by: leonardo-albertovich <leonardo@calyptia.com>
Signed-off-by: Eduardo Silva <eduardo@calyptia.com>
* workflows: enable sarif output for CIFuzz This will make it easier to interpret the output of CIFuzz by making it possible to view the result in the Github security page. Signed-off-by: David Korczynski <david@adalogics.com> * workflows: cifuzz: add sarif category Signed-off-by: David Korczynski <david@adalogics.com> --------- Signed-off-by: David Korczynski <david@adalogics.com>
Signed-off-by: David Korczynski <david@adalogics.com>
Signed-off-by: David Korczynski <david@adalogics.com>
`tmpfile()` can return NULL and this is not checked for at the moment. If indeed it returns NULL then the call on line 70 `fileno(stdoutp)` will cause a NULL dereference. Signed-off-by: David Korczynski <david@adalogics.com>
Signed-off-by: David Korczynski <david@adalogics.com>
In the previous version a new option called net.max_worker_connections was introduced
to provide control around the maximum number of allowed TCP connections per worker inside
an output plugin, the logic was wrong.
In the upstream logic, connections are linked to one of these lists:
- av_queue : connections ready to be used (available)
- busy_queue: connections that are busy (someone is using them)
- drop_queue: connections in the cleanup phase (to be drop)
Fluent Bit don't create connections ahead of time, just on demand. When
a connection is created is placed into the busy_queue, when is not longer
needed one of these things happen:
- if keepalive is enabled (default), the connection is moved to the 'av_queue'.
- if keepalive is disabled, the connection is moved to 'drop_queue' then is
closed and destroyed.
Based on the logic described above, to limit the number of total connections
in the worker, we only need to count the number of connections linked into
the 'busy_queue' list because if there are connections available 'av_queue' it
won't create a one.
This patch fixes the logic by only using the busy_queue to count the limit.
Signed-off-by: Eduardo Silva <eduardo@calyptia.com>
Bumps [helm/kind-action](https://github.com/helm/kind-action) from 1.7.0 to 1.8.0. - [Release notes](https://github.com/helm/kind-action/releases) - [Commits](helm/kind-action@v1.7.0...v1.8.0) --- updated-dependencies: - dependency-name: helm/kind-action dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
For the first revision, we'll provide log_key and one-by-one line JSON version like as out_loki plugin. --------- Signed-off-by: Hiroshi Hatake <hatake@calyptia.com>
Implement gzip compression Signed-off-by: Catherine Fang <yinghongfang@google.com> Co-authored-by: igorpeshansky <igorpeshansky@users.noreply.github.com>
Signed-off-by: braydonk <braydonk@google.com>
Signed-off-by: Phillip Whelan <phil@calyptia.com>
Signed-off-by: GitHub <noreply@github.com> Co-authored-by: edsiper <edsiper@users.noreply.github.com>
Signed-off-by: Josh Baird <jbaird@galileo.io>
added 2 commits
October 5, 2023 09:18
Signed-off-by: Leonardo Alminana <leonardo@calyptia.com>
Signed-off-by: Leonardo Alminana <leonardo@calyptia.com>
Signed-off-by: Leonardo Alminana <leonardo@calyptia.com>
Contributor
|
This PR is stale because it has been open 45 days with no activity. Remove stale label or comment or this will be closed in 10 days. |
Signed-off-by: Eduardo Silva <eduardo@chronosphere.io>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR adds a minimal filesystem abstraction layer mostly meant to allow the tail input plugin to ingest more than 8192 files while at the same time taking the platform specific code out of it so it can be leveraged by other components in order to remove duplicated code.