Skip to content

[azure_logs] Enable azure-eventhub processor v2#13049

Merged
zmoog merged 5 commits into
elastic:mainfrom
zmoog:zmoog/custom-azure-logs-processor-v2
Mar 11, 2025
Merged

[azure_logs] Enable azure-eventhub processor v2#13049
zmoog merged 5 commits into
elastic:mainfrom
zmoog:zmoog/custom-azure-logs-processor-v2

Conversation

@zmoog

@zmoog zmoog commented Mar 10, 2025

Copy link
Copy Markdown
Contributor

Proposed commit message

Enable the azure-eventhub processor v2 in the Custom Azure Logs integration.

Changes:

  • Add processor_version config option to optionally enable the processor v2 (defaults to v1).
  • Add the processor v2 related config options:
    • processor_update_interval
    • processor_start_position
    • migrate_checkpoint
    • partition_receive_timeout
    • partition_receive_count
  • Increase the min stack version to 8.15.1.

The processor v2 uses the modern Event Hub SDK. Microsoft fully supports the modern SDK, is more modular and flexible, uses fewer resources, and makes it possible to enhance the processor in upcoming releases.

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.
  • I have verified that any added dashboard complies with Kibana's Dashboard good practices

Screenshots

CleanShot 2025-03-10 at 23 22 28@2x

CleanShot 2025-03-10 at 23 23 12@2x

@zmoog zmoog self-assigned this Mar 10, 2025
@zmoog zmoog added enhancement New feature or request Integration:azure_logs Custom Azure Logs labels Mar 10, 2025
@zmoog zmoog added the Team:Service-Integrations Label for the Observability Service Integrations team label Mar 10, 2025
@zmoog zmoog marked this pull request as ready for review March 10, 2025 22:25
@zmoog zmoog requested a review from a team as a code owner March 10, 2025 22:25
Comment thread packages/azure_logs/agent/input/input.yml.hbs
Comment thread packages/azure_logs/_dev/build/docs/README.md Outdated
Comment thread packages/azure_logs/_dev/build/docs/README.md Outdated
zmoog and others added 2 commits March 11, 2025 12:21
Co-authored-by: muthu-mps <101238137+muthu-mps@users.noreply.github.com>
@zmoog zmoog requested a review from muthu-mps March 11, 2025 11:24

@muthu-mps muthu-mps left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@elasticmachine

Copy link
Copy Markdown

💚 Build Succeeded

History

cc @zmoog

@elastic-sonarqube

Copy link
Copy Markdown

Quality Gate failed Quality Gate failed

Failed conditions
0.0% Coverage on New Code (required ≥ 80%)

See analysis details on SonarQube

@zmoog zmoog merged commit dc43b5a into elastic:main Mar 11, 2025
@zmoog zmoog deleted the zmoog/custom-azure-logs-processor-v2 branch March 11, 2025 12:18
@elastic-vault-github-plugin-prod

Copy link
Copy Markdown
Contributor

Package azure_logs - 0.3.0 containing this change is available at https://epr.elastic.co/package/azure_logs/0.3.0/

flexitrev pushed a commit that referenced this pull request Mar 20, 2025
Enable the azure-eventhub processor v2 in the Custom Azure Logs integration.

Changes:

- Add `processor_version` config option to optionally enable the processor v2 (defaults to v1).
- Add the processor v2 related config options:
  - `processor_update_interval`
  - `processor_start_position`
  - `migrate_checkpoint`
  - `partition_receive_timeout`
  - `partition_receive_count`
- Increase the min stack version to 8.15.1.

The processor v2 uses the modern Event Hub SDK. Microsoft fully supports the modern SDK, is more modular and flexible, uses fewer resources, and makes it possible to enhance the processor in upcoming releases.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request Integration:azure_logs Custom Azure Logs Team:Service-Integrations Label for the Observability Service Integrations team

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants