Generic resource detector

[Doron-Bargo]

Component(s)

processor/resourcedetection

Is your feature request related to a problem? Please describe.

A customer would like to dynamicly enrich his telemetries from his asset management platform

Describe the solution you'd like

A generic resource detector processor that get a url and list of parameters. For example:

processors:
  resourcedetection/http:
    detectors: [http]
    url: http://www.my-asset-management.com
    timeout: 2s
    metadata:
        key1:
            values:
                  value1,
                  value2
         key2:
              values:
                   value3
                   value4

Since each resource detector has metadata.yaml and here it is http based we don't know in advance the metadata so we would like to put it inside the configuration.

Explanation for this example

Key1,key2 are the keys that we are going to query the asset management platform against and values are the results fields we are expect to get from the asset management platform

Describe alternatives you've considered

We can tag as environment variable on each component that is being monitored by otel but this tag is static and we would like a dynamic solution where we can update it in one place and enrich the data based on it

Additional context

No response

[github-actions]

Pinging code owners:

• processor/resourcedetection: @Aneurysm9 @dashpole

See Adding Labels via Comments if you do not have permissions to add labels yourself.

[atoulme]

You need to go a bit deeper. Are we periodically polling the endpoint? What is the behavior on error? Do we call this endpoint every single time data transits through the processor?

You can use a separate config source to do this job, which would probably work best for this application. We have offered to push the etcd and vault config sources to the contrib repository if you are interested in helping maintain them.

[Doron-Bargo]

Hi @atoulme
I was thinking on using the same method as the other resource detectors - using a map to reduce the number of requests to the api.
On error depends on the type but if it failing then log and ignore this enrichment
Can you elaborate on how to achieve the separate config ? or link to component that is doing it today so i can read its code

[atoulme]

This is such an example: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/confmap/provider/s3provider

[github-actions]

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

• processor/resourcedetection: @Aneurysm9 @dashpole

See Adding Labels via Comments if you do not have permissions to add labels yourself.

[github-actions]

This issue has been closed as inactive because it has been stale for 120 days with no activity.