Unable to emit metrics to application insights using pyhon opentelemetry

[sterankin]

Based on this PR:
#34463

It appears it should be possible to emir custom metrics to a custom namespace from within an Azure function.

Currently I am using an Azure Apim to emit custom metrics like this:

        <emit-metric name="appid-info" namespace="opensource">
            <dimension name="api-name" value="@(context.Api.Name)" />
            <dimension name="app-id" value="@(context.Variables.GetValueOrDefault<string>("appid"))" />
            <dimension name="use-case" value="@(context.Variables.GetValueOrDefault<string>("inferred_raic_use_case_name"))" />
            <dimension name="user" value="@(context.Variables.GetValueOrDefault<string>("user"))" />
        </emit-metric>

However I am moving some functionality to a python function app which is being called from the APIM. I would like to continue using app insights custom metrics so they can be charted and graphed in app insights.

I have tried this:

requirements.txt:

azure-monitor-opentelemetry
azure-monitor-opentelemetry-exporter
opentelemetry-api
opentelemetry-sdk

Python:

from azure.monitor.opentelemetry.exporter import AzureMonitorLogExporter
from opentelemetry.sdk.metrics.export import PeriodicExportingMetricReader
from opentelemetry import metrics

def log_to_app_insights():
    """Log data to Azure Application Insights"""
    try:
        os.environ["APPLICATIONINSIGHTS_METRIC_NAMESPACE_OPT_IN"] = "true"
        exporter = AzureMonitorMetricExporter(
        connection_string=os.environ["APPLICATIONINSIGHTS_CONNECTION_STRING"]
    )
        reader= PeriodicExportingMetricReader(exporter, export_interval_millis=5000)
        metrics.set_meter_provider(MeterProvider(metric_readers=[reader]))

        # metrics under this meter should show up under `testname` namespace in metrics explorer blade
        meter = metrics.get_meter("testname")
        counter= meter.create_counter("testcounter")
        counter.add(1)
        # Optionally, force export if you want on-demand export:
        reader.force_flush()

    except Exception as e:
        logging.error(f"Failed to log to Application Insights: {str(e)}")

The connection string is set correctly. I do not see the above metric in my logs. And why is there a periodic exporter set to 5000ms, I just want to export the logs at the end of the function call, preferably in an async manner.

The rest of my function executes fine (I am also logging to eventhub without issue) but i cannot get the app insights code to work - there are no errors in execution. Can anyone help spot the issue here?

[github-actions]

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @gulopesd @Haiying-MSFT @jairmyree @joshfree @KarishmaGhiya @KevinBlasko @kurtzeborn @nisha-bhatia @pvaneck @scottaddie @srnagar @ToddKingMSFT.

[lzchen]

@sterankin

I am able to use the below code and see metrics in my application insights resource without issue. Try using this and make sure you are waiting a few minutes for the telemetry to appear.

import logging
import os

from opentelemetry.sdk.metrics import MeterProvider
from opentelemetry.sdk.metrics.export import PeriodicExportingMetricReader
from opentelemetry import metrics

from azure.monitor.opentelemetry.exporter import AzureMonitorMetricExporter

logger = logging.getLogger(__name__)

"""Log data to Azure Application Insights"""
try:
    os.environ["APPLICATIONINSIGHTS_METRIC_NAMESPACE_OPT_IN"] = "true"
    exporter = AzureMonitorMetricExporter(
        connection_string=os.environ["APPLICATIONINSIGHTS_CONNECTION_STRING"]
    )
    reader= PeriodicExportingMetricReader(exporter, export_interval_millis=5000)
    metrics.set_meter_provider(MeterProvider(metric_readers=[reader]))

    # metrics under this meter should show up under `testname` namespace in metrics explorer blade
    meter = metrics.get_meter("testname")
    counter= meter.create_counter("testcounter")
    counter.add(1)
    # Optionally, force export if you want on-demand export:
    reader.force_flush()

except Exception as e:
    logging.error(f"Failed to log to Application Insights: {str(e)}")

And why is there a periodic exporter set to 5000ms, I just want to export the logs at the end of the function call, preferably in an async manner.

You don't need the 5000ms set if you are going to be calling force_flush() to export. Not setting it will default the export interval to 1minute.

[github-actions]

Hi @sterankin. Thank you for opening this issue and giving us the opportunity to assist. To help our team better understand your issue and the details of your scenario please provide a response to the question asked above or the information requested above. This will help us more accurately address your issue.

[github-actions]

Hi @sterankin, we're sending this friendly reminder because we haven't heard back from you in 7 days. We need more information about this issue to help address it. Please be sure to give us your input. If we don't hear back from you within 14 days of this comment the issue will be automatically closed. Thank you!