diff --git a/config/_default/menus/main.en.yaml b/config/_default/menus/main.en.yaml index 45c293b10b2..878ec3dd24d 100644 --- a/config/_default/menus/main.en.yaml +++ b/config/_default/menus/main.en.yaml @@ -5128,11 +5128,16 @@ menu: identifier: data_streams_kafka_setup parent: data_streams_kafka weight: 1 + - name: Data Collection + url: data_streams/kafka/data_collection + identifier: data_streams_kafka_data_collection + parent: data_streams_kafka + weight: 2 - name: Monitors and Automation url: data_streams/kafka/monitors_and_automation identifier: data_streams_kafka_monitors_and_automation parent: data_streams_kafka - weight: 2 + weight: 3 - name: Schema Tracking url: data_streams/schema_tracking identifier: data_streams_schema_tracking diff --git a/content/en/data_streams/kafka/data_collection.md b/content/en/data_streams/kafka/data_collection.md new file mode 100644 index 00000000000..ac173cdaab4 --- /dev/null +++ b/content/en/data_streams/kafka/data_collection.md @@ -0,0 +1,27 @@ +--- +title: Data Collection +description: Metrics, configurations, and capabilities collected by Data Streams Monitoring's Kafka Monitoring when cluster monitoring is enabled. +--- + +Data Streams Monitoring's [Kafka Monitoring][6] uses the [Kafka Consumer integration][1] to collect cluster health data. On top of the integration's defaults, it collects additional data and adds ability to perform actions described in this doc. + +## Metrics + +To collect the **DSM only** [Kafka Consumer integration metrics][5], set `enable_cluster_monitoring: true`. See [Kafka Monitoring Setup][4] for how to configure the check. + +## Configurations and schemas + +- Broker configurations +- Topic configurations +- Schemas from a schema registry + +## Capabilities + +Enabling cluster monitoring unlocks the ability to [read live messages on topics][3] on demand. See [Enable message inspection][2] for the additional setup steps. + +[1]: /integrations/kafka-consumer/?tab=containerized +[2]: /data_streams/kafka/setup/#enable-message-inspection +[3]: /data_streams/kafka/#inspect-topic-schemas-and-messages +[4]: /data_streams/kafka/setup/ +[5]: /integrations/kafka-consumer/?tab=containerized#metrics +[6]: /data_streams/kafka/