Kafka Consumers in Control Center¶
The Consumers menu provides a view of all consumer groups for all topics in a cluster. From the consumer pages, you can:
- View all consumer groups for a cluster in the All consumer groups page
- View consumer lag across all topics in a cluster
- View consumption metric for a consumer group
- Set up consumer group alerts
Consumer Lag for an individual topic can be accessed from the Topics menu.
The Consumers feature is enabled by default using an Access Control setting in the Control Center properties files. See Enabling and disabling the Consumers feature. If RBAC is enabled for Control Center, the resources you can access are determined by your assigned role or roles and their corresponding privileges.
All consumer groups page¶
Use the All consumer groups page to:
- View all consumer groups for a cluster
- Search for a consumer group by its ID
- View the number of consumers and number of source topics for each consumer group
- View details such as Consumer Lag and Consumption metrics for a consumer group
- Set up a pre-populated alert for Consumer Lag
To access the All consumer groups page:
Select a cluster from the navigation bar and click the Consumers menu.
View consumer lag details for a consumer group¶
From the All consumer groups page, click the ID for your desired Consumer Group. Consumer lag details are displayed, including:
- Total messages behind and the measured interval.
- All consumers in the group.
- A visualization of lag. The Max lag / consumer graph displays a pin point of each partition in the topic.
To view details for a particular point on the graph, click its pin. View the Consumer, Partition, Current offset, and Messages behind for that particular point.
View consumption details for a consumer group¶
View the percentage (%) of messages consumed and the end-to-end latency key metrics by a selected timeline.
The consumption charts are only populated if there are Confluent Monitoring Interceptors that are set up correctly. For instructions, see Confluent Monitoring Interceptors in Control Center.
From the All consumer groups page, click the ID for your desired Consumer Group.
Click the Consumption tab. The streams monitoring metrics are displayed for the default timeframe (last 4 hours).
Select a timeframe from the menu and click Apply.
Use the time range selector to select the time range for data displayed in charts:
- Static: A specific time range with constant start and end times.
- Rolling: A time range where the end time is always equal to the current time and the extent of the time range is held constant.
- Growing: A time range where the end time is always equal to the current time and the start time is held constant.
The default selection is Last 4 hours.
Select the End-to-end latency metric you want to view:
- average (ms)
- minimum (ms)
- maximum (ms)
- total (ms)
You can set up alerts for average and maximum latency values.
Set up an alert for a consumer group¶
You can set alerts from the Consumer lag page. These options pre-populate most of the consumer group trigger fields.
On the Consumer lag page, click Set up an alert.
For more details, see Consumer lag trigger.
Enabling and disabling the Consumers feature¶
feature for viewing details for consumer lag and consumption in consumer groups
is enabled by default. The feature can be disabled by setting the
in the appropriate Control Center properties file
false. After disabling the
feature, the Consumer submenu in the Cluster navigation
is no longer visible in the Control Center UI.
If RBAC is enabled for Control Center, it takes precedence over Access Control settings.
To disable the Consumers feature in Control Center:
confluent.controlcenter.consumers.view.enableoption in your
... confluent.controlcenter.consumers.view.enable=false ...
Make the change in the appropriate Control Center properties files configured for your environments, including
control-center-production.properties. The properties files are located in
/path-to-confluent/etc/confluent-control-center/. For more information, see Control Center Properties File.
Restart Control Center and pass in the properties file for the configuration to take effect.
Local (dev) environment:
Do not use confluent local for production use.
confluent local services control-center stop confluent local services control-center start --config ../etc/confluent-control-center/control-center.properties
./bin/control-center-stop ./bin/control-center-start ../etc/confluent-control-center/control-center.properties
To enable the feature again, set the option back to
true and restart
Control Center with the updated properties file.