Audit Log Concepts on Confluent Cloud

Confluent Cloud audit logs provide security monitoring and compliance capabilities for your cloud infrastructure. They capture a record of user interactions, administrative operations, and system access across all Confluent Cloud services.

The primary value of audit logs is that they provide data you can use to assess security risks in your Confluent Cloud clusters. They contain all the information necessary to follow a user’s interaction with your Confluent Cloud clusters, and provide a way to:

  • Track user and application access

  • Identify abnormal behavior and anomalies

  • Proactively monitor and resolve security risks

  • Meet regulatory compliance requirements

  • Investigate security incidents and policy violations

  • Monitor resource usage and operational changes

How audit logs work

Audit logs record the runtime decision of each permission check. This happens as users and service accounts connect to clusters and attempt actions protected by access control lists (ACLs) or role-based access control (RBAC). Confluent Cloud audit logs also capture, protect, and preserve Apache Kafka® authentication actions, authorization actions, and organization operations for activity occurring on Standard, Enterprise, Dedicated, and Freight clusters. Confluent Cloud writes these records to an independent audit log cluster. These organization operations include creating, deleting, and modifying Confluent Cloud resources, such as:

  • API keys

  • Kafka clusters

  • User accounts

  • Service accounts

  • Single sign-on (SSO) connections

  • Connectors

Each auditable event record includes information about who tried to do what, when they tried, and whether the system gave permission to proceed. Auditable event messages are emitted at the time of event occurrence. However, short delays or gaps during operational maintenance are possible, although rare.

Audit log storage and retention

Confluent Cloud retains audit log messages on an independent cluster for a default period of seven days. Consuming them requires an API key specific to that cluster. For details on extending retention beyond the default, see Retain Audit Log Records on Confluent Cloud.

Auditable events

An auditable event is an action, such as a login attempt or a topic creation, that Confluent Cloud captures in an audit log record. Confluent Cloud audit logs capture event records from auditable event methods across multiple event categories, providing visibility into your cloud infrastructure.

Audit logs track activities across these areas:

  • Cluster-level events: Capture activities within your data services, including authentication, authorization, and management operations for Kafka clusters (such as topics, consumer groups, and cluster configurations), Schema Registry, ksqlDB, Apache Flink®, and Tableflow clusters.

  • Organization-level events: Track administrative and resource management activities, including user and access management, resource lifecycle operations, security configurations, and infrastructure management.

  • Access Transparency events: Provide visibility into when Confluent personnel access customer resources for support, maintenance, or operational purposes.

For a complete reference of all auditable event categories and their specific operations, see Audit Log Event Categories on Confluent Cloud.

confluent-audit-log-events topic

All Confluent Cloud audit log messages are captured in the audit log topic, confluent-audit-log-events. This topic is created automatically in an independent audit log cluster for your Confluent Cloud organization. For details on accessing the audit log topic, see Access and Consume Audit Logs on Confluent Cloud.

The following example shows an authentication event that was sent when service account 306343 used the API key MAIDSRFG53RXYTKR to connect to the Kafka cluster lkc-6k8r8q:

{
    "id": "29ca0e51-fdcd-44bd-a393-43193432b614",
    "source": "crn://confluent.cloud/kafka=lkc-6k8r8q",
    "specversion": "1.0",
    "type": "io.confluent.kafka.server/authentication",
    "datacontenttype": "application/json",
    "subject": "crn://confluent.cloud/kafka=lkc-6k8r8q",
    "time": "2020-12-28T22:41:43.395Z",
    "data": {
        "serviceName": "crn://confluent.cloud/kafka=lkc-6k8r8q",
        "methodName": "kafka.Authentication",
        "resourceName": "crn://confluent.cloud/kafka=lkc-6k8r8q",
        "authenticationInfo": {
            "principal": "User:306343",
            "metadata": {
                "mechanism": "SASL_SSL/PLAIN",
                "identifier": "MAIDSRFG53RXYTKR"
            },
            "principalResourceId": "u-yw9507",
            "identity": "crn://confluent.cloud/organization=uuid-for-ourcorp/identity-provider=ourcorp-idp/identity=u-yw9507"
        },
        "result": {
            "status": "SUCCESS",
            "message": ""
        }
    }
}

For details, see Audit Log Event Schema.

Next steps

Now that you understand audit log concepts, you can: