Skip to content

Support configuring Kafka client Client ID in kafka exporter #30144

Closed
@richardartoul

Description

@richardartoul

Component(s)

exporter/kafka

Is your feature request related to a problem? Please describe.

Kafka client IDs are an important part of the ecosystem / protocol and have a variety of benefits:

  1. They can be used for throttling and quota enforcements of different producers / consumers in a shared multi-tenant Kafka cluster.
  2. They can be used for observability in terms of producing, consumer, and consumer group behavior.
  3. Some Apache Kafka protocol compatible systems like WarpStream leverage them to route clients to nodes running in the same availability zone to avoid inter-zone networking costs which can be quite high when exporting logs/traces.

Describe the solution you'd like

It would be great if users could provide the kafka client ID to use in the Sarama client as part of their configuration.

Describe alternatives you've considered

I can't think of any viable alternatives other than letting people specify the client ID explicitly in the configuration file.

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions