[kafkareceiver] The exporterhelper.ErrQueueIsFull error must enforce a backoff mechanism

[an-mmx]

Component(s)

receiver/kafka

Describe the issue you're reporting

In the current implementation, the BackOff mechanism is trigerred only by memory limiter error. However, the same behavior is expected for the exporterhelper.ErrQueueIsFull error, which occurs when there is a sending queue overflow (both memory queue and persistent queue).

[github-actions]

Pinging code owners:

• receiver/kafka: @pavolloffay @MovieStoreGuy @axw

See Adding Labels via Comments if you do not have permissions to add labels yourself.

[axw]

/label -needs-triage priority:p2

Agreed!

[ethuleau]

Hi @an-mmx thanks for that fix.

I also hit that issue and I think I resolved it (I'm using release v0.126.0) by setting sending_queue.block_on_overflow to true in the next component (in my case it is a kafka exporter). Did you consider to do that? Do you think it is a correct workaround until I moved to v0.118.0?

I also noticed kafka receiver is restarting all its partition consumers when backoff mechanism is trigger. Do you also noticed that? Is it expected?