This note tracks the Apache Druid work for dynamically auto-scaling Kafka stream ingestion tasks.

Operational question

When event volume changes, ingestion task count should follow the workload without manual babysitting or wasteful over-provisioning.

References

  1. Dynamic auto scale Kafka-Stream ingest tasks #10524