1. 3

  2. 1

    Druid’s use of Kafka as a persistent queue for managing ingest is really clever. Conceptually it’s a very clean approach for dealing with downstream machine failures (downstream systems just pick up data since the last checkpoint).

    Also worth noting that Suro, Netflix’s data pipeline uses Druid under the covers.