Original talk video and transcript on acmqueue.
A recent post here, Disasters I’ve seen in a microservices world covers “timeouts, retries, and resilience.” I myself have experienced frustration with these problems. So I consulted a knowledgeable friend for solutions better than my historical go to (no queuing; only client retries). He sent me this.
Applying CoDel—a packet-level queue management algorithm—to userspace services makes a ton of sense. They are fundamentally the same problem but I had never made that logical leap before!
And adaptive LIFO is brilliantly simple. It would definitely work well even without CoDel.
I really enjoyed the original article and it got me thinking about patterns for delays, back pressure and queue management. This is is spot on!