Options
Why
The server does useless work while new requests wait behind it, so it never recovers. Bound the queue, drop requests that have already waited longer than the client's timeout, or serve the newest first under overload.
Resilience · Multiple choice
The server does useless work while new requests wait behind it, so it never recovers. Bound the queue, drop requests that have already waited longer than the client's timeout, or serve the newest first under overload.