Caching · Multiple choice

A ranking model needs features computed from months of logged interactions for each of 500 candidates, within a 300 ms budget. Where should a request read them?

medium Databases

Options

Why

Features that summarise long histories change slowly, so compute them in batches offline and load them into a fast online store. A warehouse query takes around half a second and serves only a few hundred a second; the online store answers 500 keys in about a millisecond. The cost is staleness: the features are as old as the last batch.

Review this in your daily deck All cards in Caching