Finding sweet spots
Constraints are only an approximation:
assumption that utility is a step-function.
For non-real time apps, we can fudge the constraint.
Example: a search app has a 1s latency constraint.
In 1.2s we can search all documents in the cache.
After that, we need to go over the network.
There is a knee, or sweet spot at 1.2s.
I plan to automatically identify sweet spots.