Evaluation
Evaluating the idea:
- How much can we impact resource consumption by adapting the fidelity?
- Does this adaptation lead to better usability?
- How easy/difficult is it to program to the multi-fidelity API?
Evaluating the system:
- How accurately do we predict resource consumption?
- How well do fidelity selections maximize utility?
- What is the overhead of computing fidelity selections?
- How accurately do we find sweet spots?