It'd be good to have the ability when using Scale Markers to use Fields and Aggregations just like you can do for Summary Numbers. Even on a basic bar chart, if you use the Average, it just does an average of the Totals Shown, rather than the actual average of the field being used for the Y Axis, so if you show Average on both places it'll give you a different number.
Having options like this instead would be awesome and could help visually provide answers to common business questions like easily visualize performance against peers.