Cache data limits to ensure they are only computed once per update (#8234)

* Cache data limits to ensure they are only computed once per updaet
* Replace `invalidateCaches` on scales with `beforeLayout`