What an unholy mess...
Math is a formal system of symbolic strings and non-contradictory rules on how to derive valid strings (theoremes) from the initial arbitrary (but consistent) set of strings (axioms). No more no less.
Math exists in human minds, not in objective reality. There is no math in the universe. Math in no way relates to the physical universe. Being a-priori system, math cannot be confirmed nor disproved by anything in universe. Math is developed through deductive logic, objective reality is discovered.
Math cannot explain anything about universe, being totally unrelated to it. Universe is a system that has causal and temporal relationships - while math has only functional relationships.
What math does with regard to universe is it allows us to model certain aspects of it in order to achieve some quantitative results.
A model is a system in which relationships are isomorphic (have correspondence) to substantial relationships of another system. In order to construct a model of a system, one must already posess understanding of the relationships of the modelled system. Or guess them.
Why math is suitable for modeling the objective reality is a mystery that is irrelevant to our understanding of the world or our development of math.
It looks like Universe is logical. We do not know why, but if it weren't we would not be having those discussions. The only way how math could have affected the arragement of universe is if universe was an artificial creation by some powerful mind - like a computer simulation or an antfarm - according to some specific math system (there might be many) they cared to implement. Which would still live the question why math works in their (meta)universe.
Brush up on your epistemology, people. :)