From what I've seen:
Toppo's hakai was rejected because Goku and Jiren shaking the void was stated on-screen, while Toppo's tech only produced a comment about the sky and nothing about the entire WoV. Pretty sure that's backpedaling and pretty much stating that GoD Toppo is weaker than Goku's first usage of ultra instinct. They even zoomed out the screen to the point where the stage was a dot on the map and the entire world of void was warped. I think the intent here is clear.
Even if his hakai was purely hax (which it isn't, as energy of destruction is also a ki attack and thus fueled by AP), people still get ratings from it. Otherwise, we'd have a 3-B Super Shenron that can casually bring multiple universes back into existence.
Now speaking on outliers..
Vegeta easily beat Hop, Oregano and Hyssop, helped Goku with the trio de dangers, knocked off Magetta after insulting him, defeated Prum and Dr. Rota, and helped against Anilaza before fighting God Toppo.
He fought nothing but fodder and participated in team efforts, then gets a power-up which jumps him in power above every previous instance of UI Goku, and defeats Toppo using nearly all of his power.
The RoF arc was year 779, and Frieza was revived in year 780. In that time we had the U6 arc and Future Trunks arc + Zen Exhibition Match. Frieza through mental training alone while trapped in hell was able to stalemate pre-ToP SSB Goku after all those events. In his training pre-golden form, we see him fight repeatedly with Tagoma while only using his first form (restrained) and he becomes stronger than SSB in his golden form.
Frieza fought Cabba though he said he didn't even need his final form, Dyspo who was > Hit before improvement and could keep up with SSB Goku, and other fodder, plus he could hurt full power Toppo pre-GoD form, and could survive the world of void warping attack, which wasn't even Toppo's full power.
Frieza's fights > Vegeta's, and as a self-proclaimed and proven prodigy, his improvement should be faster than anyone's, bar Goku. Plus Goku said everyone broke past their limits in the tournament, so I don't see how Frieza's durability feat is more of an outlier than Vegeta's entire transformation is.
Vegeta's only standout moment other than that was the final flash that Jiren no-selled, and seeing through Jiren's attacks, only to get stomped. He did fight Toppo who wasn't using full power, but that wasn't a serious fight as neither were doing anything to each other.