Yeah you're completely wrong here:
- We literally see him charge up Enma prior.
- Zoro says he's using the limit of his ability instead of letting the fight drag on.
- His arm never shriveled up against Kaidou
- He collapsed from using the literal "limit of his ability", the Hakai wasn't enough to make him collapse as seen prior.