I've gone to midsize plus a couple extra wraps on all of my clubs for this reason. Can't imagine going back. I definitely wouldn't want different sized grips within my set.
Got my 52 and 56 regripped with midsize yesterday. Hit a few balls at lunch today and liked it. I feel like it keeps me from over-rotating.
I honestly forgot that my 3 wood (Old Taylormade V Steel) has a midsize on it and I hit it about as well as anything in my bag. I may just do my entire set in midsize.