I'm not agreeing with him at all but that's a strange jump to take.
I'd say that secondary sexual characteristics in women tend to involve body fat. Being in extremely good shape does affect that a little bit - breasts, hips, face, ass, - and some would see that as looking more masculine where I'd say they're just extremely fit.