> Isn't speed and fluency part of skill and mastery of the material?

Perhaps this comes down to definitions, but i would say that in general, no, speed is not part of mastering material in intellectual pursuits.

Sometimes it might be correlated though. Other times it might be negatively correlated, e.g. someone who memorized everything but doesn't understand the principles will have high speed and low mastery.