These are not impressive numbers and, obviously, browser cache is fast.

Pretty much any small payload/non-javascript site is going to render very quickly (and instantly from cache) making SSL time be the long pole.