Yeah, that's what I'd have expected especially because I believe the USB mass media standard was part of the original standard. You'd need no special drivers to work with a modern USB thumb drive even if you are dealing with windows 98 (Win95 had usb support, but I believe you still had to install the drivers for it).
Not only drivers. The initial release of Windows 95 predates USB itself, so the entire USB stack didn't appear until later OEM service releases that AFAIK were never released as updates for existing installs or even as retail products (unless you count MSDN or OEM System Builder products with their associated license restrictions).