You can. Refusing the field test allows them to arrest you. But it isn't sufficient to charge you. They also have to offer you a breathalyzer at the station and you can refuse that but demand a blood test.
But your car still gets towed even if you pass the tests at the station and don't ultimately get charged because you refused the field test.