You don't have to do it all the time as your primary interface. My wife asks Siri questions all the time while she's busy. "Siri, what's the time?", "Siri what will the temperature be in four hours?" etc. It's not "terrible", it's pretty smart.