I can already see future where there is group of people goading AI to right direction by repeatedly changing what they ask slightly. And then memorise the times when you got right incantation for seemingly right outcome. Without actually understanding or being able to reason about process in the middle. Possibly a seemingly inconsequential misspoken word or typo can lead to better or worse outcome. Or maybe just not saying "Please" will sometimes produce wrong output. and other times you must not use it...

Sounds like absolutely horrifying dystopia.