> to improve the company's models in areas where they still struggle, like choosing from dropdown menus and using keyboard shortcuts
Seems like a strange approach in general. I'd have assumed you'd just have it use accessibility features to get at things, if there is no other interface.
Knowing how to make an accessible website is so rare that companies pay me money to do it for them. I wish it was good enough for people, much less companies, to rely on.