I agree it is terrifying because it is unknown. It is also true that the frontier AI labs have not worked well with affected communities at all and often downright exploited them.
BUT I also agree that, like any new technology, people will find mind-blowingly creative paths forwards with it, opening up whole new art forms.
> AI labs have not worked well with affected communities at all and often downright exploited them
The first reviews of OAI's dump on math are coming out. Quasi-Riemann Hypothesis Proof looks to be valid. The irony is that is uses and approach that the people who work in that area have disregarded for the most part. As well as mining some other parts of maths corpus. There really isnt "innovation" there.
For as much as OAI is guilty of leveraging work in progress, the complaints about some of the other work(s) are looking spurious (and I'm being very kind using that word).