> My main question generally is, why is palantir doing the work that research institutions should be doing for governments.

Because they pay better.

Have you seen research institutions lobbying the governments ?