If and when the asian community decides to reappropriate "yellow" as a way of self identification, then given a few decades, it will not be seen as racist anymore.

In the mean time, "yellow" is a racist adjective for asians, "black" is not a racist adjective for black people.