I use two 4k displays with an M1 Pro MBP. They work without any flickering. They’re using HDMI rather than DisplayPort.

I’m also, to get the two external displays without them being mirrored, using a docking station and a display driver from Silicon Motion called macOS InstantView.

This is of course not ideal if you need DP and DSC.