You have to do line of sight checks based on the players entire FOV, which requires the server to know this in realtime with little latency.

This is unworkable for fast paced games.