You are definitely doing something wrong. All of my sessions constantly use subagents and are able to poll with background tasks.