That's not what it means, but go off. Although yes it is generally used pejoratively, and if you are using the term, its for a rhetorical effect.