You're right I was thinking of civil vs criminal penalties.
Personal downloading is generally only a civil violation, requiring the rights holder to sue you for reparations.