The Luddites were employed by textile manufacturers and destroyed machines to get better bargaining power in labor negotiations. They weren't indiscriminately targeting automation, they targeted machines that directly affected their work.
Destroying someone else's property is much more obviously criminal than cutting off someone else's car, which is not nice, but not destructive.
Which makes the comparison of modern anti-AI proponents (like myself) and Luddites even more apt and accurate.