You’re not wrong. They work very similar to binary arithmetic: basically the only operations they can do is increment, decrement, and shift left/right (but by 10)

But multiplication is just repeated addition, and division is just repeated subtraction. Some of the highest-end units could do square roots! Check out CuriousMarc’s videos.