If I'm picturing what you're explaining correctly, I think this would be difficult. Suddenly accelerating the arm from zero to hundreds of mph would put immense stress on the arm, not to mention whatever you're planning on using to transfer that energy (you kinda hand waved that bit).
I think your assessment is correct about the energy losses. I'm just not sure about the fix.
I think the fix is essentially a whip, that's what I meant by elasticity and flexibility.
If you want to accelerate a weight quickly in a single swipe, (simplified) gradually reducing the mass along the length of the whip imparts more kenetic energy at the end (the whip crack).
So the arm would no longer be rigid, although you can see in the OPs video it isn't actually fully rigid.