first let me say i agree its a solution looking for a problem

you can still take the glasses off. i dont own glasses but do use vr and the shift between putting on/taking off a headset feels more intentional than the glance at a phone. feels less addictive to me. maybe lightweight glasses and dark patterns will "fix" that eventually