The Dirac delta is a unitary vector when represented on a vectorial basis it's a component of.

I don't know what kind of justification you expect. There's a Dirac delta sized "hole" on linear algebra, that mathematicians need a name for. It's not like we can just leave it there, unfilled.