A robots.txt file is not anything, not enforceable, it's politeness. Of course it was ignored.