They should obviously train it to avoid this like they train it not to output verbatim passages from books and whatnot.