I actually also wondered about this because if Signal does not encrypt attachments and delivers them via CloudFlare and that would suck as CloudFlare could just look into all them.

It seems that signal is indeed encrypting all attachments and therefore the encrypted attachments are cached and served via CloudFlare.