The biggest problem I see is that web browsers don't natively support .ans inside <canvas> without Ansilove.js or Xterm.js hacks.

Having a native AV format that comes from ANSI, pre-rendered via FFmpeg, is the missing link for <video> support.