alt Hacker NewsThank you for this explanation. So the AI can respond based on the DOOM game that it’s watching? E.g. Could you ask the chatbot for advice on what to do next on the current game level?
Thank you for this explanation. So the AI can respond based on the DOOM game that it’s watching? E.g. Could you ask the chatbot for advice on what to do next on the current game level?
Kind of? Even watching is probably a bit of a stretch here. The point of an MCP server is to be a sort of AI translator for whatever you're inputting. Here we're inputting an iframe that's running a wasm binary. So I imagine in theory all the AI sees is the actual iframe and whatever is in memory currently for the wasm game. Funny enough without some sort of screenshot tool on top of this I'm not sure the AI can actually 'see' the game at all.