This is fun, and I wouldn't be surprised if someone at Google did something like this a couple decades ago, as a 20% Project.

Outside of Google, around that time, I used Google Earth for a 3D visualization tool for real flight data recorders, integrated into a larger browser-based system.

(Stack: Google Earth Plugin did the heaviest lifting, especially before there were better ways to render 3D in a browser window. The frontend used JS, HTML for instruments, and some kludges to work around some limitations of off-label use of Plugin. The backend was in Scheme, and retrieving and serving up cached data for this was one of the simplest of the things that the Scheme did in that large system. Aircraft 3D models were off-the-shelf, which I tweaked lightly in (IIRC) Google SketchUp.)