To be honest, I wouldn't be surprised if Apple isn't already doing this and just doesn't say so explicitly. There is a crazy amount of image processing going on behind the scenes in each smartphone photo. Would be interesting to compare a photo taken with the native camera app and photosynthesis to compare. I'm assuming your demo images on your site are the raw and processed images from your app that don't go through Apple's "secret sauce" processing pipeline.
Hijacking this comment because of this line that reminded me of something:
"There is a crazy amount of image processing going on behind the scenes in each smartphone"
I bought the Pixel 10 because it said it had great zooming capabilities. After 5X (that means 10X), it's completely stupid. Basically it takes a very blurred photo and then tries to reconstruct it with AI. The final results are completely awful and really distant from reality.
Any advice in how to improve that?
Phones have been doing this for a LONG time, if you had a oneplus 7 pro (released may 2019) and took it into an extremely dark area, like where your eyes can't see anything at all, and take a 'night mode' photo, it asks you to hold it steady for about 4-5 seconds and is clearly taking a series of photos with long exposure time. Then it stacks them and uses data from the sensor of hand movement jitter to deblur.
The result when done outdoors (like, standing in a dark forest at midnight) will be a photo where you can actually see what's around you, and details show up as if it was a brightly full moon lit night.
I think this is just Deep Fusion.
This should be easy to check. In these photos, the center of the image has higher detail than the edges.
Yes exactly, the site shows photos all taken from within the app. I have done A/B tests against photos taken in Camera.app and the Photosynthesis composite does significantly beat the detail central area covered by the second lens in Photosynthesis.
Because of the limitations of capturing multiple lenses at once through isVirtualDeviceConstituentPhotoDeliveryEnabled, there is a second capture mode in the app for 'Quality' which takes a simultaneous capture then takes sequential shots from each lens which do benefit from Deep Fusion, then uses those for the stitch (as long as the Deep Fusion images outperform the simultaneous capture results). That's also what I do for our Night mode.