Your last line is actually very insightful. I was just looking at LLM from the chat app perspective.
I wonder how open these services will be to data storage if they do become a "universal app". If I used LLM to make an app for tracking training for endurance running, and I slapped an 800kb .fit file in there each day, the storage for all of these files would probably be fine, but without condensing each run down to a textual summary like Garmin/Strava currently does ("You ran 10km in 35:00, at a pace of 3:30/km. This improved your speed/{vague motivational LLM quote}"), wouldn't the context become enormous after a pretty short duration, causing huge costs? Genuinely curious.