I suspect even some of the more "advanced" queries they demoed off, i.e., "what was that restaurant John and I talked about last week?" also not require LLMs whatsoever and could have been accomplished with a simple search.
I think you're going to need some kind of ML to turn that question into a structured search, and interpret the results.
I think you're going to need some kind of ML to turn that question into a structured search, and interpret the results.