alt Hacker NewsHow would flow matching work? In language we have inputs and outputs but it's not clear what the intermediate points are since it's a discrete space.
How would flow matching work? In language we have inputs and outputs but it's not clear what the intermediate points are since it's a discrete space.
One of the core ideas behind LLMs is that language is not a discrete space, but instead a multidimensional vector field where you can easily interpolate as needed. It's one of the reasons LLMs readily make up words that don't exist when translating text for example.